[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:04:26.783766 20694 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.53.190:44327
I20260709 13:04:26.785197 20694 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:04:26.786158 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:26.802553 20701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.802610 20703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.804720 20694 server_base.cc:1061] running on GCE node
W20260709 13:04:26.803151 20700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:28.010479 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:28.010699 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:28.010847 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602268010831 us; error 0 us; skew 500 ppm
I20260709 13:04:28.011662 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:28.016774 20694 webserver.cc:533] Webserver started at http://127.20.53.190:33469/ using document root <none> and password file <none>
I20260709 13:04:28.017562 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:28.017748 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:28.018124 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:28.023847 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/master-0-root/instance:
uuid: "cb008439d5f04982bc33c4901132e1eb"
format_stamp: "Formatted at 2026-07-09 13:04:28 on dist-test-slave-r056"
I20260709 13:04:28.031742 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:04:28.036645 20709 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.037739 20694 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:28.038079 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/master-0-root
uuid: "cb008439d5f04982bc33c4901132e1eb"
format_stamp: "Formatted at 2026-07-09 13:04:28 on dist-test-slave-r056"
I20260709 13:04:28.038481 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:28.092156 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:28.093637 20694 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:04:28.094087 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:28.164690 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.190:44327
I20260709 13:04:28.164794 20760 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.190:44327 every 8 connection(s)
I20260709 13:04:28.172902 20761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.197434 20761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb: Bootstrap starting.
I20260709 13:04:28.204625 20761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.206736 20761 log.cc:826] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb: Log is configured to *not* fsync() on all Append() calls
I20260709 13:04:28.211871 20761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb: No bootstrap required, opened a new log
I20260709 13:04:28.232062 20761 raft_consensus.cc:359] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb008439d5f04982bc33c4901132e1eb" member_type: VOTER }
I20260709 13:04:28.232586 20761 raft_consensus.cc:385] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.232779 20761 raft_consensus.cc:740] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb008439d5f04982bc33c4901132e1eb, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.233664 20761 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb008439d5f04982bc33c4901132e1eb" member_type: VOTER }
I20260709 13:04:28.234115 20761 raft_consensus.cc:399] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:28.234370 20761 raft_consensus.cc:493] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:28.234673 20761 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.238656 20761 raft_consensus.cc:515] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb008439d5f04982bc33c4901132e1eb" member_type: VOTER }
I20260709 13:04:28.239344 20761 leader_election.cc:304] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb008439d5f04982bc33c4901132e1eb; no voters: 
I20260709 13:04:28.241051 20761 leader_election.cc:290] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:28.241396 20764 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.243906 20764 raft_consensus.cc:697] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 1 LEADER]: Becoming Leader. State: Replica: cb008439d5f04982bc33c4901132e1eb, State: Running, Role: LEADER
I20260709 13:04:28.244863 20764 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb008439d5f04982bc33c4901132e1eb" member_type: VOTER }
I20260709 13:04:28.246143 20761 sys_catalog.cc:565] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:28.255374 20765 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb008439d5f04982bc33c4901132e1eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb008439d5f04982bc33c4901132e1eb" member_type: VOTER } }
I20260709 13:04:28.255295 20766 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb008439d5f04982bc33c4901132e1eb. Latest consensus state: current_term: 1 leader_uuid: "cb008439d5f04982bc33c4901132e1eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb008439d5f04982bc33c4901132e1eb" member_type: VOTER } }
I20260709 13:04:28.256033 20765 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:28.256075 20766 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:28.259131 20771 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:28.271678 20771 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:28.274421 20694 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:28.288058 20771 catalog_manager.cc:1383] Generated new cluster ID: 264d66b5475d43a38fb1cf390b2d60f6
I20260709 13:04:28.288338 20771 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:28.309418 20771 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:28.310860 20771 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:28.329404 20771 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb: Generated new TSK 0
I20260709 13:04:28.330324 20771 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:28.341221 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:28.350337 20784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:28.350883 20783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:28.354969 20786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:28.355226 20694 server_base.cc:1061] running on GCE node
I20260709 13:04:28.356045 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:28.356256 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:28.356446 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602268356401 us; error 0 us; skew 500 ppm
I20260709 13:04:28.357054 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:28.361414 20694 webserver.cc:533] Webserver started at http://127.20.53.129:33075/ using document root <none> and password file <none>
I20260709 13:04:28.361936 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:28.362133 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:28.362509 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:28.363590 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-0-root/instance:
uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
format_stamp: "Formatted at 2026-07-09 13:04:28 on dist-test-slave-r056"
I20260709 13:04:28.369184 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:28.373782 20791 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.374673 20694 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:04:28.374914 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
format_stamp: "Formatted at 2026-07-09 13:04:28 on dist-test-slave-r056"
I20260709 13:04:28.375165 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:28.395920 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:28.397421 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:28.400607 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:28.405898 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:28.406219 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.406555 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:28.406821 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.514853 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:45973
I20260709 13:04:28.514917 20853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:45973 every 8 connection(s)
I20260709 13:04:28.521900 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:28.532279 20858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:28.536151 20859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:28.541530 20861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:28.543816 20694 server_base.cc:1061] running on GCE node
I20260709 13:04:28.544659 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:28.544893 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:28.545094 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602268545071 us; error 0 us; skew 500 ppm
I20260709 13:04:28.545694 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:28.548648 20694 webserver.cc:533] Webserver started at http://127.20.53.130:34541/ using document root <none> and password file <none>
I20260709 13:04:28.549158 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:28.549418 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:28.549712 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:28.551159 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-1-root/instance:
uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
format_stamp: "Formatted at 2026-07-09 13:04:28 on dist-test-slave-r056"
I20260709 13:04:28.556182 20854 heartbeater.cc:344] Connected to a master server at 127.20.53.190:44327
I20260709 13:04:28.556650 20854 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:28.557605 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:04:28.557803 20854 heartbeater.cc:507] Master 127.20.53.190:44327 requested a full tablet report, sending...
I20260709 13:04:28.561118 20726 ts_manager.cc:194] Registered new tserver with Master: c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973)
I20260709 13:04:28.562084 20866 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.563409 20694 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:04:28.563681 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-1-root
uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
format_stamp: "Formatted at 2026-07-09 13:04:28 on dist-test-slave-r056"
I20260709 13:04:28.563958 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:28.564307 20726 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36278
I20260709 13:04:28.598534 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:28.599790 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:28.602419 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:28.605863 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:28.606045 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.606402 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:28.606549 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.714598 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.130:38843
I20260709 13:04:28.714715 20928 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.130:38843 every 8 connection(s)
I20260709 13:04:28.720789 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:28.729206 20932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:28.732461 20933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:28.734683 20929 heartbeater.cc:344] Connected to a master server at 127.20.53.190:44327
I20260709 13:04:28.735188 20929 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:28.736393 20929 heartbeater.cc:507] Master 127.20.53.190:44327 requested a full tablet report, sending...
I20260709 13:04:28.738951 20726 ts_manager.cc:194] Registered new tserver with Master: b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:28.740641 20726 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36294
W20260709 13:04:28.744568 20935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:28.746034 20694 server_base.cc:1061] running on GCE node
I20260709 13:04:28.746881 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:28.747054 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:28.747179 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602268747167 us; error 0 us; skew 500 ppm
I20260709 13:04:28.747613 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:28.750002 20694 webserver.cc:533] Webserver started at http://127.20.53.131:33719/ using document root <none> and password file <none>
I20260709 13:04:28.750485 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:28.750681 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:28.750952 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:28.752024 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-2-root/instance:
uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
format_stamp: "Formatted at 2026-07-09 13:04:28 on dist-test-slave-r056"
I20260709 13:04:28.756400 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:28.759639 20940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.760394 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:28.760684 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-2-root
uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
format_stamp: "Formatted at 2026-07-09 13:04:28 on dist-test-slave-r056"
I20260709 13:04:28.760973 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602266622664-20694-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:28.770231 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:28.771426 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:28.773476 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:28.776471 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:28.776677 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.776935 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:28.777100 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:28.868990 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.131:42043
I20260709 13:04:28.869081 21002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.131:42043 every 8 connection(s)
I20260709 13:04:28.885756 21003 heartbeater.cc:344] Connected to a master server at 127.20.53.190:44327
I20260709 13:04:28.886188 21003 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:28.887130 21003 heartbeater.cc:507] Master 127.20.53.190:44327 requested a full tablet report, sending...
I20260709 13:04:28.889264 20726 ts_manager.cc:194] Registered new tserver with Master: 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:28.889875 20694 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016872851s
I20260709 13:04:28.890668 20726 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36296
I20260709 13:04:28.940591 20726 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36304:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:28.944427 20726 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:29.053550 20968 tablet_service.cc:1511] Processing CreateTablet for tablet debe40d814a0429c8af6fb94bef961a9 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:29.055250 20968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debe40d814a0429c8af6fb94bef961a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.059252 20967 tablet_service.cc:1511] Processing CreateTablet for tablet 269871aca2484c8b8701845e786110de (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:29.060595 20967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269871aca2484c8b8701845e786110de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.060144 20893 tablet_service.cc:1511] Processing CreateTablet for tablet 269871aca2484c8b8701845e786110de (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:29.061595 20893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269871aca2484c8b8701845e786110de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.062683 20890 tablet_service.cc:1511] Processing CreateTablet for tablet c5603ee4b0874a04a16fecf5c3530ae5 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:29.063503 20966 tablet_service.cc:1511] Processing CreateTablet for tablet eb4df82ce30748d1a818399ad15ea52a (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:29.064049 20890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5603ee4b0874a04a16fecf5c3530ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.064792 20966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4df82ce30748d1a818399ad15ea52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.066977 20894 tablet_service.cc:1511] Processing CreateTablet for tablet debe40d814a0429c8af6fb94bef961a9 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:29.068207 20894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debe40d814a0429c8af6fb94bef961a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.071077 20892 tablet_service.cc:1511] Processing CreateTablet for tablet eb4df82ce30748d1a818399ad15ea52a (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:29.072371 20892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4df82ce30748d1a818399ad15ea52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.075364 20891 tablet_service.cc:1511] Processing CreateTablet for tablet ba1c199e13314ab8a9284bc5f73e62eb (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:29.076658 20891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1c199e13314ab8a9284bc5f73e62eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.082085 20965 tablet_service.cc:1511] Processing CreateTablet for tablet ba1c199e13314ab8a9284bc5f73e62eb (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:29.083367 20965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1c199e13314ab8a9284bc5f73e62eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.102258 20964 tablet_service.cc:1511] Processing CreateTablet for tablet c5603ee4b0874a04a16fecf5c3530ae5 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:29.104082 20964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5603ee4b0874a04a16fecf5c3530ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.109252 20889 tablet_service.cc:1511] Processing CreateTablet for tablet d2ea11dfcb73486cbe80056e3b29b4e3 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:29.115767 20819 tablet_service.cc:1511] Processing CreateTablet for tablet debe40d814a0429c8af6fb94bef961a9 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:29.117000 20818 tablet_service.cc:1511] Processing CreateTablet for tablet 269871aca2484c8b8701845e786110de (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:29.119342 20818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269871aca2484c8b8701845e786110de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.117384 20889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ea11dfcb73486cbe80056e3b29b4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.126482 20819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debe40d814a0429c8af6fb94bef961a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.133077 21021 tablet_bootstrap.cc:492] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77: Bootstrap starting.
I20260709 13:04:29.132438 20814 tablet_service.cc:1511] Processing CreateTablet for tablet d2ea11dfcb73486cbe80056e3b29b4e3 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:29.136078 20814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ea11dfcb73486cbe80056e3b29b4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.128693 20817 tablet_service.cc:1511] Processing CreateTablet for tablet eb4df82ce30748d1a818399ad15ea52a (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:29.144061 20815 tablet_service.cc:1511] Processing CreateTablet for tablet c5603ee4b0874a04a16fecf5c3530ae5 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:29.146317 20963 tablet_service.cc:1511] Processing CreateTablet for tablet d2ea11dfcb73486cbe80056e3b29b4e3 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:29.144145 20816 tablet_service.cc:1511] Processing CreateTablet for tablet ba1c199e13314ab8a9284bc5f73e62eb (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:29.148837 20817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4df82ce30748d1a818399ad15ea52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.149633 20813 tablet_service.cc:1511] Processing CreateTablet for tablet 96cf48f653354665968d2148ac0d1912 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:29.151962 20963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ea11dfcb73486cbe80056e3b29b4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.156461 20815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5603ee4b0874a04a16fecf5c3530ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.158401 20816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1c199e13314ab8a9284bc5f73e62eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.161732 20813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96cf48f653354665968d2148ac0d1912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.165354 20893 tablet_service.cc:1511] Processing CreateTablet for tablet 96cf48f653354665968d2148ac0d1912 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:29.168028 20893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96cf48f653354665968d2148ac0d1912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.182817 20962 tablet_service.cc:1511] Processing CreateTablet for tablet 96cf48f653354665968d2148ac0d1912 (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:29.191761 20962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96cf48f653354665968d2148ac0d1912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.219738 20812 tablet_service.cc:1511] Processing CreateTablet for tablet 118345599baa40db90002333a051acab (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:29.231271 20812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118345599baa40db90002333a051acab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.237335 20890 tablet_service.cc:1511] Processing CreateTablet for tablet 118345599baa40db90002333a051acab (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:29.239066 20890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118345599baa40db90002333a051acab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.241180 20961 tablet_service.cc:1511] Processing CreateTablet for tablet 118345599baa40db90002333a051acab (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:29.242491 20961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118345599baa40db90002333a051acab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.269450 21021 tablet_bootstrap.cc:654] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:29.269961 20774 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:29.274333 20811 tablet_service.cc:1511] Processing CreateTablet for tablet d91ce4375b894157ab132b21b11efcfb (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:29.277320 20811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91ce4375b894157ab132b21b11efcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.284343 20967 tablet_service.cc:1511] Processing CreateTablet for tablet d91ce4375b894157ab132b21b11efcfb (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:29.285580 20967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91ce4375b894157ab132b21b11efcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.294864 20894 tablet_service.cc:1511] Processing CreateTablet for tablet d91ce4375b894157ab132b21b11efcfb (DEFAULT_TABLE table=test-workload [id=c51f726b6282456789e8f3fcdd6b079a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:29.295873 20894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91ce4375b894157ab132b21b11efcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:29.311483 21022 tablet_bootstrap.cc:492] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e: Bootstrap starting.
I20260709 13:04:29.326529 21023 tablet_bootstrap.cc:492] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c: Bootstrap starting.
I20260709 13:04:29.345919 21021 tablet_bootstrap.cc:492] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77: No bootstrap required, opened a new log
I20260709 13:04:29.346578 21021 ts_tablet_manager.cc:1403] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77: Time spent bootstrapping tablet: real 0.228s	user 0.007s	sys 0.013s
I20260709 13:04:29.350732 21021 raft_consensus.cc:359] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.351559 21021 raft_consensus.cc:385] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.351878 21021 raft_consensus.cc:740] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.353386 21023 tablet_bootstrap.cc:654] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.352667 21021 consensus_queue.cc:260] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.352837 21022 tablet_bootstrap.cc:654] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.357107 20929 heartbeater.cc:499] Master 127.20.53.190:44327 was elected leader, sending a full tablet report...
I20260709 13:04:29.357585 21021 ts_tablet_manager.cc:1434] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:04:29.358603 21021 tablet_bootstrap.cc:492] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77: Bootstrap starting.
I20260709 13:04:29.366932 21023 tablet_bootstrap.cc:492] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c: No bootstrap required, opened a new log
I20260709 13:04:29.367512 21023 ts_tablet_manager.cc:1403] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c: Time spent bootstrapping tablet: real 0.067s	user 0.000s	sys 0.015s
I20260709 13:04:29.370513 21021 tablet_bootstrap.cc:654] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.370664 21023 raft_consensus.cc:359] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.371758 21023 raft_consensus.cc:385] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.372095 21023 raft_consensus.cc:740] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.372849 21023 consensus_queue.cc:260] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.373529 21022 tablet_bootstrap.cc:492] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e: No bootstrap required, opened a new log
I20260709 13:04:29.374112 21022 ts_tablet_manager.cc:1403] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent bootstrapping tablet: real 0.114s	user 0.016s	sys 0.000s
I20260709 13:04:29.378819 21022 raft_consensus.cc:359] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.379633 21022 raft_consensus.cc:385] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.379979 21022 raft_consensus.cc:740] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.380865 21022 consensus_queue.cc:260] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.379213 21023 ts_tablet_manager.cc:1434] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:04:29.384057 20854 heartbeater.cc:499] Master 127.20.53.190:44327 was elected leader, sending a full tablet report...
I20260709 13:04:29.384779 21023 tablet_bootstrap.cc:492] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c: Bootstrap starting.
I20260709 13:04:29.393280 21023 tablet_bootstrap.cc:654] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.398001 21022 ts_tablet_manager.cc:1434] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.008s
I20260709 13:04:29.398494 21003 heartbeater.cc:499] Master 127.20.53.190:44327 was elected leader, sending a full tablet report...
I20260709 13:04:29.400616 21021 tablet_bootstrap.cc:492] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77: No bootstrap required, opened a new log
I20260709 13:04:29.401051 21021 ts_tablet_manager.cc:1403] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.011s
I20260709 13:04:29.403476 21022 tablet_bootstrap.cc:492] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e: Bootstrap starting.
I20260709 13:04:29.403855 21021 raft_consensus.cc:359] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.404560 21021 raft_consensus.cc:385] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.404857 21021 raft_consensus.cc:740] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.405577 21021 consensus_queue.cc:260] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.409209 21030 raft_consensus.cc:493] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.409883 21021 ts_tablet_manager.cc:1434] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:29.409713 21030 raft_consensus.cc:515] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.410771 21021 tablet_bootstrap.cc:492] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77: Bootstrap starting.
I20260709 13:04:29.413664 21030 leader_election.cc:290] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:29.427947 21022 tablet_bootstrap.cc:654] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.437235 21021 tablet_bootstrap.cc:654] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.447233 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:29.448093 20904 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 0.
I20260709 13:04:29.449456 21022 tablet_bootstrap.cc:492] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e: No bootstrap required, opened a new log
I20260709 13:04:29.449914 21022 ts_tablet_manager.cc:1403] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.005s
I20260709 13:04:29.451116 20941 leader_election.cc:304] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: 
I20260709 13:04:29.451933 21030 raft_consensus.cc:2804] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.452270 21030 raft_consensus.cc:493] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.452584 21030 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.452627 21022 raft_consensus.cc:359] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.453397 21022 raft_consensus.cc:385] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.453691 21022 raft_consensus.cc:740] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.454731 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
I20260709 13:04:29.455685 21023 tablet_bootstrap.cc:492] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c: No bootstrap required, opened a new log
I20260709 13:04:29.456135 21023 ts_tablet_manager.cc:1403] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.007s
W20260709 13:04:29.456523 20944 leader_election.cc:343] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.458915 21023 raft_consensus.cc:359] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.459630 21023 raft_consensus.cc:385] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.459494 21030 raft_consensus.cc:515] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.461696 21030 leader_election.cc:290] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:29.462198 21021 tablet_bootstrap.cc:492] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77: No bootstrap required, opened a new log
I20260709 13:04:29.462539 21021 ts_tablet_manager.cc:1403] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.002s
I20260709 13:04:29.462467 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
W20260709 13:04:29.463866 20944 leader_election.cc:343] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.464298 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:29.464808 20904 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.465114 21021 raft_consensus.cc:359] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.465768 21021 raft_consensus.cc:385] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.465965 21021 raft_consensus.cc:740] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.466641 21021 consensus_queue.cc:260] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.468524 21021 ts_tablet_manager.cc:1434] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:29.469425 21021 tablet_bootstrap.cc:492] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77: Bootstrap starting.
I20260709 13:04:29.459959 21023 raft_consensus.cc:740] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Initialized, Role: FOLLOWER
W20260709 13:04:29.470458 20930 tablet.cc:2406] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:29.470649 21023 consensus_queue.cc:260] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.472746 21023 ts_tablet_manager.cc:1434] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:04:29.473630 20904 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 1.
I20260709 13:04:29.473872 21022 consensus_queue.cc:260] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.474848 20941 leader_election.cc:304] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:29.473644 21023 tablet_bootstrap.cc:492] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c: Bootstrap starting.
I20260709 13:04:29.488370 21037 raft_consensus.cc:2804] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.488945 21037 raft_consensus.cc:697] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Becoming Leader. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:29.489760 21037 consensus_queue.cc:237] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.491811 21021 tablet_bootstrap.cc:654] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.492247 21030 raft_consensus.cc:493] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.492748 21030 raft_consensus.cc:515] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.498587 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
W20260709 13:04:29.500306 20944 leader_election.cc:343] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.501721 21025 raft_consensus.cc:493] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.502249 21025 raft_consensus.cc:515] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.502995 21023 tablet_bootstrap.cc:654] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.503566 21021 tablet_bootstrap.cc:492] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77: No bootstrap required, opened a new log
I20260709 13:04:29.504019 21021 ts_tablet_manager.cc:1403] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.007s
I20260709 13:04:29.507258 21025 leader_election.cc:290] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.509116 21021 raft_consensus.cc:359] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.510613 21021 raft_consensus.cc:385] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.511196 21021 raft_consensus.cc:740] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.502803 21022 ts_tablet_manager.cc:1434] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent starting tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 13:04:29.512537 21021 consensus_queue.cc:260] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.512580 21030 leader_election.cc:290] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:29.517375 21021 ts_tablet_manager.cc:1434] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.007s
I20260709 13:04:29.514647 21022 tablet_bootstrap.cc:492] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e: Bootstrap starting.
I20260709 13:04:29.518467 21028 raft_consensus.cc:493] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.518893 21028 raft_consensus.cc:515] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.521332 21028 leader_election.cc:290] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.530750 21021 tablet_bootstrap.cc:492] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77: Bootstrap starting.
I20260709 13:04:29.541646 21023 tablet_bootstrap.cc:492] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c: No bootstrap required, opened a new log
I20260709 13:04:29.542126 21023 ts_tablet_manager.cc:1403] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.002s
I20260709 13:04:29.556936 21021 tablet_bootstrap.cc:654] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.558364 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
W20260709 13:04:29.565404 20941 leader_election.cc:343] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.565972 20941 leader_election.cc:304] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e; no voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:29.567407 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:29.569419 20904 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 0.
I20260709 13:04:29.568588 21037 raft_consensus.cc:2749] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.562853 21023 raft_consensus.cc:359] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.571537 21023 raft_consensus.cc:385] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.571873 21023 raft_consensus.cc:740] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.573243 21028 raft_consensus.cc:493] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.572588 21023 consensus_queue.cc:260] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.566078 20725 catalog_manager.cc:5697] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131). New cstate: current_term: 1 leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.574026 21028 raft_consensus.cc:515] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.575979 21028 leader_election.cc:290] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.573333 20792 leader_election.cc:304] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:29.579314 21028 raft_consensus.cc:2804] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.579751 21028 raft_consensus.cc:493] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.580188 21028 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.583673 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
I20260709 13:04:29.584599 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:29.584806 21022 tablet_bootstrap.cc:654] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.584898 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
W20260709 13:04:29.587610 20869 leader_election.cc:343] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.586126 20904 raft_consensus.cc:2468] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 0.
I20260709 13:04:29.589677 20792 leader_election.cc:304] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:29.590525 21023 ts_tablet_manager.cc:1434] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.008s
I20260709 13:04:29.591856 21023 tablet_bootstrap.cc:492] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c: Bootstrap starting.
I20260709 13:04:29.594524 21046 raft_consensus.cc:2804] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.595016 21046 raft_consensus.cc:493] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.595424 21046 raft_consensus.cc:3060] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.608676 21021 tablet_bootstrap.cc:492] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77: No bootstrap required, opened a new log
I20260709 13:04:29.609584 21021 ts_tablet_manager.cc:1403] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.005s
I20260709 13:04:29.616806 21028 raft_consensus.cc:515] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.618270 20829 raft_consensus.cc:2393] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3d3e987d9df4a999cfcce35cfdeff77 in current term 1: Already voted for candidate c0a8297c4b9c4d9fb821d479ca36000c in this term.
I20260709 13:04:29.632938 21021 raft_consensus.cc:359] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:29.633904 21021 raft_consensus.cc:385] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.634292 21021 raft_consensus.cc:740] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.631986 20870 leader_election.cc:304] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77; no voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:29.635807 21025 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.636128 21023 tablet_bootstrap.cc:654] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.640400 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:29.641525 21028 leader_election.cc:290] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Requested vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.637904 21021 consensus_queue.cc:260] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:29.649567 21046 raft_consensus.cc:515] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.653905 20977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:29.654981 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:29.655905 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
W20260709 13:04:29.657785 20794 leader_election.cc:343] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.657873 21025 raft_consensus.cc:2749] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:29.659507 20794 leader_election.cc:343] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.659986 21046 leader_election.cc:290] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Requested vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
W20260709 13:04:29.660368 20794 leader_election.cc:343] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.662717 21025 raft_consensus.cc:493] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.665016 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
W20260709 13:04:29.668006 20794 leader_election.cc:343] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.664535 21025 raft_consensus.cc:515] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.671109 21025 leader_election.cc:290] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.671731 21025 raft_consensus.cc:493] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.672286 21025 raft_consensus.cc:515] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:29.679828 21025 leader_election.cc:290] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.683811 21022 tablet_bootstrap.cc:492] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e: No bootstrap required, opened a new log
I20260709 13:04:29.684434 21022 ts_tablet_manager.cc:1403] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent bootstrapping tablet: real 0.170s	user 0.045s	sys 0.040s
I20260709 13:04:29.687703 21022 raft_consensus.cc:359] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.688504 21022 raft_consensus.cc:385] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.688822 21022 raft_consensus.cc:740] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.689523 21022 consensus_queue.cc:260] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.691931 21022 ts_tablet_manager.cc:1434] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:29.692701 21021 ts_tablet_manager.cc:1434] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.005s
I20260709 13:04:29.692912 21023 tablet_bootstrap.cc:492] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c: No bootstrap required, opened a new log
I20260709 13:04:29.692909 21022 tablet_bootstrap.cc:492] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e: Bootstrap starting.
I20260709 13:04:29.693475 21023 ts_tablet_manager.cc:1403] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c: Time spent bootstrapping tablet: real 0.102s	user 0.016s	sys 0.015s
I20260709 13:04:29.693647 21021 tablet_bootstrap.cc:492] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77: Bootstrap starting.
I20260709 13:04:29.695302 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
I20260709 13:04:29.696295 21023 raft_consensus.cc:359] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.697059 21023 raft_consensus.cc:385] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.697396 21023 raft_consensus.cc:740] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.697490 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
W20260709 13:04:29.699376 20870 leader_election.cc:343] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.699590 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
W20260709 13:04:29.700030 20870 leader_election.cc:343] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.700271 20903 raft_consensus.cc:3060] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.700551 21022 tablet_bootstrap.cc:654] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.700835 20904 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 1.
I20260709 13:04:29.705027 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:29.700649 21021 tablet_bootstrap.cc:654] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.707029 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:29.708199 20903 raft_consensus.cc:2468] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 1.
W20260709 13:04:29.708437 20869 leader_election.cc:343] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.708818 20869 leader_election.cc:304] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77; no voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:29.709290 20792 leader_election.cc:304] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 37e7e96dcd2446ac8b62f353e3a4193e
W20260709 13:04:29.709906 20869 leader_election.cc:343] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.710318 21046 raft_consensus.cc:2804] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.710881 21046 raft_consensus.cc:697] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:29.711019 21053 raft_consensus.cc:2749] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.711705 21046 consensus_queue.cc:237] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.716400 20792 leader_election.cc:304] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 37e7e96dcd2446ac8b62f353e3a4193e
I20260709 13:04:29.717377 21028 raft_consensus.cc:2804] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.710299 20869 leader_election.cc:304] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77; no voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:29.726423 21023 consensus_queue.cc:260] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.727136 21021 tablet_bootstrap.cc:492] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77: No bootstrap required, opened a new log
I20260709 13:04:29.727589 21021 ts_tablet_manager.cc:1403] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.009s
I20260709 13:04:29.728768 21053 raft_consensus.cc:2749] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.730896 21021 raft_consensus.cc:359] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.731531 21021 raft_consensus.cc:385] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.731815 21021 raft_consensus.cc:740] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.732519 21021 consensus_queue.cc:260] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.734431 21028 raft_consensus.cc:697] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:29.734963 21021 ts_tablet_manager.cc:1434] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:29.735404 21028 consensus_queue.cc:237] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.735932 21021 tablet_bootstrap.cc:492] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77: Bootstrap starting.
I20260709 13:04:29.737345 21023 ts_tablet_manager.cc:1434] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.002s
I20260709 13:04:29.738294 21023 tablet_bootstrap.cc:492] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c: Bootstrap starting.
I20260709 13:04:29.743443 21022 tablet_bootstrap.cc:492] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e: No bootstrap required, opened a new log
I20260709 13:04:29.743901 21022 ts_tablet_manager.cc:1403] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent bootstrapping tablet: real 0.051s	user 0.005s	sys 0.018s
I20260709 13:04:29.744017 21021 tablet_bootstrap.cc:654] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.749114 21022 raft_consensus.cc:359] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:29.750007 21022 raft_consensus.cc:385] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.750772 21022 raft_consensus.cc:740] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.754263 21022 consensus_queue.cc:260] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:29.756572 21023 tablet_bootstrap.cc:654] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.756644 21022 ts_tablet_manager.cc:1434] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:04:29.757324 21046 raft_consensus.cc:493] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.759312 21053 raft_consensus.cc:493] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.759357 21046 raft_consensus.cc:515] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.758456 21022 tablet_bootstrap.cc:492] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e: Bootstrap starting.
I20260709 13:04:29.760254 21053 raft_consensus.cc:515] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.760004 20724 catalog_manager.cc:5697] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 0 to 1, leader changed from <none> to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 1 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.768762 21053 leader_election.cc:290] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.770970 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:29.771502 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
W20260709 13:04:29.779481 20870 leader_election.cc:343] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:29.780145 20869 leader_election.cc:343] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.781692 20869 leader_election.cc:304] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77; no voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:29.783059 21046 leader_election.cc:290] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.783273 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118345599baa40db90002333a051acab" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:29.784050 21053 raft_consensus.cc:2749] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.783987 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118345599baa40db90002333a051acab" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
W20260709 13:04:29.784518 20792 leader_election.cc:343] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:29.785971 20794 leader_election.cc:343] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.787369 20794 leader_election.cc:304] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0a8297c4b9c4d9fb821d479ca36000c; no voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:29.789492 21046 raft_consensus.cc:2749] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.802435 21022 tablet_bootstrap.cc:654] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.805200 21023 tablet_bootstrap.cc:492] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c: No bootstrap required, opened a new log
I20260709 13:04:29.805747 21023 ts_tablet_manager.cc:1403] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.005s
I20260709 13:04:29.808005 21021 tablet_bootstrap.cc:492] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77: No bootstrap required, opened a new log
I20260709 13:04:29.808403 21028 raft_consensus.cc:493] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.809105 21021 ts_tablet_manager.cc:1403] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.001s
I20260709 13:04:29.809300 21028 raft_consensus.cc:515] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.811108 20724 catalog_manager.cc:5697] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 0 to 1, leader changed from <none> to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 1 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.812110 21028 leader_election.cc:290] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.813560 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:29.813941 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:29.813962 21021 raft_consensus.cc:359] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.814626 20976 raft_consensus.cc:2468] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 0.
I20260709 13:04:29.814860 21021 raft_consensus.cc:385] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.815104 21021 raft_consensus.cc:740] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.815670 21021 consensus_queue.cc:260] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.815796 20794 leader_election.cc:304] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:29.816321 20904 raft_consensus.cc:2468] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 0.
I20260709 13:04:29.816569 21028 raft_consensus.cc:2804] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.816937 21028 raft_consensus.cc:493] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.817251 21028 raft_consensus.cc:3060] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.821446 21022 tablet_bootstrap.cc:492] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e: No bootstrap required, opened a new log
I20260709 13:04:29.824008 21028 raft_consensus.cc:515] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.824802 21022 ts_tablet_manager.cc:1403] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.009s
I20260709 13:04:29.824723 21023 raft_consensus.cc:359] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.822613 21021 ts_tablet_manager.cc:1434] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:29.826574 21021 tablet_bootstrap.cc:492] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77: Bootstrap starting.
I20260709 13:04:29.827270 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:29.827781 20976 raft_consensus.cc:3060] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.826326 21028 leader_election.cc:290] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Requested vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.825620 21023 raft_consensus.cc:385] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.830389 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:29.830610 21023 raft_consensus.cc:740] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.830950 20904 raft_consensus.cc:3060] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.831492 21023 consensus_queue.cc:260] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.831988 21022 raft_consensus.cc:359] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.838918 21023 ts_tablet_manager.cc:1434] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:04:29.839900 21023 tablet_bootstrap.cc:492] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c: Bootstrap starting.
I20260709 13:04:29.840726 20976 raft_consensus.cc:2468] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 1.
I20260709 13:04:29.841981 20794 leader_election.cc:304] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:29.842912 21028 raft_consensus.cc:2804] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.843520 20904 raft_consensus.cc:2468] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 1.
I20260709 13:04:29.843675 21028 raft_consensus.cc:697] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:29.845477 21021 tablet_bootstrap.cc:654] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.845117 21028 consensus_queue.cc:237] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.832686 21022 raft_consensus.cc:385] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.846242 21022 raft_consensus.cc:740] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.846944 21022 consensus_queue.cc:260] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.850847 21022 ts_tablet_manager.cc:1434] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:04:29.851892 21022 tablet_bootstrap.cc:492] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e: Bootstrap starting.
I20260709 13:04:29.884802 21022 tablet_bootstrap.cc:654] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.888870 21023 tablet_bootstrap.cc:654] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.889395 20725 catalog_manager.cc:5697] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 0 to 1, leader changed from <none> to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 1 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.901268 21023 tablet_bootstrap.cc:492] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c: No bootstrap required, opened a new log
I20260709 13:04:29.901700 21023 ts_tablet_manager.cc:1403] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.028s
I20260709 13:04:29.903175 21021 tablet_bootstrap.cc:492] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77: No bootstrap required, opened a new log
I20260709 13:04:29.903642 21021 ts_tablet_manager.cc:1403] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77: Time spent bootstrapping tablet: real 0.077s	user 0.026s	sys 0.036s
I20260709 13:04:29.904539 21023 raft_consensus.cc:359] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.905228 21023 raft_consensus.cc:385] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.905529 21023 raft_consensus.cc:740] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.906404 21021 raft_consensus.cc:359] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.906683 21023 consensus_queue.cc:260] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.907128 21021 raft_consensus.cc:385] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.907500 21021 raft_consensus.cc:740] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.908185 21021 consensus_queue.cc:260] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.910180 21021 ts_tablet_manager.cc:1434] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:29.911109 21021 tablet_bootstrap.cc:492] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77: Bootstrap starting.
I20260709 13:04:29.909024 21023 ts_tablet_manager.cc:1434] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:04:29.913492 21023 tablet_bootstrap.cc:492] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c: Bootstrap starting.
I20260709 13:04:29.916741 21021 tablet_bootstrap.cc:654] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.919834 21023 tablet_bootstrap.cc:654] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.927778 21021 tablet_bootstrap.cc:492] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77: No bootstrap required, opened a new log
I20260709 13:04:29.928239 21021 ts_tablet_manager.cc:1403] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:04:29.930214 21022 tablet_bootstrap.cc:492] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e: No bootstrap required, opened a new log
I20260709 13:04:29.931326 21037 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.932363 21022 ts_tablet_manager.cc:1403] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.005s
I20260709 13:04:29.934412 21023 tablet_bootstrap.cc:492] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c: No bootstrap required, opened a new log
I20260709 13:04:29.935120 21023 ts_tablet_manager.cc:1403] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 13:04:29.935176 21022 raft_consensus.cc:359] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.935972 21022 raft_consensus.cc:385] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.936245 21022 raft_consensus.cc:740] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.936993 21037 raft_consensus.cc:493] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.936892 21022 consensus_queue.cc:260] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.937434 21037 raft_consensus.cc:515] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.939785 21022 ts_tablet_manager.cc:1434] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:04:29.940168 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
I20260709 13:04:29.940002 21023 raft_consensus.cc:359] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.940719 21022 tablet_bootstrap.cc:492] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e: Bootstrap starting.
I20260709 13:04:29.941093 21023 raft_consensus.cc:385] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.941429 21023 raft_consensus.cc:740] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.942128 21023 consensus_queue.cc:260] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.943205 21037 leader_election.cc:290] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:29.943537 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:29.944294 20903 raft_consensus.cc:2393] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e7e96dcd2446ac8b62f353e3a4193e in current term 1: Already voted for candidate c0a8297c4b9c4d9fb821d479ca36000c in this term.
I20260709 13:04:29.945313 20941 leader_election.cc:304] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e; no voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:29.946378 21037 raft_consensus.cc:3060] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.948062 21023 ts_tablet_manager.cc:1434] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:29.949007 21023 tablet_bootstrap.cc:492] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c: Bootstrap starting.
I20260709 13:04:29.953240 21037 raft_consensus.cc:2749] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.955298 21023 tablet_bootstrap.cc:654] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.955611 21021 raft_consensus.cc:359] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.956445 21022 tablet_bootstrap.cc:654] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.958529 21021 raft_consensus.cc:385] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.958913 21021 raft_consensus.cc:740] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.959652 21021 consensus_queue.cc:260] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.968030 21022 tablet_bootstrap.cc:492] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e: No bootstrap required, opened a new log
I20260709 13:04:29.969564 21022 ts_tablet_manager.cc:1403] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.005s
I20260709 13:04:29.972661 21022 raft_consensus.cc:359] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.973604 21022 raft_consensus.cc:385] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.973984 21022 raft_consensus.cc:740] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.974895 21022 consensus_queue.cc:260] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.978397 21021 ts_tablet_manager.cc:1434] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77: Time spent starting tablet: real 0.035s	user 0.001s	sys 0.004s
I20260709 13:04:29.979882 21022 ts_tablet_manager.cc:1434] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.008s
I20260709 13:04:29.980808 21028 raft_consensus.cc:493] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.981280 21028 raft_consensus.cc:515] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:29.983319 21028 leader_election.cc:290] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.980832 21022 tablet_bootstrap.cc:492] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e: Bootstrap starting.
I20260709 13:04:29.984576 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:29.985148 20976 raft_consensus.cc:2468] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 0.
I20260709 13:04:29.986727 20794 leader_election.cc:304] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:29.987453 21028 raft_consensus.cc:2804] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.988330 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:29.988896 20903 raft_consensus.cc:2468] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 0.
I20260709 13:04:29.987792 21028 raft_consensus.cc:493] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.989645 21028 raft_consensus.cc:3060] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.992775 21037 raft_consensus.cc:493] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.993216 21037 raft_consensus.cc:515] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:29.996126 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
I20260709 13:04:29.996153 21028 raft_consensus.cc:515] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
W20260709 13:04:29.997615 20944 leader_election.cc:343] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.998153 21028 leader_election.cc:290] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Requested vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:29.999943 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:30.000155 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:30.000483 20976 raft_consensus.cc:3060] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.000658 20903 raft_consensus.cc:3060] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.001120 21023 tablet_bootstrap.cc:492] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c: No bootstrap required, opened a new log
I20260709 13:04:30.001660 21023 ts_tablet_manager.cc:1403] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.014s
I20260709 13:04:30.002638 21037 leader_election.cc:290] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:30.004197 20902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:30.006484 20902 raft_consensus.cc:2468] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 0.
I20260709 13:04:30.006829 20903 raft_consensus.cc:2468] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 1.
I20260709 13:04:30.007953 20941 leader_election.cc:304] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:30.008754 21030 raft_consensus.cc:2804] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.009068 21030 raft_consensus.cc:493] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.009387 21030 raft_consensus.cc:3060] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.009553 21023 raft_consensus.cc:359] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.010215 21023 raft_consensus.cc:385] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.010476 21023 raft_consensus.cc:740] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.010524 20792 leader_election.cc:304] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:30.011126 21023 consensus_queue.cc:260] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.013206 21028 raft_consensus.cc:2804] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.014344 21028 raft_consensus.cc:697] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:30.015180 21028 consensus_queue.cc:237] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.019279 21023 ts_tablet_manager.cc:1434] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:30.020115 21023 tablet_bootstrap.cc:492] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c: Bootstrap starting.
I20260709 13:04:30.022075 20976 raft_consensus.cc:2468] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 1.
I20260709 13:04:30.022569 21030 raft_consensus.cc:515] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:30.025656 21023 tablet_bootstrap.cc:654] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.026449 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
W20260709 13:04:30.027946 20944 leader_election.cc:343] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.029587 21022 tablet_bootstrap.cc:654] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.030054 21030 leader_election.cc:290] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:30.030233 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:30.030767 20903 raft_consensus.cc:3060] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.036887 20903 raft_consensus.cc:2468] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 1.
I20260709 13:04:30.037935 20941 leader_election.cc:304] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:30.040391 21037 raft_consensus.cc:2804] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.041050 21037 raft_consensus.cc:697] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Becoming Leader. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:30.042238 21037 consensus_queue.cc:237] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:30.055472 21022 tablet_bootstrap.cc:492] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e: No bootstrap required, opened a new log
I20260709 13:04:30.055946 21022 ts_tablet_manager.cc:1403] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent bootstrapping tablet: real 0.075s	user 0.006s	sys 0.006s
I20260709 13:04:30.056690 20724 catalog_manager.cc:5697] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 0 to 1, leader changed from <none> to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 1 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.058414 21022 raft_consensus.cc:359] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.059036 21022 raft_consensus.cc:385] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.059291 21022 raft_consensus.cc:740] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.059909 21022 consensus_queue.cc:260] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.061790 21022 ts_tablet_manager.cc:1434] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:30.063745 21053 raft_consensus.cc:493] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.064225 21053 raft_consensus.cc:515] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.067147 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
I20260709 13:04:30.067749 20829 raft_consensus.cc:2468] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 0.
I20260709 13:04:30.068872 21053 leader_election.cc:290] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.068387 20725 catalog_manager.cc:5697] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131). New cstate: current_term: 1 leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.069566 21023 tablet_bootstrap.cc:492] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c: No bootstrap required, opened a new log
I20260709 13:04:30.069990 21023 ts_tablet_manager.cc:1403] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.005s
I20260709 13:04:30.071022 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:30.068943 20870 leader_election.cc:304] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:30.072511 21023 raft_consensus.cc:359] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
W20260709 13:04:30.072899 20869 leader_election.cc:343] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.073164 21023 raft_consensus.cc:385] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.073427 21023 raft_consensus.cc:740] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.073897 21053 raft_consensus.cc:2804] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.074347 21022 tablet_bootstrap.cc:492] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e: Bootstrap starting.
I20260709 13:04:30.074097 21023 consensus_queue.cc:260] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:30.074347 21053 raft_consensus.cc:493] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.075033 21053 raft_consensus.cc:3060] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.076361 21023 ts_tablet_manager.cc:1434] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:30.080080 21022 tablet_bootstrap.cc:654] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.081776 21053 raft_consensus.cc:515] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.087973 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:30.088531 20829 raft_consensus.cc:3060] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.093016 20828 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.093132 21053 leader_election.cc:290] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.095248 21022 tablet_bootstrap.cc:492] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e: No bootstrap required, opened a new log
I20260709 13:04:30.095695 21022 ts_tablet_manager.cc:1403] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:04:30.096588 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:30.097636 21053 raft_consensus.cc:493] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:30.097932 20869 leader_election.cc:343] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.098977 21022 raft_consensus.cc:359] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.100178 21022 raft_consensus.cc:385] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.100517 21022 raft_consensus.cc:740] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.098107 21053 raft_consensus.cc:515] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.101428 21036 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.102299 21053 leader_election.cc:290] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.103120 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118345599baa40db90002333a051acab" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
I20260709 13:04:30.103122 21022 consensus_queue.cc:260] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.103772 20827 raft_consensus.cc:2468] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 0.
I20260709 13:04:30.104772 20870 leader_election.cc:304] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:30.105712 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118345599baa40db90002333a051acab" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:30.106359 20976 raft_consensus.cc:2468] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 0.
I20260709 13:04:30.106776 21053 raft_consensus.cc:2804] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.107123 21053 raft_consensus.cc:493] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.107455 21053 raft_consensus.cc:3060] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.101783 20829 raft_consensus.cc:2468] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 1.
I20260709 13:04:30.110740 20870 leader_election.cc:304] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 37e7e96dcd2446ac8b62f353e3a4193e
I20260709 13:04:30.111884 21055 raft_consensus.cc:2804] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.112313 21055 raft_consensus.cc:697] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:30.105206 21022 ts_tablet_manager.cc:1434] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.001s
I20260709 13:04:30.113106 21055 consensus_queue.cc:237] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.116083 21053 raft_consensus.cc:515] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.119558 21028 consensus_queue.cc:1048] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.120433 21053 leader_election.cc:290] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.122704 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118345599baa40db90002333a051acab" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:30.123241 20827 raft_consensus.cc:3060] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.126590 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118345599baa40db90002333a051acab" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:30.127334 20976 raft_consensus.cc:3060] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.139537 21028 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.141216 20976 raft_consensus.cc:2468] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 1.
I20260709 13:04:30.144006 20869 leader_election.cc:304] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: 
I20260709 13:04:30.145115 20827 raft_consensus.cc:2468] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 1.
I20260709 13:04:30.144728 20725 catalog_manager.cc:5697] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.148981 21055 raft_consensus.cc:2804] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.152045 21055 raft_consensus.cc:697] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:30.152931 21055 consensus_queue.cc:237] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.168759 21059 consensus_queue.cc:1048] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.169749 20976 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.180837 21059 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.186805 21046 raft_consensus.cc:493] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.187295 21046 raft_consensus.cc:515] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:30.189373 21046 leader_election.cc:290] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:30.190759 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:30.191138 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:30.190685 20724 catalog_manager.cc:5697] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.192612 20903 raft_consensus.cc:2393] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0a8297c4b9c4d9fb821d479ca36000c in current term 1: Already voted for candidate 37e7e96dcd2446ac8b62f353e3a4193e in this term.
I20260709 13:04:30.193794 20792 leader_election.cc:304] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0a8297c4b9c4d9fb821d479ca36000c; no voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:30.197991 21046 raft_consensus.cc:3060] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.204432 21046 raft_consensus.cc:2749] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.205677 21059 raft_consensus.cc:493] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.206100 21059 raft_consensus.cc:515] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.208384 21059 leader_election.cc:290] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.208621 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:30.208899 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" is_pre_election: true
I20260709 13:04:30.209424 20976 raft_consensus.cc:2468] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 0.
I20260709 13:04:30.209462 20903 raft_consensus.cc:2468] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 0.
I20260709 13:04:30.210264 20794 leader_election.cc:304] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:30.211244 21046 raft_consensus.cc:2804] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.211603 21046 raft_consensus.cc:493] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.211942 21046 raft_consensus.cc:3060] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.217715 21046 raft_consensus.cc:515] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.219762 21046 leader_election.cc:290] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Requested vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.220690 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:30.220598 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:30.221217 20976 raft_consensus.cc:3060] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.221277 20903 raft_consensus.cc:3060] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.227515 20976 raft_consensus.cc:2468] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 1.
I20260709 13:04:30.227515 20903 raft_consensus.cc:2468] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 1.
I20260709 13:04:30.228606 20794 leader_election.cc:304] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:30.229190 21046 raft_consensus.cc:2804] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.229540 21046 raft_consensus.cc:697] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:30.230329 21046 consensus_queue.cc:237] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.237392 20726 catalog_manager.cc:5697] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 0 to 1, leader changed from <none> to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 1 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.238039 21046 consensus_queue.cc:1048] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.251013 21028 consensus_queue.cc:1048] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.458305 21036 consensus_queue.cc:1048] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.472922 21036 consensus_queue.cc:1048] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.512563 21036 raft_consensus.cc:493] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.513088 21036 raft_consensus.cc:515] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.515353 21036 leader_election.cc:290] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:30.516776 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" is_pre_election: true
I20260709 13:04:30.517701 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" is_pre_election: true
I20260709 13:04:30.518851 20827 raft_consensus.cc:2393] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e7e96dcd2446ac8b62f353e3a4193e in current term 1: Already voted for candidate b3d3e987d9df4a999cfcce35cfdeff77 in this term.
I20260709 13:04:30.520031 20944 leader_election.cc:304] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e; no voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:30.521632 21036 raft_consensus.cc:3060] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.523725 21055 consensus_queue.cc:1048] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.529481 21036 raft_consensus.cc:2749] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.533982 20976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9"
dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
mode: GRACEFUL
new_leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:04:30.534842 20976 raft_consensus.cc:606] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Received request to transfer leadership to TS c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:30.545624 20976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269871aca2484c8b8701845e786110de"
dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
mode: GRACEFUL
new_leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:04:30.548156 21055 consensus_queue.cc:1048] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.548967 20976 raft_consensus.cc:606] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Received request to transfer leadership to TS c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:30.551707 21028 consensus_queue.cc:1048] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.577790 21055 consensus_queue.cc:1048] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.584158 21060 consensus_queue.cc:1048] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.589740 20829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
mode: GRACEFUL
new_leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:35118
I20260709 13:04:30.590312 20829 raft_consensus.cc:606] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Received request to transfer leadership to TS b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:30.597250 20829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
mode: GRACEFUL
new_leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:35118
I20260709 13:04:30.601619 21053 consensus_queue.cc:1048] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.602451 20829 raft_consensus.cc:606] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Received request to transfer leadership to TS b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:30.642073 21046 consensus_queue.cc:1048] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.644971 20829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96cf48f653354665968d2148ac0d1912"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
mode: GRACEFUL
new_leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:35118
I20260709 13:04:30.645570 20829 raft_consensus.cc:606] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Received request to transfer leadership to TS b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:30.648984 21059 raft_consensus.cc:993] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c: : Instructing follower b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:30.649461 21059 raft_consensus.cc:1081] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Signalling peer b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:30.653560 21059 consensus_queue.cc:1048] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.653770 20903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:50144
I20260709 13:04:30.654407 20903 raft_consensus.cc:493] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.654812 20903 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.660385 20903 raft_consensus.cc:515] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.668615 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:30.669241 20829 raft_consensus.cc:3055] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:30.669566 20829 raft_consensus.cc:740] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:30.672199 20829 consensus_queue.cc:260] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.673604 20829 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.676872 21059 raft_consensus.cc:993] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c: : Instructing follower b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:30.677367 21059 raft_consensus.cc:1081] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Signalling peer b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:30.685689 20904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96cf48f653354665968d2148ac0d1912"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:50144
I20260709 13:04:30.688277 20904 raft_consensus.cc:493] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.688877 20904 raft_consensus.cc:3060] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.690980 20829 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:30.692245 20903 leader_election.cc:290] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.694201 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:30.694766 20978 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.697139 20904 raft_consensus.cc:515] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.699139 20904 leader_election.cc:290] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.704744 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:30.705323 20976 raft_consensus.cc:3060] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.707052 20870 leader_election.cc:304] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:30.709492 21036 raft_consensus.cc:993] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e: : Instructing follower c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:30.709894 21036 raft_consensus.cc:1081] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Signalling peer c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:30.709952 21053 raft_consensus.cc:2804] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:30.710541 21053 raft_consensus.cc:697] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:30.711470 20827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269871aca2484c8b8701845e786110de"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:35108
I20260709 13:04:30.711308 21053 consensus_queue.cc:237] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.712004 20827 raft_consensus.cc:493] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.712395 20827 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.716979 20976 raft_consensus.cc:2468] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:30.718652 20827 raft_consensus.cc:515] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.723485 20978 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:30.725536 20902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:30.726102 20902 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.722628 21028 raft_consensus.cc:993] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c: : Instructing follower b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:30.726693 21028 raft_consensus.cc:1081] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Signalling peer b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:30.724123 20869 leader_election.cc:304] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: 
I20260709 13:04:30.728569 21053 raft_consensus.cc:2804] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:30.725551 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:30.729209 21053 raft_consensus.cc:697] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:30.729421 20976 raft_consensus.cc:3055] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:30.729837 20976 raft_consensus.cc:740] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:30.730055 21053 consensus_queue.cc:237] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.730773 20976 consensus_queue.cc:260] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.733084 20827 leader_election.cc:290] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 2 election: Requested vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.734777 20903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:50144
I20260709 13:04:30.735316 20903 raft_consensus.cc:493] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.721673 20722 catalog_manager.cc:5697] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 1 to 2, leader changed from c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129) to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.735672 20903 raft_consensus.cc:3060] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.736585 20976 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.732695 20902 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 2.
I20260709 13:04:30.738371 20792 leader_election.cc:304] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:30.739168 21059 raft_consensus.cc:2804] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:30.739629 21059 raft_consensus.cc:697] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:30.740391 21059 consensus_queue.cc:237] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.745404 20904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
mode: GRACEFUL
new_leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:44764
I20260709 13:04:30.745958 20904 raft_consensus.cc:606] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Received request to transfer leadership to TS 37e7e96dcd2446ac8b62f353e3a4193e
I20260709 13:04:30.746749 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:30.747282 20829 raft_consensus.cc:3055] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:30.747562 20829 raft_consensus.cc:740] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:30.750114 20722 catalog_manager.cc:5697] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 1 to 2, leader changed from 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131) to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 2 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.751202 20976 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 2.
I20260709 13:04:30.750976 20723 catalog_manager.cc:5697] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 1 to 2, leader changed from c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129) to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.748333 20829 consensus_queue.cc:260] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.753104 20903 raft_consensus.cc:515] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.755805 20829 raft_consensus.cc:3060] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.757985 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:30.758570 20827 raft_consensus.cc:3055] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:30.758850 20827 raft_consensus.cc:740] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:30.759572 20827 consensus_queue.cc:260] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.760557 20827 raft_consensus.cc:3060] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.762130 20829 raft_consensus.cc:2468] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:30.765434 20903 leader_election.cc:290] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:30.769059 20827 raft_consensus.cc:2468] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:30.771397 20870 leader_election.cc:304] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:30.772208 21053 raft_consensus.cc:2804] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:30.772492 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ea11dfcb73486cbe80056e3b29b4e3" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:30.773118 20976 raft_consensus.cc:3060] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.774056 21053 raft_consensus.cc:697] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:30.775269 21053 consensus_queue.cc:237] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:30.779361 20976 raft_consensus.cc:2468] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:30.785128 20723 catalog_manager.cc:5697] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 1 to 2, leader changed from c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129) to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.083741 21036 raft_consensus.cc:993] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e: : Instructing follower c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:31.084233 21030 raft_consensus.cc:1081] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Signalling peer c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:31.085716 20827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:35108
I20260709 13:04:31.086306 20827 raft_consensus.cc:493] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:31.086876 20827 raft_consensus.cc:3060] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.092922 20827 raft_consensus.cc:515] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:31.094653 20827 leader_election.cc:290] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 2 election: Requested vote from peers 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:31.095332 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:31.095606 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:31.096009 20976 raft_consensus.cc:3055] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:31.096181 20903 raft_consensus.cc:3060] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.096366 20976 raft_consensus.cc:740] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:31.097189 20976 consensus_queue.cc:260] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:31.098083 20976 raft_consensus.cc:3060] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.100840 20903 raft_consensus.cc:2468] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 2.
I20260709 13:04:31.101804 20792 leader_election.cc:304] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:31.102541 21059 raft_consensus.cc:2804] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:31.102638 20976 raft_consensus.cc:2468] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 2.
I20260709 13:04:31.102982 21059 raft_consensus.cc:697] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:31.103884 21059 consensus_queue.cc:237] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:31.110682 20723 catalog_manager.cc:5697] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 1 to 2, leader changed from 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131) to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 2 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.119525 20976 raft_consensus.cc:1275] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.120746 21053 consensus_queue.cc:1048] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.128342 20827 raft_consensus.cc:1275] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.131822 21102 consensus_queue.cc:1048] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.134560 21053 raft_consensus.cc:993] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77: : Instructing follower 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:31.136704 21102 raft_consensus.cc:1081] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Signalling peer 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:31.138607 20976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb"
dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:49376
I20260709 13:04:31.139179 20976 raft_consensus.cc:493] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:31.139580 20976 raft_consensus.cc:3060] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.146649 20976 raft_consensus.cc:515] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:31.148912 20976 leader_election.cc:290] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 2 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:31.149966 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:31.150427 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91ce4375b894157ab132b21b11efcfb" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:31.150578 20903 raft_consensus.cc:3055] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:31.150998 20903 raft_consensus.cc:740] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:31.151050 20827 raft_consensus.cc:3060] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.151914 20903 consensus_queue.cc:260] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:31.153123 20903 raft_consensus.cc:3060] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.157817 20827 raft_consensus.cc:2468] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 2.
I20260709 13:04:31.158984 20944 leader_election.cc:304] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:31.159767 21030 raft_consensus.cc:2804] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:31.159895 20903 raft_consensus.cc:2468] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 2.
I20260709 13:04:31.160259 21030 raft_consensus.cc:697] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 LEADER]: Becoming Leader. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:31.161135 21030 consensus_queue.cc:237] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:31.168035 20723 catalog_manager.cc:5697] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e reported cstate change: term changed from 1 to 2, leader changed from b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130) to 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131). New cstate: current_term: 2 leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.227717 20827 raft_consensus.cc:1275] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.228971 21053 consensus_queue.cc:1048] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.238258 20976 raft_consensus.cc:1275] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.240139 21054 consensus_queue.cc:1048] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.270015 20976 raft_consensus.cc:1275] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.270016 20903 raft_consensus.cc:1275] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.271481 21054 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.271559 21059 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.282591 20976 raft_consensus.cc:1275] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.284876 21046 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.295420 20827 raft_consensus.cc:1275] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.297016 21054 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.551294 20903 raft_consensus.cc:1275] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.552503 21046 consensus_queue.cc:1048] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.560814 20976 raft_consensus.cc:1275] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.562816 21046 consensus_queue.cc:1048] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.668123 20827 raft_consensus.cc:1275] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.669442 21030 consensus_queue.cc:1048] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.679648 20903 raft_consensus.cc:1275] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.681233 21030 consensus_queue.cc:1048] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.776381 20694 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:04:33.777299 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:33.797072 20827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269871aca2484c8b8701845e786110de"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
mode: GRACEFUL
new_leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:60420
I20260709 13:04:33.797591 20827 raft_consensus.cc:606] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Received request to transfer leadership to TS 37e7e96dcd2446ac8b62f353e3a4193e
I20260709 13:04:33.807224 20903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
mode: GRACEFUL
new_leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:44776
I20260709 13:04:33.807754 20903 raft_consensus.cc:606] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Received request to transfer leadership to TS 37e7e96dcd2446ac8b62f353e3a4193e
I20260709 13:04:33.808995 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:33.809423 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:34.155908 21125 raft_consensus.cc:993] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77: : Instructing follower 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:34.156373 21053 raft_consensus.cc:1081] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Signalling peer 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:34.157840 20976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5"
dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:49376
I20260709 13:04:34.158295 20976 raft_consensus.cc:493] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:34.158526 20976 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.162256 20976 raft_consensus.cc:515] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:34.163705 20976 leader_election.cc:290] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 3 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:34.164383 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:34.164710 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:34.164952 20827 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.165262 20903 raft_consensus.cc:3055] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:34.165555 20903 raft_consensus.cc:740] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:34.166344 20903 consensus_queue.cc:260] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:34.167511 20903 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.171258 20827 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 3.
I20260709 13:04:34.172925 20944 leader_election.cc:304] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:34.172968 20903 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 3.
I20260709 13:04:34.173893 21118 raft_consensus.cc:2804] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:34.175745 21118 raft_consensus.cc:697] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Becoming Leader. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:34.176609 21118 consensus_queue.cc:237] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:34.181555 21128 raft_consensus.cc:993] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c: : Instructing follower 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:34.182068 21128 raft_consensus.cc:1081] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Signalling peer 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:34.183670 20976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269871aca2484c8b8701845e786110de"
dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:49388
I20260709 13:04:34.184222 20976 raft_consensus.cc:493] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:34.184604 20976 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.184885 20725 catalog_manager.cc:5697] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e reported cstate change: term changed from 2 to 3, leader changed from b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130) to 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131). New cstate: current_term: 3 leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.190060 20976 raft_consensus.cc:515] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:34.193554 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:34.194205 20976 leader_election.cc:290] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 3 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:34.196321 20827 raft_consensus.cc:3055] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:34.196652 20827 raft_consensus.cc:740] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:34.195722 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:34.198549 20903 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.197393 20827 consensus_queue.cc:260] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:34.199733 20827 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.204725 20903 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 3.
I20260709 13:04:34.205724 20827 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 3.
I20260709 13:04:34.205827 20941 leader_election.cc:304] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: 
I20260709 13:04:34.206656 21118 raft_consensus.cc:2804] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:34.207154 21118 raft_consensus.cc:697] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Becoming Leader. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:34.207855 21118 consensus_queue.cc:237] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:34.213948 20725 catalog_manager.cc:5697] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e reported cstate change: term changed from 2 to 3, leader changed from c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129) to 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131). New cstate: current_term: 3 leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.584877 20829 raft_consensus.cc:1275] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:34.586253 21118 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:34.595249 20903 raft_consensus.cc:1275] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:34.597105 21118 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:34.683262 20903 raft_consensus.cc:1275] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:34.684417 21136 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:34.692010 20829 raft_consensus.cc:1275] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:34.693375 21118 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:34.810254 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:34.820406 20829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
mode: GRACEFUL
new_leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:35118
I20260709 13:04:34.820910 20829 raft_consensus.cc:606] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Received request to transfer leadership to TS b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:34.825240 20976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269871aca2484c8b8701845e786110de"
dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
mode: GRACEFUL
new_leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:04:34.825758 20976 raft_consensus.cc:606] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Received request to transfer leadership to TS b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:34.827222 21128 raft_consensus.cc:993] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c: : Instructing follower b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:34.827700 21142 raft_consensus.cc:1081] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Signalling peer b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:34.829082 20903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:50144
I20260709 13:04:34.829574 20903 raft_consensus.cc:493] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:34.829891 20903 raft_consensus.cc:3060] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.830906 20829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
mode: GRACEFUL
new_leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:35118
I20260709 13:04:34.831351 20829 raft_consensus.cc:606] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Received request to transfer leadership to TS b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:34.834414 20903 raft_consensus.cc:515] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:34.835855 20829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
mode: GRACEFUL
new_leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:35118
I20260709 13:04:34.836421 20903 leader_election.cc:290] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 3 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:34.836625 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:34.836881 20829 raft_consensus.cc:606] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Received request to transfer leadership to TS b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:34.837172 20827 raft_consensus.cc:3055] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:34.837445 20827 raft_consensus.cc:740] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:34.838049 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debe40d814a0429c8af6fb94bef961a9" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:34.838510 20976 raft_consensus.cc:3060] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.838256 20827 consensus_queue.cc:260] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:34.839295 20827 raft_consensus.cc:3060] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.842058 20978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5"
dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
mode: GRACEFUL
new_leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:49392
I20260709 13:04:34.842624 20978 raft_consensus.cc:606] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Received request to transfer leadership to TS b3d3e987d9df4a999cfcce35cfdeff77
I20260709 13:04:34.843884 20976 raft_consensus.cc:2468] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 3.
I20260709 13:04:34.845407 20827 raft_consensus.cc:2468] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 3.
I20260709 13:04:34.846112 20869 leader_election.cc:304] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: 
I20260709 13:04:34.846935 21125 raft_consensus.cc:2804] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:34.847391 21125 raft_consensus.cc:697] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:34.848212 21125 consensus_queue.cc:237] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } }
I20260709 13:04:34.856205 20722 catalog_manager.cc:5697] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 2 to 3, leader changed from c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129) to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 3 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:35.153275 21136 raft_consensus.cc:993] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e: : Instructing follower b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:35.153705 21118 raft_consensus.cc:1081] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Signalling peer b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:35.155113 20903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:50140
I20260709 13:04:35.155478 20903 raft_consensus.cc:493] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.155689 20903 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:35.159629 20903 raft_consensus.cc:515] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.160846 20903 leader_election.cc:290] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 4 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:35.161849 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:35.161800 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:35.162482 20976 raft_consensus.cc:3055] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:35.162597 20827 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:35.162782 20976 raft_consensus.cc:740] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:35.163600 20976 consensus_queue.cc:260] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.164368 20976 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:35.167870 20827 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 4.
I20260709 13:04:35.167932 20976 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 4.
I20260709 13:04:35.169028 20870 leader_election.cc:304] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:35.169735 21125 raft_consensus.cc:2804] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:35.170162 21125 raft_consensus.cc:697] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:35.170848 21125 consensus_queue.cc:237] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.176374 20722 catalog_manager.cc:5697] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 3 to 4, leader changed from 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131) to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 4 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.187175 21128 raft_consensus.cc:993] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c: : Instructing follower b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:35.187582 21142 raft_consensus.cc:1081] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Signalling peer b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:35.188738 20903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:50144
I20260709 13:04:35.189174 20903 raft_consensus.cc:493] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.189452 20903 raft_consensus.cc:3060] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.193272 20903 raft_consensus.cc:515] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.194604 20903 leader_election.cc:290] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:35.195334 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:35.195623 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4df82ce30748d1a818399ad15ea52a" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:35.195888 20827 raft_consensus.cc:3055] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.196139 20976 raft_consensus.cc:3060] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.196245 20827 raft_consensus.cc:740] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:35.197021 20827 consensus_queue.cc:260] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.198129 20827 raft_consensus.cc:3060] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.199926 20976 raft_consensus.cc:2468] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:35.200798 20869 leader_election.cc:304] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: 
I20260709 13:04:35.201536 21125 raft_consensus.cc:2804] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.201946 21125 raft_consensus.cc:697] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:35.202653 21125 consensus_queue.cc:237] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.203289 20827 raft_consensus.cc:2468] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:35.209277 20722 catalog_manager.cc:5697] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 1 to 2, leader changed from c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129) to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.266249 21128 raft_consensus.cc:993] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c: : Instructing follower b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:35.266638 21142 raft_consensus.cc:1081] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Signalling peer b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:35.267884 20903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:50144
I20260709 13:04:35.268332 20903 raft_consensus.cc:493] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.268661 20903 raft_consensus.cc:3060] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.272358 20903 raft_consensus.cc:515] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.274207 21136 raft_consensus.cc:993] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e: : Instructing follower b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:35.274310 20903 leader_election.cc:290] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:35.274494 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:35.274716 21118 raft_consensus.cc:1081] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Signalling peer b3d3e987d9df4a999cfcce35cfdeff77 to start an election
I20260709 13:04:35.274978 20827 raft_consensus.cc:3055] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:35.275301 20827 raft_consensus.cc:740] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:35.275539 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:35.276047 20976 raft_consensus.cc:3060] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.275951 20827 consensus_queue.cc:260] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.276221 20903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269871aca2484c8b8701845e786110de"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
 from {username='slave'} at 127.0.0.1:50140
I20260709 13:04:35.276790 20903 raft_consensus.cc:493] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:35.277096 20903 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:35.277055 20827 raft_consensus.cc:3060] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.281535 20976 raft_consensus.cc:2468] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:35.281823 20903 raft_consensus.cc:515] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.282481 20869 leader_election.cc:304] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: 
I20260709 13:04:35.282714 20827 raft_consensus.cc:2468] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 2.
I20260709 13:04:35.283376 20903 leader_election.cc:290] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 4 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:35.283325 21125 raft_consensus.cc:2804] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:35.284333 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:35.284436 21125 raft_consensus.cc:697] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:35.284989 20976 raft_consensus.cc:3055] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:35.285282 20976 raft_consensus.cc:740] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:35.285418 21125 consensus_queue.cc:237] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.285981 20976 consensus_queue.cc:260] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.287055 20976 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:35.284374 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:35.288283 20827 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:35.292492 20976 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 4.
I20260709 13:04:35.293402 20869 leader_election.cc:304] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, b3d3e987d9df4a999cfcce35cfdeff77; no voters: 
I20260709 13:04:35.293550 20827 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d3e987d9df4a999cfcce35cfdeff77 in term 4.
I20260709 13:04:35.294059 21125 raft_consensus.cc:2804] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:35.294597 21125 raft_consensus.cc:697] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Becoming Leader. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:35.295351 21125 consensus_queue.cc:237] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:35.296643 20722 catalog_manager.cc:5697] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 1 to 2, leader changed from c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129) to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.307137 20976 raft_consensus.cc:1275] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:35.307757 20722 catalog_manager.cc:5697] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 reported cstate change: term changed from 3 to 4, leader changed from 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131) to b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130). New cstate: current_term: 4 leader_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.308374 21125 consensus_queue.cc:1048] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:35.318396 20827 raft_consensus.cc:1275] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:35.320040 21053 consensus_queue.cc:1048] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:35.664021 20827 raft_consensus.cc:1275] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.665177 21053 consensus_queue.cc:1048] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.668045 20829 raft_consensus.cc:1275] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 4 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:35.669504 21125 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:35.674578 20976 raft_consensus.cc:1275] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.676363 21125 consensus_queue.cc:1048] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:35.688643 20976 raft_consensus.cc:1275] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 4 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:35.696054 21125 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:35.699616 20827 raft_consensus.cc:1275] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 4 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:35.700783 21125 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:35.708570 20976 raft_consensus.cc:1275] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 4 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:35.710222 21053 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:35.769976 20976 raft_consensus.cc:1275] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.771135 21160 consensus_queue.cc:1048] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:35.779852 20827 raft_consensus.cc:1275] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Refusing update from remote peer b3d3e987d9df4a999cfcce35cfdeff77: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:35.781131 21157 consensus_queue.cc:1048] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:37.856535 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:37.864590 20903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "118345599baa40db90002333a051acab"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
mode: GRACEFUL
new_leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:44776
I20260709 13:04:37.865433 20903 raft_consensus.cc:606] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Received request to transfer leadership to TS 37e7e96dcd2446ac8b62f353e3a4193e
I20260709 13:04:37.868474 20903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269871aca2484c8b8701845e786110de"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
mode: GRACEFUL
new_leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:44776
I20260709 13:04:37.868903 20903 raft_consensus.cc:606] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Received request to transfer leadership to TS c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:37.871141 20903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96cf48f653354665968d2148ac0d1912"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
mode: GRACEFUL
new_leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:44776
I20260709 13:04:37.871546 20903 raft_consensus.cc:606] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Received request to transfer leadership to TS 37e7e96dcd2446ac8b62f353e3a4193e
I20260709 13:04:37.873586 20903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
mode: GRACEFUL
new_leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:44776
I20260709 13:04:37.873994 20903 raft_consensus.cc:606] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Received request to transfer leadership to TS c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:37.876161 20903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5"
dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
mode: GRACEFUL
new_leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:44776
I20260709 13:04:37.876514 20903 raft_consensus.cc:606] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Received request to transfer leadership to TS c0a8297c4b9c4d9fb821d479ca36000c
I20260709 13:04:37.877452 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:37.877859 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:38.009016 21167 raft_consensus.cc:993] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77: : Instructing follower 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:38.009603 21166 raft_consensus.cc:1081] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Signalling peer 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:38.011165 20976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "118345599baa40db90002333a051acab"
dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:49376
I20260709 13:04:38.011632 20976 raft_consensus.cc:493] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.011955 20976 raft_consensus.cc:3060] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.016451 20976 raft_consensus.cc:515] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.017949 20976 leader_election.cc:290] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 2 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:38.018872 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118345599baa40db90002333a051acab" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:38.018996 20827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118345599baa40db90002333a051acab" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:38.019608 20827 raft_consensus.cc:3060] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.019578 20903 raft_consensus.cc:3055] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:38.020025 20903 raft_consensus.cc:740] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:38.020821 20903 consensus_queue.cc:260] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.022022 20903 raft_consensus.cc:3060] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.025916 20827 raft_consensus.cc:2468] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 2.
I20260709 13:04:38.027252 20944 leader_election.cc:304] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:38.027741 20903 raft_consensus.cc:2468] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 2.
I20260709 13:04:38.028147 21118 raft_consensus.cc:2804] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.029181 21118 raft_consensus.cc:697] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 LEADER]: Becoming Leader. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:38.029901 21118 consensus_queue.cc:237] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.036072 20723 catalog_manager.cc:5697] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e reported cstate change: term changed from 1 to 2, leader changed from b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130) to 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131). New cstate: current_term: 2 leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.219359 21167 raft_consensus.cc:993] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77: : Instructing follower c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:38.219848 21167 raft_consensus.cc:1081] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Signalling peer c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:38.221602 20827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269871aca2484c8b8701845e786110de"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:35112
I20260709 13:04:38.222198 20827 raft_consensus.cc:493] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.222500 20827 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:38.224334 21167 raft_consensus.cc:993] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77: : Instructing follower c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:38.224823 21166 raft_consensus.cc:1081] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Signalling peer c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:38.226433 20829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:35112
I20260709 13:04:38.226933 20829 raft_consensus.cc:493] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.227289 20829 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:38.227474 20827 raft_consensus.cc:515] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.229921 20827 leader_election.cc:290] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 5 election: Requested vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:38.230461 20976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:38.230965 20976 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:38.231706 20903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269871aca2484c8b8701845e786110de" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:38.232185 20903 raft_consensus.cc:3055] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:38.232457 20903 raft_consensus.cc:740] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:38.233129 20903 consensus_queue.cc:260] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.233935 20829 raft_consensus.cc:515] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.234310 20903 raft_consensus.cc:3060] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:38.235968 20829 leader_election.cc:290] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 5 election: Requested vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:38.236538 20976 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 5.
I20260709 13:04:38.237860 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:38.238052 20794 leader_election.cc:304] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:38.238432 20978 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:38.240130 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5603ee4b0874a04a16fecf5c3530ae5" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:38.240885 20904 raft_consensus.cc:3055] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:38.241269 20904 raft_consensus.cc:740] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:38.241461 20903 raft_consensus.cc:2468] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 5.
I20260709 13:04:38.242491 20904 consensus_queue.cc:260] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.243191 21175 raft_consensus.cc:2804] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:38.243714 20904 raft_consensus.cc:3060] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:38.244545 21175 raft_consensus.cc:697] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 5 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:38.245270 20978 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 5.
I20260709 13:04:38.245920 21175 consensus_queue.cc:237] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.246531 20794 leader_election.cc:304] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:38.247473 21176 raft_consensus.cc:2804] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:38.248795 21176 raft_consensus.cc:697] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 5 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:38.249909 20904 raft_consensus.cc:2468] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 5.
I20260709 13:04:38.249845 21176 consensus_queue.cc:237] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.254105 20723 catalog_manager.cc:5697] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 4 to 5, leader changed from b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130) to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 5 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.264684 20723 catalog_manager.cc:5697] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 4 to 5, leader changed from b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130) to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 5 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.300763 21167 raft_consensus.cc:993] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77: : Instructing follower c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:38.301215 21167 raft_consensus.cc:1081] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Signalling peer c0a8297c4b9c4d9fb821d479ca36000c to start an election
I20260709 13:04:38.302680 20829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb"
dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
 from {username='slave'} at 127.0.0.1:35112
I20260709 13:04:38.303157 20829 raft_consensus.cc:493] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.303483 20829 raft_consensus.cc:3060] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.308218 20829 raft_consensus.cc:515] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.310012 20829 leader_election.cc:290] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 3 election: Requested vote from peers b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843), 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131:42043)
I20260709 13:04:38.310642 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:38.311197 20904 raft_consensus.cc:3055] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:38.311167 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1c199e13314ab8a9284bc5f73e62eb" candidate_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
I20260709 13:04:38.311630 20904 raft_consensus.cc:740] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:38.311900 20978 raft_consensus.cc:3060] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.312485 20904 consensus_queue.cc:260] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.313390 20904 raft_consensus.cc:3060] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.317234 20978 raft_consensus.cc:2468] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 3.
I20260709 13:04:38.317608 20904 raft_consensus.cc:2468] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a8297c4b9c4d9fb821d479ca36000c in term 3.
I20260709 13:04:38.318295 20794 leader_election.cc:304] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:38.318946 21176 raft_consensus.cc:2804] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:38.319391 21176 raft_consensus.cc:697] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 3 LEADER]: Becoming Leader. State: Replica: c0a8297c4b9c4d9fb821d479ca36000c, State: Running, Role: LEADER
I20260709 13:04:38.320103 21176 consensus_queue.cc:237] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.326521 20723 catalog_manager.cc:5697] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c reported cstate change: term changed from 2 to 3, leader changed from b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130) to c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129). New cstate: current_term: 3 leader_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.420483 21174 raft_consensus.cc:993] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77: : Instructing follower 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:38.420892 21174 raft_consensus.cc:1081] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Signalling peer 37e7e96dcd2446ac8b62f353e3a4193e to start an election
I20260709 13:04:38.422219 20976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96cf48f653354665968d2148ac0d1912"
dest_uuid: "37e7e96dcd2446ac8b62f353e3a4193e"
 from {username='slave'} at 127.0.0.1:49376
I20260709 13:04:38.422644 20976 raft_consensus.cc:493] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.422883 20976 raft_consensus.cc:3060] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.426636 20976 raft_consensus.cc:515] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.427839 20976 leader_election.cc:290] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 3 election: Requested vote from peers c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973), b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130:38843)
I20260709 13:04:38.428633 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0a8297c4b9c4d9fb821d479ca36000c"
I20260709 13:04:38.428784 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96cf48f653354665968d2148ac0d1912" candidate_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3d3e987d9df4a999cfcce35cfdeff77"
I20260709 13:04:38.429224 20829 raft_consensus.cc:3060] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.429278 20904 raft_consensus.cc:3055] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:38.429646 20904 raft_consensus.cc:740] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3d3e987d9df4a999cfcce35cfdeff77, State: Running, Role: LEADER
I20260709 13:04:38.430292 20904 consensus_queue.cc:260] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.431140 20904 raft_consensus.cc:3060] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.433568 20829 raft_consensus.cc:2468] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 3.
I20260709 13:04:38.434448 20944 leader_election.cc:304] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e7e96dcd2446ac8b62f353e3a4193e, c0a8297c4b9c4d9fb821d479ca36000c; no voters: 
I20260709 13:04:38.435110 21118 raft_consensus.cc:2804] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:38.435590 21118 raft_consensus.cc:697] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Becoming Leader. State: Replica: 37e7e96dcd2446ac8b62f353e3a4193e, State: Running, Role: LEADER
I20260709 13:04:38.435837 20904 raft_consensus.cc:2468] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e7e96dcd2446ac8b62f353e3a4193e in term 3.
I20260709 13:04:38.436471 21118 consensus_queue.cc:237] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } }
I20260709 13:04:38.442515 20723 catalog_manager.cc:5697] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e reported cstate change: term changed from 2 to 3, leader changed from b3d3e987d9df4a999cfcce35cfdeff77 (127.20.53.130) to 37e7e96dcd2446ac8b62f353e3a4193e (127.20.53.131). New cstate: current_term: 3 leader_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.447609 20904 raft_consensus.cc:1275] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:38.448800 21118 consensus_queue.cc:1048] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:38.460759 20829 raft_consensus.cc:1275] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:38.462296 21184 consensus_queue.cc:1048] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:38.724110 20976 raft_consensus.cc:1275] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 5 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:38.725255 21176 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:38.733412 20904 raft_consensus.cc:1275] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 5 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:38.735073 21177 consensus_queue.cc:1048] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:38.752063 20904 raft_consensus.cc:1275] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 5 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:38.753237 21177 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:38.761917 20976 raft_consensus.cc:1275] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 5 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:38.764359 21177 consensus_queue.cc:1048] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:38.854012 20829 raft_consensus.cc:1275] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:38.855190 21184 consensus_queue.cc:1048] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0a8297c4b9c4d9fb821d479ca36000c" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:38.862360 20978 raft_consensus.cc:1275] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:38.864578 20904 raft_consensus.cc:1275] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Refusing update from remote peer 37e7e96dcd2446ac8b62f353e3a4193e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:38.865932 21118 consensus_queue.cc:1048] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:38.865182 21177 consensus_queue.cc:1048] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e7e96dcd2446ac8b62f353e3a4193e" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:04:38.878661 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:38.882614 20904 raft_consensus.cc:1275] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Refusing update from remote peer c0a8297c4b9c4d9fb821d479ca36000c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:38.884164 21176 consensus_queue.cc:1048] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d3e987d9df4a999cfcce35cfdeff77" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 38843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:38.889645 20694 tablet_server.cc:179] TabletServer@127.20.53.129:0 shutting down...
W20260709 13:04:38.908123 20870 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:38.923143 20870 consensus_peers.cc:597] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 -> Peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Couldn't send request to peer c0a8297c4b9c4d9fb821d479ca36000c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:38.934932 20944 consensus_peers.cc:597] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e -> Peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Couldn't send request to peer c0a8297c4b9c4d9fb821d479ca36000c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:38.940531 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:38.941334 20694 tablet_replica.cc:333] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c: stopping tablet replica
I20260709 13:04:38.942497 20694 raft_consensus.cc:2243] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.943109 20694 raft_consensus.cc:2272] T debe40d814a0429c8af6fb94bef961a9 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.945327 20694 tablet_replica.cc:333] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c: stopping tablet replica
I20260709 13:04:38.945813 20694 raft_consensus.cc:2243] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.946317 20694 raft_consensus.cc:2272] T d91ce4375b894157ab132b21b11efcfb P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.948199 20694 tablet_replica.cc:333] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c: stopping tablet replica
I20260709 13:04:38.948901 20694 raft_consensus.cc:2243] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.949760 20694 raft_consensus.cc:2272] T 269871aca2484c8b8701845e786110de P c0a8297c4b9c4d9fb821d479ca36000c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.951714 20694 tablet_replica.cc:333] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c: stopping tablet replica
I20260709 13:04:38.952256 20694 raft_consensus.cc:2243] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.952683 20694 raft_consensus.cc:2272] T eb4df82ce30748d1a818399ad15ea52a P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.954455 20694 tablet_replica.cc:333] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c: stopping tablet replica
I20260709 13:04:38.954945 20694 raft_consensus.cc:2243] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.955336 20694 raft_consensus.cc:2272] T 118345599baa40db90002333a051acab P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.957417 20694 tablet_replica.cc:333] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c: stopping tablet replica
I20260709 13:04:38.957916 20694 raft_consensus.cc:2243] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.958369 20694 raft_consensus.cc:2272] T d2ea11dfcb73486cbe80056e3b29b4e3 P c0a8297c4b9c4d9fb821d479ca36000c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.959972 20694 tablet_replica.cc:333] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c: stopping tablet replica
I20260709 13:04:38.960433 20694 raft_consensus.cc:2243] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.960860 20694 raft_consensus.cc:2272] T 96cf48f653354665968d2148ac0d1912 P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.962875 20694 tablet_replica.cc:333] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c: stopping tablet replica
I20260709 13:04:38.963362 20694 raft_consensus.cc:2243] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.964121 20694 raft_consensus.cc:2272] T ba1c199e13314ab8a9284bc5f73e62eb P c0a8297c4b9c4d9fb821d479ca36000c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.965939 20694 tablet_replica.cc:333] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c: stopping tablet replica
I20260709 13:04:38.966470 20694 raft_consensus.cc:2243] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.967152 20694 raft_consensus.cc:2272] T c5603ee4b0874a04a16fecf5c3530ae5 P c0a8297c4b9c4d9fb821d479ca36000c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.087910 20694 tablet_server.cc:196] TabletServer@127.20.53.129:0 shutdown complete.
W20260709 13:04:39.088177 20870 consensus_peers.cc:597] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 -> Peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Couldn't send request to peer c0a8297c4b9c4d9fb821d479ca36000c. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:45973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.104475 20694 tablet_server.cc:179] TabletServer@127.20.53.130:0 shutting down...
W20260709 13:04:39.126103 20870 consensus_peers.cc:597] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 -> Peer c0a8297c4b9c4d9fb821d479ca36000c (127.20.53.129:45973): Couldn't send request to peer c0a8297c4b9c4d9fb821d479ca36000c. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:45973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.127979 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:39.128650 20694 tablet_replica.cc:333] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77: stopping tablet replica
I20260709 13:04:39.129241 20694 raft_consensus.cc:2243] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.129634 20694 raft_consensus.cc:2272] T d91ce4375b894157ab132b21b11efcfb P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.131366 20694 tablet_replica.cc:333] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77: stopping tablet replica
I20260709 13:04:39.132045 20694 raft_consensus.cc:2243] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.132380 20694 raft_consensus.cc:2272] T 118345599baa40db90002333a051acab P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.134765 20694 tablet_replica.cc:333] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77: stopping tablet replica
I20260709 13:04:39.135227 20694 raft_consensus.cc:2243] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.135545 20694 raft_consensus.cc:2272] T ba1c199e13314ab8a9284bc5f73e62eb P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.137257 20694 tablet_replica.cc:333] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77: stopping tablet replica
I20260709 13:04:39.137669 20694 raft_consensus.cc:2243] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.137975 20694 raft_consensus.cc:2272] T 96cf48f653354665968d2148ac0d1912 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.139923 20694 tablet_replica.cc:333] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77: stopping tablet replica
I20260709 13:04:39.140357 20694 raft_consensus.cc:2243] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:39.140990 20694 raft_consensus.cc:2272] T d2ea11dfcb73486cbe80056e3b29b4e3 P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.142452 20694 tablet_replica.cc:333] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77: stopping tablet replica
I20260709 13:04:39.142849 20694 raft_consensus.cc:2243] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:39.143472 20694 raft_consensus.cc:2272] T eb4df82ce30748d1a818399ad15ea52a P b3d3e987d9df4a999cfcce35cfdeff77 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.144868 20694 tablet_replica.cc:333] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77: stopping tablet replica
I20260709 13:04:39.145256 20694 raft_consensus.cc:2243] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:39.145823 20694 raft_consensus.cc:2272] T debe40d814a0429c8af6fb94bef961a9 P b3d3e987d9df4a999cfcce35cfdeff77 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.147245 20694 tablet_replica.cc:333] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77: stopping tablet replica
I20260709 13:04:39.147636 20694 raft_consensus.cc:2243] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.147938 20694 raft_consensus.cc:2272] T c5603ee4b0874a04a16fecf5c3530ae5 P b3d3e987d9df4a999cfcce35cfdeff77 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.149688 20694 tablet_replica.cc:333] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77: stopping tablet replica
I20260709 13:04:39.150055 20694 raft_consensus.cc:2243] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.150437 20694 raft_consensus.cc:2272] T 269871aca2484c8b8701845e786110de P b3d3e987d9df4a999cfcce35cfdeff77 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.176419 20694 tablet_server.cc:196] TabletServer@127.20.53.130:0 shutdown complete.
I20260709 13:04:39.191614 20694 tablet_server.cc:179] TabletServer@127.20.53.131:0 shutting down...
I20260709 13:04:39.219163 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:39.219719 20694 tablet_replica.cc:333] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e: stopping tablet replica
I20260709 13:04:39.220270 20694 raft_consensus.cc:2243] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:39.221031 20694 raft_consensus.cc:2272] T d91ce4375b894157ab132b21b11efcfb P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.222672 20694 tablet_replica.cc:333] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e: stopping tablet replica
I20260709 13:04:39.223151 20694 raft_consensus.cc:2243] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:39.223789 20694 raft_consensus.cc:2272] T 118345599baa40db90002333a051acab P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.225422 20694 tablet_replica.cc:333] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e: stopping tablet replica
I20260709 13:04:39.225883 20694 raft_consensus.cc:2243] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.226347 20694 raft_consensus.cc:2272] T c5603ee4b0874a04a16fecf5c3530ae5 P 37e7e96dcd2446ac8b62f353e3a4193e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.228097 20694 tablet_replica.cc:333] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e: stopping tablet replica
I20260709 13:04:39.228554 20694 raft_consensus.cc:2243] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.228929 20694 raft_consensus.cc:2272] T eb4df82ce30748d1a818399ad15ea52a P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.230466 20694 tablet_replica.cc:333] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e: stopping tablet replica
I20260709 13:04:39.230901 20694 raft_consensus.cc:2243] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.231271 20694 raft_consensus.cc:2272] T d2ea11dfcb73486cbe80056e3b29b4e3 P 37e7e96dcd2446ac8b62f353e3a4193e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.232681 20694 tablet_replica.cc:333] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e: stopping tablet replica
I20260709 13:04:39.233132 20694 raft_consensus.cc:2243] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.233525 20694 raft_consensus.cc:2272] T debe40d814a0429c8af6fb94bef961a9 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.234963 20694 tablet_replica.cc:333] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e: stopping tablet replica
I20260709 13:04:39.235391 20694 raft_consensus.cc:2243] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:39.236052 20694 raft_consensus.cc:2272] T 96cf48f653354665968d2148ac0d1912 P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.237582 20694 tablet_replica.cc:333] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e: stopping tablet replica
I20260709 13:04:39.238022 20694 raft_consensus.cc:2243] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.238435 20694 raft_consensus.cc:2272] T ba1c199e13314ab8a9284bc5f73e62eb P 37e7e96dcd2446ac8b62f353e3a4193e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.240077 20694 tablet_replica.cc:333] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e: stopping tablet replica
I20260709 13:04:39.240437 20694 raft_consensus.cc:2243] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:39.240775 20694 raft_consensus.cc:2272] T 269871aca2484c8b8701845e786110de P 37e7e96dcd2446ac8b62f353e3a4193e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.266806 20694 tablet_server.cc:196] TabletServer@127.20.53.131:0 shutdown complete.
I20260709 13:04:39.282348 20694 master.cc:562] Master@127.20.53.190:44327 shutting down...
I20260709 13:04:39.475620 20694 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:39.476223 20694 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.476564 20694 tablet_replica.cc:333] T 00000000000000000000000000000000 P cb008439d5f04982bc33c4901132e1eb: stopping tablet replica
I20260709 13:04:39.496907 20694 master.cc:584] Master@127.20.53.190:44327 shutdown complete.
37e7e96dcd2446ac8b62f353e3a4193e  1
b3d3e987d9df4a999cfcce35cfdeff77  4
c0a8297c4b9c4d9fb821d479ca36000c  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12754 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:04:39.535343 20694 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.53.190:41173
I20260709 13:04:39.536409 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:39.541586 21199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:39.542212 21200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:39.543628 21202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:39.544147 20694 server_base.cc:1061] running on GCE node
I20260709 13:04:39.544992 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:39.545158 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:39.545307 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602279545278 us; error 0 us; skew 500 ppm
I20260709 13:04:39.545738 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:39.547976 20694 webserver.cc:533] Webserver started at http://127.20.53.190:46507/ using document root <none> and password file <none>
I20260709 13:04:39.548410 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:39.548561 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:39.548764 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:39.549798 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/master-0-root/instance:
uuid: "f33ebead3cfa47bb8f258cf75edbe16a"
format_stamp: "Formatted at 2026-07-09 13:04:39 on dist-test-slave-r056"
I20260709 13:04:39.553966 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:04:39.557118 21207 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.557849 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:39.558121 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/master-0-root
uuid: "f33ebead3cfa47bb8f258cf75edbe16a"
format_stamp: "Formatted at 2026-07-09 13:04:39 on dist-test-slave-r056"
I20260709 13:04:39.558451 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:39.578997 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:39.580122 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:39.616417 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.190:41173
I20260709 13:04:39.616506 21258 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.190:41173 every 8 connection(s)
I20260709 13:04:39.620257 21259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.632519 21259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a: Bootstrap starting.
I20260709 13:04:39.636818 21259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.640599 21259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a: No bootstrap required, opened a new log
I20260709 13:04:39.642596 21259 raft_consensus.cc:359] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f33ebead3cfa47bb8f258cf75edbe16a" member_type: VOTER }
I20260709 13:04:39.642961 21259 raft_consensus.cc:385] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.643189 21259 raft_consensus.cc:740] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33ebead3cfa47bb8f258cf75edbe16a, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.643786 21259 consensus_queue.cc:260] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f33ebead3cfa47bb8f258cf75edbe16a" member_type: VOTER }
I20260709 13:04:39.644214 21259 raft_consensus.cc:399] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:39.644440 21259 raft_consensus.cc:493] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:39.644727 21259 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.648352 21259 raft_consensus.cc:515] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f33ebead3cfa47bb8f258cf75edbe16a" member_type: VOTER }
I20260709 13:04:39.648831 21259 leader_election.cc:304] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f33ebead3cfa47bb8f258cf75edbe16a; no voters: 
I20260709 13:04:39.649869 21259 leader_election.cc:290] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:39.650313 21262 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.651564 21262 raft_consensus.cc:697] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 1 LEADER]: Becoming Leader. State: Replica: f33ebead3cfa47bb8f258cf75edbe16a, State: Running, Role: LEADER
I20260709 13:04:39.652137 21262 consensus_queue.cc:237] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f33ebead3cfa47bb8f258cf75edbe16a" member_type: VOTER }
I20260709 13:04:39.652647 21259 sys_catalog.cc:565] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:39.656354 21263 sys_catalog.cc:455] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f33ebead3cfa47bb8f258cf75edbe16a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f33ebead3cfa47bb8f258cf75edbe16a" member_type: VOTER } }
I20260709 13:04:39.656765 21264 sys_catalog.cc:455] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f33ebead3cfa47bb8f258cf75edbe16a. Latest consensus state: current_term: 1 leader_uuid: "f33ebead3cfa47bb8f258cf75edbe16a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f33ebead3cfa47bb8f258cf75edbe16a" member_type: VOTER } }
I20260709 13:04:39.656997 21263 sys_catalog.cc:458] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:39.657327 21264 sys_catalog.cc:458] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:39.658761 21268 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:39.663789 21268 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:39.667940 20694 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:39.673808 21268 catalog_manager.cc:1383] Generated new cluster ID: b9c8448e361a440bb739f8c3ee732ea7
I20260709 13:04:39.674067 21268 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:39.697988 21268 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:39.699152 21268 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:39.717085 21268 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a: Generated new TSK 0
I20260709 13:04:39.717658 21268 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:39.734943 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:39.740883 21280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:39.741976 21281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:39.743337 20694 server_base.cc:1061] running on GCE node
W20260709 13:04:39.743729 21283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:39.744500 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:39.744721 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:39.744891 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602279744867 us; error 0 us; skew 500 ppm
I20260709 13:04:39.745378 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:39.747522 20694 webserver.cc:533] Webserver started at http://127.20.53.129:34077/ using document root <none> and password file <none>
I20260709 13:04:39.747989 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:39.748216 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:39.748471 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:39.749478 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-0-root/instance:
uuid: "28a08cf73c484600a444fec9b6a343c4"
format_stamp: "Formatted at 2026-07-09 13:04:39 on dist-test-slave-r056"
I20260709 13:04:39.753590 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:04:39.756903 21288 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.757620 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:39.757897 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "28a08cf73c484600a444fec9b6a343c4"
format_stamp: "Formatted at 2026-07-09 13:04:39 on dist-test-slave-r056"
I20260709 13:04:39.758213 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:39.777148 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:39.778386 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:39.779808 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:39.781977 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:39.782229 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.782470 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:39.782662 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.821046 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:45133
I20260709 13:04:39.821132 21350 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:45133 every 8 connection(s)
I20260709 13:04:39.825698 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:39.832357 21355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:39.832741 21356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:39.836606 21358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:39.837402 20694 server_base.cc:1061] running on GCE node
I20260709 13:04:39.838433 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:39.838692 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:39.838986 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602279838964 us; error 0 us; skew 500 ppm
I20260709 13:04:39.839681 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:39.841262 21351 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41173
I20260709 13:04:39.841586 21351 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:39.842355 20694 webserver.cc:533] Webserver started at http://127.20.53.130:33531/ using document root <none> and password file <none>
I20260709 13:04:39.842449 21351 heartbeater.cc:507] Master 127.20.53.190:41173 requested a full tablet report, sending...
I20260709 13:04:39.842855 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:39.843116 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:39.843384 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:39.844803 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-1-root/instance:
uuid: "91df6974e17b4f488fe277b9a3f7a33b"
format_stamp: "Formatted at 2026-07-09 13:04:39 on dist-test-slave-r056"
I20260709 13:04:39.844880 21224 ts_manager.cc:194] Registered new tserver with Master: 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133)
I20260709 13:04:39.847242 21224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38186
I20260709 13:04:39.850318 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260709 13:04:39.853390 21363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.854277 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:39.854561 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-1-root
uuid: "91df6974e17b4f488fe277b9a3f7a33b"
format_stamp: "Formatted at 2026-07-09 13:04:39 on dist-test-slave-r056"
I20260709 13:04:39.854817 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:39.875061 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:39.876178 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:39.877620 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:39.879784 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:39.879954 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.880232 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:39.880386 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.919008 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.130:39711
I20260709 13:04:39.919104 21425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.130:39711 every 8 connection(s)
I20260709 13:04:39.923489 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:39.930529 21429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:39.933284 21432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:39.934346 21430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:39.934993 21426 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41173
I20260709 13:04:39.935295 21426 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:39.935894 21426 heartbeater.cc:507] Master 127.20.53.190:41173 requested a full tablet report, sending...
I20260709 13:04:39.937258 20694 server_base.cc:1061] running on GCE node
I20260709 13:04:39.937896 21224 ts_manager.cc:194] Registered new tserver with Master: 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:39.938247 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:39.938498 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:39.938689 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602279938672 us; error 0 us; skew 500 ppm
I20260709 13:04:39.939397 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:39.939631 21224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38188
I20260709 13:04:39.941927 20694 webserver.cc:533] Webserver started at http://127.20.53.131:44545/ using document root <none> and password file <none>
I20260709 13:04:39.942442 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:39.942641 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:39.942902 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:39.943946 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-2-root/instance:
uuid: "31d783f835ff477388b2bf6d6b4246e5"
format_stamp: "Formatted at 2026-07-09 13:04:39 on dist-test-slave-r056"
I20260709 13:04:39.948014 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:04:39.951013 21437 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.951686 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:39.951957 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-2-root
uuid: "31d783f835ff477388b2bf6d6b4246e5"
format_stamp: "Formatted at 2026-07-09 13:04:39 on dist-test-slave-r056"
I20260709 13:04:39.952220 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602266622664-20694-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:39.964375 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:39.965406 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:39.966799 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:39.968778 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:39.969002 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:39.969231 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:39.969419 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:40.008096 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.131:38985
I20260709 13:04:40.008222 21499 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.131:38985 every 8 connection(s)
I20260709 13:04:40.021795 21500 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41173
I20260709 13:04:40.022224 21500 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:40.022910 21500 heartbeater.cc:507] Master 127.20.53.190:41173 requested a full tablet report, sending...
I20260709 13:04:40.024809 21224 ts_manager.cc:194] Registered new tserver with Master: 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.025591 20694 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014356568s
I20260709 13:04:40.026100 21224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38192
I20260709 13:04:40.049536 21224 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38206:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:40.052358 21224 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:40.118660 21391 tablet_service.cc:1511] Processing CreateTablet for tablet dbd4e2bf2f0f45e4b8d5d02f6d270cda (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:40.120107 21391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd4e2bf2f0f45e4b8d5d02f6d270cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.122678 21389 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff2979731cb45b5ac332c97ecda0070 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:40.123263 21390 tablet_service.cc:1511] Processing CreateTablet for tablet 750059ee678249adaa67a9c2505a7f6a (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:40.124017 21389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff2979731cb45b5ac332c97ecda0070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.124732 21390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 750059ee678249adaa67a9c2505a7f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.140120 21388 tablet_service.cc:1511] Processing CreateTablet for tablet 16daaa1fea224086b1898c912c12d347 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:40.140530 21316 tablet_service.cc:1511] Processing CreateTablet for tablet dbd4e2bf2f0f45e4b8d5d02f6d270cda (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:40.141430 21388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16daaa1fea224086b1898c912c12d347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.141775 21316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd4e2bf2f0f45e4b8d5d02f6d270cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.143270 21315 tablet_service.cc:1511] Processing CreateTablet for tablet 750059ee678249adaa67a9c2505a7f6a (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:40.144490 21315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 750059ee678249adaa67a9c2505a7f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.147063 21387 tablet_service.cc:1511] Processing CreateTablet for tablet fb91c4c654954c56ba49ca75781aed99 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:40.147282 21314 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff2979731cb45b5ac332c97ecda0070 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:40.148304 21387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb91c4c654954c56ba49ca75781aed99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.148566 21314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff2979731cb45b5ac332c97ecda0070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.152063 21313 tablet_service.cc:1511] Processing CreateTablet for tablet 16daaa1fea224086b1898c912c12d347 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:40.153921 21313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16daaa1fea224086b1898c912c12d347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.153885 21386 tablet_service.cc:1511] Processing CreateTablet for tablet bc4a6c1c43a84bf39343088d33e8e2fe (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:40.154259 21312 tablet_service.cc:1511] Processing CreateTablet for tablet fb91c4c654954c56ba49ca75781aed99 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:40.155236 21386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc4a6c1c43a84bf39343088d33e8e2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.155551 21312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb91c4c654954c56ba49ca75781aed99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.156172 21311 tablet_service.cc:1511] Processing CreateTablet for tablet bc4a6c1c43a84bf39343088d33e8e2fe (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:40.157621 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc4a6c1c43a84bf39343088d33e8e2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.166584 21310 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2037d0f89046c9bfd4d63a809e66ba (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:40.167918 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2037d0f89046c9bfd4d63a809e66ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.172111 21385 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2037d0f89046c9bfd4d63a809e66ba (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:40.173254 21385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2037d0f89046c9bfd4d63a809e66ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.175083 21309 tablet_service.cc:1511] Processing CreateTablet for tablet dfd9f45477604728a3eecfe729aab3d1 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:40.176345 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd9f45477604728a3eecfe729aab3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.183132 21308 tablet_service.cc:1511] Processing CreateTablet for tablet 6b4b1a9de6b646dc93be3b48b06bb327 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:40.184469 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4b1a9de6b646dc93be3b48b06bb327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.185436 21384 tablet_service.cc:1511] Processing CreateTablet for tablet 6b4b1a9de6b646dc93be3b48b06bb327 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:40.186740 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4b1a9de6b646dc93be3b48b06bb327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.188354 21307 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfc71058a5d4688bef10576ffa5a973 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:40.189621 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfc71058a5d4688bef10576ffa5a973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.192174 21383 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfc71058a5d4688bef10576ffa5a973 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:40.193389 21383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfc71058a5d4688bef10576ffa5a973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.199335 21389 tablet_service.cc:1511] Processing CreateTablet for tablet dfd9f45477604728a3eecfe729aab3d1 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:40.200645 21389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd9f45477604728a3eecfe729aab3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.213299 21515 tablet_bootstrap.cc:492] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:40.227286 21465 tablet_service.cc:1511] Processing CreateTablet for tablet dbd4e2bf2f0f45e4b8d5d02f6d270cda (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:40.227588 21462 tablet_service.cc:1511] Processing CreateTablet for tablet 16daaa1fea224086b1898c912c12d347 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:40.228557 21465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd4e2bf2f0f45e4b8d5d02f6d270cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.229319 21462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16daaa1fea224086b1898c912c12d347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.230278 21464 tablet_service.cc:1511] Processing CreateTablet for tablet 750059ee678249adaa67a9c2505a7f6a (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:40.231600 21464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 750059ee678249adaa67a9c2505a7f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.231421 21463 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff2979731cb45b5ac332c97ecda0070 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:40.231725 21460 tablet_service.cc:1511] Processing CreateTablet for tablet bc4a6c1c43a84bf39343088d33e8e2fe (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:40.232652 21463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff2979731cb45b5ac332c97ecda0070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.233373 21460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc4a6c1c43a84bf39343088d33e8e2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.235531 21458 tablet_service.cc:1511] Processing CreateTablet for tablet dfd9f45477604728a3eecfe729aab3d1 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:40.227196 21459 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2037d0f89046c9bfd4d63a809e66ba (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:40.240641 21456 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfc71058a5d4688bef10576ffa5a973 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:40.241669 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd9f45477604728a3eecfe729aab3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.255511 21515 tablet_bootstrap.cc:654] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.258638 21461 tablet_service.cc:1511] Processing CreateTablet for tablet fb91c4c654954c56ba49ca75781aed99 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:40.259471 21457 tablet_service.cc:1511] Processing CreateTablet for tablet 6b4b1a9de6b646dc93be3b48b06bb327 (DEFAULT_TABLE table=test-workload [id=7b3d752fe0c448209736e3856437ca75]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:40.266721 21459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2037d0f89046c9bfd4d63a809e66ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.267319 21461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb91c4c654954c56ba49ca75781aed99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.273674 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfc71058a5d4688bef10576ffa5a973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.298313 21457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4b1a9de6b646dc93be3b48b06bb327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:40.330361 21516 tablet_bootstrap.cc:492] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.332075 21517 tablet_bootstrap.cc:492] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.338200 21516 tablet_bootstrap.cc:654] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.348372 21517 tablet_bootstrap.cc:654] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.354209 21515 tablet_bootstrap.cc:492] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
I20260709 13:04:40.354770 21515 ts_tablet_manager.cc:1403] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.013s
I20260709 13:04:40.355113 21517 tablet_bootstrap.cc:492] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.355515 21517 ts_tablet_manager.cc:1403] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.001s
I20260709 13:04:40.356832 21516 tablet_bootstrap.cc:492] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:40.357312 21516 ts_tablet_manager.cc:1403] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 13:04:40.357610 21517 raft_consensus.cc:359] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.357543 21515 raft_consensus.cc:359] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.358286 21517 raft_consensus.cc:385] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.358403 21515 raft_consensus.cc:385] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.358551 21517 raft_consensus.cc:740] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.358811 21515 raft_consensus.cc:740] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.359194 21517 consensus_queue.cc:260] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.359543 21515 consensus_queue.cc:260] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.361359 21500 heartbeater.cc:499] Master 127.20.53.190:41173 was elected leader, sending a full tablet report...
I20260709 13:04:40.360960 21516 raft_consensus.cc:359] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.361910 21517 ts_tablet_manager.cc:1434] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:04:40.362042 21516 raft_consensus.cc:385] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.362668 21516 raft_consensus.cc:740] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.363713 21517 tablet_bootstrap.cc:492] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.363848 21516 consensus_queue.cc:260] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.368674 21515 ts_tablet_manager.cc:1434] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:04:40.369426 21426 heartbeater.cc:499] Master 127.20.53.190:41173 was elected leader, sending a full tablet report...
I20260709 13:04:40.369906 21517 tablet_bootstrap.cc:654] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.370277 21351 heartbeater.cc:499] Master 127.20.53.190:41173 was elected leader, sending a full tablet report...
I20260709 13:04:40.379520 21516 ts_tablet_manager.cc:1434] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:04:40.379572 21515 tablet_bootstrap.cc:492] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:40.380641 21516 tablet_bootstrap.cc:492] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.387686 21516 tablet_bootstrap.cc:654] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.388773 21515 tablet_bootstrap.cc:654] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.393151 21517 tablet_bootstrap.cc:492] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.393769 21517 ts_tablet_manager.cc:1403] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.011s
I20260709 13:04:40.397572 21517 raft_consensus.cc:359] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.398571 21517 raft_consensus.cc:385] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.398962 21517 raft_consensus.cc:740] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.400395 21516 tablet_bootstrap.cc:492] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:40.400071 21517 consensus_queue.cc:260] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.400910 21516 ts_tablet_manager.cc:1403] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:04:40.403260 21517 ts_tablet_manager.cc:1434] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 13:04:40.403800 21516 raft_consensus.cc:359] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.404420 21517 tablet_bootstrap.cc:492] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.404454 21516 raft_consensus.cc:385] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.404969 21516 raft_consensus.cc:740] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.405769 21516 consensus_queue.cc:260] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.408099 21516 ts_tablet_manager.cc:1434] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:40.408947 21516 tablet_bootstrap.cc:492] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.411819 21522 raft_consensus.cc:493] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.412298 21522 raft_consensus.cc:515] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.413785 21517 tablet_bootstrap.cc:654] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.419649 21522 leader_election.cc:290] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.426723 21517 tablet_bootstrap.cc:492] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.430452 21517 ts_tablet_manager.cc:1403] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 13:04:40.430286 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:40.431020 21475 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 0.
I20260709 13:04:40.432348 21364 leader_election.cc:304] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:40.433136 21522 raft_consensus.cc:2804] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.433511 21522 raft_consensus.cc:493] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.433838 21522 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.434298 21517 raft_consensus.cc:359] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.435258 21517 raft_consensus.cc:385] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.435622 21517 raft_consensus.cc:740] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.436760 21517 consensus_queue.cc:260] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.439879 21517 ts_tablet_manager.cc:1434] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:40.441120 21517 tablet_bootstrap.cc:492] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.448239 21522 raft_consensus.cc:515] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.449555 21517 tablet_bootstrap.cc:654] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.455875 21517 tablet_bootstrap.cc:492] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.456423 21517 ts_tablet_manager.cc:1403] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:04:40.456732 21516 tablet_bootstrap.cc:654] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.459197 21517 raft_consensus.cc:359] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.459909 21517 raft_consensus.cc:385] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.460213 21517 raft_consensus.cc:740] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.459545 21515 tablet_bootstrap.cc:492] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
I20260709 13:04:40.461165 21515 ts_tablet_manager.cc:1403] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.082s	user 0.029s	sys 0.046s
I20260709 13:04:40.462126 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:40.462348 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:40.462944 21475 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.462060 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:40.464310 21516 tablet_bootstrap.cc:492] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:40.464047 21515 raft_consensus.cc:359] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.464740 21515 raft_consensus.cc:385] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.464856 21516 ts_tablet_manager.cc:1403] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 13:04:40.465065 21515 raft_consensus.cc:740] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
W20260709 13:04:40.465564 21367 leader_election.cc:343] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.465786 21515 consensus_queue.cc:260] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.466600 21522 leader_election.cc:290] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
W20260709 13:04:40.466252 21367 leader_election.cc:343] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.464484 21517 consensus_queue.cc:260] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.468175 21516 raft_consensus.cc:359] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.468963 21516 raft_consensus.cc:385] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.469307 21516 raft_consensus.cc:740] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.470046 21516 consensus_queue.cc:260] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.473059 21517 ts_tablet_manager.cc:1434] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:04:40.473995 21517 tablet_bootstrap.cc:492] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.480266 21517 tablet_bootstrap.cc:654] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.480775 21475 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 1.
I20260709 13:04:40.482352 21364 leader_election.cc:304] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:40.482862 21516 ts_tablet_manager.cc:1434] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:04:40.483820 21522 raft_consensus.cc:2804] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:40.484398 21522 raft_consensus.cc:697] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:40.485419 21522 consensus_queue.cc:237] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.492045 21516 tablet_bootstrap.cc:492] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.501070 21516 tablet_bootstrap.cc:654] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.506270 21224 catalog_manager.cc:5697] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 0 to 1, leader changed from <none> to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 1 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.518791 21515 ts_tablet_manager.cc:1434] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.057s	user 0.037s	sys 0.019s
I20260709 13:04:40.518898 21516 tablet_bootstrap.cc:492] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:40.519542 21516 ts_tablet_manager.cc:1403] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 13:04:40.519804 21515 tablet_bootstrap.cc:492] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:40.520048 21517 tablet_bootstrap.cc:492] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.520484 21517 ts_tablet_manager.cc:1403] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.019s
I20260709 13:04:40.522786 21516 raft_consensus.cc:359] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.523545 21516 raft_consensus.cc:385] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.523947 21516 raft_consensus.cc:740] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.523603 21517 raft_consensus.cc:359] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.524734 21517 raft_consensus.cc:385] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.525075 21517 raft_consensus.cc:740] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.524899 21516 consensus_queue.cc:260] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.525866 21517 consensus_queue.cc:260] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.526574 21515 tablet_bootstrap.cc:654] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.528127 21517 ts_tablet_manager.cc:1434] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:04:40.529084 21517 tablet_bootstrap.cc:492] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.530182 21516 ts_tablet_manager.cc:1434] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:40.531165 21516 tablet_bootstrap.cc:492] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.537305 21516 tablet_bootstrap.cc:654] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.537348 21517 tablet_bootstrap.cc:654] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.556721 21515 tablet_bootstrap.cc:492] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
I20260709 13:04:40.556725 21516 tablet_bootstrap.cc:492] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:40.556890 21517 tablet_bootstrap.cc:492] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.557344 21515 ts_tablet_manager.cc:1403] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.018s
I20260709 13:04:40.557461 21516 ts_tablet_manager.cc:1403] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 13:04:40.557524 21517 ts_tablet_manager.cc:1403] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.008s
I20260709 13:04:40.559859 21516 raft_consensus.cc:359] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.560344 21515 raft_consensus.cc:359] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.560746 21516 raft_consensus.cc:385] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.561007 21515 raft_consensus.cc:385] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.560670 21517 raft_consensus.cc:359] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.561146 21516 raft_consensus.cc:740] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.561364 21515 raft_consensus.cc:740] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.561447 21517 raft_consensus.cc:385] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.561858 21517 raft_consensus.cc:740] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.561940 21516 consensus_queue.cc:260] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.562209 21515 consensus_queue.cc:260] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.562741 21517 consensus_queue.cc:260] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.564354 21515 ts_tablet_manager.cc:1434] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:40.565279 21515 tablet_bootstrap.cc:492] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:40.566079 21516 ts_tablet_manager.cc:1434] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:40.566951 21516 tablet_bootstrap.cc:492] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.567083 21517 ts_tablet_manager.cc:1434] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:04:40.568013 21517 tablet_bootstrap.cc:492] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.571305 21515 tablet_bootstrap.cc:654] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.573494 21516 tablet_bootstrap.cc:654] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.574033 21517 tablet_bootstrap.cc:654] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.580330 21521 raft_consensus.cc:493] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.580957 21521 raft_consensus.cc:515] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.585414 21515 tablet_bootstrap.cc:492] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
I20260709 13:04:40.585883 21515 ts_tablet_manager.cc:1403] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:04:40.588953 21515 raft_consensus.cc:359] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.589651 21515 raft_consensus.cc:385] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.589870 21521 leader_election.cc:290] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:40.592301 21516 tablet_bootstrap.cc:492] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:40.592873 21516 ts_tablet_manager.cc:1403] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:04:40.597039 21516 raft_consensus.cc:359] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.597822 21516 raft_consensus.cc:385] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.589956 21515 raft_consensus.cc:740] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.598116 21516 raft_consensus.cc:740] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.598421 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:40.599046 21326 raft_consensus.cc:2468] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 0.
I20260709 13:04:40.599131 21516 consensus_queue.cc:260] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.599170 21515 consensus_queue.cc:260] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.600454 21441 leader_election.cc:304] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:40.601433 21521 raft_consensus.cc:2804] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.601783 21521 raft_consensus.cc:493] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.601994 21515 ts_tablet_manager.cc:1434] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 13:04:40.602150 21516 ts_tablet_manager.cc:1434] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:04:40.602098 21521 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.603372 21515 tablet_bootstrap.cc:492] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:40.603639 21516 tablet_bootstrap.cc:492] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.610152 21515 tablet_bootstrap.cc:654] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.610316 21516 tablet_bootstrap.cc:654] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.619154 21523 raft_consensus.cc:493] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.620041 21523 raft_consensus.cc:515] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.622438 21531 raft_consensus.cc:493] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.622967 21531 raft_consensus.cc:515] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.625346 21531 leader_election.cc:290] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.627115 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:40.627861 21475 raft_consensus.cc:2468] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 0.
I20260709 13:04:40.629142 21364 leader_election.cc:304] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:40.629065 21517 tablet_bootstrap.cc:492] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.629410 21523 leader_election.cc:290] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.630055 21531 raft_consensus.cc:2804] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.630597 21531 raft_consensus.cc:493] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.630125 21517 ts_tablet_manager.cc:1403] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.004s
I20260709 13:04:40.631114 21531 raft_consensus.cc:3060] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.630038 21523 raft_consensus.cc:493] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.634706 21523 raft_consensus.cc:515] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.636797 21517 raft_consensus.cc:359] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.637567 21517 raft_consensus.cc:385] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.637997 21517 raft_consensus.cc:740] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.638447 21515 tablet_bootstrap.cc:492] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
I20260709 13:04:40.638886 21515 ts_tablet_manager.cc:1403] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.009s
I20260709 13:04:40.638809 21517 consensus_queue.cc:260] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.637410 21523 leader_election.cc:290] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.642251 21515 raft_consensus.cc:359] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.644057 21516 tablet_bootstrap.cc:492] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:40.643880 21401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.644537 21516 ts_tablet_manager.cc:1403] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.004s
W20260709 13:04:40.647029 21439 leader_election.cc:343] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.647889 21516 raft_consensus.cc:359] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.648825 21516 raft_consensus.cc:385] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.648963 21515 raft_consensus.cc:385] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.649259 21516 raft_consensus.cc:740] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.649427 21515 raft_consensus.cc:740] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.650436 21515 consensus_queue.cc:260] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.653378 21515 ts_tablet_manager.cc:1434] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:04:40.657703 21515 tablet_bootstrap.cc:492] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:40.655413 21531 raft_consensus.cc:515] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
W20260709 13:04:40.664191 21272 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:40.666741 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:40.666699 21521 raft_consensus.cc:515] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.667465 21475 raft_consensus.cc:3060] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.668346 21515 tablet_bootstrap.cc:654] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.669665 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:40.673889 21326 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.676684 21475 raft_consensus.cc:2468] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 1.
I20260709 13:04:40.677920 21364 leader_election.cc:304] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:40.678865 21522 raft_consensus.cc:2804] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:40.684276 21326 raft_consensus.cc:2468] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 1.
I20260709 13:04:40.684931 21531 leader_election.cc:290] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.685710 21441 leader_election.cc:304] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:40.691223 21545 raft_consensus.cc:493] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.691857 21545 raft_consensus.cc:515] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.694337 21523 raft_consensus.cc:493] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.694824 21523 raft_consensus.cc:515] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.696801 21523 leader_election.cc:290] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.697024 21516 consensus_queue.cc:260] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.700304 21523 raft_consensus.cc:493] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.700850 21523 raft_consensus.cc:515] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.703078 21523 leader_election.cc:290] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.705915 21545 leader_election.cc:290] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.707324 21516 ts_tablet_manager.cc:1434] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:04:40.708549 21516 tablet_bootstrap.cc:492] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.719341 21552 raft_consensus.cc:2804] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:40.719372 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:40.719934 21552 raft_consensus.cc:697] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 LEADER]: Becoming Leader. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Running, Role: LEADER
I20260709 13:04:40.718533 21522 raft_consensus.cc:697] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:40.720880 21552 consensus_queue.cc:237] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.728811 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
W20260709 13:04:40.728893 21367 leader_election.cc:343] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.729693 21517 ts_tablet_manager.cc:1434] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.098s	user 0.032s	sys 0.030s
I20260709 13:04:40.727815 21521 leader_election.cc:290] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:40.731118 21521 raft_consensus.cc:493] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.732700 21521 raft_consensus.cc:515] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.731552 21551 raft_consensus.cc:493] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.732383 21515 tablet_bootstrap.cc:492] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
W20260709 13:04:40.733001 21367 leader_election.cc:343] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.733101 21401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.738582 21401 raft_consensus.cc:2468] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 0.
I20260709 13:04:40.721712 21522 consensus_queue.cc:237] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.739682 21401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.739830 21399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.731505 21517 tablet_bootstrap.cc:492] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.740549 21290 leader_election.cc:304] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:40.737690 21515 ts_tablet_manager.cc:1403] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.080s	user 0.028s	sys 0.031s
I20260709 13:04:40.737601 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:40.741137 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
W20260709 13:04:40.742213 21439 leader_election.cc:343] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.742456 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.743094 21397 raft_consensus.cc:2468] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 0.
I20260709 13:04:40.739862 21516 tablet_bootstrap.cc:654] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.737751 21548 raft_consensus.cc:493] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.744506 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:40.745035 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.746429 21326 raft_consensus.cc:2468] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 0.
I20260709 13:04:40.746347 21548 raft_consensus.cc:515] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.747421 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:40.747653 21553 raft_consensus.cc:2804] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.747516 21441 leader_election.cc:304] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:40.748082 21553 raft_consensus.cc:493] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:40.745198 21290 leader_election.cc:343] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.746754 21397 raft_consensus.cc:2468] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 0.
I20260709 13:04:40.749577 21472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:40.748229 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:40.750838 21472 raft_consensus.cc:2468] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 0.
I20260709 13:04:40.748445 21553 raft_consensus.cc:3060] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.743350 21521 leader_election.cc:290] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:40.743866 21551 raft_consensus.cc:515] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.755811 21548 leader_election.cc:290] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:40.759290 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:40.759945 21326 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 0.
I20260709 13:04:40.760982 21441 leader_election.cc:304] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:40.749599 21474 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 0.
I20260709 13:04:40.762458 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
W20260709 13:04:40.761952 21290 leader_election.cc:343] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.764204 21552 raft_consensus.cc:2804] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.764431 21289 leader_election.cc:304] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:40.748960 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:40.766808 21473 raft_consensus.cc:2468] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 0.
W20260709 13:04:40.766995 21289 leader_election.cc:343] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.767134 21551 leader_election.cc:290] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:40.767832 21545 raft_consensus.cc:2804] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.768186 21545 raft_consensus.cc:493] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.768536 21545 raft_consensus.cc:3060] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:40.764729 21290 leader_election.cc:343] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:40.770936 21289 leader_election.cc:343] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.771184 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:40.769670 21553 raft_consensus.cc:515] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.771374 21289 leader_election.cc:304] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4; no voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:40.772104 21523 raft_consensus.cc:2749] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:40.774396 21441 leader_election.cc:343] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.775795 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.776746 21517 tablet_bootstrap.cc:654] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.776561 21224 catalog_manager.cc:5697] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "31d783f835ff477388b2bf6d6b4246e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.778045 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
W20260709 13:04:40.779866 21439 leader_election.cc:343] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.780027 21554 raft_consensus.cc:2804] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:40.781365 21439 leader_election.cc:343] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.781163 21289 leader_election.cc:304] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:40.782307 21523 raft_consensus.cc:2804] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.782653 21523 raft_consensus.cc:493] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.783017 21523 raft_consensus.cc:3060] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.783012 21289 leader_election.cc:304] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:40.781771 21439 leader_election.cc:304] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5; no voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:40.785778 21515 raft_consensus.cc:359] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.786525 21515 raft_consensus.cc:385] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.786806 21515 raft_consensus.cc:740] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.787528 21515 consensus_queue.cc:260] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.790060 21515 ts_tablet_manager.cc:1434] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:04:40.790704 21552 raft_consensus.cc:493] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.791163 21515 tablet_bootstrap.cc:492] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:40.791391 21552 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.791501 21523 raft_consensus.cc:515] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.794953 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
W20260709 13:04:40.796414 21290 leader_election.cc:343] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.797318 21523 leader_election.cc:290] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.798180 21551 raft_consensus.cc:2749] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:40.792595 21554 raft_consensus.cc:493] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.799526 21554 raft_consensus.cc:3060] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.800460 21523 raft_consensus.cc:2804] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.805761 21515 tablet_bootstrap.cc:654] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.806109 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:40.784338 21545 raft_consensus.cc:515] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.809146 21397 raft_consensus.cc:3060] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.807624 21523 raft_consensus.cc:493] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.807399 21553 leader_election.cc:290] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.809147 21552 raft_consensus.cc:515] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.814235 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:40.815145 21517 tablet_bootstrap.cc:492] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.815105 21474 raft_consensus.cc:3060] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.815676 21517 ts_tablet_manager.cc:1403] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.021s
I20260709 13:04:40.815511 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:40.816474 21398 raft_consensus.cc:3060] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.811627 21523 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.816740 21545 leader_election.cc:290] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.818841 21516 tablet_bootstrap.cc:492] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:40.819423 21516 ts_tablet_manager.cc:1403] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.111s	user 0.006s	sys 0.012s
I20260709 13:04:40.820171 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:40.822579 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:40.823387 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:40.824313 21516 raft_consensus.cc:359] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.825313 21516 raft_consensus.cc:385] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:40.825542 21289 leader_election.cc:343] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.825729 21516 raft_consensus.cc:740] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.824923 21517 raft_consensus.cc:359] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.826553 21517 raft_consensus.cc:385] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.826903 21517 raft_consensus.cc:740] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.826743 21516 consensus_queue.cc:260] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.827740 21517 consensus_queue.cc:260] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.828498 21550 raft_consensus.cc:493] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.829562 21517 ts_tablet_manager.cc:1434] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:04:40.830530 21517 tablet_bootstrap.cc:492] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.829159 21550 raft_consensus.cc:515] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.834736 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:40.836298 21517 tablet_bootstrap.cc:654] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.832978 21550 leader_election.cc:290] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.838311 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:40.839583 21471 raft_consensus.cc:2468] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 0.
W20260709 13:04:40.838416 21367 leader_election.cc:343] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.842533 21364 leader_election.cc:304] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:40.842094 21552 leader_election.cc:290] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:40.843361 21516 ts_tablet_manager.cc:1434] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:04:40.844183 21550 raft_consensus.cc:2804] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.844528 21550 raft_consensus.cc:493] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.843757 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:40.844854 21550 raft_consensus.cc:3060] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.845620 21516 tablet_bootstrap.cc:492] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.846486 21398 raft_consensus.cc:2468] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 1.
I20260709 13:04:40.848026 21290 leader_election.cc:304] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
W20260709 13:04:40.848223 21439 leader_election.cc:343] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.848883 21545 raft_consensus.cc:2804] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:40.849447 21545 raft_consensus.cc:697] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:40.851238 21545 consensus_queue.cc:237] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.863027 21474 raft_consensus.cc:2468] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 1.
I20260709 13:04:40.858546 21221 catalog_manager.cc:5697] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 0 to 1, leader changed from <none> to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 1 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.873097 21397 raft_consensus.cc:2468] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 1.
I20260709 13:04:40.868860 21289 leader_election.cc:304] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:40.875262 21558 raft_consensus.cc:2804] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:40.875365 21290 leader_election.cc:304] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:40.876267 21558 raft_consensus.cc:697] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:40.877020 21553 raft_consensus.cc:2804] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:40.877462 21553 raft_consensus.cc:697] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:40.878417 21553 consensus_queue.cc:237] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.877383 21558 consensus_queue.cc:237] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.883800 21517 tablet_bootstrap.cc:492] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.884171 21517 ts_tablet_manager.cc:1403] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.003s
I20260709 13:04:40.881587 21523 raft_consensus.cc:515] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.889573 21222 catalog_manager.cc:5697] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.890074 21545 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.898394 21545 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.900282 21545 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.901821 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:40.901767 21550 raft_consensus.cc:515] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.902894 21517 raft_consensus.cc:359] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.903164 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.903549 21517 raft_consensus.cc:385] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.903713 21397 raft_consensus.cc:2468] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 0.
I20260709 13:04:40.903821 21517 raft_consensus.cc:740] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.904507 21326 raft_consensus.cc:2393] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 31d783f835ff477388b2bf6d6b4246e5 in current term 1: Already voted for candidate 28a08cf73c484600a444fec9b6a343c4 in this term.
W20260709 13:04:40.904147 21289 leader_election.cc:343] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.904896 21517 consensus_queue.cc:260] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.909221 21517 ts_tablet_manager.cc:1434] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:04:40.908949 21441 leader_election.cc:304] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5; no voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:40.909337 21523 leader_election.cc:290] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.908145 21290 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:40.910303 21552 raft_consensus.cc:2749] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:40.910900 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:40.911581 21474 raft_consensus.cc:2393] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 28a08cf73c484600a444fec9b6a343c4 in current term 1: Already voted for candidate 31d783f835ff477388b2bf6d6b4246e5 in this term.
I20260709 13:04:40.911959 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
W20260709 13:04:40.913224 21290 leader_election.cc:343] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.913698 21517 tablet_bootstrap.cc:492] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5: Bootstrap starting.
I20260709 13:04:40.914110 21289 leader_election.cc:304] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4; no voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:40.915874 21523 raft_consensus.cc:2804] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.915704 21554 raft_consensus.cc:515] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.916774 21523 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.916350 21545 raft_consensus.cc:2749] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:40.917613 21523 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.918501 21473 raft_consensus.cc:2393] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 28a08cf73c484600a444fec9b6a343c4 in current term 1: Already voted for candidate 31d783f835ff477388b2bf6d6b4246e5 in this term.
I20260709 13:04:40.918917 21515 tablet_bootstrap.cc:492] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
I20260709 13:04:40.919661 21515 ts_tablet_manager.cc:1403] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.017s
I20260709 13:04:40.920444 21516 tablet_bootstrap.cc:654] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.923210 21554 leader_election.cc:290] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:40.923183 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:40.924036 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:40.925228 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:40.925961 21397 raft_consensus.cc:2393] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 31d783f835ff477388b2bf6d6b4246e5 in current term 1: Already voted for candidate 28a08cf73c484600a444fec9b6a343c4 in this term.
I20260709 13:04:40.927188 21439 leader_election.cc:304] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5; no voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:40.927610 21515 raft_consensus.cc:359] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.928435 21515 raft_consensus.cc:385] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:40.929126 21367 leader_election.cc:343] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.930651 21554 raft_consensus.cc:2749] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:40.934835 21517 tablet_bootstrap.cc:654] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.935251 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:40.935817 21473 raft_consensus.cc:3060] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.928928 21515 raft_consensus.cc:740] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.933627 21523 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.937742 21550 leader_election.cc:290] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.939258 21224 catalog_manager.cc:5697] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.941007 21224 catalog_manager.cc:5697] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.943508 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:40.944126 21397 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.945326 21523 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.941444 21515 consensus_queue.cc:260] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.947361 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:40.947988 21517 tablet_bootstrap.cc:492] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5: No bootstrap required, opened a new log
I20260709 13:04:40.948405 21517 ts_tablet_manager.cc:1403] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.007s
W20260709 13:04:40.948724 21289 leader_election.cc:343] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:40.949165 21515 ts_tablet_manager.cc:1434] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:04:40.950209 21473 raft_consensus.cc:2468] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 1.
I20260709 13:04:40.951375 21515 tablet_bootstrap.cc:492] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:40.953423 21517 raft_consensus.cc:359] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.954494 21517 raft_consensus.cc:385] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.954792 21517 raft_consensus.cc:740] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.956909 21397 raft_consensus.cc:2468] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 1.
I20260709 13:04:40.958001 21290 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:40.958787 21554 raft_consensus.cc:493] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.957996 21364 leader_election.cc:304] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:40.959718 21517 consensus_queue.cc:260] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.961594 21515 tablet_bootstrap.cc:654] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.962132 21516 tablet_bootstrap.cc:492] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:40.961048 21523 raft_consensus.cc:2804] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:40.962592 21516 ts_tablet_manager.cc:1403] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.118s	user 0.017s	sys 0.004s
I20260709 13:04:40.959221 21554 raft_consensus.cc:515] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.964468 21517 ts_tablet_manager.cc:1434] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:04:40.965886 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:40.966485 21554 leader_election.cc:290] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:40.967173 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.967869 21397 raft_consensus.cc:2393] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31d783f835ff477388b2bf6d6b4246e5 in current term 1: Already voted for candidate 28a08cf73c484600a444fec9b6a343c4 in this term.
I20260709 13:04:40.968129 21516 raft_consensus.cc:359] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.968658 21439 leader_election.cc:304] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5; no voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:40.968786 21516 raft_consensus.cc:385] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.969081 21523 raft_consensus.cc:697] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:40.969223 21516 raft_consensus.cc:740] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.969712 21554 raft_consensus.cc:3060] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.970624 21516 consensus_queue.cc:260] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.970633 21523 consensus_queue.cc:237] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.972640 21516 ts_tablet_manager.cc:1434] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:40.974200 21516 tablet_bootstrap.cc:492] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4: Bootstrap starting.
I20260709 13:04:40.962349 21550 raft_consensus.cc:2804] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:40.977463 21550 raft_consensus.cc:697] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:40.978713 21554 raft_consensus.cc:2749] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:40.978588 21550 consensus_queue.cc:237] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.981128 21516 tablet_bootstrap.cc:654] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:40.986202 21325 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.988785 21222 catalog_manager.cc:5697] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 0 to 1, leader changed from <none> to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 1 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.990115 21515 tablet_bootstrap.cc:492] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
I20260709 13:04:40.990581 21515 ts_tablet_manager.cc:1403] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.001s
I20260709 13:04:40.991477 21523 raft_consensus.cc:493] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.991905 21523 raft_consensus.cc:515] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.994390 21523 leader_election.cc:290] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:40.994774 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:40.996047 21550 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.997135 21515 raft_consensus.cc:359] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:40.998231 21515 raft_consensus.cc:385] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:40.998775 21515 raft_consensus.cc:740] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
I20260709 13:04:40.999578 21515 consensus_queue.cc:260] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.001433 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:41.002302 21515 ts_tablet_manager.cc:1434] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:41.002641 21473 raft_consensus.cc:2393] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28a08cf73c484600a444fec9b6a343c4 in current term 1: Already voted for candidate 91df6974e17b4f488fe277b9a3f7a33b in this term.
I20260709 13:04:41.003402 21515 tablet_bootstrap.cc:492] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:41.004173 21289 leader_election.cc:304] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4; no voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:41.005653 21523 raft_consensus.cc:3060] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:41.013154 21515 tablet_bootstrap.cc:654] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:41.017524 21224 catalog_manager.cc:5697] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.023434 21523 raft_consensus.cc:2749] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:41.033520 21522 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:41.046777 21515 tablet_bootstrap.cc:492] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
I20260709 13:04:41.047349 21515 ts_tablet_manager.cc:1403] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.010s
I20260709 13:04:41.047652 21516 tablet_bootstrap.cc:492] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4: No bootstrap required, opened a new log
I20260709 13:04:41.048117 21516 ts_tablet_manager.cc:1403] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.057s
I20260709 13:04:41.050597 21516 raft_consensus.cc:359] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.050622 21515 raft_consensus.cc:359] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.051433 21516 raft_consensus.cc:385] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:41.051674 21515 raft_consensus.cc:385] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:41.051831 21516 raft_consensus.cc:740] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.052172 21515 raft_consensus.cc:740] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.052767 21516 consensus_queue.cc:260] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.053205 21515 consensus_queue.cc:260] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.055233 21516 ts_tablet_manager.cc:1434] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:41.056282 21515 ts_tablet_manager.cc:1434] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:41.057407 21515 tablet_bootstrap.cc:492] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b: Bootstrap starting.
I20260709 13:04:41.063494 21515 tablet_bootstrap.cc:654] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:41.069315 21515 tablet_bootstrap.cc:492] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b: No bootstrap required, opened a new log
I20260709 13:04:41.069705 21515 ts_tablet_manager.cc:1403] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:04:41.071836 21515 raft_consensus.cc:359] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.072243 21515 raft_consensus.cc:385] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:41.072461 21515 raft_consensus.cc:740] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Initialized, Role: FOLLOWER
I20260709 13:04:41.073025 21515 consensus_queue.cc:260] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.074754 21515 ts_tablet_manager.cc:1434] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:04:41.150090 21554 consensus_queue.cc:1048] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.155622 21522 raft_consensus.cc:493] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.156126 21522 raft_consensus.cc:515] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.159257 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:41.159632 21397 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:41.159890 21473 raft_consensus.cc:2468] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 0.
I20260709 13:04:41.159291 21522 leader_election.cc:290] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:41.161558 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:41.163208 21364 leader_election.cc:304] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:41.163592 21325 raft_consensus.cc:2468] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 0.
I20260709 13:04:41.164116 21522 raft_consensus.cc:2804] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:41.164543 21522 raft_consensus.cc:493] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.164886 21522 raft_consensus.cc:3060] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:41.168458 21555 consensus_queue.cc:1048] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:41.171000 21522 raft_consensus.cc:515] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.173440 21522 leader_election.cc:290] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:41.174202 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:41.174427 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:41.174778 21325 raft_consensus.cc:3060] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:41.175050 21473 raft_consensus.cc:3060] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:41.180333 21325 raft_consensus.cc:2468] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 1.
I20260709 13:04:41.181380 21367 leader_election.cc:304] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:41.182211 21473 raft_consensus.cc:2468] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 1.
I20260709 13:04:41.182257 21522 raft_consensus.cc:2804] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:41.182890 21522 raft_consensus.cc:697] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:41.183586 21522 consensus_queue.cc:237] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.189646 21224 catalog_manager.cc:5697] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 0 to 1, leader changed from <none> to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 1 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.288177 21523 raft_consensus.cc:493] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.288719 21523 raft_consensus.cc:515] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.290524 21523 leader_election.cc:290] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:41.291257 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:41.291448 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:41.292201 21473 raft_consensus.cc:2393] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28a08cf73c484600a444fec9b6a343c4 in current term 1: Already voted for candidate 91df6974e17b4f488fe277b9a3f7a33b in this term.
I20260709 13:04:41.293182 21289 leader_election.cc:304] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4; no voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:41.293779 21523 raft_consensus.cc:3060] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:41.298091 21523 raft_consensus.cc:2749] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:41.303557 21522 consensus_queue.cc:1048] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.304144 21550 consensus_queue.cc:1048] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.321429 21522 raft_consensus.cc:493] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.321878 21522 raft_consensus.cc:515] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.323661 21522 leader_election.cc:290] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:41.324254 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:41.324515 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:41.325242 21473 raft_consensus.cc:2393] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91df6974e17b4f488fe277b9a3f7a33b in current term 1: Already voted for candidate 28a08cf73c484600a444fec9b6a343c4 in this term.
I20260709 13:04:41.326121 21364 leader_election.cc:304] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91df6974e17b4f488fe277b9a3f7a33b; no voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:41.326901 21522 raft_consensus.cc:3060] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:41.331532 21522 raft_consensus.cc:2749] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:41.337549 21523 consensus_queue.cc:1048] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.343745 21523 consensus_queue.cc:1048] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.347954 21545 consensus_queue.cc:1048] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.358994 21558 consensus_queue.cc:1048] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.359966 21553 consensus_queue.cc:1048] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.378098 21545 consensus_queue.cc:1048] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.401610 21522 consensus_queue.cc:1048] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.413264 21531 consensus_queue.cc:1048] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.436416 21473 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:41.441823 21545 consensus_queue.cc:1048] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.443325 21555 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.443809 21555 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.445571 21555 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:41.446261 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:41.446769 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:41.447466 21397 raft_consensus.cc:2468] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 1.
I20260709 13:04:41.448442 21439 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:41.449151 21555 raft_consensus.cc:2804] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:41.449501 21555 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 28a08cf73c484600a444fec9b6a343c4)
I20260709 13:04:41.449851 21555 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.452842 21558 consensus_queue.cc:1048] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.456226 21555 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.457463 21473 raft_consensus.cc:1240] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Rejecting Update request from peer 28a08cf73c484600a444fec9b6a343c4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:41.458845 21555 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 2 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:41.459038 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:41.460054 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:41.462139 21558 consensus_queue.cc:1059] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.462888 21553 raft_consensus.cc:3055] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:41.463265 21553 raft_consensus.cc:740] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:41.464007 21553 consensus_queue.cc:260] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.465164 21553 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:41.465788 21441 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5; no voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:41.466560 21555 raft_consensus.cc:2749] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:41.494540 21531 raft_consensus.cc:493] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.494978 21531 raft_consensus.cc:515] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:41.496645 21531 leader_election.cc:290] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:41.497366 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:41.497628 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:41.497975 21325 raft_consensus.cc:2393] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91df6974e17b4f488fe277b9a3f7a33b in current term 1: Already voted for candidate 28a08cf73c484600a444fec9b6a343c4 in this term.
I20260709 13:04:41.498376 21473 raft_consensus.cc:2393] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91df6974e17b4f488fe277b9a3f7a33b in current term 1: Already voted for candidate 31d783f835ff477388b2bf6d6b4246e5 in this term.
I20260709 13:04:41.499358 21364 leader_election.cc:304] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91df6974e17b4f488fe277b9a3f7a33b; no voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:41.499951 21531 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:41.504298 21531 raft_consensus.cc:2749] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:41.668809 21272 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:41.677354 21531 consensus_queue.cc:1048] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:41.687791 21595 consensus_queue.cc:1048] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:42.460064 21558 raft_consensus.cc:493] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.460533 21558 raft_consensus.cc:515] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.462080 21558 leader_election.cc:290] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:42.462850 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:42.463131 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:42.463485 21397 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 1.
I20260709 13:04:42.463666 21473 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 1.
I20260709 13:04:42.464627 21289 leader_election.cc:304] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:42.465464 21558 raft_consensus.cc:2804] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.465777 21558 raft_consensus.cc:493] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.465994 21558 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.470227 21558 raft_consensus.cc:515] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.471786 21558 leader_election.cc:290] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:42.472538 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:42.472810 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:42.473119 21397 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.473322 21473 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.479489 21397 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:42.479493 21473 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:42.480695 21289 leader_election.cc:304] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:42.481364 21553 raft_consensus.cc:2804] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.481819 21553 raft_consensus.cc:697] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:42.482560 21553 consensus_queue.cc:237] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.489192 21222 catalog_manager.cc:5697] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 0 to 2, leader changed from <none> to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:42.677054 21553 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.677640 21553 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.679744 21553 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:42.680902 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:42.680896 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:42.682559 21289 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4; no voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:42.683171 21553 raft_consensus.cc:2749] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:42.800655 21397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
mode: GRACEFUL
new_leader_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:49684
I20260709 13:04:42.801124 21397 raft_consensus.cc:606] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Received request to transfer leadership to TS 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:42.805552 21397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
mode: GRACEFUL
new_leader_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:49684
I20260709 13:04:42.805994 21397 raft_consensus.cc:606] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Received request to transfer leadership to TS 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:42.810072 21397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
mode: GRACEFUL
new_leader_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:49684
I20260709 13:04:42.810524 21397 raft_consensus.cc:606] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Received request to transfer leadership to TS 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:42.814657 21397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16daaa1fea224086b1898c912c12d347"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
mode: GRACEFUL
new_leader_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:49684
I20260709 13:04:42.815088 21397 raft_consensus.cc:606] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Received request to transfer leadership to TS 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:42.829653 21326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
mode: GRACEFUL
new_leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:04:42.830246 21326 raft_consensus.cc:606] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Received request to transfer leadership to TS 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:42.832365 21550 raft_consensus.cc:993] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b: : Instructing follower 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:42.832827 21605 raft_consensus.cc:1081] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Signalling peer 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:42.834440 21326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16daaa1fea224086b1898c912c12d347"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:47532
I20260709 13:04:42.834995 21326 raft_consensus.cc:493] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.835371 21326 raft_consensus.cc:3060] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.835644 21325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
mode: GRACEFUL
new_leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:04:42.836102 21325 raft_consensus.cc:606] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Received request to transfer leadership to TS 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:42.836359 21325 raft_consensus.cc:614] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:42.840667 21326 raft_consensus.cc:515] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.842921 21326 leader_election.cc:290] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:42.843935 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:42.844106 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:42.844574 21473 raft_consensus.cc:3060] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.844620 21397 raft_consensus.cc:3055] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:42.845099 21397 raft_consensus.cc:740] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:42.845799 21397 consensus_queue.cc:260] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.847255 21397 raft_consensus.cc:3060] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.850876 21473 raft_consensus.cc:2468] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:42.850824 21474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1"
dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
mode: GRACEFUL
new_leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:35184
I20260709 13:04:42.851532 21474 raft_consensus.cc:606] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 LEADER]: Received request to transfer leadership to TS 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:42.851923 21289 leader_election.cc:304] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:42.852663 21553 raft_consensus.cc:2804] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.853111 21553 raft_consensus.cc:697] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:42.853900 21553 consensus_queue.cc:237] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.856767 21326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
mode: GRACEFUL
new_leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:04:42.857226 21326 raft_consensus.cc:606] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Received request to transfer leadership to TS 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:42.853874 21397 raft_consensus.cc:2468] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:42.863440 21222 catalog_manager.cc:5697] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 1 to 2, leader changed from 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130) to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:42.865594 21326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
mode: GRACEFUL
new_leader_uuid: "31d783f835ff477388b2bf6d6b4246e5"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:04:42.866222 21326 raft_consensus.cc:606] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Received request to transfer leadership to TS 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:42.932389 21474 raft_consensus.cc:1275] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:42.933585 21553 consensus_queue.cc:1048] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:42.944125 21397 raft_consensus.cc:1275] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:42.945451 21553 consensus_queue.cc:1048] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:42.954598 21610 raft_consensus.cc:993] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4: : Instructing follower 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:42.955037 21553 raft_consensus.cc:1081] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Signalling peer 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:42.956751 21605 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 28a08cf73c484600a444fec9b6a343c4)
I20260709 13:04:42.956679 21397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:49682
I20260709 13:04:42.957423 21397 raft_consensus.cc:493] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.957288 21605 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.957806 21397 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.959417 21605 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:42.960188 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:42.960824 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5" is_pre_election: true
I20260709 13:04:42.961591 21474 raft_consensus.cc:2393] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91df6974e17b4f488fe277b9a3f7a33b in current term 2: Already voted for candidate 31d783f835ff477388b2bf6d6b4246e5 in this term.
I20260709 13:04:42.960806 21326 raft_consensus.cc:2468] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 2.
I20260709 13:04:42.963999 21397 raft_consensus.cc:515] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.964607 21367 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:42.965652 21605 raft_consensus.cc:2804] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:42.965979 21605 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 28a08cf73c484600a444fec9b6a343c4)
I20260709 13:04:42.966468 21397 leader_election.cc:290] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 3 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:42.966708 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:42.966985 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:42.967685 21474 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.967643 21326 raft_consensus.cc:3055] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:42.968145 21605 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.968184 21326 raft_consensus.cc:740] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:42.969084 21326 consensus_queue.cc:260] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.970296 21326 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.974488 21474 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 3.
I20260709 13:04:42.975656 21364 leader_election.cc:304] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:42.976481 21550 raft_consensus.cc:2804] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:42.976083 21605 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.976853 21326 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 3.
I20260709 13:04:42.979839 21605 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:42.979908 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:42.981539 21614 raft_consensus.cc:993] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5: : Instructing follower 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:42.981994 21551 raft_consensus.cc:1081] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 LEADER]: Signalling peer 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:42.983422 21397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:36710
I20260709 13:04:42.983783 21397 raft_consensus.cc:493] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.984009 21397 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.986485 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:42.986781 21550 raft_consensus.cc:697] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 3 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:42.987262 21473 raft_consensus.cc:2393] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 91df6974e17b4f488fe277b9a3f7a33b in current term 2: Already voted for candidate 31d783f835ff477388b2bf6d6b4246e5 in this term.
I20260709 13:04:42.987658 21550 consensus_queue.cc:237] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.989109 21397 raft_consensus.cc:515] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.989513 21325 raft_consensus.cc:2468] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 2.
I20260709 13:04:42.990474 21367 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:42.991115 21397 leader_election.cc:290] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:42.992197 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:42.992497 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:42.992784 21325 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.992981 21473 raft_consensus.cc:3055] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:42.993355 21473 raft_consensus.cc:740] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Running, Role: LEADER
I20260709 13:04:42.993558 21615 raft_consensus.cc:2804] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.994067 21615 raft_consensus.cc:697] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:42.994128 21473 consensus_queue.cc:260] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.994887 21615 consensus_queue.cc:237] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:42.995357 21473 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.995893 21224 catalog_manager.cc:5697] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 2 to 3, leader changed from 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129) to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 3 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:42.999500 21325 raft_consensus.cc:2468] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 2.
I20260709 13:04:43.001430 21367 leader_election.cc:304] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:43.001752 21473 raft_consensus.cc:2468] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 2.
I20260709 13:04:43.002344 21550 raft_consensus.cc:2804] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:43.002791 21550 raft_consensus.cc:697] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:43.003549 21550 consensus_queue.cc:237] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.012383 21224 catalog_manager.cc:5697] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 1 to 2, leader changed from 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129) to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 2 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.013412 21224 catalog_manager.cc:5697] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 1 to 2, leader changed from 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131) to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 2 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.098877 21551 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.099452 21551 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.101217 21551 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:43.101398 21615 raft_consensus.cc:993] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b: : Instructing follower 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:43.101809 21550 raft_consensus.cc:1081] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Signalling peer 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:43.101886 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4" is_pre_election: true
I20260709 13:04:43.102288 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b" is_pre_election: true
I20260709 13:04:43.102564 21325 raft_consensus.cc:2468] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 2.
I20260709 13:04:43.103502 21326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:47532
I20260709 13:04:43.103751 21441 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:43.104058 21326 raft_consensus.cc:493] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.104406 21326 raft_consensus.cc:3060] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.104529 21551 raft_consensus.cc:2804] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:43.104938 21551 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.105360 21551 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.105917 21610 raft_consensus.cc:993] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4: : Instructing follower 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:43.106395 21553 raft_consensus.cc:1081] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Signalling peer 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:43.107900 21397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:49682
I20260709 13:04:43.108408 21397 raft_consensus.cc:493] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.108759 21397 raft_consensus.cc:3060] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.110263 21326 raft_consensus.cc:515] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.112444 21326 leader_election.cc:290] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:43.113471 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:43.111995 21551 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.114378 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd4e2bf2f0f45e4b8d5d02f6d270cda" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:43.114970 21400 raft_consensus.cc:3055] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.115312 21400 raft_consensus.cc:740] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:43.115072 21397 raft_consensus.cc:515] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.115849 21551 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 3 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:43.116475 21473 raft_consensus.cc:3060] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.116546 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:43.117149 21326 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.117234 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:43.117568 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:43.118295 21325 raft_consensus.cc:3055] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.118626 21325 raft_consensus.cc:740] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:43.116063 21400 consensus_queue.cc:260] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.119381 21325 consensus_queue.cc:260] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.120244 21400 raft_consensus.cc:3060] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.120354 21325 raft_consensus.cc:3060] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.122140 21397 leader_election.cc:290] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:43.123160 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4b1a9de6b646dc93be3b48b06bb327" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:43.123739 21474 raft_consensus.cc:3060] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.123703 21326 raft_consensus.cc:2468] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 3.
I20260709 13:04:43.124823 21441 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:43.125626 21551 raft_consensus.cc:2804] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.126839 21551 raft_consensus.cc:697] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Becoming Leader. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Running, Role: LEADER
I20260709 13:04:43.127720 21551 consensus_queue.cc:237] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.128408 21325 raft_consensus.cc:2468] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 2.
I20260709 13:04:43.129164 21400 raft_consensus.cc:2468] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:43.129609 21367 leader_election.cc:304] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:43.130404 21550 raft_consensus.cc:2804] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:43.130712 21290 leader_election.cc:304] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:43.130934 21550 raft_consensus.cc:697] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:43.131546 21553 raft_consensus.cc:2804] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:43.131963 21553 raft_consensus.cc:697] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:43.132048 21550 consensus_queue.cc:237] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.132710 21553 consensus_queue.cc:237] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.134274 21474 raft_consensus.cc:2468] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 2.
I20260709 13:04:43.123164 21473 raft_consensus.cc:2468] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:43.142421 21224 catalog_manager.cc:5697] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 reported cstate change: term changed from 2 to 3, leader changed from 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130) to 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "31d783f835ff477388b2bf6d6b4246e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.147522 21222 catalog_manager.cc:5697] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 1 to 2, leader changed from 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130) to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.149726 21221 catalog_manager.cc:5697] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 1 to 2, leader changed from 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129) to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 2 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.203402 21615 raft_consensus.cc:993] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b: : Instructing follower 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:43.203886 21615 raft_consensus.cc:1081] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Signalling peer 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:43.205518 21325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:47532
I20260709 13:04:43.206055 21325 raft_consensus.cc:493] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.206442 21325 raft_consensus.cc:3060] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.210690 21325 raft_consensus.cc:515] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.212126 21325 leader_election.cc:290] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:43.212841 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:43.213131 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff2979731cb45b5ac332c97ecda0070" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:43.213403 21400 raft_consensus.cc:3055] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.213640 21473 raft_consensus.cc:3060] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.213732 21400 raft_consensus.cc:740] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:43.214581 21400 consensus_queue.cc:260] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.215724 21400 raft_consensus.cc:3060] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.220016 21473 raft_consensus.cc:2468] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:43.221088 21289 leader_election.cc:304] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:43.221810 21553 raft_consensus.cc:2804] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:43.222035 21400 raft_consensus.cc:2468] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:43.222256 21553 raft_consensus.cc:697] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:43.223050 21553 consensus_queue.cc:237] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.229295 21221 catalog_manager.cc:5697] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 1 to 2, leader changed from 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130) to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.269192 21553 raft_consensus.cc:993] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4: : Instructing follower 31d783f835ff477388b2bf6d6b4246e5 to start an election
I20260709 13:04:43.269706 21610 raft_consensus.cc:1081] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Signalling peer 31d783f835ff477388b2bf6d6b4246e5 to start an election
I20260709 13:04:43.270067 21473 raft_consensus.cc:1275] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.271528 21473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973"
dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
 from {username='slave'} at 127.0.0.1:35174
I20260709 13:04:43.271355 21610 consensus_queue.cc:1048] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.272028 21473 raft_consensus.cc:493] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.272426 21473 raft_consensus.cc:3060] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.278769 21473 raft_consensus.cc:515] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.280254 21400 raft_consensus.cc:1275] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.281265 21325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:43.281724 21325 raft_consensus.cc:3055] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.281668 21610 consensus_queue.cc:1048] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.282099 21325 raft_consensus.cc:740] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:43.282972 21325 consensus_queue.cc:260] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.283994 21325 raft_consensus.cc:3060] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.288544 21615 raft_consensus.cc:993] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b: : Instructing follower 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:43.288982 21605 raft_consensus.cc:1081] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Signalling peer 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:43.290748 21326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:47532
I20260709 13:04:43.291234 21326 raft_consensus.cc:493] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.291560 21326 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.294469 21397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71058a5d4688bef10576ffa5a973" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:43.295153 21397 raft_consensus.cc:3060] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.297266 21325 raft_consensus.cc:2468] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 2.
I20260709 13:04:43.298206 21473 leader_election.cc:290] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 2 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:43.298382 21441 leader_election.cc:304] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:43.299553 21551 raft_consensus.cc:2804] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:43.300117 21551 raft_consensus.cc:697] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 LEADER]: Becoming Leader. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Running, Role: LEADER
I20260709 13:04:43.301012 21551 consensus_queue.cc:237] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.301180 21326 raft_consensus.cc:515] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.303570 21326 leader_election.cc:290] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:43.304112 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:43.304105 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:43.304781 21473 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.304773 21400 raft_consensus.cc:3055] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:43.305238 21400 raft_consensus.cc:740] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:43.305972 21400 consensus_queue.cc:260] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.307185 21400 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.313357 21473 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:43.313498 21400 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 2.
I20260709 13:04:43.314456 21289 leader_election.cc:304] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:43.315608 21553 raft_consensus.cc:2804] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:43.316062 21553 raft_consensus.cc:697] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:43.316783 21553 consensus_queue.cc:237] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.318090 21397 raft_consensus.cc:2468] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 2.
I20260709 13:04:43.318447 21222 catalog_manager.cc:5697] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 reported cstate change: term changed from 1 to 2, leader changed from 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129) to 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "31d783f835ff477388b2bf6d6b4246e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.324986 21221 catalog_manager.cc:5697] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 1 to 2, leader changed from 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130) to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.388921 21473 raft_consensus.cc:1275] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:43.390136 21550 consensus_queue.cc:1048] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.397387 21326 raft_consensus.cc:1275] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:43.399121 21605 consensus_queue.cc:1048] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.487545 21473 raft_consensus.cc:1275] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.488659 21605 consensus_queue.cc:1048] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.496572 21326 raft_consensus.cc:1275] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.498076 21615 consensus_queue.cc:1048] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.510389 21473 raft_consensus.cc:1240] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Rejecting Update request from peer 91df6974e17b4f488fe277b9a3f7a33b for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:43.511483 21615 consensus_queue.cc:1059] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:43.512066 21615 consensus_queue.cc:1243] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Peer 31d783f835ff477388b2bf6d6b4246e5 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:04:43.512454 21550 raft_consensus.cc:3055] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.512795 21550 raft_consensus.cc:740] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:43.513443 21550 consensus_queue.cc:260] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:43.514245 21550 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.627859 21473 raft_consensus.cc:1275] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.627859 21397 raft_consensus.cc:1275] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:04:43.628429 21397 pending_rounds.cc:85] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b: Aborting all ops after (but not including) 1
I20260709 13:04:43.628736 21397 pending_rounds.cc:107] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:04:43.629073 21397 raft_consensus.cc:2889] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:43.629307 21553 consensus_queue.cc:1048] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.630435 21551 consensus_queue.cc:1048] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.642827 21400 raft_consensus.cc:1275] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.644714 21558 consensus_queue.cc:1048] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.642831 21326 raft_consensus.cc:1275] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:43.648995 21614 consensus_queue.cc:1048] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.683429 21473 raft_consensus.cc:1275] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.684710 21550 consensus_queue.cc:1048] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.693331 21326 raft_consensus.cc:1275] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.694998 21615 consensus_queue.cc:1048] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.710184 21326 raft_consensus.cc:1275] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.711427 21614 consensus_queue.cc:1048] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.719833 21400 raft_consensus.cc:1275] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.720715 21473 raft_consensus.cc:1275] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.721323 21614 consensus_queue.cc:1048] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.722108 21553 consensus_queue.cc:1048] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.733201 21400 raft_consensus.cc:1275] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.734954 21553 consensus_queue.cc:1048] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.772511 21473 raft_consensus.cc:1275] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.773528 21553 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.781103 21400 raft_consensus.cc:1275] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.782862 21610 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:45.896602 20694 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:04:45.897292 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:45.915434 21326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
mode: GRACEFUL
new_leader_uuid: "31d783f835ff477388b2bf6d6b4246e5"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:04:45.915926 21326 raft_consensus.cc:606] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Received request to transfer leadership to TS 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:45.916939 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:04:45.917346 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:46.273386 21640 raft_consensus.cc:993] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4: : Instructing follower 31d783f835ff477388b2bf6d6b4246e5 to start an election
I20260709 13:04:46.273904 21640 raft_consensus.cc:1081] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Signalling peer 31d783f835ff477388b2bf6d6b4246e5 to start an election
I20260709 13:04:46.275203 21473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a"
dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
 from {username='slave'} at 127.0.0.1:35174
I20260709 13:04:46.275679 21473 raft_consensus.cc:493] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.275993 21473 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.280063 21473 raft_consensus.cc:515] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:46.281657 21473 leader_election.cc:290] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 3 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:46.282351 21326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:46.282734 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:46.282928 21326 raft_consensus.cc:3055] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:46.283331 21400 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.283313 21326 raft_consensus.cc:740] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:46.284258 21326 consensus_queue.cc:260] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:46.285426 21326 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.289925 21400 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 3.
I20260709 13:04:46.291095 21439 leader_election.cc:304] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:46.291826 21629 raft_consensus.cc:2804] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:46.291847 21326 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 3.
I20260709 13:04:46.293061 21629 raft_consensus.cc:697] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Becoming Leader. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Running, Role: LEADER
I20260709 13:04:46.293875 21629 consensus_queue.cc:237] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:46.299834 21222 catalog_manager.cc:5697] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 reported cstate change: term changed from 2 to 3, leader changed from 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129) to 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "31d783f835ff477388b2bf6d6b4246e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.741156 21400 raft_consensus.cc:1275] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.742460 21629 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.753100 21326 raft_consensus.cc:1275] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.754539 21654 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.918895 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:46.934681 21473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a"
dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
mode: GRACEFUL
new_leader_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:35184
I20260709 13:04:46.935487 21473 raft_consensus.cc:606] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Received request to transfer leadership to TS 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:46.948307 21400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
mode: GRACEFUL
new_leader_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:49684
I20260709 13:04:46.948908 21400 raft_consensus.cc:606] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 3 LEADER]: Received request to transfer leadership to TS 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:46.953881 21473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba"
dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
mode: GRACEFUL
new_leader_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:35184
I20260709 13:04:46.954375 21473 raft_consensus.cc:606] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Received request to transfer leadership to TS 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:46.958987 21400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
mode: GRACEFUL
new_leader_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:49684
I20260709 13:04:46.959568 21400 raft_consensus.cc:606] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Received request to transfer leadership to TS 28a08cf73c484600a444fec9b6a343c4
I20260709 13:04:47.065536 21615 raft_consensus.cc:993] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b: : Instructing follower 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:47.065959 21615 raft_consensus.cc:1081] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Signalling peer 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:47.067478 21326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:47532
I20260709 13:04:47.067924 21326 raft_consensus.cc:493] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.068236 21326 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.073446 21326 raft_consensus.cc:515] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.074924 21326 leader_election.cc:290] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 3 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:47.075908 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:47.076360 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:47.076654 21400 raft_consensus.cc:3055] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:47.076855 21473 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.076987 21400 raft_consensus.cc:740] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:47.077955 21400 consensus_queue.cc:260] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.079334 21400 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.084985 21473 raft_consensus.cc:2468] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 3.
I20260709 13:04:47.085850 21615 raft_consensus.cc:993] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b: : Instructing follower 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:47.086360 21615 raft_consensus.cc:1081] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 3 LEADER]: Signalling peer 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:47.086633 21289 leader_election.cc:304] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:47.087661 21640 raft_consensus.cc:2804] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:47.088748 21324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:47532
I20260709 13:04:47.088999 21400 raft_consensus.cc:2468] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 3.
I20260709 13:04:47.089406 21324 raft_consensus.cc:493] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.089865 21324 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.094547 21640 raft_consensus.cc:697] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 3 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:47.096527 21640 consensus_queue.cc:237] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.101394 21324 raft_consensus.cc:515] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.103471 21324 leader_election.cc:290] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 4 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:47.103780 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:47.104128 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc4a6c1c43a84bf39343088d33e8e2fe" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:47.104406 21400 raft_consensus.cc:3055] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:47.104671 21473 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.104857 21400 raft_consensus.cc:740] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:47.105659 21222 catalog_manager.cc:5697] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 2 to 3, leader changed from 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130) to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.105736 21400 consensus_queue.cc:260] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.107163 21400 raft_consensus.cc:3060] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.109215 21473 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 4.
I20260709 13:04:47.110064 21289 leader_election.cc:304] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 31d783f835ff477388b2bf6d6b4246e5; no voters: 
I20260709 13:04:47.110972 21640 raft_consensus.cc:2804] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:47.111410 21640 raft_consensus.cc:697] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 4 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:47.112288 21640 consensus_queue.cc:237] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.115000 21400 raft_consensus.cc:2468] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 4.
I20260709 13:04:47.123730 21222 catalog_manager.cc:5697] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 3 to 4, leader changed from 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130) to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 4 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.219875 21654 raft_consensus.cc:993] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5: : Instructing follower 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:47.220358 21629 raft_consensus.cc:1081] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Signalling peer 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:47.221688 21324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:47542
I20260709 13:04:47.222152 21324 raft_consensus.cc:493] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.222489 21324 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.227169 21324 raft_consensus.cc:515] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.228646 21324 leader_election.cc:290] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 4 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:47.229472 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:47.229703 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2037d0f89046c9bfd4d63a809e66ba" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:47.229987 21400 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.230249 21473 raft_consensus.cc:3055] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:47.230562 21473 raft_consensus.cc:740] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Running, Role: LEADER
I20260709 13:04:47.231145 21473 consensus_queue.cc:260] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.231990 21473 raft_consensus.cc:3060] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.234726 21400 raft_consensus.cc:2468] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 4.
I20260709 13:04:47.235654 21290 leader_election.cc:304] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:47.236027 21473 raft_consensus.cc:2468] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 4.
I20260709 13:04:47.236335 21640 raft_consensus.cc:2804] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:47.236828 21640 raft_consensus.cc:697] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 4 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:47.237622 21640 consensus_queue.cc:237] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.244330 21222 catalog_manager.cc:5697] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 3 to 4, leader changed from 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131) to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 4 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.307890 21654 raft_consensus.cc:993] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5: : Instructing follower 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:47.308458 21667 raft_consensus.cc:1081] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Signalling peer 28a08cf73c484600a444fec9b6a343c4 to start an election
I20260709 13:04:47.309917 21324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
 from {username='slave'} at 127.0.0.1:47542
I20260709 13:04:47.310426 21324 raft_consensus.cc:493] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.310719 21324 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.316511 21324 raft_consensus.cc:515] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.318049 21324 leader_election.cc:290] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 4 election: Requested vote from peers 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:47.318703 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:47.318919 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "28a08cf73c484600a444fec9b6a343c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:47.319298 21400 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.319391 21473 raft_consensus.cc:3055] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:47.319715 21473 raft_consensus.cc:740] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Running, Role: LEADER
I20260709 13:04:47.320294 21473 consensus_queue.cc:260] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.321086 21473 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.323663 21400 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 4.
I20260709 13:04:47.324627 21290 leader_election.cc:304] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a08cf73c484600a444fec9b6a343c4, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:47.325129 21473 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a08cf73c484600a444fec9b6a343c4 in term 4.
I20260709 13:04:47.325280 21640 raft_consensus.cc:2804] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:47.325753 21640 raft_consensus.cc:697] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 4 LEADER]: Becoming Leader. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:47.326592 21640 consensus_queue.cc:237] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:47.331610 21222 catalog_manager.cc:5697] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 reported cstate change: term changed from 3 to 4, leader changed from 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131) to 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129). New cstate: current_term: 4 leader_uuid: "28a08cf73c484600a444fec9b6a343c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.579761 21473 raft_consensus.cc:1275] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:47.580987 21640 consensus_queue.cc:1048] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:47.592371 21400 raft_consensus.cc:1275] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:47.594123 21671 consensus_queue.cc:1048] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:47.683542 21400 raft_consensus.cc:1275] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:47.684701 21671 consensus_queue.cc:1048] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:47.687147 21473 raft_consensus.cc:1275] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:47.688406 21640 consensus_queue.cc:1048] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:47.791290 21473 raft_consensus.cc:1275] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:47.792577 21640 consensus_queue.cc:1048] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:47.801285 21400 raft_consensus.cc:1275] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:47.802729 21640 consensus_queue.cc:1048] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:47.896015 21473 raft_consensus.cc:1275] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:47.897173 21640 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:47.905447 21400 raft_consensus.cc:1275] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Refusing update from remote peer 28a08cf73c484600a444fec9b6a343c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:47.911137 21640 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:49.967003 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:49.975104 21324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16daaa1fea224086b1898c912c12d347"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
mode: GRACEFUL
new_leader_uuid: "31d783f835ff477388b2bf6d6b4246e5"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:04:49.975706 21324 raft_consensus.cc:606] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Received request to transfer leadership to TS 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:49.978003 21324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
mode: GRACEFUL
new_leader_uuid: "31d783f835ff477388b2bf6d6b4246e5"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:04:49.978554 21324 raft_consensus.cc:606] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 4 LEADER]: Received request to transfer leadership to TS 31d783f835ff477388b2bf6d6b4246e5
I20260709 13:04:49.980613 21324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
mode: GRACEFUL
new_leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:04:49.981087 21324 raft_consensus.cc:606] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 3 LEADER]: Received request to transfer leadership to TS 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:49.983269 21324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99"
dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
mode: GRACEFUL
new_leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:04:49.983724 21324 raft_consensus.cc:606] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Received request to transfer leadership to TS 91df6974e17b4f488fe277b9a3f7a33b
I20260709 13:04:49.984701 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:49.985127 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:50.110277 21681 raft_consensus.cc:993] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4: : Instructing follower 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:50.110760 21671 raft_consensus.cc:1081] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Signalling peer 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:50.112222 21400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:49682
I20260709 13:04:50.112680 21400 raft_consensus.cc:493] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:50.112931 21400 raft_consensus.cc:3060] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.117152 21400 raft_consensus.cc:515] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.118920 21400 leader_election.cc:290] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:50.119746 21324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:50.119879 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91c4c654954c56ba49ca75781aed99" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:50.120241 21324 raft_consensus.cc:3055] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:50.120419 21473 raft_consensus.cc:3060] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.120608 21324 raft_consensus.cc:740] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:50.121410 21324 consensus_queue.cc:260] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.122526 21324 raft_consensus.cc:3060] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:50.125623 21473 raft_consensus.cc:2468] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 2.
I20260709 13:04:50.126806 21364 leader_election.cc:304] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:50.127571 21659 raft_consensus.cc:2804] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:50.127822 21324 raft_consensus.cc:2468] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 2.
I20260709 13:04:50.128846 21659 raft_consensus.cc:697] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:50.129954 21659 consensus_queue.cc:237] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.136093 21221 catalog_manager.cc:5697] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 1 to 2, leader changed from 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129) to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 2 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.198879 21681 raft_consensus.cc:993] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4: : Instructing follower 31d783f835ff477388b2bf6d6b4246e5 to start an election
I20260709 13:04:50.199276 21671 raft_consensus.cc:1081] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 4 LEADER]: Signalling peer 31d783f835ff477388b2bf6d6b4246e5 to start an election
I20260709 13:04:50.200621 21473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a"
dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
 from {username='slave'} at 127.0.0.1:35174
I20260709 13:04:50.201056 21473 raft_consensus.cc:493] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:50.201282 21473 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:50.205708 21473 raft_consensus.cc:515] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.207291 21473 leader_election.cc:290] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 5 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:50.208009 21324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:50.208346 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "750059ee678249adaa67a9c2505a7f6a" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:50.208607 21324 raft_consensus.cc:3055] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:50.208845 21400 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:50.208935 21324 raft_consensus.cc:740] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:50.209736 21324 consensus_queue.cc:260] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.210623 21324 raft_consensus.cc:3060] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:50.213596 21400 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 5.
I20260709 13:04:50.214895 21439 leader_election.cc:304] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:50.215691 21680 raft_consensus.cc:2804] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:50.216164 21324 raft_consensus.cc:2468] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 5.
I20260709 13:04:50.216938 21680 raft_consensus.cc:697] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 5 LEADER]: Becoming Leader. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Running, Role: LEADER
I20260709 13:04:50.217769 21680 consensus_queue.cc:237] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.224201 21221 catalog_manager.cc:5697] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 reported cstate change: term changed from 4 to 5, leader changed from 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129) to 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131). New cstate: current_term: 5 leader_uuid: "31d783f835ff477388b2bf6d6b4246e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.265568 21671 raft_consensus.cc:993] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4: : Instructing follower 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:50.265964 21681 raft_consensus.cc:1081] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 3 LEADER]: Signalling peer 91df6974e17b4f488fe277b9a3f7a33b to start an election
I20260709 13:04:50.267403 21400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1"
dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
 from {username='slave'} at 127.0.0.1:49682
I20260709 13:04:50.267832 21400 raft_consensus.cc:493] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:50.268132 21400 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:50.272900 21400 raft_consensus.cc:515] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.274144 21400 leader_election.cc:290] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 4 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131:38985)
I20260709 13:04:50.274930 21324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:50.275219 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd9f45477604728a3eecfe729aab3d1" candidate_uuid: "91df6974e17b4f488fe277b9a3f7a33b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
I20260709 13:04:50.275520 21324 raft_consensus.cc:3055] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:50.275720 21473 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:50.275892 21324 raft_consensus.cc:740] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:50.276652 21324 consensus_queue.cc:260] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.277544 21324 raft_consensus.cc:3060] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:50.279546 21473 raft_consensus.cc:2468] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 4.
I20260709 13:04:50.280386 21364 leader_election.cc:304] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:50.281131 21659 raft_consensus.cc:2804] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:50.281579 21659 raft_consensus.cc:697] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 4 LEADER]: Becoming Leader. State: Replica: 91df6974e17b4f488fe277b9a3f7a33b, State: Running, Role: LEADER
I20260709 13:04:50.282711 21324 raft_consensus.cc:2468] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91df6974e17b4f488fe277b9a3f7a33b in term 4.
I20260709 13:04:50.282877 21659 consensus_queue.cc:237] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.292205 21221 catalog_manager.cc:5697] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b reported cstate change: term changed from 3 to 4, leader changed from 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129) to 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130). New cstate: current_term: 4 leader_uuid: "91df6974e17b4f488fe277b9a3f7a33b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.323648 21671 raft_consensus.cc:993] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4: : Instructing follower 31d783f835ff477388b2bf6d6b4246e5 to start an election
I20260709 13:04:50.324100 21681 raft_consensus.cc:1081] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Signalling peer 31d783f835ff477388b2bf6d6b4246e5 to start an election
I20260709 13:04:50.325538 21473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16daaa1fea224086b1898c912c12d347"
dest_uuid: "31d783f835ff477388b2bf6d6b4246e5"
 from {username='slave'} at 127.0.0.1:35174
I20260709 13:04:50.326007 21473 raft_consensus.cc:493] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:50.326326 21473 raft_consensus.cc:3060] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.330261 21473 raft_consensus.cc:515] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.331588 21473 leader_election.cc:290] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 3 election: Requested vote from peers 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133), 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711)
I20260709 13:04:50.332368 21324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28a08cf73c484600a444fec9b6a343c4"
I20260709 13:04:50.332623 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16daaa1fea224086b1898c912c12d347" candidate_uuid: "31d783f835ff477388b2bf6d6b4246e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91df6974e17b4f488fe277b9a3f7a33b"
I20260709 13:04:50.332952 21324 raft_consensus.cc:3055] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:50.333176 21400 raft_consensus.cc:3060] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.333300 21324 raft_consensus.cc:740] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 28a08cf73c484600a444fec9b6a343c4, State: Running, Role: LEADER
I20260709 13:04:50.334040 21324 consensus_queue.cc:260] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.335031 21324 raft_consensus.cc:3060] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:50.337203 21400 raft_consensus.cc:2468] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 3.
I20260709 13:04:50.338117 21439 leader_election.cc:304] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d783f835ff477388b2bf6d6b4246e5, 91df6974e17b4f488fe277b9a3f7a33b; no voters: 
I20260709 13:04:50.339018 21680 raft_consensus.cc:2804] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:50.339454 21680 raft_consensus.cc:697] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Becoming Leader. State: Replica: 31d783f835ff477388b2bf6d6b4246e5, State: Running, Role: LEADER
I20260709 13:04:50.339999 21324 raft_consensus.cc:2468] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d783f835ff477388b2bf6d6b4246e5 in term 3.
I20260709 13:04:50.340370 21680 consensus_queue.cc:237] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } }
I20260709 13:04:50.348791 21221 catalog_manager.cc:5697] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 reported cstate change: term changed from 2 to 3, leader changed from 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129) to 31d783f835ff477388b2bf6d6b4246e5 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "31d783f835ff477388b2bf6d6b4246e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.510718 21473 raft_consensus.cc:1275] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:50.511989 21659 consensus_queue.cc:1048] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.524324 21324 raft_consensus.cc:1275] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:50.525655 21695 consensus_queue.cc:1048] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.723901 21398 raft_consensus.cc:1275] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 5 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:50.724977 21680 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:50.736996 21324 raft_consensus.cc:1275] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 5 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:50.738924 21699 consensus_queue.cc:1048] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:50.747442 21473 raft_consensus.cc:1275] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:50.748668 21695 consensus_queue.cc:1048] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d783f835ff477388b2bf6d6b4246e5" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 38985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:50.757951 21324 raft_consensus.cc:1275] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Refusing update from remote peer 91df6974e17b4f488fe277b9a3f7a33b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:50.759088 21695 consensus_queue.cc:1048] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:50.760416 21398 raft_consensus.cc:1275] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:50.761795 21699 consensus_queue.cc:1048] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91df6974e17b4f488fe277b9a3f7a33b" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 39711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:50.778878 21324 raft_consensus.cc:1275] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Refusing update from remote peer 31d783f835ff477388b2bf6d6b4246e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:50.780359 21680 consensus_queue.cc:1048] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28a08cf73c484600a444fec9b6a343c4" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 45133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:50.985882 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:50.991575 20694 tablet_server.cc:179] TabletServer@127.20.53.129:0 shutting down...
I20260709 13:04:51.012152 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:51.012940 20694 tablet_replica.cc:333] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.013705 20694 raft_consensus.cc:2243] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.014142 20694 raft_consensus.cc:2272] T 16daaa1fea224086b1898c912c12d347 P 28a08cf73c484600a444fec9b6a343c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.016361 20694 tablet_replica.cc:333] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.016824 20694 raft_consensus.cc:2243] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.017484 20694 raft_consensus.cc:2272] T 8ff2979731cb45b5ac332c97ecda0070 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.019068 20694 tablet_replica.cc:333] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.019490 20694 raft_consensus.cc:2243] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.019814 20694 raft_consensus.cc:2272] T 750059ee678249adaa67a9c2505a7f6a P 28a08cf73c484600a444fec9b6a343c4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.021785 20694 tablet_replica.cc:333] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.022347 20694 raft_consensus.cc:2243] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.022706 20694 raft_consensus.cc:2272] T 0cfc71058a5d4688bef10576ffa5a973 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.024113 20694 tablet_replica.cc:333] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.024549 20694 raft_consensus.cc:2243] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.024894 20694 raft_consensus.cc:2272] T 6b4b1a9de6b646dc93be3b48b06bb327 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.026398 20694 tablet_replica.cc:333] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.026813 20694 raft_consensus.cc:2243] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.027393 20694 raft_consensus.cc:2272] T 1d2037d0f89046c9bfd4d63a809e66ba P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.028868 20694 tablet_replica.cc:333] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.029356 20694 raft_consensus.cc:2243] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.029774 20694 raft_consensus.cc:2272] T fb91c4c654954c56ba49ca75781aed99 P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.031728 20694 tablet_replica.cc:333] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.032191 20694 raft_consensus.cc:2243] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.032567 20694 raft_consensus.cc:2272] T dfd9f45477604728a3eecfe729aab3d1 P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.034893 20694 tablet_replica.cc:333] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.035403 20694 raft_consensus.cc:2243] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.036033 20694 raft_consensus.cc:2272] T bc4a6c1c43a84bf39343088d33e8e2fe P 28a08cf73c484600a444fec9b6a343c4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.037437 20694 tablet_replica.cc:333] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4: stopping tablet replica
I20260709 13:04:51.037859 20694 raft_consensus.cc:2243] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.038576 20694 raft_consensus.cc:2272] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 28a08cf73c484600a444fec9b6a343c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.058776 20694 tablet_server.cc:196] TabletServer@127.20.53.129:0 shutdown complete.
W20260709 13:04:51.071565 21441 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.129:45133: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260709 13:04:51.075911 21441 consensus_peers.cc:597] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 -> Peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Couldn't send request to peer 28a08cf73c484600a444fec9b6a343c4. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:45133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.079447 20694 tablet_server.cc:179] TabletServer@127.20.53.130:0 shutting down...
I20260709 13:04:51.102936 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:51.103614 20694 tablet_replica.cc:333] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.104140 20694 raft_consensus.cc:2243] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.104496 20694 raft_consensus.cc:2272] T bc4a6c1c43a84bf39343088d33e8e2fe P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.106040 20694 tablet_replica.cc:333] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.106565 20694 raft_consensus.cc:2243] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.106909 20694 raft_consensus.cc:2272] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.108305 20694 tablet_replica.cc:333] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.108738 20694 raft_consensus.cc:2243] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.109073 20694 raft_consensus.cc:2272] T 16daaa1fea224086b1898c912c12d347 P 91df6974e17b4f488fe277b9a3f7a33b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.111539 20694 tablet_replica.cc:333] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.111951 20694 raft_consensus.cc:2243] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.112280 20694 raft_consensus.cc:2272] T 1d2037d0f89046c9bfd4d63a809e66ba P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.113615 20694 tablet_replica.cc:333] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.114008 20694 raft_consensus.cc:2243] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.114457 20694 raft_consensus.cc:2272] T 750059ee678249adaa67a9c2505a7f6a P 91df6974e17b4f488fe277b9a3f7a33b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.116428 20694 tablet_replica.cc:333] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.116834 20694 raft_consensus.cc:2243] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.117164 20694 raft_consensus.cc:2272] T 8ff2979731cb45b5ac332c97ecda0070 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.118796 20694 tablet_replica.cc:333] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.119194 20694 raft_consensus.cc:2243] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.119797 20694 raft_consensus.cc:2272] T 6b4b1a9de6b646dc93be3b48b06bb327 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.121157 20694 tablet_replica.cc:333] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.121554 20694 raft_consensus.cc:2243] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.121850 20694 raft_consensus.cc:2272] T 0cfc71058a5d4688bef10576ffa5a973 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.123409 20694 tablet_replica.cc:333] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.123778 20694 raft_consensus.cc:2243] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.124373 20694 raft_consensus.cc:2272] T dfd9f45477604728a3eecfe729aab3d1 P 91df6974e17b4f488fe277b9a3f7a33b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.126295 20694 tablet_replica.cc:333] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b: stopping tablet replica
I20260709 13:04:51.126695 20694 raft_consensus.cc:2243] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.127267 20694 raft_consensus.cc:2272] T fb91c4c654954c56ba49ca75781aed99 P 91df6974e17b4f488fe277b9a3f7a33b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.133538 21441 consensus_peers.cc:597] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 -> Peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Couldn't send request to peer 28a08cf73c484600a444fec9b6a343c4. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:45133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.157317 20694 tablet_server.cc:196] TabletServer@127.20.53.130:0 shutdown complete.
W20260709 13:04:51.170485 21439 consensus_peers.cc:597] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 -> Peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Couldn't send request to peer 91df6974e17b4f488fe277b9a3f7a33b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:39711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.177505 20694 tablet_server.cc:179] TabletServer@127.20.53.131:0 shutting down...
W20260709 13:04:51.190413 21441 consensus_peers.cc:597] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 -> Peer 28a08cf73c484600a444fec9b6a343c4 (127.20.53.129:45133): Couldn't send request to peer 28a08cf73c484600a444fec9b6a343c4. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:45133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.204414 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:51.205225 20694 tablet_replica.cc:333] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
W20260709 13:04:51.205271 21439 consensus_peers.cc:597] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 -> Peer 91df6974e17b4f488fe277b9a3f7a33b (127.20.53.130:39711): Couldn't send request to peer 91df6974e17b4f488fe277b9a3f7a33b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:39711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.205952 20694 raft_consensus.cc:2243] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.206420 20694 raft_consensus.cc:2272] T 1d2037d0f89046c9bfd4d63a809e66ba P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.208045 20694 tablet_replica.cc:333] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
I20260709 13:04:51.208571 20694 raft_consensus.cc:2243] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.209017 20694 raft_consensus.cc:2272] T dbd4e2bf2f0f45e4b8d5d02f6d270cda P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.210629 20694 tablet_replica.cc:333] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
I20260709 13:04:51.211133 20694 raft_consensus.cc:2243] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.211527 20694 raft_consensus.cc:2272] T bc4a6c1c43a84bf39343088d33e8e2fe P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.212934 20694 tablet_replica.cc:333] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
I20260709 13:04:51.213407 20694 raft_consensus.cc:2243] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.214063 20694 raft_consensus.cc:2272] T 16daaa1fea224086b1898c912c12d347 P 31d783f835ff477388b2bf6d6b4246e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.216136 20694 tablet_replica.cc:333] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
I20260709 13:04:51.216617 20694 raft_consensus.cc:2243] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.217250 20694 raft_consensus.cc:2272] T 0cfc71058a5d4688bef10576ffa5a973 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.218818 20694 tablet_replica.cc:333] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
I20260709 13:04:51.219265 20694 raft_consensus.cc:2243] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.219628 20694 raft_consensus.cc:2272] T 6b4b1a9de6b646dc93be3b48b06bb327 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.221071 20694 tablet_replica.cc:333] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
I20260709 13:04:51.221567 20694 raft_consensus.cc:2243] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.221958 20694 raft_consensus.cc:2272] T 8ff2979731cb45b5ac332c97ecda0070 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.223497 20694 tablet_replica.cc:333] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
I20260709 13:04:51.223930 20694 raft_consensus.cc:2243] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.224586 20694 raft_consensus.cc:2272] T 750059ee678249adaa67a9c2505a7f6a P 31d783f835ff477388b2bf6d6b4246e5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.226527 20694 tablet_replica.cc:333] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
I20260709 13:04:51.227108 20694 raft_consensus.cc:2243] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.227632 20694 raft_consensus.cc:2272] T fb91c4c654954c56ba49ca75781aed99 P 31d783f835ff477388b2bf6d6b4246e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.229529 20694 tablet_replica.cc:333] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5: stopping tablet replica
I20260709 13:04:51.230062 20694 raft_consensus.cc:2243] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.230518 20694 raft_consensus.cc:2272] T dfd9f45477604728a3eecfe729aab3d1 P 31d783f835ff477388b2bf6d6b4246e5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.256503 20694 tablet_server.cc:196] TabletServer@127.20.53.131:0 shutdown complete.
I20260709 13:04:51.273761 20694 master.cc:562] Master@127.20.53.190:41173 shutting down...
I20260709 13:04:51.291776 20694 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.292297 20694 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.292621 20694 tablet_replica.cc:333] T 00000000000000000000000000000000 P f33ebead3cfa47bb8f258cf75edbe16a: stopping tablet replica
I20260709 13:04:51.311852 20694 master.cc:584] Master@127.20.53.190:41173 shutdown complete.
28a08cf73c484600a444fec9b6a343c4  5
31d783f835ff477388b2bf6d6b4246e5  2
91df6974e17b4f488fe277b9a3f7a33b  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11815 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:04:51.351214 20694 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.53.190:38207
I20260709 13:04:51.352303 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.358234 21707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.358250 21708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.359017 21710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.359314 20694 server_base.cc:1061] running on GCE node
I20260709 13:04:51.360142 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.360337 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.360497 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602291360465 us; error 0 us; skew 500 ppm
I20260709 13:04:51.361018 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.363401 20694 webserver.cc:533] Webserver started at http://127.20.53.190:35547/ using document root <none> and password file <none>
I20260709 13:04:51.363859 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.364023 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.364359 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.365461 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/master-0-root/instance:
uuid: "8f8230518d3b4d7090bda1a8eda4b421"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-r056"
I20260709 13:04:51.369791 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:04:51.373027 21715 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.373874 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:04:51.374153 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/master-0-root
uuid: "8f8230518d3b4d7090bda1a8eda4b421"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-r056"
I20260709 13:04:51.374478 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.387681 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.388785 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.425211 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.190:38207
I20260709 13:04:51.425324 21766 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.190:38207 every 8 connection(s)
I20260709 13:04:51.428915 21767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.438305 21767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Bootstrap starting.
I20260709 13:04:51.442822 21767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.446692 21767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: No bootstrap required, opened a new log
I20260709 13:04:51.448660 21767 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f8230518d3b4d7090bda1a8eda4b421" member_type: VOTER }
I20260709 13:04:51.449038 21767 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.449249 21767 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f8230518d3b4d7090bda1a8eda4b421, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.449887 21767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f8230518d3b4d7090bda1a8eda4b421" member_type: VOTER }
I20260709 13:04:51.450359 21767 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:51.450635 21767 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:51.450920 21767 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.454900 21767 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f8230518d3b4d7090bda1a8eda4b421" member_type: VOTER }
I20260709 13:04:51.455374 21767 leader_election.cc:304] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f8230518d3b4d7090bda1a8eda4b421; no voters: 
I20260709 13:04:51.456424 21767 leader_election.cc:290] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:51.456701 21770 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:51.458009 21770 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 1 LEADER]: Becoming Leader. State: Replica: 8f8230518d3b4d7090bda1a8eda4b421, State: Running, Role: LEADER
I20260709 13:04:51.458691 21770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f8230518d3b4d7090bda1a8eda4b421" member_type: VOTER }
I20260709 13:04:51.459270 21767 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:51.462839 21772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f8230518d3b4d7090bda1a8eda4b421. Latest consensus state: current_term: 1 leader_uuid: "8f8230518d3b4d7090bda1a8eda4b421" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f8230518d3b4d7090bda1a8eda4b421" member_type: VOTER } }
I20260709 13:04:51.462891 21771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f8230518d3b4d7090bda1a8eda4b421" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f8230518d3b4d7090bda1a8eda4b421" member_type: VOTER } }
I20260709 13:04:51.463501 21772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:51.463528 21771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:51.466084 21777 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:51.470681 21777 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:51.475292 20694 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:51.479194 21777 catalog_manager.cc:1383] Generated new cluster ID: fe1a3dc6fce7493fb04311b4be66491a
I20260709 13:04:51.479452 21777 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:51.509588 21777 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:51.510754 21777 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:51.531219 21777 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Generated new TSK 0
I20260709 13:04:51.531778 21777 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:51.542021 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.547456 21788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.548542 21789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.550371 21791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.550621 20694 server_base.cc:1061] running on GCE node
I20260709 13:04:51.551477 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.551671 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.551831 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602291551796 us; error 0 us; skew 500 ppm
I20260709 13:04:51.552369 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.554522 20694 webserver.cc:533] Webserver started at http://127.20.53.129:40029/ using document root <none> and password file <none>
I20260709 13:04:51.554975 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.555150 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.555430 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.556401 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/instance:
uuid: "479255846c5141b584b16aa253f587c7"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-r056"
I20260709 13:04:51.560523 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:04:51.563597 21796 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.564306 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:51.564589 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "479255846c5141b584b16aa253f587c7"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-r056"
I20260709 13:04:51.564862 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.574734 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.575836 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.577262 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.579406 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.579624 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.579867 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.580050 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.617483 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:39085
I20260709 13:04:51.617570 21858 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:39085 every 8 connection(s)
I20260709 13:04:51.628870 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.640955 21863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.643785 21864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.652145 20694 server_base.cc:1061] running on GCE node
W20260709 13:04:51.652866 21866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.654587 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.654906 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.655181 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602291655162 us; error 0 us; skew 500 ppm
I20260709 13:04:51.656069 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.656893 21859 heartbeater.cc:344] Connected to a master server at 127.20.53.190:38207
I20260709 13:04:51.657279 21859 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.659181 20694 webserver.cc:533] Webserver started at http://127.20.53.130:35633/ using document root <none> and password file <none>
I20260709 13:04:51.659675 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.659933 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.660320 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.660260 21859 heartbeater.cc:507] Master 127.20.53.190:38207 requested a full tablet report, sending...
I20260709 13:04:51.662137 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/instance:
uuid: "ac1dd8ad9fc44263932ec57d9376a271"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-r056"
I20260709 13:04:51.662912 21732 ts_manager.cc:194] Registered new tserver with Master: 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:04:51.665333 21732 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33508
I20260709 13:04:51.668216 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:51.671453 21871 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.672259 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:51.672572 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root
uuid: "ac1dd8ad9fc44263932ec57d9376a271"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-r056"
I20260709 13:04:51.672861 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.689697 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.690913 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.692263 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.694424 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.694643 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.694872 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.695041 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.735556 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.130:43149
I20260709 13:04:51.735685 21933 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.130:43149 every 8 connection(s)
I20260709 13:04:51.740118 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.746945 21937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.748225 21938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.751025 21940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.751598 21934 heartbeater.cc:344] Connected to a master server at 127.20.53.190:38207
I20260709 13:04:51.751946 21934 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.752241 20694 server_base.cc:1061] running on GCE node
I20260709 13:04:51.752835 21934 heartbeater.cc:507] Master 127.20.53.190:38207 requested a full tablet report, sending...
I20260709 13:04:51.753218 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.753485 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.753685 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602291753666 us; error 0 us; skew 500 ppm
I20260709 13:04:51.754457 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.755002 21732 ts_manager.cc:194] Registered new tserver with Master: ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:51.756482 21732 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33520
I20260709 13:04:51.756891 20694 webserver.cc:533] Webserver started at http://127.20.53.131:45797/ using document root <none> and password file <none>
I20260709 13:04:51.757503 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.757743 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.758018 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.759111 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/instance:
uuid: "3d76b2c4699e43fba10eeb81a91e4913"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-r056"
I20260709 13:04:51.763438 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:51.766685 21945 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.767445 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:51.767730 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root
uuid: "3d76b2c4699e43fba10eeb81a91e4913"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-r056"
I20260709 13:04:51.768008 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.781576 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.782768 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.784147 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.786294 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.786510 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.786738 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.786906 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.825449 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.131:42795
I20260709 13:04:51.825556 22007 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.131:42795 every 8 connection(s)
I20260709 13:04:51.844658 22008 heartbeater.cc:344] Connected to a master server at 127.20.53.190:38207
I20260709 13:04:51.845167 22008 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.846227 22008 heartbeater.cc:507] Master 127.20.53.190:38207 requested a full tablet report, sending...
I20260709 13:04:51.848572 21732 ts_manager.cc:194] Registered new tserver with Master: 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:51.849414 20694 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021018486s
I20260709 13:04:51.850262 21732 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33528
I20260709 13:04:51.883962 21732 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33542:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:51.889842 21732 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:52.084375 21898 tablet_service.cc:1511] Processing CreateTablet for tablet dd50c9e5c9a94fbb940c4168747744ab (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:52.084537 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 18adc37fa2ee428c9cdcfe76e72e77a4 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:52.085848 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd50c9e5c9a94fbb940c4168747744ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.086872 21897 tablet_service.cc:1511] Processing CreateTablet for tablet 402a4aa48c774bb6919a83e05b1a61ee (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:52.088336 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402a4aa48c774bb6919a83e05b1a61ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.092653 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18adc37fa2ee428c9cdcfe76e72e77a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.096346 21824 tablet_service.cc:1511] Processing CreateTablet for tablet 18adc37fa2ee428c9cdcfe76e72e77a4 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:52.097604 21824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18adc37fa2ee428c9cdcfe76e72e77a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.099313 21823 tablet_service.cc:1511] Processing CreateTablet for tablet dd50c9e5c9a94fbb940c4168747744ab (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:52.100513 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd50c9e5c9a94fbb940c4168747744ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.103356 21822 tablet_service.cc:1511] Processing CreateTablet for tablet 402a4aa48c774bb6919a83e05b1a61ee (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:52.104609 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402a4aa48c774bb6919a83e05b1a61ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.105976 21973 tablet_service.cc:1511] Processing CreateTablet for tablet 18adc37fa2ee428c9cdcfe76e72e77a4 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:52.107216 21973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18adc37fa2ee428c9cdcfe76e72e77a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.107327 21821 tablet_service.cc:1511] Processing CreateTablet for tablet add79beae9d04c6983a531c46dc72deb (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:52.108582 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add79beae9d04c6983a531c46dc72deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.111308 21972 tablet_service.cc:1511] Processing CreateTablet for tablet dd50c9e5c9a94fbb940c4168747744ab (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:52.112541 21972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd50c9e5c9a94fbb940c4168747744ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.115207 21971 tablet_service.cc:1511] Processing CreateTablet for tablet 402a4aa48c774bb6919a83e05b1a61ee (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:52.116446 21971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402a4aa48c774bb6919a83e05b1a61ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.117322 21894 tablet_service.cc:1511] Processing CreateTablet for tablet 864ca05a434d488c83f87f71e27dfa63 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:52.114133 21819 tablet_service.cc:1511] Processing CreateTablet for tablet a6e402ca5ed540e5a1c44b9a1dafcf78 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:52.119443 21819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e402ca5ed540e5a1c44b9a1dafcf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.119302 21970 tablet_service.cc:1511] Processing CreateTablet for tablet add79beae9d04c6983a531c46dc72deb (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:52.120501 21970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add79beae9d04c6983a531c46dc72deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.120134 21817 tablet_service.cc:1511] Processing CreateTablet for tablet 61e3ce132d8a443eb412d1816ffc7579 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:52.121472 21817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e3ce132d8a443eb412d1816ffc7579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.113094 21818 tablet_service.cc:1511] Processing CreateTablet for tablet 864ca05a434d488c83f87f71e27dfa63 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:52.123246 21896 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4dac7f6b7b440d84e044b62b559aae (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:52.123780 21818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864ca05a434d488c83f87f71e27dfa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.124488 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4dac7f6b7b440d84e044b62b559aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.126458 21894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864ca05a434d488c83f87f71e27dfa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.126744 21895 tablet_service.cc:1511] Processing CreateTablet for tablet a6e402ca5ed540e5a1c44b9a1dafcf78 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:52.127985 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e402ca5ed540e5a1c44b9a1dafcf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.128863 21815 tablet_service.cc:1511] Processing CreateTablet for tablet 4a225d8f594046389ec56c017df3b70c (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:52.130077 21815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a225d8f594046389ec56c017df3b70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.111325 21820 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4dac7f6b7b440d84e044b62b559aae (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:52.131561 21820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4dac7f6b7b440d84e044b62b559aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.131800 21893 tablet_service.cc:1511] Processing CreateTablet for tablet 61e3ce132d8a443eb412d1816ffc7579 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:52.133087 21893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e3ce132d8a443eb412d1816ffc7579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.124506 21816 tablet_service.cc:1511] Processing CreateTablet for tablet 48cad01af8fd4976ba77658d6a8e31b7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:52.135416 21816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cad01af8fd4976ba77658d6a8e31b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.135633 21892 tablet_service.cc:1511] Processing CreateTablet for tablet 48cad01af8fd4976ba77658d6a8e31b7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:52.136878 21892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cad01af8fd4976ba77658d6a8e31b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.139153 21969 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4dac7f6b7b440d84e044b62b559aae (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:52.140380 21969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4dac7f6b7b440d84e044b62b559aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.143237 21968 tablet_service.cc:1511] Processing CreateTablet for tablet a6e402ca5ed540e5a1c44b9a1dafcf78 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:52.144466 21968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e402ca5ed540e5a1c44b9a1dafcf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.144299 21899 tablet_service.cc:1511] Processing CreateTablet for tablet add79beae9d04c6983a531c46dc72deb (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:52.145476 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add79beae9d04c6983a531c46dc72deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.147136 21967 tablet_service.cc:1511] Processing CreateTablet for tablet 864ca05a434d488c83f87f71e27dfa63 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:52.148327 21967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864ca05a434d488c83f87f71e27dfa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.151134 21966 tablet_service.cc:1511] Processing CreateTablet for tablet 61e3ce132d8a443eb412d1816ffc7579 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:52.152354 21966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e3ce132d8a443eb412d1816ffc7579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.155207 21891 tablet_service.cc:1511] Processing CreateTablet for tablet 4a225d8f594046389ec56c017df3b70c (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:52.156471 21891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a225d8f594046389ec56c017df3b70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.156097 21890 tablet_service.cc:1511] Processing CreateTablet for tablet ff74442193fb468c966c8842f014e361 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:52.157363 21890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff74442193fb468c966c8842f014e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.174342 21965 tablet_service.cc:1511] Processing CreateTablet for tablet 48cad01af8fd4976ba77658d6a8e31b7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:52.174806 21964 tablet_service.cc:1511] Processing CreateTablet for tablet 4a225d8f594046389ec56c017df3b70c (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:52.175662 21965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cad01af8fd4976ba77658d6a8e31b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.186508 21964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a225d8f594046389ec56c017df3b70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.222934 22023 tablet_bootstrap.cc:492] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:52.227377 21898 tablet_service.cc:1511] Processing CreateTablet for tablet 9bdbae418d5246588152f31784da5bec (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:52.228785 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bdbae418d5246588152f31784da5bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.229588 21892 tablet_service.cc:1511] Processing CreateTablet for tablet 094b605ab81240b687b2fd4857aee3c3 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:52.230778 21892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094b605ab81240b687b2fd4857aee3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.233820 22023 tablet_bootstrap.cc:654] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.244534 21973 tablet_service.cc:1511] Processing CreateTablet for tablet 094b605ab81240b687b2fd4857aee3c3 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:52.245795 21973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094b605ab81240b687b2fd4857aee3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.276899 21893 tablet_service.cc:1511] Processing CreateTablet for tablet bccfbbc2aaa5423fb599eeb56b38121c (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:52.277644 21970 tablet_service.cc:1511] Processing CreateTablet for tablet 9bdbae418d5246588152f31784da5bec (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:52.278894 21970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bdbae418d5246588152f31784da5bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.285691 21895 tablet_service.cc:1511] Processing CreateTablet for tablet 9a451fba336b41e5954a827976c17a50 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:52.287185 21967 tablet_service.cc:1511] Processing CreateTablet for tablet bccfbbc2aaa5423fb599eeb56b38121c (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:52.288053 22025 tablet_bootstrap.cc:492] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:52.288566 21967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccfbbc2aaa5423fb599eeb56b38121c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.293958 22025 tablet_bootstrap.cc:654] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.295123 21897 tablet_service.cc:1511] Processing CreateTablet for tablet dd4225b745e54206b600f5380ed664be (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:52.297349 22024 tablet_bootstrap.cc:492] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:52.299825 21821 tablet_service.cc:1511] Processing CreateTablet for tablet ff74442193fb468c966c8842f014e361 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:52.328151 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff74442193fb468c966c8842f014e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.328737 21964 tablet_service.cc:1511] Processing CreateTablet for tablet 9a451fba336b41e5954a827976c17a50 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:52.304418 21817 tablet_service.cc:1511] Processing CreateTablet for tablet dd4225b745e54206b600f5380ed664be (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:52.329777 21894 tablet_service.cc:1511] Processing CreateTablet for tablet 9206e3439eb54425a3de6b25e0d8b36a (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:52.330152 21964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a451fba336b41e5954a827976c17a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.330916 21817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4225b745e54206b600f5380ed664be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.318017 21820 tablet_service.cc:1511] Processing CreateTablet for tablet 86489c4c9e90474881f2bd8eb6fa582f (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:52.333139 21820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86489c4c9e90474881f2bd8eb6fa582f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.335090 21891 tablet_service.cc:1511] Processing CreateTablet for tablet 86489c4c9e90474881f2bd8eb6fa582f (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:52.336009 21822 tablet_service.cc:1511] Processing CreateTablet for tablet 79240f02176941bdb28ac4ee2d3f446e (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:52.337404 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79240f02176941bdb28ac4ee2d3f446e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.307042 21818 tablet_service.cc:1511] Processing CreateTablet for tablet 9a451fba336b41e5954a827976c17a50 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:52.337915 21969 tablet_service.cc:1511] Processing CreateTablet for tablet 9206e3439eb54425a3de6b25e0d8b36a (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:52.338848 21818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a451fba336b41e5954a827976c17a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.339097 21969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9206e3439eb54425a3de6b25e0d8b36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.309192 21823 tablet_service.cc:1511] Processing CreateTablet for tablet 2705e36077094db8a03a8b3e606284be (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:52.303182 21815 tablet_service.cc:1511] Processing CreateTablet for tablet bccfbbc2aaa5423fb599eeb56b38121c (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:52.309953 21966 tablet_service.cc:1511] Processing CreateTablet for tablet dd4225b745e54206b600f5380ed664be (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:52.342654 21890 tablet_service.cc:1511] Processing CreateTablet for tablet 79240f02176941bdb28ac4ee2d3f446e (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:52.343111 21966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4225b745e54206b600f5380ed664be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.328167 21896 tablet_service.cc:1511] Processing CreateTablet for tablet 2705e36077094db8a03a8b3e606284be (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:52.303659 21893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccfbbc2aaa5423fb599eeb56b38121c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.346503 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2705e36077094db8a03a8b3e606284be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.348296 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a451fba336b41e5954a827976c17a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.312947 21819 tablet_service.cc:1511] Processing CreateTablet for tablet 094b605ab81240b687b2fd4857aee3c3 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:52.312947 21971 tablet_service.cc:1511] Processing CreateTablet for tablet 2705e36077094db8a03a8b3e606284be (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:52.350014 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4225b745e54206b600f5380ed664be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.350847 21894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9206e3439eb54425a3de6b25e0d8b36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.350047 21971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2705e36077094db8a03a8b3e606284be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.319139 21965 tablet_service.cc:1511] Processing CreateTablet for tablet ff74442193fb468c966c8842f014e361 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:52.325496 21816 tablet_service.cc:1511] Processing CreateTablet for tablet 9bdbae418d5246588152f31784da5bec (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:52.342886 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2705e36077094db8a03a8b3e606284be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.365378 21965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff74442193fb468c966c8842f014e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.366945 21815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccfbbc2aaa5423fb599eeb56b38121c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.315574 21824 tablet_service.cc:1511] Processing CreateTablet for tablet 9206e3439eb54425a3de6b25e0d8b36a (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:52.377691 21899 tablet_service.cc:1511] Processing CreateTablet for tablet ed07e2d846e24b06abb770ea1376b9fb (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:52.377242 21819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094b605ab81240b687b2fd4857aee3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.375136 21968 tablet_service.cc:1511] Processing CreateTablet for tablet 86489c4c9e90474881f2bd8eb6fa582f (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:52.383562 21968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86489c4c9e90474881f2bd8eb6fa582f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.397334 21892 tablet_service.cc:1511] Processing CreateTablet for tablet 9a439d1de6924cf49dda5333182516bb (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:52.401319 21972 tablet_service.cc:1511] Processing CreateTablet for tablet 79240f02176941bdb28ac4ee2d3f446e (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:52.402405 21891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86489c4c9e90474881f2bd8eb6fa582f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.403950 22024 tablet_bootstrap.cc:654] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.428452 21822 tablet_service.cc:1511] Processing CreateTablet for tablet ed07e2d846e24b06abb770ea1376b9fb (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:52.429047 21815 tablet_service.cc:1511] Processing CreateTablet for tablet 9a439d1de6924cf49dda5333182516bb (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:52.429934 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed07e2d846e24b06abb770ea1376b9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.434513 21891 tablet_service.cc:1511] Processing CreateTablet for tablet 0533e3146ff14445bcdca10aa4432f4b (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:52.431888 21821 tablet_service.cc:1511] Processing CreateTablet for tablet 0533e3146ff14445bcdca10aa4432f4b (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:52.442000 21818 tablet_service.cc:1511] Processing CreateTablet for tablet ad9d9c562d2d411db01a7eaf4427d325 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:52.446506 21972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79240f02176941bdb28ac4ee2d3f446e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.436614 21890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79240f02176941bdb28ac4ee2d3f446e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.447428 21815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a439d1de6924cf49dda5333182516bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.460933 21816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bdbae418d5246588152f31784da5bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.461553 22023 tablet_bootstrap.cc:492] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:52.462044 22023 ts_tablet_manager.cc:1403] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.239s	user 0.014s	sys 0.000s
I20260709 13:04:52.462478 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed07e2d846e24b06abb770ea1376b9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.462783 21898 tablet_service.cc:1511] Processing CreateTablet for tablet ad9d9c562d2d411db01a7eaf4427d325 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:52.464008 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9d9c562d2d411db01a7eaf4427d325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.466607 21891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0533e3146ff14445bcdca10aa4432f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.470659 21824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9206e3439eb54425a3de6b25e0d8b36a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:52.471053 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:52.471549 21818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9d9c562d2d411db01a7eaf4427d325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.475212 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0533e3146ff14445bcdca10aa4432f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.472810 22025 tablet_bootstrap.cc:492] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:52.475145 21966 tablet_service.cc:1511] Processing CreateTablet for tablet ed07e2d846e24b06abb770ea1376b9fb (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:52.465060 22023 raft_consensus.cc:359] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.476435 21966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed07e2d846e24b06abb770ea1376b9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.475970 22025 ts_tablet_manager.cc:1403] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.188s	user 0.008s	sys 0.014s
I20260709 13:04:52.476372 22023 raft_consensus.cc:385] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.482431 22023 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.484871 21969 tablet_service.cc:1511] Processing CreateTablet for tablet 9a439d1de6924cf49dda5333182516bb (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:52.497658 21892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a439d1de6924cf49dda5333182516bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.520856 21823 tablet_service.cc:1511] Processing CreateTablet for tablet cc0e6a6fba594f8db28b949dbce488c7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:52.485740 22023 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.486097 21969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a439d1de6924cf49dda5333182516bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.528618 22024 tablet_bootstrap.cc:492] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:52.529071 22024 ts_tablet_manager.cc:1403] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.232s	user 0.014s	sys 0.012s
I20260709 13:04:52.532924 21973 tablet_service.cc:1511] Processing CreateTablet for tablet ad9d9c562d2d411db01a7eaf4427d325 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:52.535171 21896 tablet_service.cc:1511] Processing CreateTablet for tablet cc0e6a6fba594f8db28b949dbce488c7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:52.535800 22024 raft_consensus.cc:359] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.536518 22024 raft_consensus.cc:385] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.537352 21965 tablet_service.cc:1511] Processing CreateTablet for tablet 16eb6999a3524d59835c31e2b76d09da (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:52.517292 21819 tablet_service.cc:1511] Processing CreateTablet for tablet 16eb6999a3524d59835c31e2b76d09da (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:52.515218 21894 tablet_service.cc:1511] Processing CreateTablet for tablet 16eb6999a3524d59835c31e2b76d09da (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:52.513631 21970 tablet_service.cc:1511] Processing CreateTablet for tablet 0533e3146ff14445bcdca10aa4432f4b (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:52.522037 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0e6a6fba594f8db28b949dbce488c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.548777 21894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16eb6999a3524d59835c31e2b76d09da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.552803 22023 ts_tablet_manager.cc:1434] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.006s
I20260709 13:04:52.536818 22024 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.560315 21819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16eb6999a3524d59835c31e2b76d09da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.560858 21893 tablet_service.cc:1511] Processing CreateTablet for tablet efae0b9ae5b44891a8bd0df1878c7c42 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:52.561560 21890 tablet_service.cc:1511] Processing CreateTablet for tablet c8aeca641b1d407488c25c7e1e347adc (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:52.561591 21815 tablet_service.cc:1511] Processing CreateTablet for tablet c8aeca641b1d407488c25c7e1e347adc (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:52.567376 22024 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.568595 21815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8aeca641b1d407488c25c7e1e347adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.563416 21966 tablet_service.cc:1511] Processing CreateTablet for tablet cc0e6a6fba594f8db28b949dbce488c7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:52.564963 21964 tablet_service.cc:1511] Processing CreateTablet for tablet efae0b9ae5b44891a8bd0df1878c7c42 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:52.566483 21934 heartbeater.cc:499] Master 127.20.53.190:38207 was elected leader, sending a full tablet report...
I20260709 13:04:52.555209 21965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16eb6999a3524d59835c31e2b76d09da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.566761 22023 tablet_bootstrap.cc:492] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:52.577499 21971 tablet_service.cc:1511] Processing CreateTablet for tablet 554595014abc431286bf4ba1922fc147 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:52.555119 22025 raft_consensus.cc:359] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.581377 21967 tablet_service.cc:1511] Processing CreateTablet for tablet c8aeca641b1d407488c25c7e1e347adc (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:52.586838 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0e6a6fba594f8db28b949dbce488c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.586349 22025 raft_consensus.cc:385] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.592059 22025 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.596040 21893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efae0b9ae5b44891a8bd0df1878c7c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.597121 22025 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.593657 21973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9d9c562d2d411db01a7eaf4427d325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.611686 21890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8aeca641b1d407488c25c7e1e347adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.616479 22008 heartbeater.cc:499] Master 127.20.53.190:38207 was elected leader, sending a full tablet report...
I20260709 13:04:52.619261 21964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efae0b9ae5b44891a8bd0df1878c7c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.622714 21966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0e6a6fba594f8db28b949dbce488c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.623942 21971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554595014abc431286bf4ba1922fc147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.623880 21897 tablet_service.cc:1511] Processing CreateTablet for tablet 554595014abc431286bf4ba1922fc147 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:52.629369 21820 tablet_service.cc:1511] Processing CreateTablet for tablet 554595014abc431286bf4ba1922fc147 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:52.630601 21820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554595014abc431286bf4ba1922fc147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.634444 21967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8aeca641b1d407488c25c7e1e347adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.636649 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554595014abc431286bf4ba1922fc147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.642817 21968 tablet_service.cc:1511] Processing CreateTablet for tablet 8957eea5c26d4180a331c4edcb3753b7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:52.644039 21968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8957eea5c26d4180a331c4edcb3753b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.647230 21815 tablet_service.cc:1511] Processing CreateTablet for tablet 373c4d5502fd42dca6f9cbb5a894ee0b (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:52.648427 21815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373c4d5502fd42dca6f9cbb5a894ee0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.651139 21821 tablet_service.cc:1511] Processing CreateTablet for tablet 8957eea5c26d4180a331c4edcb3753b7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:52.651975 21816 tablet_service.cc:1511] Processing CreateTablet for tablet 24f26969ffdf4e1eb377ceacb0750ca5 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:52.653554 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 373c4d5502fd42dca6f9cbb5a894ee0b (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:52.654897 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373c4d5502fd42dca6f9cbb5a894ee0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.656880 22029 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.674099 22029 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.676857 22029 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:52.679389 21818 tablet_service.cc:1511] Processing CreateTablet for tablet 14d5f024a39b4860be959c964acb51e6 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:52.657764 21898 tablet_service.cc:1511] Processing CreateTablet for tablet 8957eea5c26d4180a331c4edcb3753b7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:52.658936 21972 tablet_service.cc:1511] Processing CreateTablet for tablet 373c4d5502fd42dca6f9cbb5a894ee0b (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:52.689988 21823 tablet_service.cc:1511] Processing CreateTablet for tablet 6bde6ac1d042400fbc88831c01b9fdda (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:52.664386 22024 ts_tablet_manager.cc:1434] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.135s	user 0.009s	sys 0.004s
I20260709 13:04:52.691766 22024 tablet_bootstrap.cc:492] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:52.664662 21817 tablet_service.cc:1511] Processing CreateTablet for tablet efae0b9ae5b44891a8bd0df1878c7c42 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:52.666441 21970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0533e3146ff14445bcdca10aa4432f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.663421 21822 tablet_service.cc:1511] Processing CreateTablet for tablet 0bca2c885e084ef9af7344b6abb486aa (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:52.667394 22025 ts_tablet_manager.cc:1434] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.190s	user 0.023s	sys 0.002s
I20260709 13:04:52.667645 21859 heartbeater.cc:499] Master 127.20.53.190:38207 was elected leader, sending a full tablet report...
I20260709 13:04:52.694267 22025 tablet_bootstrap.cc:492] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:52.694473 21972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373c4d5502fd42dca6f9cbb5a894ee0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.666996 22023 tablet_bootstrap.cc:654] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.690533 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8957eea5c26d4180a331c4edcb3753b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.716634 21895 tablet_service.cc:1511] Processing CreateTablet for tablet 24f26969ffdf4e1eb377ceacb0750ca5 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:52.708907 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8957eea5c26d4180a331c4edcb3753b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.724875 21824 tablet_service.cc:1511] Processing CreateTablet for tablet edb7f62b920e42349d56d878295176b2 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:52.728374 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f26969ffdf4e1eb377ceacb0750ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.731040 21891 tablet_service.cc:1511] Processing CreateTablet for tablet 0bca2c885e084ef9af7344b6abb486aa (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:52.731854 21894 tablet_service.cc:1511] Processing CreateTablet for tablet 14d5f024a39b4860be959c964acb51e6 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:52.732316 21891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bca2c885e084ef9af7344b6abb486aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.733039 21894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d5f024a39b4860be959c964acb51e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.735247 21819 tablet_service.cc:1511] Processing CreateTablet for tablet ed83b85c2e96457c82a5beb8aa8c18f3 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:52.742637 21971 tablet_service.cc:1511] Processing CreateTablet for tablet 24f26969ffdf4e1eb377ceacb0750ca5 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:52.743837 21971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f26969ffdf4e1eb377ceacb0750ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.747256 21964 tablet_service.cc:1511] Processing CreateTablet for tablet 14d5f024a39b4860be959c964acb51e6 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:52.750571 21816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f26969ffdf4e1eb377ceacb0750ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.771049 21965 tablet_service.cc:1511] Processing CreateTablet for tablet 0bca2c885e084ef9af7344b6abb486aa (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:52.782950 21965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bca2c885e084ef9af7344b6abb486aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.782852 21966 tablet_service.cc:1511] Processing CreateTablet for tablet edb7f62b920e42349d56d878295176b2 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:52.784144 21966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb7f62b920e42349d56d878295176b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.786468 21819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed83b85c2e96457c82a5beb8aa8c18f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.788764 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bde6ac1d042400fbc88831c01b9fdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.777209 22024 tablet_bootstrap.cc:654] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.795948 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bca2c885e084ef9af7344b6abb486aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.798444 21824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb7f62b920e42349d56d878295176b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.799129 21969 tablet_service.cc:1511] Processing CreateTablet for tablet ed83b85c2e96457c82a5beb8aa8c18f3 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:52.800379 21969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed83b85c2e96457c82a5beb8aa8c18f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.803020 21890 tablet_service.cc:1511] Processing CreateTablet for tablet 6bde6ac1d042400fbc88831c01b9fdda (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:52.804209 21890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bde6ac1d042400fbc88831c01b9fdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.809712 21964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d5f024a39b4860be959c964acb51e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.812529 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:52.814093 21873 leader_election.cc:343] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.814873 21818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d5f024a39b4860be959c964acb51e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.815970 21896 tablet_service.cc:1511] Processing CreateTablet for tablet edb7f62b920e42349d56d878295176b2 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:52.817180 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb7f62b920e42349d56d878295176b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.818460 21817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efae0b9ae5b44891a8bd0df1878c7c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.825670 21899 tablet_service.cc:1511] Processing CreateTablet for tablet ed83b85c2e96457c82a5beb8aa8c18f3 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:52.827291 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed83b85c2e96457c82a5beb8aa8c18f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.832242 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:52.835261 21897 tablet_service.cc:1511] Processing CreateTablet for tablet b51a2766379a4c6195da185ed192fd0d (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:52.845810 21820 tablet_service.cc:1511] Processing CreateTablet for tablet b51a2766379a4c6195da185ed192fd0d (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:04:52.846349 21875 leader_election.cc:343] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.846884 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:52.847133 21820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51a2766379a4c6195da185ed192fd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.848672 22029 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.861652 21967 tablet_service.cc:1511] Processing CreateTablet for tablet 32a7f60c55ae4cc99c25348a1d82e6de (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:52.863024 21967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a7f60c55ae4cc99c25348a1d82e6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.866515 21973 tablet_service.cc:1511] Processing CreateTablet for tablet 6bde6ac1d042400fbc88831c01b9fdda (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:52.867751 21973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bde6ac1d042400fbc88831c01b9fdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.868317 21815 tablet_service.cc:1511] Processing CreateTablet for tablet 32a7f60c55ae4cc99c25348a1d82e6de (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:52.869499 21892 tablet_service.cc:1511] Processing CreateTablet for tablet 32a7f60c55ae4cc99c25348a1d82e6de (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:52.870719 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51a2766379a4c6195da185ed192fd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.882508 21892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a7f60c55ae4cc99c25348a1d82e6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.885442 22030 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.885962 22030 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.887526 21893 tablet_service.cc:1511] Processing CreateTablet for tablet 691d4cf0a1ef4f689413711647c88f75 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:52.888478 22030 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:52.906208 21893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691d4cf0a1ef4f689413711647c88f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.913236 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd0981f0f71482b83434dddd7e49dc4 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:52.918880 21965 tablet_service.cc:1511] Processing CreateTablet for tablet 691d4cf0a1ef4f689413711647c88f75 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:52.920135 21965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691d4cf0a1ef4f689413711647c88f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.901427 21815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a7f60c55ae4cc99c25348a1d82e6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.933017 22023 tablet_bootstrap.cc:492] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:52.933466 22023 ts_tablet_manager.cc:1403] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.367s	user 0.010s	sys 0.014s
I20260709 13:04:52.936491 22023 raft_consensus.cc:359] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.937234 22023 raft_consensus.cc:385] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.937641 22023 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.939592 22023 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.942333 22023 ts_tablet_manager.cc:1434] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:04:52.947907 21968 tablet_service.cc:1511] Processing CreateTablet for tablet ae693bf6616e4755b822cea96cf12222 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:52.899282 21971 tablet_service.cc:1511] Processing CreateTablet for tablet b51a2766379a4c6195da185ed192fd0d (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:52.954960 21895 tablet_service.cc:1511] Processing CreateTablet for tablet 911b6cb205984b78bafd3ecdcc02ef3c (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:52.957049 22024 tablet_bootstrap.cc:492] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
W20260709 13:04:52.890583 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 56990.9us
I20260709 13:04:52.963227 21969 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd0981f0f71482b83434dddd7e49dc4 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:52.968580 21970 tablet_service.cc:1511] Processing CreateTablet for tablet 91268f1f8ef64ef4b455bead2f60e2ff (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:52.969245 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd0981f0f71482b83434dddd7e49dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.975934 22024 ts_tablet_manager.cc:1403] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.284s	user 0.013s	sys 0.004s
I20260709 13:04:52.984964 22024 raft_consensus.cc:359] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.985374 22031 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.985987 22031 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.986792 22025 tablet_bootstrap.cc:654] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.976805 21969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd0981f0f71482b83434dddd7e49dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.978211 21819 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd0981f0f71482b83434dddd7e49dc4 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:52.988576 21819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd0981f0f71482b83434dddd7e49dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.985708 22024 raft_consensus.cc:385] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.989204 22024 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.989552 22031 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:52.987135 21823 tablet_service.cc:1511] Processing CreateTablet for tablet 911b6cb205984b78bafd3ecdcc02ef3c (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:53.000731 21968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae693bf6616e4755b822cea96cf12222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.012889 21890 tablet_service.cc:1511] Processing CreateTablet for tablet 503591d3d16047368f003bcc9f73d8a2 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:53.006361 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911b6cb205984b78bafd3ecdcc02ef3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.014678 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911b6cb205984b78bafd3ecdcc02ef3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.001916 21898 tablet_service.cc:1511] Processing CreateTablet for tablet 91268f1f8ef64ef4b455bead2f60e2ff (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:53.016297 22024 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:52.974092 21972 tablet_service.cc:1511] Processing CreateTablet for tablet 911b6cb205984b78bafd3ecdcc02ef3c (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:53.017500 22023 tablet_bootstrap.cc:492] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.017728 21820 tablet_service.cc:1511] Processing CreateTablet for tablet 691d4cf0a1ef4f689413711647c88f75 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:53.020208 21824 tablet_service.cc:1511] Processing CreateTablet for tablet ae693bf6616e4755b822cea96cf12222 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:53.020323 21894 tablet_service.cc:1511] Processing CreateTablet for tablet 535de8a48bb34b5f9976321c2d08b8d6 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:53.022403 21891 tablet_service.cc:1511] Processing CreateTablet for tablet ae693bf6616e4755b822cea96cf12222 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:53.022810 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:53.036644 21816 tablet_service.cc:1511] Processing CreateTablet for tablet 503591d3d16047368f003bcc9f73d8a2 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:53.026652 21970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91268f1f8ef64ef4b455bead2f60e2ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.985669 21973 tablet_service.cc:1511] Processing CreateTablet for tablet 503591d3d16047368f003bcc9f73d8a2 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:04:53.038182 21949 leader_election.cc:343] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.038535 21973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503591d3d16047368f003bcc9f73d8a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.040251 21971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51a2766379a4c6195da185ed192fd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.063127 21972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911b6cb205984b78bafd3ecdcc02ef3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.066131 21820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691d4cf0a1ef4f689413711647c88f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.066469 22024 ts_tablet_manager.cc:1434] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.002s
I20260709 13:04:53.066965 21824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae693bf6616e4755b822cea96cf12222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.067976 21822 tablet_service.cc:1511] Processing CreateTablet for tablet 91268f1f8ef64ef4b455bead2f60e2ff (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:53.069351 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91268f1f8ef64ef4b455bead2f60e2ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.069984 22024 tablet_bootstrap.cc:492] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:53.076320 22024 tablet_bootstrap.cc:654] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.076397 21821 tablet_service.cc:1511] Processing CreateTablet for tablet 535de8a48bb34b5f9976321c2d08b8d6 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:53.078447 21966 tablet_service.cc:1511] Processing CreateTablet for tablet fa248ef2ee9049c9a1f86b77185b86a3 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:53.079569 21817 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef872609f3d4b9ab42d0ccec83ae647 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:53.081586 21964 tablet_service.cc:1511] Processing CreateTablet for tablet 535de8a48bb34b5f9976321c2d08b8d6 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:04:53.115687 21717 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53297.7us
I20260709 13:04:53.112532 21816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503591d3d16047368f003bcc9f73d8a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.112802 21891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae693bf6616e4755b822cea96cf12222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.119097 21890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503591d3d16047368f003bcc9f73d8a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.121435 21896 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef872609f3d4b9ab42d0ccec83ae647 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:53.122449 21894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535de8a48bb34b5f9976321c2d08b8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.123186 21897 tablet_service.cc:1511] Processing CreateTablet for tablet fa248ef2ee9049c9a1f86b77185b86a3 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:53.123654 21964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535de8a48bb34b5f9976321c2d08b8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.124385 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa248ef2ee9049c9a1f86b77185b86a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.125443 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91268f1f8ef64ef4b455bead2f60e2ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.086403 21815 tablet_service.cc:1511] Processing CreateTablet for tablet fa248ef2ee9049c9a1f86b77185b86a3 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:53.134438 21815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa248ef2ee9049c9a1f86b77185b86a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.134929 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef872609f3d4b9ab42d0ccec83ae647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.140013 21973 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef872609f3d4b9ab42d0ccec83ae647 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:53.141252 21973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef872609f3d4b9ab42d0ccec83ae647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.144325 21965 tablet_service.cc:1511] Processing CreateTablet for tablet 90821f4436f045a0a3847b276293f36f (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:53.145514 21965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90821f4436f045a0a3847b276293f36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.148195 21817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef872609f3d4b9ab42d0ccec83ae647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.159638 21818 tablet_service.cc:1511] Processing CreateTablet for tablet 90821f4436f045a0a3847b276293f36f (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:53.144575 21969 tablet_service.cc:1511] Processing CreateTablet for tablet b3bbb48eaef64910973105f716cf813d (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:53.159817 21893 tablet_service.cc:1511] Processing CreateTablet for tablet 90821f4436f045a0a3847b276293f36f (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:53.164669 21893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90821f4436f045a0a3847b276293f36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.164933 21966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa248ef2ee9049c9a1f86b77185b86a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.166132 21969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bbb48eaef64910973105f716cf813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.161656 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535de8a48bb34b5f9976321c2d08b8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.168637 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.172240 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:04:53.179847 21948 leader_election.cc:343] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.180428 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:04:53.190214 21799 leader_election.cc:343] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.195873 21818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90821f4436f045a0a3847b276293f36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.198570 22030 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.214689 21819 tablet_service.cc:1511] Processing CreateTablet for tablet b3bbb48eaef64910973105f716cf813d (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:04:53.215126 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44984.6us
I20260709 13:04:53.216637 22025 tablet_bootstrap.cc:492] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:53.219082 22024 tablet_bootstrap.cc:492] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:53.219954 21899 tablet_service.cc:1511] Processing CreateTablet for tablet b3bbb48eaef64910973105f716cf813d (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:53.291741 22025 ts_tablet_manager.cc:1403] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.598s	user 0.012s	sys 0.037s
I20260709 13:04:53.291662 22029 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.292580 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bbb48eaef64910973105f716cf813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.292393 22029 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.291741 22024 ts_tablet_manager.cc:1403] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.222s	user 0.009s	sys 0.016s
I20260709 13:04:53.296792 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:53.297075 22024 raft_consensus.cc:359] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.297791 22024 raft_consensus.cc:385] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:53.298601 21875 leader_election.cc:343] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.299188 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:53.299371 22029 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.290722 21815 tablet_service.cc:1511] Processing CreateTablet for tablet 552d2504e5364dfe94b59ccc5d4bf3f7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:53.300652 22025 raft_consensus.cc:359] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.301281 21815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552d2504e5364dfe94b59ccc5d4bf3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.301355 22025 raft_consensus.cc:385] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.301818 22025 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.281584 21822 tablet_service.cc:1511] Processing CreateTablet for tablet 5b63bdc0c16e46fe907a6ef4f7f26653 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:53.302708 22025 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.222240 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:53.234560 21717 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 75578.9us
W20260709 13:04:53.238364 21718 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 77049us
I20260709 13:04:53.240669 21897 tablet_service.cc:1511] Processing CreateTablet for tablet 6d93b81c2ba1474cbbc824b7bbdd72a8 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:53.306748 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d93b81c2ba1474cbbc824b7bbdd72a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.307232 21817 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5da3aecad04fb0982188c37426f599 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:53.309580 21966 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2f8130ad944310bea7f2f3d408309f (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:53.298067 22024 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.310791 21966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2f8130ad944310bea7f2f3d408309f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.310926 22024 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.310101 22025 ts_tablet_manager.cc:1434] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.006s
I20260709 13:04:53.313174 22025 tablet_bootstrap.cc:492] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:53.221635 21892 tablet_service.cc:1511] Processing CreateTablet for tablet 865ede4842b04242930bf2619bb09d16 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:04:53.314242 21798 leader_election.cc:343] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.245052 21895 tablet_service.cc:1511] Processing CreateTablet for tablet dbb4eb8dd14248918867a27aa6d9bac9 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:53.314677 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:53.245364 21890 tablet_service.cc:1511] Processing CreateTablet for tablet 5b63bdc0c16e46fe907a6ef4f7f26653 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:53.316242 22031 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.316835 21892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865ede4842b04242930bf2619bb09d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.267097 21970 tablet_service.cc:1511] Processing CreateTablet for tablet 865ede4842b04242930bf2619bb09d16 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:53.320488 21970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865ede4842b04242930bf2619bb09d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.267159 21967 tablet_service.cc:1511] Processing CreateTablet for tablet 6d93b81c2ba1474cbbc824b7bbdd72a8 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:53.267768 22030 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.330577 22030 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.244894 21824 tablet_service.cc:1511] Processing CreateTablet for tablet 865ede4842b04242930bf2619bb09d16 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:53.271565 21968 tablet_service.cc:1511] Processing CreateTablet for tablet 96da242efa5849aab4168785047cff48 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:53.275532 21818 tablet_service.cc:1511] Processing CreateTablet for tablet dbb4eb8dd14248918867a27aa6d9bac9 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:53.279358 21820 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2f8130ad944310bea7f2f3d408309f (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:53.332718 22030 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:04:53.333580 21968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96da242efa5849aab4168785047cff48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.269403 21971 tablet_service.cc:1511] Processing CreateTablet for tablet dbb4eb8dd14248918867a27aa6d9bac9 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:53.334872 21971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb4eb8dd14248918867a27aa6d9bac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.265775 21816 tablet_service.cc:1511] Processing CreateTablet for tablet 6d93b81c2ba1474cbbc824b7bbdd72a8 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:53.303196 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b63bdc0c16e46fe907a6ef4f7f26653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.338620 21982 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:53.338828 21820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2f8130ad944310bea7f2f3d408309f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.247025 22023 tablet_bootstrap.cc:654] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.340150 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:53.340250 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.340919 21909 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
W20260709 13:04:53.341987 21949 leader_election.cc:343] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.342703 21816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d93b81c2ba1474cbbc824b7bbdd72a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.343298 21873 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:53.344390 22029 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.344767 22029 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.345091 22029 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.346526 21818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb4eb8dd14248918867a27aa6d9bac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.352097 22024 ts_tablet_manager.cc:1434] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 13:04:53.354897 22024 tablet_bootstrap.cc:492] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:53.361416 21890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b63bdc0c16e46fe907a6ef4f7f26653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.353009 21824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865ede4842b04242930bf2619bb09d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.351920 22029 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.365828 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb4eb8dd14248918867a27aa6d9bac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.366617 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:04:53.367997 21875 leader_election.cc:343] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.370460 21819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bbb48eaef64910973105f716cf813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.374078 22029 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.374887 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:53.375444 21982 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.382688 21967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d93b81c2ba1474cbbc824b7bbdd72a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.386476 21817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5da3aecad04fb0982188c37426f599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.382037 21982 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:53.286093 21823 tablet_service.cc:1511] Processing CreateTablet for tablet 96da242efa5849aab4168785047cff48 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:53.389745 21873 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:53.391798 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96da242efa5849aab4168785047cff48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.393874 21948 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:53.394028 21896 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2f8130ad944310bea7f2f3d408309f (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:53.412828 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2f8130ad944310bea7f2f3d408309f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.395409 21898 tablet_service.cc:1511] Processing CreateTablet for tablet 552d2504e5364dfe94b59ccc5d4bf3f7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:53.415414 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552d2504e5364dfe94b59ccc5d4bf3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.418419 22030 raft_consensus.cc:2764] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:53.410933 22025 tablet_bootstrap.cc:654] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.420305 21972 tablet_service.cc:1511] Processing CreateTablet for tablet 6e964a7ca2a54491a72482e75917bd10 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:53.421525 21972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e964a7ca2a54491a72482e75917bd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.394454 21894 tablet_service.cc:1511] Processing CreateTablet for tablet 96da242efa5849aab4168785047cff48 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:53.423460 21894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96da242efa5849aab4168785047cff48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.399425 21968 tablet_service.cc:1511] Processing CreateTablet for tablet 5b63bdc0c16e46fe907a6ef4f7f26653 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:53.427386 21968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b63bdc0c16e46fe907a6ef4f7f26653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.442353 22029 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.396157 21891 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5da3aecad04fb0982188c37426f599 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:53.447675 21891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5da3aecad04fb0982188c37426f599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.388947 22023 tablet_bootstrap.cc:492] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:53.459125 22023 ts_tablet_manager.cc:1403] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.442s	user 0.010s	sys 0.014s
I20260709 13:04:53.416714 21970 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5da3aecad04fb0982188c37426f599 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:53.396497 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 6e964a7ca2a54491a72482e75917bd10 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:53.462831 21970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5da3aecad04fb0982188c37426f599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.463534 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e964a7ca2a54491a72482e75917bd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.466687 22024 tablet_bootstrap.cc:654] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.404155 21964 tablet_service.cc:1511] Processing CreateTablet for tablet 552d2504e5364dfe94b59ccc5d4bf3f7 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:53.468436 21964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552d2504e5364dfe94b59ccc5d4bf3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.469352 22023 raft_consensus.cc:359] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.470255 22023 raft_consensus.cc:385] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.470623 22023 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
W20260709 13:04:53.473757 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:53.486927 22029 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:53.488301 22029 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.475558 22023 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.402040 21821 tablet_service.cc:1511] Processing CreateTablet for tablet 6e964a7ca2a54491a72482e75917bd10 (DEFAULT_TABLE table=test-workload [id=7d695e017c694a9c91caa34686eaea7e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:53.497323 22025 tablet_bootstrap.cc:492] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:53.497853 22025 ts_tablet_manager.cc:1403] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.185s	user 0.016s	sys 0.016s
I20260709 13:04:53.503959 22023 ts_tablet_manager.cc:1434] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:04:53.504961 22023 tablet_bootstrap.cc:492] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.508977 22025 raft_consensus.cc:359] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.509585 22025 raft_consensus.cc:385] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.509805 22025 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.510463 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e964a7ca2a54491a72482e75917bd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.510529 22025 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.512924 22025 ts_tablet_manager.cc:1434] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:53.517168 22023 tablet_bootstrap.cc:654] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.512917 22024 tablet_bootstrap.cc:492] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:53.518260 22024 ts_tablet_manager.cc:1403] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.021s
I20260709 13:04:53.520927 22024 raft_consensus.cc:359] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.521682 22024 raft_consensus.cc:385] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.523259 22025 tablet_bootstrap.cc:492] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:53.524257 22024 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.525173 21731 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.527078 22023 tablet_bootstrap.cc:492] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:53.527522 22023 ts_tablet_manager.cc:1403] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:04:53.529076 22025 tablet_bootstrap.cc:654] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.525197 22024 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.532122 22024 ts_tablet_manager.cc:1434] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:04:53.533048 22024 tablet_bootstrap.cc:492] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:53.530342 22023 raft_consensus.cc:359] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.534909 22023 raft_consensus.cc:385] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.535223 22023 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.536047 22023 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.538504 22023 ts_tablet_manager.cc:1434] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:53.539084 22024 tablet_bootstrap.cc:654] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.539413 22023 tablet_bootstrap.cc:492] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.547465 22023 tablet_bootstrap.cc:654] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.552052 22025 tablet_bootstrap.cc:492] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:53.552527 22025 ts_tablet_manager.cc:1403] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.004s
I20260709 13:04:53.555351 22025 raft_consensus.cc:359] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.556097 22025 raft_consensus.cc:385] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.556444 22025 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.557427 22025 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.561398 22025 ts_tablet_manager.cc:1434] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:53.561916 22024 tablet_bootstrap.cc:492] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:53.562157 22025 tablet_bootstrap.cc:492] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:53.562427 22024 ts_tablet_manager.cc:1403] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.007s
I20260709 13:04:53.565383 22024 raft_consensus.cc:359] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.568081 22024 raft_consensus.cc:385] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.568367 22024 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.570981 22025 tablet_bootstrap.cc:654] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.571298 22023 tablet_bootstrap.cc:492] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:53.571748 22023 ts_tablet_manager.cc:1403] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.006s
I20260709 13:04:53.573554 22029 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.569063 22024 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.574007 22029 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.575615 22023 raft_consensus.cc:359] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.576023 22029 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.577488 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:53.577730 22025 tablet_bootstrap.cc:492] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:53.578228 22025 ts_tablet_manager.cc:1403] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:04:53.578096 21982 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:53.578085 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:53.578083 22024 ts_tablet_manager.cc:1434] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
W20260709 13:04:53.579566 21875 leader_election.cc:343] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.580045 22024 tablet_bootstrap.cc:492] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:53.580125 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:53.581128 22025 raft_consensus.cc:359] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.581669 22025 raft_consensus.cc:385] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.581910 22025 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.582585 22025 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.584645 22025 ts_tablet_manager.cc:1434] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:53.576145 22023 raft_consensus.cc:385] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.585153 22023 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.585667 22029 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.586054 22029 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.585860 22023 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.586432 22029 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.586500 22024 tablet_bootstrap.cc:654] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.588223 22023 ts_tablet_manager.cc:1434] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:53.590250 22023 tablet_bootstrap.cc:492] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.589100 22025 tablet_bootstrap.cc:492] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:53.595000 22030 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.595484 22030 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.597443 22030 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:53.598855 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:53.600142 21949 leader_election.cc:343] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.594363 22029 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.602130 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.602733 21909 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:53.603286 22025 tablet_bootstrap.cc:654] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.603847 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:53.604053 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:53.604895 22030 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.605248 22030 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:53.605350 21875 leader_election.cc:343] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.605620 22030 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.595126 22023 tablet_bootstrap.cc:654] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.607519 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:53.608057 21982 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.611382 22029 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.615803 21982 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:53.614717 22030 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.620329 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:53.622654 22029 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.623174 22029 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:53.624084 22029 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.630681 22024 tablet_bootstrap.cc:492] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:53.630614 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:53.631227 22024 ts_tablet_manager.cc:1403] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.024s
W20260709 13:04:53.632062 21949 leader_election.cc:343] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.633378 22030 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:53.634219 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:53.634801 21909 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.635015 22025 tablet_bootstrap.cc:492] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:53.635460 22025 ts_tablet_manager.cc:1403] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.012s
I20260709 13:04:53.636483 22023 tablet_bootstrap.cc:492] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:53.636991 22023 ts_tablet_manager.cc:1403] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.016s
I20260709 13:04:53.636329 21732 catalog_manager.cc:5697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.638222 22025 raft_consensus.cc:359] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.638891 22025 raft_consensus.cc:385] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.639173 22025 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.639876 22025 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.640214 22023 raft_consensus.cc:359] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.641024 22023 raft_consensus.cc:385] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.634101 22024 raft_consensus.cc:359] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.641364 22023 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.641652 22024 raft_consensus.cc:385] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.642030 22025 ts_tablet_manager.cc:1434] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:04:53.642035 22024 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.642465 22023 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.643469 22025 tablet_bootstrap.cc:492] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:53.643060 22024 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.644953 22023 ts_tablet_manager.cc:1434] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:53.645849 22023 tablet_bootstrap.cc:492] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.650069 22025 tablet_bootstrap.cc:654] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.650790 22024 ts_tablet_manager.cc:1434] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:04:53.651757 22024 tablet_bootstrap.cc:492] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:53.651818 22023 tablet_bootstrap.cc:654] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.659884 22024 tablet_bootstrap.cc:654] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.662464 22025 tablet_bootstrap.cc:492] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:53.662938 22023 tablet_bootstrap.cc:492] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:53.662963 22025 ts_tablet_manager.cc:1403] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:04:53.663470 22023 ts_tablet_manager.cc:1403] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:04:53.666126 22025 raft_consensus.cc:359] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.666935 22025 raft_consensus.cc:385] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.666373 22023 raft_consensus.cc:359] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.667294 22025 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.667424 22023 raft_consensus.cc:385] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.667917 22023 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.668330 22025 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.668725 22023 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.671231 22025 ts_tablet_manager.cc:1434] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:53.671501 22023 ts_tablet_manager.cc:1434] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:53.672487 22023 tablet_bootstrap.cc:492] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.672609 22025 tablet_bootstrap.cc:492] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:53.678881 22023 tablet_bootstrap.cc:654] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.680518 22031 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.681002 22031 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.681413 22025 tablet_bootstrap.cc:654] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.684907 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:53.685906 21982 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:53.688580 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.689663 22023 tablet_bootstrap.cc:492] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:53.690088 22023 ts_tablet_manager.cc:1403] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:04:53.689991 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:53.691179 22031 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.691641 22031 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.692755 22023 raft_consensus.cc:359] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.693374 22023 raft_consensus.cc:385] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.693641 22023 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.694763 22025 tablet_bootstrap.cc:492] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:53.694435 22023 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.695466 22025 ts_tablet_manager.cc:1403] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:04:53.699107 22023 ts_tablet_manager.cc:1434] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:04:53.698700 22025 raft_consensus.cc:359] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.699781 22025 raft_consensus.cc:385] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.699970 22023 tablet_bootstrap.cc:492] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.700253 22025 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.701150 22025 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.705695 22023 tablet_bootstrap.cc:654] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.709826 22071 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.712308 22071 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.711822 22025 ts_tablet_manager.cc:1434] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:04:53.714080 22025 tablet_bootstrap.cc:492] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:53.715773 21909 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:53.716850 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:53.717994 22023 tablet_bootstrap.cc:492] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:53.719033 22023 ts_tablet_manager.cc:1403] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.011s
I20260709 13:04:53.719350 22030 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.719856 22030 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:53.721138 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:53.721740 21982 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:53.721400 22030 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.722198 22023 raft_consensus.cc:359] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.723003 22023 raft_consensus.cc:385] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.722968 21798 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:53.723431 22023 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.724012 22071 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.724406 22023 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.726148 22025 tablet_bootstrap.cc:654] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.727979 22023 ts_tablet_manager.cc:1434] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:53.726722 22071 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.728466 22071 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.728894 22071 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.729107 22023 tablet_bootstrap.cc:492] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.731459 21731 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:53.723204 22031 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.733958 22030 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.734468 22030 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.735975 22023 tablet_bootstrap.cc:654] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.737061 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:53.737226 22030 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:53.737661 21834 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:53.737749 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.738375 21909 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:53.738926 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:53.739941 22030 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.739187 22071 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.740319 22030 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.740738 22030 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:53.739966 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50052.4us
I20260709 13:04:53.742988 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:53.743494 21982 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.745437 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.748307 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:53.745990 21909 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:53.749996 21982 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:53.751298 21798 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:53.752197 22071 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.752763 22071 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.752874 22025 tablet_bootstrap.cc:492] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:53.753319 22071 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:53.756954 22071 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.757824 22024 tablet_bootstrap.cc:492] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:53.758296 22024 ts_tablet_manager.cc:1403] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.107s	user 0.038s	sys 0.025s
I20260709 13:04:53.753377 22025 ts_tablet_manager.cc:1403] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.001s
I20260709 13:04:53.753504 22030 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.762148 22030 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:53.762610 22073 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.762832 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:53.763187 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:53.763391 21834 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.763103 22073 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.763789 21909 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.764801 22030 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.764693 22025 raft_consensus.cc:359] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.765411 22025 raft_consensus.cc:385] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.765301 22030 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.765708 22025 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.766408 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.766996 21908 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:53.768090 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:53.768599 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.768689 21833 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:53.769249 21908 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:53.767822 22025 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.769776 22030 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:53.770100 21949 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:53.771392 22025 ts_tablet_manager.cc:1434] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:04:53.772250 22025 tablet_bootstrap.cc:492] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:53.772487 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:53.773135 22073 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.773816 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:53.761572 22024 raft_consensus.cc:359] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.774636 21834 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:53.774801 22024 raft_consensus.cc:385] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.774868 22073 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.775252 22024 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.775496 22073 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.775941 22073 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.775903 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:53.777024 22030 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.777074 22046 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.777505 22030 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.778123 22025 tablet_bootstrap.cc:654] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.774119 21909 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:53.776087 22024 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.778532 22029 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.785614 22029 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.788275 22029 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.783558 22046 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:53.789414 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:53.789921 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:53.777886 22030 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.791353 21982 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
W20260709 13:04:53.792095 21873 leader_election.cc:343] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.791332 21834 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:53.794013 22071 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.789975 22046 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.797202 22024 ts_tablet_manager.cc:1434] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.004s
I20260709 13:04:53.798974 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:53.800314 22024 tablet_bootstrap.cc:492] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:53.802723 22023 tablet_bootstrap.cc:492] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:53.803148 22023 ts_tablet_manager.cc:1403] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.015s
I20260709 13:04:53.800279 22029 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.806357 22029 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.806847 22029 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.807042 22030 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.808732 22030 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:53.809751 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:53.810043 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:53.810331 21834 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.810609 21909 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.799001 22071 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.802500 21730 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.805663 22023 raft_consensus.cc:359] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.815325 22023 raft_consensus.cc:385] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.815660 22023 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.816392 22023 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.820742 21909 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:53.821259 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.823114 21908 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:53.821453 22071 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.824209 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:53.825263 22071 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.825687 22071 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.826085 22071 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.827965 22029 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.821612 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:53.830819 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:53.831352 21833 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:53.831832 21798 leader_election.cc:343] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.831879 22023 ts_tablet_manager.cc:1434] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:04:53.833554 22073 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.837950 21833 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:53.838559 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:53.839090 21908 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.822371 22024 tablet_bootstrap.cc:654] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.839843 22023 tablet_bootstrap.cc:492] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.839210 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:53.839381 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:53.841964 21982 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.841542 22049 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.840309 22073 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.847465 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:53.846278 21834 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:53.855978 22071 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.857779 21908 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:53.858871 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:53.859347 22029 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.859300 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:53.859951 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:53.853813 22030 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.860713 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:53.861869 22073 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:53.862464 21798 leader_election.cc:343] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:53.862649 21873 leader_election.cc:343] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.863320 21982 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:53.859962 21909 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.863394 22073 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:53.861538 22030 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:53.866770 22073 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.868593 22023 tablet_bootstrap.cc:654] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.872176 22025 tablet_bootstrap.cc:492] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:53.872561 22025 ts_tablet_manager.cc:1403] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.100s	user 0.029s	sys 0.007s
I20260709 13:04:53.867142 22071 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.868340 22030 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.874388 21730 catalog_manager.cc:5697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:53.875344 22025 raft_consensus.cc:359] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.876227 22025 raft_consensus.cc:385] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.876502 22025 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.877406 22025 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.870309 22049 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:53.879649 22025 ts_tablet_manager.cc:1434] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:53.880280 22049 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.881290 21909 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:53.884080 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:53.885593 22070 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.885671 22029 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.890070 22025 tablet_bootstrap.cc:492] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:53.886313 22070 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:53.891352 22070 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.898957 22025 tablet_bootstrap.cc:654] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.909106 21729 catalog_manager.cc:5697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.928042 22073 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.926239 22029 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:53.929615 22073 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.931737 22073 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.933476 22024 tablet_bootstrap.cc:492] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:53.934032 22024 ts_tablet_manager.cc:1403] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.004s
I20260709 13:04:53.934482 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.933386 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:53.940028 22024 raft_consensus.cc:359] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.941390 22024 raft_consensus.cc:385] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.944623 22024 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.945820 22024 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.947492 22023 tablet_bootstrap.cc:492] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:53.947896 22023 ts_tablet_manager.cc:1403] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.110s	user 0.018s	sys 0.005s
I20260709 13:04:53.948164 22024 ts_tablet_manager.cc:1434] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:04:53.949246 22024 tablet_bootstrap.cc:492] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:53.951561 22023 raft_consensus.cc:359] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.952221 22023 raft_consensus.cc:385] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.951648 21730 catalog_manager.cc:5697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.952476 22023 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.953119 22023 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.955271 22023 ts_tablet_manager.cc:1434] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:04:53.956094 22023 tablet_bootstrap.cc:492] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:53.956379 22024 tablet_bootstrap.cc:654] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.959374 22049 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.959841 22049 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.962390 22049 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.962697 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:53.963828 21875 leader_election.cc:343] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.958642 21981 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:53.972237 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:53.978477 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:53.980978 22073 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.981698 22073 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:53.985782 22073 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:53.981005 22070 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:53.987210 21873 leader_election.cc:343] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.990206 21873 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:53.990219 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:53.991770 21909 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:53.992807 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:53.993302 22081 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.993531 22073 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.993873 22073 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.994213 22073 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.997936 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:53.999329 21798 leader_election.cc:343] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.999568 22024 tablet_bootstrap.cc:492] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:54.000036 22024 ts_tablet_manager.cc:1403] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.011s
I20260709 13:04:53.999150 21730 catalog_manager.cc:5697] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.003979 22024 raft_consensus.cc:359] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.004544 22024 raft_consensus.cc:385] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.004832 22024 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.005625 22024 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.007520 22024 ts_tablet_manager.cc:1434] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:54.008216 22024 tablet_bootstrap.cc:492] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:54.012434 21731 catalog_manager.cc:5697] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.018000 22073 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.021663 22025 tablet_bootstrap.cc:492] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:54.022078 22025 ts_tablet_manager.cc:1403] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.132s	user 0.025s	sys 0.022s
I20260709 13:04:54.022864 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:54.023586 21909 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.024580 22025 raft_consensus.cc:359] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.025207 22025 raft_consensus.cc:385] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.025465 22025 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.026124 22025 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.027266 22024 tablet_bootstrap.cc:654] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.031286 21909 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:54.004416 22023 tablet_bootstrap.cc:654] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.019358 22070 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.040498 22025 ts_tablet_manager.cc:1434] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:04:54.041716 22025 tablet_bootstrap.cc:492] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:54.041796 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:54.042480 21983 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.043128 22023 tablet_bootstrap.cc:492] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:54.043601 22023 ts_tablet_manager.cc:1403] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.002s
I20260709 13:04:54.040560 22073 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.046232 22023 raft_consensus.cc:359] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.047314 22029 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.047524 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:54.048245 22073 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.048897 22073 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:54.049902 22073 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.051337 21983 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:54.053553 22023 raft_consensus.cc:385] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.054211 22023 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.055558 22023 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.056615 22025 tablet_bootstrap.cc:654] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.059544 22024 tablet_bootstrap.cc:492] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:54.060119 22024 ts_tablet_manager.cc:1403] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.015s
I20260709 13:04:54.063505 22024 raft_consensus.cc:359] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.064347 22024 raft_consensus.cc:385] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.064683 22024 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.065805 22023 ts_tablet_manager.cc:1434] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:54.068270 22023 tablet_bootstrap.cc:492] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:54.065469 22024 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.071178 22024 ts_tablet_manager.cc:1434] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:54.078485 22024 tablet_bootstrap.cc:492] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:54.086759 22025 tablet_bootstrap.cc:492] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:54.087199 22025 ts_tablet_manager.cc:1403] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.008s
I20260709 13:04:54.089443 21730 catalog_manager.cc:5697] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.092830 22023 tablet_bootstrap.cc:654] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.090905 22024 tablet_bootstrap.cc:654] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.091614 22081 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:54.094230 22025 raft_consensus.cc:359] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.102027 22025 raft_consensus.cc:385] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.102344 22025 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.103003 22025 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.103899 22070 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.104427 22070 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.104892 22025 ts_tablet_manager.cc:1434] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
I20260709 13:04:54.105511 22025 tablet_bootstrap.cc:492] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:54.106351 22070 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.107481 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:54.108304 21909 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:04:54.109756 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:54.111821 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:54.112884 22070 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.114315 22025 tablet_bootstrap.cc:654] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.119867 22070 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.123207 22023 tablet_bootstrap.cc:492] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:54.123687 22023 ts_tablet_manager.cc:1403] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.013s
I20260709 13:04:54.126318 22030 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.126261 22023 raft_consensus.cc:359] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.127743 22023 raft_consensus.cc:385] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.128094 22023 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.130064 22023 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.131136 22025 tablet_bootstrap.cc:492] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:54.131551 22025 ts_tablet_manager.cc:1403] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.005s
I20260709 13:04:54.134322 22024 tablet_bootstrap.cc:492] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:54.134054 22025 raft_consensus.cc:359] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.134654 22025 raft_consensus.cc:385] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.134980 22025 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.134723 22024 ts_tablet_manager.cc:1403] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.003s
I20260709 13:04:54.135823 22025 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.137405 22023 ts_tablet_manager.cc:1434] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:04:54.138870 22023 tablet_bootstrap.cc:492] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:54.137895 22025 ts_tablet_manager.cc:1434] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:54.138827 22024 raft_consensus.cc:359] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.139678 22024 raft_consensus.cc:385] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.139976 22025 tablet_bootstrap.cc:492] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:54.139981 22024 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.147773 22023 tablet_bootstrap.cc:654] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.147948 22024 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.150007 22024 ts_tablet_manager.cc:1434] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:04:54.154451 22024 tablet_bootstrap.cc:492] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:54.155347 22078 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.157627 22046 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.158073 22046 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.160203 22046 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:54.160705 22025 tablet_bootstrap.cc:654] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.161278 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:54.162072 21908 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:04:54.162748 22081 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.164011 22081 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.165822 22081 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.167533 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:54.169898 21875 leader_election.cc:343] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.170516 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:54.172079 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:54.172297 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:54.173569 22046 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:54.173893 21873 leader_election.cc:343] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.174511 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:54.175935 22081 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.180922 22046 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.192967 22024 tablet_bootstrap.cc:654] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.195964 22025 tablet_bootstrap.cc:492] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:54.196400 22025 ts_tablet_manager.cc:1403] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.010s
I20260709 13:04:54.197736 22023 tablet_bootstrap.cc:492] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:54.198135 22023 ts_tablet_manager.cc:1403] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.038s
I20260709 13:04:54.198928 22025 raft_consensus.cc:359] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.199579 22025 raft_consensus.cc:385] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.199865 22025 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.200219 22023 raft_consensus.cc:359] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.200907 22023 raft_consensus.cc:385] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.200500 22025 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.201201 22023 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.201924 22024 tablet_bootstrap.cc:492] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:54.201817 22023 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.202376 22024 ts_tablet_manager.cc:1403] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.002s
I20260709 13:04:54.203800 22023 ts_tablet_manager.cc:1434] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:54.204623 22023 tablet_bootstrap.cc:492] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:54.205173 22024 raft_consensus.cc:359] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.205823 22024 raft_consensus.cc:385] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.206121 22024 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.206789 22024 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.208549 22025 ts_tablet_manager.cc:1434] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.006s
I20260709 13:04:54.209425 22025 tablet_bootstrap.cc:492] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:54.210772 22023 tablet_bootstrap.cc:654] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.211792 22024 ts_tablet_manager.cc:1434] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:54.212685 22024 tablet_bootstrap.cc:492] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:54.214706 22025 tablet_bootstrap.cc:654] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.220131 22024 tablet_bootstrap.cc:654] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.225639 22023 tablet_bootstrap.cc:492] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:54.226089 22023 ts_tablet_manager.cc:1403] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:04:54.227259 22025 tablet_bootstrap.cc:492] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:54.227654 22025 ts_tablet_manager.cc:1403] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:04:54.228782 22023 raft_consensus.cc:359] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.229410 22023 raft_consensus.cc:385] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.229646 22023 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.230002 22025 raft_consensus.cc:359] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.230628 22025 raft_consensus.cc:385] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.230345 22023 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.230866 22025 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.231487 22025 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.233554 22025 ts_tablet_manager.cc:1434] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:54.234373 22025 tablet_bootstrap.cc:492] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:54.235419 22023 ts_tablet_manager.cc:1434] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:04:54.236214 22023 tablet_bootstrap.cc:492] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:54.239791 22025 tablet_bootstrap.cc:654] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.241330 22024 tablet_bootstrap.cc:492] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:54.241756 22024 ts_tablet_manager.cc:1403] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:04:54.245481 22024 raft_consensus.cc:359] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.246359 22024 raft_consensus.cc:385] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.246687 22024 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.247483 22024 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.249238 22070 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.250484 22024 ts_tablet_manager.cc:1434] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.004s
I20260709 13:04:54.254069 22046 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.254554 22046 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.256479 22046 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:54.257886 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:54.259408 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:54.259989 22024 tablet_bootstrap.cc:492] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:54.260078 21833 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:54.261323 22046 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.261552 21949 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:54.261950 22046 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.262494 22030 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.263164 22030 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.263551 22030 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.264581 22046 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:04:54.267612 21948 leader_election.cc:343] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.268507 22023 tablet_bootstrap.cc:654] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.268642 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:54.269456 21833 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:54.273245 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:54.279117 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:54.279896 22024 tablet_bootstrap.cc:654] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.279963 22046 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.286444 22023 tablet_bootstrap.cc:492] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:54.286962 22023 ts_tablet_manager.cc:1403] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.001s
I20260709 13:04:54.289837 22070 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.290544 22023 raft_consensus.cc:359] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.291419 22023 raft_consensus.cc:385] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.291743 22023 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.292675 22046 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.294837 22024 tablet_bootstrap.cc:492] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:54.295279 22024 ts_tablet_manager.cc:1403] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.002s
I20260709 13:04:54.295747 22030 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.298147 22024 raft_consensus.cc:359] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.298720 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:54.298979 22024 raft_consensus.cc:385] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.299273 21833 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.299376 22024 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.292666 22023 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.302529 22023 ts_tablet_manager.cc:1434] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:54.303875 22023 tablet_bootstrap.cc:492] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:54.306468 22030 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:54.307698 21833 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:54.307349 22024 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.308874 21949 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:54.310004 22024 ts_tablet_manager.cc:1434] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:54.310738 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:54.309968 22078 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.311623 22031 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.311861 22078 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:04:54.312933 21948 leader_election.cc:343] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.313571 22078 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.314253 22031 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.315181 22024 tablet_bootstrap.cc:492] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:54.325148 22023 tablet_bootstrap.cc:654] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.329643 21906 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.329818 22024 tablet_bootstrap.cc:654] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.331491 22046 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.337958 22024 tablet_bootstrap.cc:492] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:54.338400 22024 ts_tablet_manager.cc:1403] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:04:54.338984 22031 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.343473 22081 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.347172 22081 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.341483 22024 raft_consensus.cc:359] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.348157 22024 raft_consensus.cc:385] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.348508 22024 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.349347 22081 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.350971 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:54.352325 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:54.352972 21983 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
W20260709 13:04:54.357189 21875 leader_election.cc:343] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.358378 21873 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:54.359552 22081 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.359937 22081 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.360276 22081 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.361150 22046 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.349349 22024 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.377108 22049 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.377712 22049 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.378942 22070 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.380163 22049 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.381989 22031 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.381589 22024 ts_tablet_manager.cc:1434] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:04:54.382562 22031 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.383257 22024 tablet_bootstrap.cc:492] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:54.406453 22031 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.398386 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:54.407773 22081 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.405473 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:54.411803 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:04:54.411257 21875 leader_election.cc:343] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.411196 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:54.434825 22081 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.436795 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:04:54.438060 21875 leader_election.cc:343] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:54.438737 21798 leader_election.cc:343] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:54.439425 21873 leader_election.cc:343] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.440598 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:54.443217 22030 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 13:04:54.449239 22049 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.610080 22049 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.523885 22073 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.514678 22070 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.618870 22119 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.618125 22046 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:54.615876 21980 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.488845 22031 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.452983 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:54.623015 22070 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.639093 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:54.639696 21983 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:54.640077 22023 tablet_bootstrap.cc:492] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:54.640497 22023 ts_tablet_manager.cc:1403] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.337s	user 0.020s	sys 0.037s
I20260709 13:04:54.637930 22070 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:04:54.640916 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:54.670264 22025 tablet_bootstrap.cc:492] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:54.670740 22025 ts_tablet_manager.cc:1403] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.437s	user 0.050s	sys 0.122s
I20260709 13:04:54.622681 22073 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.619993 22119 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.640889 21798 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:54.635339 22031 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.670310 22078 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.676430 22071 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.678459 22129 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.678752 22071 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.679136 22071 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.677141 22078 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.680109 22031 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.681172 22078 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:54.681998 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:54.668478 22029 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:54.683197 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:54.684551 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:54.685912 21798 leader_election.cc:343] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:54.685976 21949 leader_election.cc:343] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.686892 22031 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.687654 22049 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.688354 22023 raft_consensus.cc:359] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.688997 22023 raft_consensus.cc:385] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.689327 22023 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.690431 22023 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:54.671577 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 232187us
I20260709 13:04:54.695266 22024 tablet_bootstrap.cc:654] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.701906 22023 ts_tablet_manager.cc:1434] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.002s
I20260709 13:04:54.702837 22023 tablet_bootstrap.cc:492] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:54.705353 22081 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.695928 22073 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.709203 22049 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.710880 22130 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:54.711483 22049 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.713339 22049 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.713888 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:54.705848 22081 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.714864 21907 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:54.715857 22081 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.713521 22119 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:54.717307 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:54.728153 22122 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:54.729035 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:54.726532 21798 leader_election.cc:343] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.733852 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:54.734503 21981 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:54.734824 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:54.735891 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:54.741283 22119 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.740394 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:54.741791 22119 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.738723 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:54.743155 22119 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.742007 21908 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:54.748557 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:54.749187 21831 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:54.756867 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:54.761237 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:54.762084 22081 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.762495 22081 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.762856 22081 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:54.449543 21799 leader_election.cc:343] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.763918 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:04:54.766724 21875 leader_election.cc:343] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.766281 22071 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.773635 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:54.774611 22046 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.775030 22046 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.769506 22031 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.775409 22046 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:54.771239 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 324102us
I20260709 13:04:54.791428 21873 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:54.792472 22130 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:54.792550 21873 leader_election.cc:343] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.793222 22130 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.795182 22024 tablet_bootstrap.cc:492] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:54.795627 22024 ts_tablet_manager.cc:1403] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.413s	user 0.020s	sys 0.022s
I20260709 13:04:54.798357 22025 raft_consensus.cc:359] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.799122 22025 raft_consensus.cc:385] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.799393 22025 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.799991 22025 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.803575 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:54.804277 21907 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:54.793778 22130 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.807313 22071 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.815680 22025 ts_tablet_manager.cc:1434] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.145s	user 0.006s	sys 0.001s
I20260709 13:04:54.818717 22025 tablet_bootstrap.cc:492] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:54.825814 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:54.826694 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:54.827262 21909 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.827107 22081 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.828213 21908 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:54.829099 22081 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:54.836452 21980 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:54.843875 22130 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.844660 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:54.845177 21979 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.844373 22023 tablet_bootstrap.cc:654] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.833225 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:54.849531 22130 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:04:54.850725 21799 leader_election.cc:343] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.851198 21799 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:54.851718 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:54.852248 21832 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.852476 22073 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.853533 21909 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:54.853672 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:54.854327 21834 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:54.855408 22046 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.857299 22046 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:54.831457 22071 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:54.862439 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:54.863077 21831 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.866274 22119 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.868197 21976 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 1: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:04:54.871054 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:54.879616 21873 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:54.880676 22029 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.881350 22029 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:54.882282 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:54.886487 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:54.887279 21909 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:54.887233 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:54.888466 21982 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 1: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:04:54.890918 22029 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.899322 22119 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:54.900372 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:54.900703 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:54.901515 22081 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:54.901930 21949 leader_election.cc:343] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.903404 22025 tablet_bootstrap.cc:654] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:54.903828 21873 leader_election.cc:343] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.909713 22024 raft_consensus.cc:359] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.910436 22024 raft_consensus.cc:385] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.910706 22024 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.911404 22024 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.913164 21832 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:54.913756 22024 ts_tablet_manager.cc:1434] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.118s	user 0.004s	sys 0.000s
I20260709 13:04:54.915343 22024 tablet_bootstrap.cc:492] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:54.914992 22070 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.918277 22119 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:54.921551 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50590.9us
I20260709 13:04:54.914947 21873 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:54.925076 22127 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.925232 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:54.926008 22127 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.926474 22127 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:54.927733 22127 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:54.920890 21948 consensus_peers.cc:597] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:54.934305 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:54.936743 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:54.945139 22144 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.945776 22144 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:54.958586 21979 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:54.961485 22081 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.963060 22144 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:54.968135 21729 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.977053 21831 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:54.986631 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:54.987514 22119 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.988122 22119 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:54.990624 21909 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:54.994019 22024 tablet_bootstrap.cc:654] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.000459 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:54.989809 22119 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.006049 22078 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.007663 22078 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:55.010392 22078 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.029135 22023 tablet_bootstrap.cc:492] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:55.029728 22023 ts_tablet_manager.cc:1403] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.327s	user 0.002s	sys 0.017s
I20260709 13:04:55.033766 22023 raft_consensus.cc:359] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.034700 22023 raft_consensus.cc:385] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.035055 22023 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.035862 22023 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.046105 22023 ts_tablet_manager.cc:1434] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 13:04:55.046870 22023 tablet_bootstrap.cc:492] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:55.052465 22025 tablet_bootstrap.cc:492] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:55.053090 22025 ts_tablet_manager.cc:1403] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.236s	user 0.006s	sys 0.025s
I20260709 13:04:55.056463 22025 raft_consensus.cc:359] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.057632 22025 raft_consensus.cc:385] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.057857 22025 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.059927 22025 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.061076 22127 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.061851 22025 ts_tablet_manager.cc:1434] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:04:55.061574 22127 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.062681 22024 tablet_bootstrap.cc:492] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:55.062872 22025 tablet_bootstrap.cc:492] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:55.063010 22024 ts_tablet_manager.cc:1403] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.149s	user 0.027s	sys 0.009s
I20260709 13:04:55.066182 22127 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.068390 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:55.069972 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.071389 22024 raft_consensus.cc:359] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.072301 22024 raft_consensus.cc:385] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.072664 22024 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
W20260709 13:04:55.071835 21873 leader_election.cc:343] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.073829 21832 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:55.074744 22024 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.075496 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:55.076638 22127 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.076924 22024 ts_tablet_manager.cc:1434] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:04:55.077216 22025 tablet_bootstrap.cc:654] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.077008 22127 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.078236 22024 tablet_bootstrap.cc:492] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:55.078711 22127 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.087761 22127 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.090548 22127 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.092921 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:55.094846 21832 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.095115 22024 tablet_bootstrap.cc:654] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.093878 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:55.099298 22023 tablet_bootstrap.cc:654] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:55.100059 21873 leader_election.cc:343] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.106338 21832 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:55.107478 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:55.108520 22081 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.108986 22081 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:55.109800 22025 tablet_bootstrap.cc:492] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:55.110343 22025 ts_tablet_manager.cc:1403] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.004s
I20260709 13:04:55.109881 22081 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.113348 22025 raft_consensus.cc:359] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.115041 22023 tablet_bootstrap.cc:492] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:55.115775 22023 ts_tablet_manager.cc:1403] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.000s
I20260709 13:04:55.115878 21731 catalog_manager.cc:5697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.114125 22025 raft_consensus.cc:385] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.117286 22025 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.118043 22025 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.120519 21731 catalog_manager.cc:5697] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.130960 22024 tablet_bootstrap.cc:492] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:55.131446 22024 ts_tablet_manager.cc:1403] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.002s
I20260709 13:04:55.133476 22025 ts_tablet_manager.cc:1434] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:04:55.136377 22025 tablet_bootstrap.cc:492] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:55.136592 22024 raft_consensus.cc:359] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.135061 22023 raft_consensus.cc:359] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.137315 22024 raft_consensus.cc:385] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.137460 22023 raft_consensus.cc:385] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.137670 22024 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.137908 22023 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.139739 22023 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.147473 22023 ts_tablet_manager.cc:1434] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:04:55.148388 22023 tablet_bootstrap.cc:492] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:55.149117 21729 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.142275 22024 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.152594 22024 ts_tablet_manager.cc:1434] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:04:55.152140 21729 catalog_manager.cc:5697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.153472 22024 tablet_bootstrap.cc:492] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:55.154685 22023 tablet_bootstrap.cc:654] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.156278 22025 tablet_bootstrap.cc:654] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.165278 22023 tablet_bootstrap.cc:492] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:55.165729 22023 ts_tablet_manager.cc:1403] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:04:55.168424 22023 raft_consensus.cc:359] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.169097 22023 raft_consensus.cc:385] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.169381 22023 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.170673 22023 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.172101 21728 catalog_manager.cc:5697] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.176327 21730 catalog_manager.cc:5697] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.177918 22024 tablet_bootstrap.cc:654] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.178695 22023 ts_tablet_manager.cc:1434] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:04:55.179627 22023 tablet_bootstrap.cc:492] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:55.185767 22023 tablet_bootstrap.cc:654] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.188022 22025 tablet_bootstrap.cc:492] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:55.188475 22025 ts_tablet_manager.cc:1403] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.052s	user 0.004s	sys 0.006s
I20260709 13:04:55.190500 22024 tablet_bootstrap.cc:492] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:55.190938 22024 ts_tablet_manager.cc:1403] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 13:04:55.191087 22025 raft_consensus.cc:359] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.191748 22025 raft_consensus.cc:385] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.191994 22025 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.192672 22025 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.193392 22024 raft_consensus.cc:359] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.194032 22024 raft_consensus.cc:385] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.194314 22024 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.194692 22025 ts_tablet_manager.cc:1434] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:55.195058 22024 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.195662 22025 tablet_bootstrap.cc:492] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:55.202250 22024 ts_tablet_manager.cc:1434] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:04:55.204424 22025 tablet_bootstrap.cc:654] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.212524 22025 tablet_bootstrap.cc:492] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:55.203214 22024 tablet_bootstrap.cc:492] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:55.212934 22025 ts_tablet_manager.cc:1403] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.005s
I20260709 13:04:55.215710 22023 tablet_bootstrap.cc:492] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:55.216176 22023 ts_tablet_manager.cc:1403] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 13:04:55.217697 22024 tablet_bootstrap.cc:654] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.218400 22144 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.218784 22023 raft_consensus.cc:359] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.218901 22144 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.219506 22023 raft_consensus.cc:385] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.219801 22023 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.220566 22023 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.222391 22025 raft_consensus.cc:359] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.223093 22025 raft_consensus.cc:385] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.223387 22025 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.224071 22025 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.224997 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:55.225770 21909 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:55.226518 22023 ts_tablet_manager.cc:1434] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:04:55.227494 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:55.222826 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.228629 22142 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.229012 22142 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.229338 22142 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:55.230043 21798 leader_election.cc:343] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.234203 22144 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.227495 22023 tablet_bootstrap.cc:492] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:55.243623 22081 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.244107 22081 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.247138 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.247356 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:55.247758 21979 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:55.248965 21873 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:55.249435 22078 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.249739 22081 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.250334 22081 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.250068 22078 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.250723 22081 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.251156 22081 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.252703 22078 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:55.255250 22142 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.258209 22025 ts_tablet_manager.cc:1434] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:04:55.259074 22025 tablet_bootstrap.cc:492] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
W20260709 13:04:55.260478 21875 leader_election.cc:343] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.262070 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:55.262707 21832 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:55.264842 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:55.262594 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:55.265851 22119 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.266256 22119 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.267289 22119 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.266129 21909 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:55.269135 22142 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.270372 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:04:55.271777 21798 leader_election.cc:343] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.272624 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:55.273216 21909 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.275997 22023 tablet_bootstrap.cc:654] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.280367 21909 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:55.281356 22081 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.281569 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:55.283003 22144 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.283490 22144 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:55.284628 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:55.285224 21979 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.277598 22025 tablet_bootstrap.cc:654] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.286154 22119 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.289057 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:55.289611 21832 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.289840 22024 tablet_bootstrap.cc:492] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:55.290318 22024 ts_tablet_manager.cc:1403] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.087s	user 0.022s	sys 0.027s
I20260709 13:04:55.290505 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:55.291122 21907 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.293135 22024 raft_consensus.cc:359] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.294212 22081 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.294770 22119 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:55.294703 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:55.293836 22024 raft_consensus.cc:385] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.295529 22024 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
W20260709 13:04:55.296267 21875 leader_election.cc:343] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.296629 22142 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.297036 21832 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:55.296924 22144 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.297113 22142 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.298557 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:55.299320 22142 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.299759 22119 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.296236 22024 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.300438 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.301575 22119 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:55.302541 22119 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.307417 22024 ts_tablet_manager.cc:1434] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:04:55.308066 22025 tablet_bootstrap.cc:492] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:55.308593 22025 ts_tablet_manager.cc:1403] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.005s
I20260709 13:04:55.308632 22024 tablet_bootstrap.cc:492] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:55.308835 22129 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:55.309568 21798 leader_election.cc:343] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.309335 22129 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.311460 22129 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.311525 22025 raft_consensus.cc:359] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.312300 22025 raft_consensus.cc:385] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.312626 22025 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.312976 21905 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.313462 22025 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.315501 22025 ts_tablet_manager.cc:1434] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:55.316401 22025 tablet_bootstrap.cc:492] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:55.317642 22132 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.318343 22132 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.319108 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.320979 22024 tablet_bootstrap.cc:654] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.321795 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:55.322408 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:55.323091 21831 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:55.323561 21875 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:55.324530 21949 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:55.325714 22078 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.326246 22078 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.326709 22078 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.327400 22025 tablet_bootstrap.cc:654] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.330534 22132 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:55.336977 22078 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.342860 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:55.343680 21909 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
W20260709 13:04:55.341030 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 59553.7us
I20260709 13:04:55.349040 21979 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:55.350864 21907 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:55.353248 21873 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:55.354496 22081 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.354966 22081 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:55.355855 22081 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.356495 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:04:55.358297 21799 leader_election.cc:343] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.358888 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:55.361119 22143 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.378293 22078 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:55.378897 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:55.379794 21832 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.385386 22127 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.389673 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:55.390419 21909 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.396485 22129 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.410665 22023 tablet_bootstrap.cc:492] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:55.411315 22023 ts_tablet_manager.cc:1403] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.184s	user 0.049s	sys 0.025s
I20260709 13:04:55.408025 21730 catalog_manager.cc:5697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.415130 22025 tablet_bootstrap.cc:492] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:55.415552 22025 ts_tablet_manager.cc:1403] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.004s
I20260709 13:04:55.416199 22024 tablet_bootstrap.cc:492] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:55.416752 22024 ts_tablet_manager.cc:1403] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.000s
I20260709 13:04:55.428738 22078 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.429037 22024 raft_consensus.cc:359] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.429777 22024 raft_consensus.cc:385] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.425074 22025 raft_consensus.cc:359] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.432236 22025 raft_consensus.cc:385] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.432586 22025 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.433224 22025 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.430058 22024 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.436324 22024 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.437853 22143 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.438319 22143 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.439566 22024 ts_tablet_manager.cc:1434] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:04:55.440523 22024 tablet_bootstrap.cc:492] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:55.440219 21731 catalog_manager.cc:5697] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.443379 22143 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.446849 22025 ts_tablet_manager.cc:1434] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:04:55.456169 22025 tablet_bootstrap.cc:492] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:55.432108 21832 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:55.459475 22078 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.459939 22078 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.462949 22078 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:55.465972 21949 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:55.449172 21909 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:55.450369 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.468503 21982 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:55.468362 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:55.449438 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:55.475148 21982 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.479746 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:55.479823 22129 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.481020 22143 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.482285 22078 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.482775 22078 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:55.483597 22078 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.487169 22119 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.488245 22144 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.499172 22143 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.499330 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:55.501464 22129 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.504235 21732 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.513736 21948 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:55.515719 22023 raft_consensus.cc:359] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.516546 22023 raft_consensus.cc:385] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.516871 22023 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.525642 22129 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.526074 21982 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.517642 22023 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.538687 22023 ts_tablet_manager.cc:1434] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.127s	user 0.009s	sys 0.000s
I20260709 13:04:55.539505 22023 tablet_bootstrap.cc:492] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:55.554225 22119 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:55.573240 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:55.584098 22142 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.586619 22024 tablet_bootstrap.cc:654] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.589665 21732 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.595682 22128 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:55.605230 22025 tablet_bootstrap.cc:654] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.609355 22023 tablet_bootstrap.cc:654] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.617898 22127 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.645859 22029 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.657883 22142 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.658622 22142 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.663137 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:55.665990 21798 leader_election.cc:343] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.666749 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:55.666962 22142 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:04:55.668820 21799 leader_election.cc:343] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.669416 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:55.673269 22142 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.708223 22023 tablet_bootstrap.cc:492] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:55.708701 22023 ts_tablet_manager.cc:1403] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.169s	user 0.009s	sys 0.000s
I20260709 13:04:55.711341 22023 raft_consensus.cc:359] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.712142 22023 raft_consensus.cc:385] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.712414 22023 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.713263 22023 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.716755 22025 tablet_bootstrap.cc:492] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:55.717190 22025 ts_tablet_manager.cc:1403] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.263s	user 0.023s	sys 0.063s
I20260709 13:04:55.717784 22023 ts_tablet_manager.cc:1434] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:04:55.718783 22023 tablet_bootstrap.cc:492] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:55.740850 22025 raft_consensus.cc:359] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.741583 22025 raft_consensus.cc:385] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.741887 22025 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.744014 22024 tablet_bootstrap.cc:492] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:55.743651 22025 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.744459 22024 ts_tablet_manager.cc:1403] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.304s	user 0.050s	sys 0.032s
I20260709 13:04:55.745810 22025 ts_tablet_manager.cc:1434] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.004s
I20260709 13:04:55.748081 22025 tablet_bootstrap.cc:492] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:55.748624 22023 tablet_bootstrap.cc:654] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:55.749002 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:55.750686 22024 raft_consensus.cc:359] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.755564 22023 tablet_bootstrap.cc:492] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:55.758898 22024 raft_consensus.cc:385] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.759106 22023 ts_tablet_manager.cc:1403] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.005s
I20260709 13:04:55.759231 22024 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.757134 22025 tablet_bootstrap.cc:654] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.760005 22024 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.762290 22024 ts_tablet_manager.cc:1434] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:04:55.763198 22024 tablet_bootstrap.cc:492] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:55.764410 22023 raft_consensus.cc:359] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.765087 22023 raft_consensus.cc:385] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.765455 22023 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.767640 22023 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.769739 22023 ts_tablet_manager.cc:1434] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:04:55.770797 22023 tablet_bootstrap.cc:492] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:55.771299 22024 tablet_bootstrap.cc:654] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.771286 22029 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.778528 22023 tablet_bootstrap.cc:654] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.783134 22025 tablet_bootstrap.cc:492] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:55.783696 22025 ts_tablet_manager.cc:1403] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.007s
I20260709 13:04:55.786226 22025 raft_consensus.cc:359] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.786872 22025 raft_consensus.cc:385] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.787189 22025 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.788961 22025 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.791064 22025 ts_tablet_manager.cc:1434] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:55.791778 22023 tablet_bootstrap.cc:492] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:55.792232 22023 ts_tablet_manager.cc:1403] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:04:55.792586 22025 tablet_bootstrap.cc:492] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:55.794919 22023 raft_consensus.cc:359] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.795642 22023 raft_consensus.cc:385] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.795931 22023 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.796690 22023 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.798926 22023 ts_tablet_manager.cc:1434] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:55.799829 22025 tablet_bootstrap.cc:654] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.800462 22023 tablet_bootstrap.cc:492] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:55.804864 22029 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.805392 22029 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.806802 22023 tablet_bootstrap.cc:654] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.806917 21831 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.808462 22024 tablet_bootstrap.cc:492] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:55.808895 22024 ts_tablet_manager.cc:1403] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.017s
I20260709 13:04:55.809525 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:55.811162 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.811414 22024 raft_consensus.cc:359] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.811748 21982 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:55.812043 22024 raft_consensus.cc:385] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.812319 22024 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.812932 22024 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:55.815599 21875 leader_election.cc:343] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.816761 22024 ts_tablet_manager.cc:1434] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:55.817082 22142 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.817312 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:55.817538 22142 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.818511 22127 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.819161 22127 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.819895 22142 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.820252 22024 tablet_bootstrap.cc:492] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:55.823299 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:55.824191 21904 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:55.849710 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.850394 22128 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:55.851375 21873 leader_election.cc:343] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.850901 22128 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.853972 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.854099 22142 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.854650 22142 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.844135 22081 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.855594 22081 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.855978 22081 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.856828 22142 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.822023 22127 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.857496 22127 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.857949 22127 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.854611 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:55.876283 22127 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.827823 22029 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.878676 22142 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.879199 22142 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.879634 22142 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.873013 22129 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:04:55.897042 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:55.897761 21831 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:55.906262 22081 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:55.911871 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 56920.1us
I20260709 13:04:55.941938 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:55.942646 21831 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:55.949024 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:55.951809 22127 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.952226 22127 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.952605 22127 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.961341 22127 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.962886 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:55.977533 22029 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.978029 22029 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.978461 22029 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.908181 22081 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.989178 22024 tablet_bootstrap.cc:654] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.990535 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:55.993427 22025 tablet_bootstrap.cc:492] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:55.993834 22128 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:55.993861 22025 ts_tablet_manager.cc:1403] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.201s	user 0.032s	sys 0.009s
I20260709 13:04:55.996057 22023 tablet_bootstrap.cc:492] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:55.996476 22023 ts_tablet_manager.cc:1403] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.196s	user 0.015s	sys 0.037s
I20260709 13:04:55.996536 22127 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:55.996778 22025 raft_consensus.cc:359] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:55.997340 21798 leader_election.cc:343] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.997449 22025 raft_consensus.cc:385] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.997963 22025 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.998469 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:55.998704 22025 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.998948 22023 raft_consensus.cc:359] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:55.999809 22029 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.000217 22023 raft_consensus.cc:385] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.000573 22023 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.001163 22023 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.001731 22029 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.002590 22023 ts_tablet_manager.cc:1434] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:04:56.003456 22023 tablet_bootstrap.cc:492] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.003557 21976 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.004999 22025 ts_tablet_manager.cc:1434] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:04:56.005931 22025 tablet_bootstrap.cc:492] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.006440 22183 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.007819 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.009222 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:56.009752 21831 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.013926 22142 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.018954 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:56.019672 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.020398 21907 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:04:56.016410 21831 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:56.016599 22023 tablet_bootstrap.cc:654] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.018257 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:56.027534 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:56.028365 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:56.028463 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:04:56.030622 21875 leader_election.cc:343] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.028785 21834 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.032239 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:56.032969 22129 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.033394 22129 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:56.022691 22142 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.037789 22129 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.039377 22025 tablet_bootstrap.cc:654] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.044171 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:56.044727 21907 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.045524 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:56.046548 21834 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:56.049643 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:56.051671 21907 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:56.036291 21982 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.053906 22143 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:04:56.055924 22127 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:56.068785 21873 leader_election.cc:343] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:56.071807 21873 leader_election.cc:343] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.071700 21798 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:56.073462 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:56.074070 22127 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:56.074527 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:56.075232 22127 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.078339 22143 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.078912 22143 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:56.078716 22132 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:56.081302 21873 leader_election.cc:343] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.079825 22143 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.084019 22024 tablet_bootstrap.cc:492] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:56.084462 22024 ts_tablet_manager.cc:1403] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.264s	user 0.009s	sys 0.013s
I20260709 13:04:56.086237 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:56.087414 22119 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.087224 22024 raft_consensus.cc:359] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.088053 22024 raft_consensus.cc:385] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.088305 22024 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.088495 22132 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.088891 22024 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.099226 22143 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.111439 22024 ts_tablet_manager.cc:1434] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:04:56.112542 22024 tablet_bootstrap.cc:492] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
W20260709 13:04:56.113234 21798 leader_election.cc:343] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.114301 22132 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:56.129345 22025 tablet_bootstrap.cc:492] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.129719 22025 ts_tablet_manager.cc:1403] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.007s
I20260709 13:04:56.134999 22144 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.140452 22023 tablet_bootstrap.cc:492] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.140977 22023 ts_tablet_manager.cc:1403] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.138s	user 0.008s	sys 0.006s
I20260709 13:04:56.145208 22025 raft_consensus.cc:359] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.146618 22025 raft_consensus.cc:385] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.147135 22025 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.145203 22024 tablet_bootstrap.cc:654] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.146510 21730 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.148999 22025 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.156705 22025 ts_tablet_manager.cc:1434] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.004s
I20260709 13:04:56.157666 22025 tablet_bootstrap.cc:492] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.155490 22119 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.158303 22119 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.158582 22023 raft_consensus.cc:359] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.159282 22023 raft_consensus.cc:385] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.159576 22023 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.160329 22023 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.166613 22023 ts_tablet_manager.cc:1434] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:04:56.167685 22023 tablet_bootstrap.cc:492] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.192514 22128 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.195225 22128 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.197222 22128 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:56.188105 22119 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:56.205267 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:56.207751 22025 tablet_bootstrap.cc:654] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:56.206909 21949 leader_election.cc:343] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.208869 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:56.216634 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.217434 21909 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:56.219538 21982 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:56.220305 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:04:56.221536 21949 leader_election.cc:343] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.224413 21834 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.228258 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:56.229013 21907 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:56.229519 22119 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.229873 22119 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.230247 22119 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.230033 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:56.231258 22129 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.231730 22129 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:56.232602 22129 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.236832 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:56.236779 22119 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.239571 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:04:56.240918 21949 leader_election.cc:343] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.241458 22023 tablet_bootstrap.cc:654] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.241788 22119 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:56.245519 22138 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.246038 22138 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.246512 22138 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.249536 22024 tablet_bootstrap.cc:492] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:56.253512 22024 ts_tablet_manager.cc:1403] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.016s
I20260709 13:04:56.256032 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:56.258191 21909 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.260042 22138 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.266319 22023 tablet_bootstrap.cc:492] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.263890 22024 raft_consensus.cc:359] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.266734 22024 raft_consensus.cc:385] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.266737 22023 ts_tablet_manager.cc:1403] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.007s
I20260709 13:04:56.266949 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:56.267309 22024 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.267613 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:56.266918 22138 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:04:56.268857 21949 leader_election.cc:343] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.268232 22024 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.268186 21907 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.270999 22024 ts_tablet_manager.cc:1434] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:56.272761 22024 tablet_bootstrap.cc:492] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:56.269661 22023 raft_consensus.cc:359] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.276285 22023 raft_consensus.cc:385] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.276578 22023 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.276643 21907 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:56.277598 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:56.279978 22128 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.280417 22128 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:56.281204 22128 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.285377 21909 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:56.286463 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:56.287446 22119 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.287884 22119 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:56.288640 22119 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.292841 22023 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.293258 22183 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.293713 22183 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.294868 22025 tablet_bootstrap.cc:492] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.295020 22023 ts_tablet_manager.cc:1434] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:04:56.295317 22025 ts_tablet_manager.cc:1403] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.008s
I20260709 13:04:56.295643 22183 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:56.295889 22023 tablet_bootstrap.cc:492] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.297116 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:56.297833 21834 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:56.297909 22025 raft_consensus.cc:359] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.298728 22025 raft_consensus.cc:385] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.299027 22025 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.300169 22025 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.300611 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.302564 22025 ts_tablet_manager.cc:1434] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:04:56.302968 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:56.303491 22025 tablet_bootstrap.cc:492] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.303872 22183 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.302459 21730 catalog_manager.cc:5697] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.308663 22023 tablet_bootstrap.cc:654] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.307952 21730 catalog_manager.cc:5697] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.312913 22183 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.314234 22025 tablet_bootstrap.cc:654] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.315708 22024 tablet_bootstrap.cc:654] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.331713 21732 catalog_manager.cc:5697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.335693 22023 tablet_bootstrap.cc:492] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.336123 22023 ts_tablet_manager.cc:1403] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.019s
I20260709 13:04:56.337919 22023 raft_consensus.cc:359] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.338600 22023 raft_consensus.cc:385] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.338932 22023 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.340749 22023 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.343335 21728 catalog_manager.cc:5697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.344724 22023 ts_tablet_manager.cc:1434] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:04:56.345767 22023 tablet_bootstrap.cc:492] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.366104 22023 tablet_bootstrap.cc:654] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.369066 22024 tablet_bootstrap.cc:492] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:56.369880 22024 ts_tablet_manager.cc:1403] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.002s
I20260709 13:04:56.372817 22024 raft_consensus.cc:359] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.373602 22024 raft_consensus.cc:385] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.373883 22024 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.375123 22024 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.376317 22025 tablet_bootstrap.cc:492] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.376845 22025 ts_tablet_manager.cc:1403] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.028s
I20260709 13:04:56.377875 22024 ts_tablet_manager.cc:1434] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:04:56.378908 22024 tablet_bootstrap.cc:492] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:56.379487 22025 raft_consensus.cc:359] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.380183 22025 raft_consensus.cc:385] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.380479 22025 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.381138 22025 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.383374 22025 ts_tablet_manager.cc:1434] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:04:56.384438 22025 tablet_bootstrap.cc:492] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.385378 22023 tablet_bootstrap.cc:492] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.385331 22024 tablet_bootstrap.cc:654] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.385931 22023 ts_tablet_manager.cc:1403] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:04:56.384447 21728 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.388849 22023 raft_consensus.cc:359] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.389503 22023 raft_consensus.cc:385] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.389778 22023 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.390514 22023 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.391367 22025 tablet_bootstrap.cc:654] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.397758 22023 ts_tablet_manager.cc:1434] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:04:56.399096 22023 tablet_bootstrap.cc:492] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.402035 22025 tablet_bootstrap.cc:492] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.402508 22025 ts_tablet_manager.cc:1403] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:04:56.405045 22023 tablet_bootstrap.cc:654] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.405565 22025 raft_consensus.cc:359] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.406289 22025 raft_consensus.cc:385] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.406559 22025 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.407665 22025 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.409849 22025 ts_tablet_manager.cc:1434] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:56.410652 22025 tablet_bootstrap.cc:492] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.416270 22025 tablet_bootstrap.cc:654] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.419481 22129 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.430159 22024 tablet_bootstrap.cc:492] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:56.430701 22024 ts_tablet_manager.cc:1403] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.017s
I20260709 13:04:56.432983 22081 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.433434 22024 raft_consensus.cc:359] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.436311 22024 raft_consensus.cc:385] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.439368 22024 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.440354 22024 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.442615 22024 ts_tablet_manager.cc:1434] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:04:56.444000 22023 tablet_bootstrap.cc:492] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.444586 22023 ts_tablet_manager.cc:1403] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.008s
I20260709 13:04:56.447685 22024 tablet_bootstrap.cc:492] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:56.448194 22031 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.448683 22031 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.452679 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.453120 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:56.453904 21982 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:56.455060 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:56.455984 22143 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.457334 22024 tablet_bootstrap.cc:654] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.460872 22031 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.467617 22023 raft_consensus.cc:359] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.468258 22023 raft_consensus.cc:385] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.468506 22023 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.471118 22023 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.472992 22023 ts_tablet_manager.cc:1434] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:04:56.475632 22025 tablet_bootstrap.cc:492] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.476136 22025 ts_tablet_manager.cc:1403] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.015s
I20260709 13:04:56.478642 22025 raft_consensus.cc:359] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.479272 22025 raft_consensus.cc:385] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.479534 22025 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.480059 22023 tablet_bootstrap.cc:492] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.480304 22025 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.482527 22025 ts_tablet_manager.cc:1434] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:56.483351 22025 tablet_bootstrap.cc:492] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.488950 22023 tablet_bootstrap.cc:654] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.490149 22025 tablet_bootstrap.cc:654] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.496352 22031 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.497167 22031 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.500835 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.501621 21909 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:56.503144 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:56.504235 22142 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.504681 22142 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.505219 22142 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.505511 22031 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.507206 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:56.507819 21978 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:56.508844 22025 tablet_bootstrap.cc:492] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.509303 22025 ts_tablet_manager.cc:1403] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 13:04:56.512499 22025 raft_consensus.cc:359] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.513242 22025 raft_consensus.cc:385] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.513568 22025 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.514834 22025 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.516696 22023 tablet_bootstrap.cc:492] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.517017 22025 ts_tablet_manager.cc:1434] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:56.517118 22023 ts_tablet_manager.cc:1403] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.007s
I20260709 13:04:56.517912 22025 tablet_bootstrap.cc:492] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.519496 22023 raft_consensus.cc:359] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.520112 22023 raft_consensus.cc:385] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.523279 22023 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.524494 22025 tablet_bootstrap.cc:654] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.524228 22023 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.504642 22143 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:56.522921 21798 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:56.526275 22023 ts_tablet_manager.cc:1434] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:56.524641 22142 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.530941 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:56.531503 21978 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.531574 22142 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.533089 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:56.533666 21909 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.538483 21978 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:56.531471 22023 tablet_bootstrap.cc:492] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.539832 21798 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:56.541204 22143 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.541738 22143 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:56.542683 22143 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.547195 22023 tablet_bootstrap.cc:654] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.541705 21909 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:56.552999 22024 tablet_bootstrap.cc:492] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:56.553462 22024 ts_tablet_manager.cc:1403] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.106s	user 0.033s	sys 0.032s
I20260709 13:04:56.557808 22024 raft_consensus.cc:359] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.558235 22142 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.558552 22024 raft_consensus.cc:385] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.558876 22024 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.558820 22142 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.559862 22023 tablet_bootstrap.cc:492] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.558100 22025 tablet_bootstrap.cc:492] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.560411 22023 ts_tablet_manager.cc:1403] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.005s
I20260709 13:04:56.560811 22025 ts_tablet_manager.cc:1403] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.004s
I20260709 13:04:56.562825 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:56.563107 22142 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.563309 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.563962 21909 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
W20260709 13:04:56.564074 21798 leader_election.cc:343] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.563937 22024 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.565132 22023 raft_consensus.cc:359] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.565325 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:56.565753 22023 raft_consensus.cc:385] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.566046 22023 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.566433 22142 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.566819 22142 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.566708 22023 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.567338 22142 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.572384 22023 ts_tablet_manager.cc:1434] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:04:56.573246 22023 tablet_bootstrap.cc:492] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.577540 22142 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.578676 21978 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.580128 22025 raft_consensus.cc:359] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.580806 22025 raft_consensus.cc:385] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.581832 22025 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.581252 22024 ts_tablet_manager.cc:1434] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:04:56.582301 21730 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.583556 22024 tablet_bootstrap.cc:492] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:56.585807 22025 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.586838 22142 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.587847 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:56.588730 22025 ts_tablet_manager.cc:1434] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:04:56.589255 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:56.589593 22025 tablet_bootstrap.cc:492] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
W20260709 13:04:56.589737 21798 leader_election.cc:343] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.589838 21909 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.592196 22029 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.592844 22029 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.593657 22199 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.597062 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:56.598590 21875 leader_election.cc:343] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.599642 22029 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.600131 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:56.601392 21873 leader_election.cc:343] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.601804 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:56.602799 22029 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.603160 22023 tablet_bootstrap.cc:654] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.608960 22119 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.609400 22119 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.611346 22119 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:56.612540 22024 tablet_bootstrap.cc:654] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.612712 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.613320 21907 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:56.614413 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:56.615119 22128 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.615463 22128 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.615811 22128 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.616479 22025 tablet_bootstrap.cc:654] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.615339 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:56.622977 21834 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:56.622255 21909 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:56.636878 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:56.637912 22143 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.638393 22143 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:56.639252 22128 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.640121 22143 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.643232 22142 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.648167 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:56.648712 21832 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.649119 22081 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.649538 22081 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.651530 22081 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.653275 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:56.653877 21831 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:56.653877 22128 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:56.655388 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:56.655646 21832 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:56.656810 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:56.656982 22199 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.657333 22199 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.657668 22199 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.657822 22128 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.659017 22128 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:56.659852 22128 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.661662 22025 tablet_bootstrap.cc:492] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.662300 22025 ts_tablet_manager.cc:1403] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.003s
I20260709 13:04:56.667155 22023 tablet_bootstrap.cc:492] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.667773 22023 ts_tablet_manager.cc:1403] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.013s
I20260709 13:04:56.672214 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:56.673975 22023 raft_consensus.cc:359] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.675016 22023 raft_consensus.cc:385] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.675420 22023 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.676180 22023 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.672241 22024 tablet_bootstrap.cc:492] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
W20260709 13:04:56.677350 21873 leader_election.cc:343] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.677920 22024 ts_tablet_manager.cc:1403] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.014s
I20260709 13:04:56.680224 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:56.680987 22024 raft_consensus.cc:359] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.682186 22024 raft_consensus.cc:385] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.682493 22024 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.682904 21907 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.683190 22025 raft_consensus.cc:359] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.683883 22025 raft_consensus.cc:385] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.684163 22025 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.684918 22025 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.685537 21732 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.686427 22199 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.687126 22025 ts_tablet_manager.cc:1434] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 13:04:56.688082 22025 tablet_bootstrap.cc:492] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.688649 22199 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.694420 22024 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.696169 21907 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:56.698493 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:56.700330 22029 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:56.701828 21873 leader_election.cc:343] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.703027 22024 ts_tablet_manager.cc:1434] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:04:56.703348 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:56.703912 21834 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.705649 22023 ts_tablet_manager.cc:1434] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.037s	user 0.000s	sys 0.008s
I20260709 13:04:56.706614 22023 tablet_bootstrap.cc:492] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
W20260709 13:04:56.711383 21949 consensus_peers.cc:597] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:56.703944 22024 tablet_bootstrap.cc:492] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:56.721487 22024 tablet_bootstrap.cc:654] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.722077 22025 tablet_bootstrap.cc:654] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.727155 22023 tablet_bootstrap.cc:654] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.731742 22081 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.736967 22129 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.737715 22129 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.739543 22024 tablet_bootstrap.cc:492] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:56.739782 22129 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.740028 22024 ts_tablet_manager.cc:1403] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.003s
I20260709 13:04:56.741788 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:56.742303 22138 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.743189 22138 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.746593 22023 tablet_bootstrap.cc:492] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.742852 22025 tablet_bootstrap.cc:492] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.746711 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:56.747094 22023 ts_tablet_manager.cc:1403] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.004s
I20260709 13:04:56.747393 22138 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:04:56.748020 21949 leader_election.cc:343] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:56.744331 21875 leader_election.cc:343] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.748407 22025 ts_tablet_manager.cc:1403] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.001s
I20260709 13:04:56.742659 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:56.747933 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.748963 21982 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:56.749330 21907 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:56.749791 22023 raft_consensus.cc:359] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.750530 22023 raft_consensus.cc:385] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.750440 21948 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:56.751031 22023 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.751736 21834 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:56.751716 22023 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.752995 22128 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.753398 22128 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.743331 22024 raft_consensus.cc:359] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.753732 22128 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.754026 22024 raft_consensus.cc:385] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.754347 22024 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.755036 22024 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.750311 21873 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:56.757376 22024 ts_tablet_manager.cc:1434] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:56.758399 22024 tablet_bootstrap.cc:492] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:56.759264 22129 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.759668 22129 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.760031 22129 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.765419 22023 ts_tablet_manager.cc:1434] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:04:56.766470 22023 tablet_bootstrap.cc:492] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.753032 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:56.767419 22127 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.767906 22127 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:56.768764 22127 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.770514 22143 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.770937 22143 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.773999 22143 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.774370 22128 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.775065 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:56.775669 21982 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:56.776796 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:56.777127 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:56.777619 22143 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.777969 22143 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.778324 22143 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.778577 22023 tablet_bootstrap.cc:654] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:56.778585 21949 leader_election.cc:343] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.779603 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.780269 21907 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:56.775777 22024 tablet_bootstrap.cc:654] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.770228 21732 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.776695 22129 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.784848 22143 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.786481 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:56.789748 21982 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 1: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:04:56.790897 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:56.791654 22129 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.791664 21909 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.797160 22023 tablet_bootstrap.cc:492] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.796996 22025 raft_consensus.cc:359] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.797714 22023 ts_tablet_manager.cc:1403] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 13:04:56.799597 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:56.801329 22023 raft_consensus.cc:359] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.802884 22023 raft_consensus.cc:385] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.803568 22023 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.802181 22029 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.802239 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:56.804728 22031 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.805296 22031 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.806672 21909 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:56.807544 22031 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.807720 22024 tablet_bootstrap.cc:492] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:56.808277 22024 ts_tablet_manager.cc:1403] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.006s
I20260709 13:04:56.810454 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:56.812064 21798 leader_election.cc:343] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.812522 21832 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.813722 22023 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.816124 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:56.810822 22024 raft_consensus.cc:359] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.816749 21978 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.817749 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:56.818681 22031 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.819073 22143 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.819322 22031 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:56.820250 22031 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.805299 21907 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:56.821559 22132 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.822387 22128 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:56.797734 22025 raft_consensus.cc:385] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.816743 22024 raft_consensus.cc:385] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.825546 22024 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.825133 22025 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.826176 22024 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.826696 22025 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.827567 21831 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.828182 22024 ts_tablet_manager.cc:1434] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 13:04:56.829035 22024 tablet_bootstrap.cc:492] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:56.816342 22023 ts_tablet_manager.cc:1434] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:56.831266 22023 tablet_bootstrap.cc:492] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.834306 21978 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:56.842053 21948 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:56.844146 22132 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.844203 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:56.845103 21907 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:56.846575 21799 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:56.847738 22031 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.848192 22031 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.848594 22031 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.849042 21831 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:56.852551 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:56.853663 22029 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.854334 22029 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:04:56.857000 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:56.857594 22029 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.866194 22025 ts_tablet_manager.cc:1434] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.001s
I20260709 13:04:56.867129 22025 tablet_bootstrap.cc:492] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.905525 21730 catalog_manager.cc:5697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.909572 21730 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.913420 22025 tablet_bootstrap.cc:654] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.910677 22132 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:56.907979 22031 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.925529 22031 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.927006 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:56.927618 22023 tablet_bootstrap.cc:654] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.927892 22024 tablet_bootstrap.cc:654] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.929670 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:56.929826 22138 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.930296 21907 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:56.928436 21798 leader_election.cc:343] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.945163 22199 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.946400 22199 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.948480 22199 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:56.954748 22025 tablet_bootstrap.cc:492] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:56.955205 22025 ts_tablet_manager.cc:1403] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.002s
I20260709 13:04:56.956063 22023 tablet_bootstrap.cc:492] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:56.956483 22023 ts_tablet_manager.cc:1403] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.001s
I20260709 13:04:56.957490 22024 tablet_bootstrap.cc:492] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:56.957870 22024 ts_tablet_manager.cc:1403] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.000s
I20260709 13:04:56.957634 22025 raft_consensus.cc:359] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.958323 22025 raft_consensus.cc:385] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.958587 22025 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.958814 22023 raft_consensus.cc:359] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.959507 22023 raft_consensus.cc:385] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.959198 22025 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.959764 22023 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.959853 22024 raft_consensus.cc:359] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.960496 22024 raft_consensus.cc:385] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.960636 22025 ts_tablet_manager.cc:1434] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:56.960376 22023 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.960781 22024 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.961526 22025 tablet_bootstrap.cc:492] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:56.961455 22024 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:56.962342 22023 ts_tablet_manager.cc:1434] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:56.963109 22024 ts_tablet_manager.cc:1434] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:56.963147 22023 tablet_bootstrap.cc:492] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:56.963841 22024 tablet_bootstrap.cc:492] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:56.967778 22025 tablet_bootstrap.cc:654] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.968076 22024 tablet_bootstrap.cc:654] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.015736 22127 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.017246 22127 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.013916 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:57.034782 21732 catalog_manager.cc:5697] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:57.039856 21873 leader_election.cc:343] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.047647 22142 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.050539 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:57.053740 21875 leader_election.cc:343] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.054358 21875 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:57.055406 22127 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.057003 22199 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.061064 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:57.061829 22031 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:57.062790 21873 leader_election.cc:343] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.069836 22023 tablet_bootstrap.cc:654] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.070613 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:57.080008 21875 leader_election.cc:343] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.080466 21875 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:57.081607 22199 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.083184 22138 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.084882 22142 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.069011 21907 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:57.086342 22142 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.090294 22142 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.092005 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:57.102697 21799 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:57.104038 22138 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.104647 22031 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.105283 22031 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:57.106410 22031 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:57.108098 21798 leader_election.cc:343] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.104715 22138 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.127674 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:57.127832 22138 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:57.128983 22023 tablet_bootstrap.cc:492] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:57.138695 22023 ts_tablet_manager.cc:1403] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.176s	user 0.031s	sys 0.013s
I20260709 13:04:57.143011 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.144024 21908 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:04:57.146056 21948 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:57.146936 22132 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.162575 22128 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.163290 22128 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.164891 22023 raft_consensus.cc:359] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.165566 22023 raft_consensus.cc:385] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.165848 22023 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.166683 22128 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:57.167520 22023 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.160933 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.172405 21907 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:57.176784 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:57.178452 22025 tablet_bootstrap.cc:492] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:57.179045 22025 ts_tablet_manager.cc:1403] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.218s	user 0.013s	sys 0.010s
I20260709 13:04:57.180305 22132 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.181680 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:57.183063 21832 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:57.183770 22023 ts_tablet_manager.cc:1434] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.005s
W20260709 13:04:57.156035 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 46743.9us
I20260709 13:04:57.178072 22144 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.193053 22144 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.193423 22144 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.194391 22023 tablet_bootstrap.cc:492] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:57.198293 22142 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.199043 22142 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.181945 22025 raft_consensus.cc:359] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.201485 22025 raft_consensus.cc:385] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.201740 22025 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.218955 22024 tablet_bootstrap.cc:492] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:57.219656 22024 ts_tablet_manager.cc:1403] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.256s	user 0.025s	sys 0.025s
I20260709 13:04:57.255362 22025 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.266752 22142 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.273458 22143 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:57.277093 22144 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.280504 22025 ts_tablet_manager.cc:1434] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.101s	user 0.012s	sys 0.010s
I20260709 13:04:57.283776 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:57.283933 22024 raft_consensus.cc:359] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.284914 22024 raft_consensus.cc:385] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.285205 22024 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.287441 22024 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.289163 22024 ts_tablet_manager.cc:1434] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.002s
I20260709 13:04:57.290809 22023 tablet_bootstrap.cc:654] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.292184 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.292390 22270 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.292194 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.293305 22031 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.293730 21907 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:57.295698 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:57.303699 22025 tablet_bootstrap.cc:492] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:57.304186 22024 tablet_bootstrap.cc:492] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:57.309219 22132 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.310490 22144 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.312861 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:57.324014 22143 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.324404 22143 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.324771 22143 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.326205 22273 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.055s
I20260709 13:04:57.327697 21730 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.334415 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:57.335019 21905 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.349184 22132 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.366654 22029 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.368172 22025 tablet_bootstrap.cc:654] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.373415 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:04:57.372249 21798 leader_election.cc:343] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:57.382436 21798 leader_election.cc:343] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.382905 22142 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.383821 22023 tablet_bootstrap.cc:492] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:57.384354 22023 ts_tablet_manager.cc:1403] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.200s	user 0.005s	sys 0.013s
I20260709 13:04:57.387751 22023 raft_consensus.cc:359] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.388411 22023 raft_consensus.cc:385] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.391163 22024 tablet_bootstrap.cc:654] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.388772 22023 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.414836 22132 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.426029 22132 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.391235 21905 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:57.428937 22127 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.429183 22132 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:57.434742 22023 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.437079 22127 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.441401 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:57.442108 21829 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:57.443962 22023 ts_tablet_manager.cc:1434] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.004s
I20260709 13:04:57.446379 22023 tablet_bootstrap.cc:492] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:57.448978 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:57.450059 22274 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.450805 22274 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:57.451870 22274 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.455847 22025 tablet_bootstrap.cc:492] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:57.456427 22025 ts_tablet_manager.cc:1403] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.153s	user 0.026s	sys 0.001s
I20260709 13:04:57.459100 21949 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:57.459985 22273 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.460551 22273 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.398598 22143 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.461508 22273 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.468739 22025 raft_consensus.cc:359] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.472610 22143 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.474306 22025 raft_consensus.cc:385] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.475972 22025 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.481622 22024 tablet_bootstrap.cc:492] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:57.482106 22024 ts_tablet_manager.cc:1403] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.178s	user 0.029s	sys 0.015s
I20260709 13:04:57.492655 22127 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.501060 22273 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.513259 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:57.515787 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:57.516386 21904 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:57.516744 21798 leader_election.cc:343] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.518289 22023 tablet_bootstrap.cc:654] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.520470 22273 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:57.520947 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:57.522631 21831 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.523419 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.524102 21908 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:57.530609 22025 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.533051 22025 ts_tablet_manager.cc:1434] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.000s
I20260709 13:04:57.526721 21904 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:57.534032 22025 tablet_bootstrap.cc:492] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:57.559160 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:57.566273 22142 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.566833 22142 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:57.567833 22142 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.573331 22024 raft_consensus.cc:359] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.574034 22024 raft_consensus.cc:385] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.574326 22024 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.576241 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:57.576757 21908 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.579866 21831 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:57.583002 21949 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:57.584056 22132 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.584511 22132 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:57.585274 22132 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.591689 21908 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:57.596582 22270 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.591198 22024 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.603773 22025 tablet_bootstrap.cc:654] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.634708 22024 ts_tablet_manager.cc:1434] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.152s	user 0.008s	sys 0.000s
I20260709 13:04:57.647207 22024 tablet_bootstrap.cc:492] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:57.651460 22023 tablet_bootstrap.cc:492] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:57.651949 22023 ts_tablet_manager.cc:1403] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.206s	user 0.019s	sys 0.042s
I20260709 13:04:57.646636 21730 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.653411 21730 catalog_manager.cc:5697] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.660435 21976 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.662539 22025 tablet_bootstrap.cc:492] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:57.662273 22023 raft_consensus.cc:359] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.662966 22025 ts_tablet_manager.cc:1403] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.007s
I20260709 13:04:57.663012 22023 raft_consensus.cc:385] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.663483 22023 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.664211 22023 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.665627 22025 raft_consensus.cc:359] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.683013 22025 raft_consensus.cc:385] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.683375 22025 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.687659 22025 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.689749 22025 ts_tablet_manager.cc:1434] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 13:04:57.690795 22025 tablet_bootstrap.cc:492] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
W20260709 13:04:57.695184 21798 consensus_peers.cc:597] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:57.697283 22025 tablet_bootstrap.cc:654] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.698650 22023 ts_tablet_manager.cc:1434] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.003s
I20260709 13:04:57.699492 22024 tablet_bootstrap.cc:654] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.699815 22023 tablet_bootstrap.cc:492] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:57.699774 21728 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.708494 22025 tablet_bootstrap.cc:492] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:57.708923 22025 ts_tablet_manager.cc:1403] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:04:57.713753 22023 tablet_bootstrap.cc:654] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.713519 22025 raft_consensus.cc:359] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.714193 22025 raft_consensus.cc:385] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.714470 22025 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.715322 22025 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.718048 22025 ts_tablet_manager.cc:1434] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:04:57.719261 22025 tablet_bootstrap.cc:492] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:57.728202 22025 tablet_bootstrap.cc:654] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.759889 22023 tablet_bootstrap.cc:492] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:57.760399 22023 ts_tablet_manager.cc:1403] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.037s
I20260709 13:04:57.760609 22024 tablet_bootstrap.cc:492] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:57.761438 22024 ts_tablet_manager.cc:1403] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.122s	user 0.018s	sys 0.022s
I20260709 13:04:57.764240 22024 raft_consensus.cc:359] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.764935 22024 raft_consensus.cc:385] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.765214 22024 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.765516 22023 raft_consensus.cc:359] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.765908 22024 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.766398 22023 raft_consensus.cc:385] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.766841 22023 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.768697 22024 ts_tablet_manager.cc:1434] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:04:57.769788 22024 tablet_bootstrap.cc:492] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:57.769363 22023 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.777043 22024 tablet_bootstrap.cc:654] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.778807 22023 ts_tablet_manager.cc:1434] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:57.779973 22023 tablet_bootstrap.cc:492] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:57.782094 22025 tablet_bootstrap.cc:492] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:57.782534 22025 ts_tablet_manager.cc:1403] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.007s
I20260709 13:04:57.786836 22023 tablet_bootstrap.cc:654] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.788578 22025 raft_consensus.cc:359] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.789237 22025 raft_consensus.cc:385] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.800566 22025 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.789754 22274 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.801546 22274 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.804162 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.807754 22274 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.808828 22024 tablet_bootstrap.cc:492] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:57.808584 22025 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.808941 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:57.809309 22024 ts_tablet_manager.cc:1403] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.019s
I20260709 13:04:57.810503 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:57.811717 22142 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.811998 22024 raft_consensus.cc:359] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.812575 22024 raft_consensus.cc:385] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.812793 22024 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.813369 22024 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.815237 22024 ts_tablet_manager.cc:1434] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:57.816398 22024 tablet_bootstrap.cc:492] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:57.821310 22132 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.821971 22024 tablet_bootstrap.cc:654] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.821827 22132 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.824517 22025 ts_tablet_manager.cc:1434] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:04:57.825721 22025 tablet_bootstrap.cc:492] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:57.827474 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:57.829624 22132 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:57.831705 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.832721 21908 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:04:57.833190 22023 tablet_bootstrap.cc:492] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:57.833806 22023 ts_tablet_manager.cc:1403] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.022s
I20260709 13:04:57.834095 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:57.835065 22132 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.838981 22025 tablet_bootstrap.cc:654] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.842335 22132 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.844405 22025 tablet_bootstrap.cc:492] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:57.844816 22025 ts_tablet_manager.cc:1403] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:04:57.848097 22025 raft_consensus.cc:359] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.848701 22025 raft_consensus.cc:385] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.848950 22025 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.849614 22025 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.852465 22023 raft_consensus.cc:359] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.853449 22023 raft_consensus.cc:385] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.853816 22023 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.854964 21831 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.854701 22023 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.857779 22023 ts_tablet_manager.cc:1434] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:04:57.859756 22023 tablet_bootstrap.cc:492] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:57.859807 22025 ts_tablet_manager.cc:1434] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:04:57.860947 22025 tablet_bootstrap.cc:492] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:57.865737 22023 tablet_bootstrap.cc:654] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.874511 22199 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.874992 22199 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.877650 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:57.878986 21875 leader_election.cc:343] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.879927 22142 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.880702 22129 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.881134 22129 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.880378 22142 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.882941 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:57.884338 21873 leader_election.cc:343] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.884465 22142 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.884763 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:57.885564 22029 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.887197 22129 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.887774 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:57.888223 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.888804 21908 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:57.888248 22024 tablet_bootstrap.cc:492] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:57.889930 22024 ts_tablet_manager.cc:1403] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.025s
W20260709 13:04:57.890121 21798 leader_election.cc:343] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.891213 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:57.891383 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:57.893517 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:57.893435 22024 raft_consensus.cc:359] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.894486 22024 raft_consensus.cc:385] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.894829 22024 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
W20260709 13:04:57.895138 21873 leader_election.cc:343] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.896080 22143 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:57.896179 21875 leader_election.cc:343] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.896492 22143 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.896593 21875 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:57.896850 22143 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.898147 22029 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.899085 22024 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.901940 22199 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.907075 22024 ts_tablet_manager.cc:1434] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:57.903076 22023 tablet_bootstrap.cc:492] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:57.908404 22023 ts_tablet_manager.cc:1403] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.016s
I20260709 13:04:57.911089 22143 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.911708 22023 raft_consensus.cc:359] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.912348 22023 raft_consensus.cc:385] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.912599 22023 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.912858 22132 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.913173 22023 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.913282 22132 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.914767 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:57.915295 21908 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.916764 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:57.917338 21830 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:57.919008 22024 tablet_bootstrap.cc:492] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:57.918798 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:57.920749 22128 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.921072 22128 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.921406 22128 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.925793 22024 tablet_bootstrap.cc:654] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.928793 22023 ts_tablet_manager.cc:1434] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:04:57.929761 22023 tablet_bootstrap.cc:492] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
W20260709 13:04:57.942525 21798 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:57.945320 22128 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.947841 22199 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.948079 22024 tablet_bootstrap.cc:492] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:57.948153 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:57.948594 22024 ts_tablet_manager.cc:1403] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:04:57.948421 22199 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:57.949555 21798 leader_election.cc:343] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.950454 22199 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.952194 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:57.953258 21873 leader_election.cc:343] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.953501 22142 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.953943 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:04:57.954313 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:57.954001 22142 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.954730 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:57.954959 21830 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.954803 22024 raft_consensus.cc:359] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.955430 21832 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:57.955605 22024 raft_consensus.cc:385] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.955919 22024 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.956072 22142 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.956683 22024 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.958240 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.958341 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:57.958633 22024 ts_tablet_manager.cc:1434] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:04:57.959372 22199 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:57.959679 21799 leader_election.cc:343] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.959810 22199 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.959887 22024 tablet_bootstrap.cc:492] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:57.960721 22199 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.962486 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:57.963055 21904 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.962014 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:57.964006 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:57.959882 22132 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:57.966642 22128 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:57.966877 22024 tablet_bootstrap.cc:654] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.966297 22143 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.943562 22023 tablet_bootstrap.cc:654] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:57.969429 21798 leader_election.cc:343] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.969841 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:57.974248 22274 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.975598 21904 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:57.982633 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:57.984047 22025 tablet_bootstrap.cc:654] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.985970 22129 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.990595 22129 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.985430 21908 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:57.985994 22128 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.995157 22129 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:57.995121 22128 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:57.995263 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:57.996874 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:57.997292 22199 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:57.997958 22128 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.000507 22274 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.000582 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:58.001138 22274 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:58.002233 22199 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:58.001953 22274 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.003098 22142 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:58.004621 21875 leader_election.cc:343] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.005604 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:58.006980 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:58.007612 21832 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.008490 22024 tablet_bootstrap.cc:492] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:58.008911 22024 ts_tablet_manager.cc:1403] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.005s
W20260709 13:04:58.001956 21873 leader_election.cc:343] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.011296 22024 raft_consensus.cc:359] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.012163 22024 raft_consensus.cc:385] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.012452 22024 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.013070 22024 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.018002 22024 ts_tablet_manager.cc:1434] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:58.018949 22024 tablet_bootstrap.cc:492] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:58.005954 21830 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
W20260709 13:04:58.026782 21873 leader_election.cc:343] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.027376 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:58.028390 22199 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.031154 22024 tablet_bootstrap.cc:654] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.033816 22025 tablet_bootstrap.cc:492] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:58.034339 22025 ts_tablet_manager.cc:1403] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.174s	user 0.011s	sys 0.011s
I20260709 13:04:58.032073 22023 tablet_bootstrap.cc:492] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:58.036834 22023 ts_tablet_manager.cc:1403] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.004s
I20260709 13:04:58.039710 22025 raft_consensus.cc:359] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.040701 22025 raft_consensus.cc:385] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.041039 22025 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.033691 21832 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:58.041818 22025 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.042647 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:58.043709 22199 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.043797 22025 ts_tablet_manager.cc:1434] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:04:58.044160 22199 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:58.045034 22025 tablet_bootstrap.cc:492] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:58.044997 22199 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.065785 22025 tablet_bootstrap.cc:654] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.066715 22023 raft_consensus.cc:359] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.067377 22023 raft_consensus.cc:385] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.067633 22023 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.068212 22023 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.067934 21732 catalog_manager.cc:5697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.069886 22144 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.074911 22023 ts_tablet_manager.cc:1434] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:04:58.075825 22023 tablet_bootstrap.cc:492] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:58.110291 22024 tablet_bootstrap.cc:492] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:58.110884 22024 ts_tablet_manager.cc:1403] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.092s	user 0.024s	sys 0.033s
I20260709 13:04:58.111637 22025 tablet_bootstrap.cc:492] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:58.112108 22025 ts_tablet_manager.cc:1403] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.000s
I20260709 13:04:58.116968 21732 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:58.118227 22024 raft_consensus.cc:359] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.119194 22024 raft_consensus.cc:385] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.119596 22024 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.120334 22024 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.121042 22023 tablet_bootstrap.cc:654] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.123344 22025 raft_consensus.cc:359] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.124151 22025 raft_consensus.cc:385] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.124792 22025 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.124006 21728 catalog_manager.cc:5697] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.126550 22025 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.128371 22025 ts_tablet_manager.cc:1434] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:04:58.129392 22025 tablet_bootstrap.cc:492] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:58.134764 22024 ts_tablet_manager.cc:1434] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:04:58.160833 22024 tablet_bootstrap.cc:492] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:58.187836 22127 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.188380 22127 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.178961 22142 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:04:58.197198 22023 tablet_bootstrap.cc:492] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:58.197840 22023 ts_tablet_manager.cc:1403] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.122s	user 0.008s	sys 0.017s
I20260709 13:04:58.199836 22025 tablet_bootstrap.cc:654] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.200795 22023 raft_consensus.cc:359] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.201308 22023 raft_consensus.cc:385] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.201526 22023 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.204519 22024 tablet_bootstrap.cc:654] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.204201 22273 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.207391 22273 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.208477 22127 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:58.209120 22132 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.209303 22273 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:58.209403 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:58.210512 21832 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:58.210831 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:58.210500 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:58.211161 22132 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.211496 21831 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:58.212323 21875 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:58.212942 21949 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:58.213238 21907 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:58.213442 22132 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:58.213850 22127 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.214444 22127 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.213951 22132 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.215040 22132 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.215416 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:58.217495 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:58.216027 22132 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.220137 22023 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.215488 22127 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.221613 22270 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.235901 22023 ts_tablet_manager.cc:1434] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.001s
I20260709 13:04:58.235704 22128 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.236843 22023 tablet_bootstrap.cc:492] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:58.239810 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:58.241719 22273 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.244410 22270 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.253713 22270 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:58.257126 22132 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.259155 21982 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 1: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:04:58.289374 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:58.294601 22128 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.311904 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:58.320380 22023 tablet_bootstrap.cc:654] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.320101 22127 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:58.320629 21799 leader_election.cc:343] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.327767 22316 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.327984 21982 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.328418 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:58.328264 22316 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.329149 21979 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 1: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:04:58.330283 22316 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:58.332345 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:58.336001 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:58.336601 21832 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.336695 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:58.337532 21830 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:58.339234 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:58.340016 22129 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.340479 22129 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.342638 22129 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:58.343377 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:04:58.349769 21798 leader_election.cc:343] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.350935 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:58.348474 22316 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.351858 22144 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.333025 22127 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:58.367384 22025 tablet_bootstrap.cc:492] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:58.367862 22025 ts_tablet_manager.cc:1403] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.239s	user 0.011s	sys 0.010s
I20260709 13:04:58.371331 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:58.372515 22025 raft_consensus.cc:359] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.373539 22025 raft_consensus.cc:385] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.349920 22128 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.373924 22025 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.379889 22025 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.375409 22128 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.377338 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:58.379108 22132 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:58.429440 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:58.430130 22024 tablet_bootstrap.cc:492] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:58.430368 21908 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:04:58.430505 22025 ts_tablet_manager.cc:1434] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:04:58.432094 22024 ts_tablet_manager.cc:1403] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.283s	user 0.030s	sys 0.044s
I20260709 13:04:58.434031 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:58.448989 22025 tablet_bootstrap.cc:492] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
W20260709 13:04:58.445483 21875 leader_election.cc:343] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.452150 21949 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:58.454813 22023 tablet_bootstrap.cc:492] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:58.455309 22023 ts_tablet_manager.cc:1403] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.019s
I20260709 13:04:58.455412 21832 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
W20260709 13:04:58.465582 21873 leader_election.cc:343] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.466053 21873 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:58.466791 22029 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.469488 22142 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.469766 22024 raft_consensus.cc:359] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.471797 22024 raft_consensus.cc:385] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.471627 22273 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.473913 22024 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.487263 22024 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.495740 21875 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:58.496347 22025 tablet_bootstrap.cc:654] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.499078 22128 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:58.505066 22029 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.506002 22029 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:58.507151 22029 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.508215 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:58.509022 21905 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:58.510669 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:58.511353 22023 raft_consensus.cc:359] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.516866 22023 raft_consensus.cc:385] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.517272 22023 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.527874 22023 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.533465 22329 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.533987 22329 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.534403 22329 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.545217 22024 ts_tablet_manager.cc:1434] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.001s
I20260709 13:04:58.546106 22024 tablet_bootstrap.cc:492] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:58.514961 22132 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:04:58.553014 22023 ts_tablet_manager.cc:1434] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.001s
I20260709 13:04:58.557044 22023 tablet_bootstrap.cc:492] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:58.566291 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:58.566893 21832 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:58.563768 22316 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.581281 21978 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.584064 22025 tablet_bootstrap.cc:492] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:58.585752 22025 ts_tablet_manager.cc:1403] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.011s
I20260709 13:04:58.588328 22025 raft_consensus.cc:359] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.588619 22329 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.589061 22025 raft_consensus.cc:385] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.589444 22025 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.591352 22025 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.598660 22025 ts_tablet_manager.cc:1434] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:04:58.599627 22025 tablet_bootstrap.cc:492] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:58.604382 22024 tablet_bootstrap.cc:654] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.608395 21728 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.618069 22023 tablet_bootstrap.cc:654] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.619572 22127 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:04:58.632086 22316 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.642908 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:58.643550 21829 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.647399 22319 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:58.648006 22329 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:58.670064 21829 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:58.673377 22025 tablet_bootstrap.cc:654] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.673960 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:58.674609 21908 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.702385 21908 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:58.693974 22029 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:58.686211 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:58.709992 22024 tablet_bootstrap.cc:492] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:58.710477 22024 ts_tablet_manager.cc:1403] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.165s	user 0.017s	sys 0.005s
I20260709 13:04:58.713898 22024 raft_consensus.cc:359] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.714550 22024 raft_consensus.cc:385] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.714799 22024 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.715317 22329 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.715382 22024 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.715898 22329 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:58.716710 22329 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.718273 22024 ts_tablet_manager.cc:1434] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:58.719265 22024 tablet_bootstrap.cc:492] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:58.731878 22025 tablet_bootstrap.cc:492] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:58.732471 22023 tablet_bootstrap.cc:492] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:58.733306 22025 ts_tablet_manager.cc:1403] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.018s
I20260709 13:04:58.733536 22024 tablet_bootstrap.cc:654] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.733646 22023 ts_tablet_manager.cc:1403] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.177s	user 0.023s	sys 0.003s
I20260709 13:04:58.738225 22025 raft_consensus.cc:359] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.740204 22025 raft_consensus.cc:385] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.740525 22025 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.741871 22023 raft_consensus.cc:359] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.742534 22023 raft_consensus.cc:385] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.742901 22023 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.744079 22023 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.747944 22024 tablet_bootstrap.cc:492] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:58.748358 22024 ts_tablet_manager.cc:1403] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.002s
I20260709 13:04:58.750767 22024 raft_consensus.cc:359] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.751366 22024 raft_consensus.cc:385] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.751631 22024 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.752220 22024 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.754956 22199 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.755357 22199 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.757613 22199 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:58.757820 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:58.758541 21829 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:58.758656 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:58.759244 21980 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:58.759850 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:58.760792 22328 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.761229 22328 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.761511 22328 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.760744 22024 ts_tablet_manager.cc:1434] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:04:58.763185 22024 tablet_bootstrap.cc:492] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:58.764849 22025 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.767804 22025 ts_tablet_manager.cc:1434] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:04:58.768563 22024 tablet_bootstrap.cc:654] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.769623 22025 tablet_bootstrap.cc:492] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:58.769657 22329 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.770368 22329 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.772195 22329 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:58.774495 22328 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.775367 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:58.777114 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:58.777616 22025 tablet_bootstrap.cc:654] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.778076 21832 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.778637 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:58.786253 22024 tablet_bootstrap.cc:492] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:58.786681 22024 ts_tablet_manager.cc:1403] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.005s
I20260709 13:04:58.789090 22024 raft_consensus.cc:359] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.789690 22024 raft_consensus.cc:385] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.790539 22023 ts_tablet_manager.cc:1434] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:04:58.792065 22023 tablet_bootstrap.cc:492] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:58.789952 22024 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.794883 22328 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:58.798779 22024 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.800196 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:58.800660 21832 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:58.801347 22025 tablet_bootstrap.cc:492] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:58.806625 21980 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.806843 22025 ts_tablet_manager.cc:1403] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.037s	user 0.024s	sys 0.003s
I20260709 13:04:58.803599 22024 ts_tablet_manager.cc:1434] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
I20260709 13:04:58.807335 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:58.808274 22328 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.808776 22328 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:58.802636 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:58.809768 22328 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.810483 22329 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.811496 22023 tablet_bootstrap.cc:654] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.808291 22024 tablet_bootstrap.cc:492] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:58.819363 22025 raft_consensus.cc:359] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.817001 21728 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:58.825842 22025 raft_consensus.cc:385] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.826244 22025 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.826920 22025 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.829735 22025 ts_tablet_manager.cc:1434] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:04:58.830770 22025 tablet_bootstrap.cc:492] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:58.816906 21980 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:58.836809 22025 tablet_bootstrap.cc:654] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.837458 22023 tablet_bootstrap.cc:492] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:58.837960 22023 ts_tablet_manager.cc:1403] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.004s
I20260709 13:04:58.841748 22023 raft_consensus.cc:359] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.842696 22023 raft_consensus.cc:385] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.843117 22023 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.844417 22023 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.848196 22023 ts_tablet_manager.cc:1434] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:04:58.849917 22023 tablet_bootstrap.cc:492] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:58.849824 21731 catalog_manager.cc:5697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.856011 22024 tablet_bootstrap.cc:654] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.857031 22023 tablet_bootstrap.cc:654] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.861972 22025 tablet_bootstrap.cc:492] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:58.862519 22025 ts_tablet_manager.cc:1403] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.004s
I20260709 13:04:58.864305 22023 tablet_bootstrap.cc:492] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:58.864979 22023 ts_tablet_manager.cc:1403] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.015s	user 0.003s	sys 0.008s
I20260709 13:04:58.865998 22025 raft_consensus.cc:359] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.867071 22025 raft_consensus.cc:385] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.867466 22025 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.867745 22023 raft_consensus.cc:359] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.868992 22023 raft_consensus.cc:385] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.869498 22023 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.868363 22025 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.870482 22023 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.871658 22025 ts_tablet_manager.cc:1434] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:58.872956 22023 ts_tablet_manager.cc:1434] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:58.872959 22025 tablet_bootstrap.cc:492] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:58.874138 22023 tablet_bootstrap.cc:492] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:58.879245 22025 tablet_bootstrap.cc:654] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.881705 22023 tablet_bootstrap.cc:654] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.887019 22024 tablet_bootstrap.cc:492] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:58.887425 22024 ts_tablet_manager.cc:1403] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.007s
I20260709 13:04:58.890928 22023 tablet_bootstrap.cc:492] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:58.891320 22023 ts_tablet_manager.cc:1403] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:04:58.895134 22025 tablet_bootstrap.cc:492] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:58.895596 22025 ts_tablet_manager.cc:1403] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:04:58.896823 22023 raft_consensus.cc:359] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.897570 22023 raft_consensus.cc:385] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.897356 22024 raft_consensus.cc:359] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.897933 22023 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.898097 22024 raft_consensus.cc:385] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.900425 22024 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.900141 22025 raft_consensus.cc:359] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.900602 22023 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.901068 22024 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.901425 22025 raft_consensus.cc:385] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.901752 22025 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.902439 22025 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.903712 22024 ts_tablet_manager.cc:1434] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:58.904529 22025 ts_tablet_manager.cc:1434] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:04:58.905061 22024 tablet_bootstrap.cc:492] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:58.905754 22025 tablet_bootstrap.cc:492] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:58.909844 22023 ts_tablet_manager.cc:1434] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:04:58.916465 22023 tablet_bootstrap.cc:492] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:58.920686 22025 tablet_bootstrap.cc:654] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.910991 22024 tablet_bootstrap.cc:654] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.911074 22328 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.922905 22023 tablet_bootstrap.cc:654] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.923162 22328 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.925424 22328 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:58.927423 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:58.929301 21875 leader_election.cc:343] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.933760 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:58.936690 21873 leader_election.cc:343] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.937306 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:58.939446 22127 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.966346 21976 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.977777 22025 tablet_bootstrap.cc:492] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:58.978333 22025 ts_tablet_manager.cc:1403] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.073s	user 0.026s	sys 0.036s
I20260709 13:04:58.979609 22024 tablet_bootstrap.cc:492] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:58.980145 22024 ts_tablet_manager.cc:1403] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.014s
I20260709 13:04:58.981118 22025 raft_consensus.cc:359] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.981835 22025 raft_consensus.cc:385] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.982182 22025 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.983042 22025 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.979645 22023 tablet_bootstrap.cc:492] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:58.983196 22024 raft_consensus.cc:359] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:58.984020 22024 raft_consensus.cc:385] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.984046 22023 ts_tablet_manager.cc:1403] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.068s	user 0.036s	sys 0.020s
I20260709 13:04:58.984549 22024 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.985318 22025 ts_tablet_manager.cc:1434] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:58.986562 22025 tablet_bootstrap.cc:492] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:58.992902 22025 tablet_bootstrap.cc:654] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.001845 22024 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.011962 22024 ts_tablet_manager.cc:1434] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:04:59.013484 22024 tablet_bootstrap.cc:492] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:59.024040 22199 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.026566 22023 raft_consensus.cc:359] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.027297 22023 raft_consensus.cc:385] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.027587 22023 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.028285 22023 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.030589 22023 ts_tablet_manager.cc:1434] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:04:59.031566 22023 tablet_bootstrap.cc:492] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:59.036540 22025 tablet_bootstrap.cc:492] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:59.037014 22025 ts_tablet_manager.cc:1403] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.032s
W20260709 13:04:59.037459 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 62012.2us
I20260709 13:04:59.038380 22023 tablet_bootstrap.cc:654] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.039705 22024 tablet_bootstrap.cc:654] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.039412 22025 raft_consensus.cc:359] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.043234 22025 raft_consensus.cc:385] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.043516 22025 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.044207 22025 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.046196 22025 ts_tablet_manager.cc:1434] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 13:04:59.062839 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:59.061697 22328 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.065364 22024 tablet_bootstrap.cc:492] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:59.065827 22024 ts_tablet_manager.cc:1403] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.004s
I20260709 13:04:59.064808 22328 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.069432 22024 raft_consensus.cc:359] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.070055 22024 raft_consensus.cc:385] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.070338 22024 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.070937 22024 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.072671 22024 ts_tablet_manager.cc:1434] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:04:59.073637 22024 tablet_bootstrap.cc:492] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:59.076601 22127 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.079052 22024 tablet_bootstrap.cc:654] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.084743 22328 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.085470 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:59.086061 21831 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:59.087596 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:59.099963 22025 tablet_bootstrap.cc:492] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:59.109740 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:59.110527 21979 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:59.117568 22029 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.117978 22029 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.118350 22029 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.118568 22025 tablet_bootstrap.cc:654] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.128551 22025 tablet_bootstrap.cc:492] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:59.128980 22025 ts_tablet_manager.cc:1403] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:04:59.136026 22143 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.136626 22143 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.136726 22025 raft_consensus.cc:359] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.137609 22025 raft_consensus.cc:385] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.137989 22025 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.138764 22025 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.140297 22025 ts_tablet_manager.cc:1434] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:04:59.141228 22025 tablet_bootstrap.cc:492] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:59.143280 22024 tablet_bootstrap.cc:492] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:59.143862 22024 ts_tablet_manager.cc:1403] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.001s
I20260709 13:04:59.174531 22270 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.175124 22025 tablet_bootstrap.cc:654] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.174652 22029 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.175836 22331 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.176401 22331 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.179881 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:59.180116 22331 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:59.180689 21829 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:59.175351 22270 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.182312 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:59.183384 22316 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.183792 22316 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.184171 22316 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.185184 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:59.187052 21798 leader_election.cc:343] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.189288 22143 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.191144 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:59.192792 21798 leader_election.cc:343] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.194187 22270 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.198910 22142 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.199532 22142 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.201268 22316 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.202023 22142 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.204080 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:04:59.219666 21798 leader_election.cc:343] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.171725 22024 raft_consensus.cc:359] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.211691 22025 tablet_bootstrap.cc:492] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:59.220386 22024 raft_consensus.cc:385] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.220618 22025 ts_tablet_manager.cc:1403] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.002s
I20260709 13:04:59.220938 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:59.221598 21829 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.223865 22025 raft_consensus.cc:359] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.224485 22025 raft_consensus.cc:385] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.224745 22025 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.220830 22024 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.228818 22024 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.229601 21829 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:59.230705 22024 ts_tablet_manager.cc:1434] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.001s
I20260709 13:04:59.229178 22025 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.231292 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:59.231874 22024 tablet_bootstrap.cc:492] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:59.232492 22128 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.232985 22128 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:59.233726 22128 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.234817 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.236056 21905 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:59.236356 22025 ts_tablet_manager.cc:1434] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:04:59.237270 22025 tablet_bootstrap.cc:492] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:59.238179 22199 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.238678 22199 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.240715 22199 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.242688 22024 tablet_bootstrap.cc:654] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.246554 22142 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.247048 22142 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.247282 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:59.247977 21831 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:59.249222 22142 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.251652 22143 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.252111 22143 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.254331 22143 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.253978 22331 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.255416 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:59.256229 21979 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:59.257500 22025 tablet_bootstrap.cc:654] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.257501 21875 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:59.262063 22129 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.262631 22129 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.264907 22129 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.267671 22375 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.268040 22375 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.269701 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:59.268359 22375 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.268491 21798 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:59.275537 22143 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.275887 22143 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.276281 22143 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.280707 22024 tablet_bootstrap.cc:492] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:59.281297 22024 ts_tablet_manager.cc:1403] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.016s
I20260709 13:04:59.283892 22143 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.285264 22024 raft_consensus.cc:359] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.285804 22024 raft_consensus.cc:385] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.286079 22024 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.286943 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:59.286751 22024 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.287685 21829 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:04:59.288671 22329 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.288883 22024 ts_tablet_manager.cc:1434] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:59.289132 22329 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.289543 22029 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.289938 22024 tablet_bootstrap.cc:492] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:59.292227 22329 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:04:59.292871 21798 leader_election.cc:343] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.296916 22023 tablet_bootstrap.cc:492] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:59.297348 22023 ts_tablet_manager.cc:1403] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.266s	user 0.045s	sys 0.051s
I20260709 13:04:59.298418 22024 tablet_bootstrap.cc:654] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.300045 22023 raft_consensus.cc:359] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.300766 22023 raft_consensus.cc:385] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.301052 22023 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.301748 22375 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.302801 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:59.304051 21829 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.304888 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:59.306100 21949 leader_election.cc:343] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.301677 22023 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:59.312263 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 97096us
I20260709 13:04:59.314957 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.315904 22023 ts_tablet_manager.cc:1434] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:59.324472 22023 tablet_bootstrap.cc:492] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:04:59.318354 22143 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.325055 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:59.325955 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:04:59.329452 21873 leader_election.cc:343] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.332683 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:59.333876 22329 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.336330 22316 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:59.338415 22128 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.337795 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:59.352535 22199 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.342950 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:59.346859 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.350263 22329 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.353456 21829 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:59.354723 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.357494 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:59.357707 21907 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:59.356343 22128 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.350088 21980 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:04:59.359792 22128 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:59.360086 21976 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.336648 21905 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:59.352672 22375 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.363912 22024 tablet_bootstrap.cc:492] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:59.365340 22024 ts_tablet_manager.cc:1403] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.013s
I20260709 13:04:59.366389 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:59.366885 21832 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.364945 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:59.368228 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:59.363888 21908 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:59.371863 21830 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:59.386355 21949 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:04:59.387441 22128 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.387853 22128 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.388212 22128 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.373944 22129 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.435557 22023 tablet_bootstrap.cc:654] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.455238 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:04:59.457295 21873 leader_election.cc:343] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.459540 22025 tablet_bootstrap.cc:492] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:59.459985 22025 ts_tablet_manager.cc:1403] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.223s	user 0.029s	sys 0.007s
I20260709 13:04:59.422228 22129 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.465121 22129 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.372282 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:59.470108 22379 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:59.470023 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 101069us
I20260709 13:04:59.472685 22379 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:59.473497 22379 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.485152 21832 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
W20260709 13:04:59.489149 22009 tablet.cc:2406] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:59.494024 21875 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:59.493909 22024 raft_consensus.cc:359] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.495870 22024 raft_consensus.cc:385] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.496160 22024 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.496984 22024 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.504094 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:04:59.503090 22367 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.508343 22367 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:59.509362 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.514241 21906 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:59.509397 22367 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.515837 22129 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.519333 22329 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:59.523962 22129 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.521248 22128 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.520356 21728 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.515066 22024 ts_tablet_manager.cc:1434] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.149s	user 0.010s	sys 0.003s
I20260709 13:04:59.525785 22025 raft_consensus.cc:359] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.532970 22025 raft_consensus.cc:385] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.533303 22025 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.534531 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.535105 21909 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:59.539101 22025 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.543236 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:59.548159 22024 tablet_bootstrap.cc:492] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:59.548789 21832 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:04:59.547304 22142 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.550627 22142 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.552629 22142 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.556984 22025 ts_tablet_manager.cc:1434] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.002s
I20260709 13:04:59.558593 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.559173 21909 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:59.545620 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:59.566551 22025 tablet_bootstrap.cc:492] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:04:59.568746 21799 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:04:59.569576 21799 leader_election.cc:343] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.569962 21799 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:59.571446 21980 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.571573 22142 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.565551 22375 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.572458 22375 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.574378 22375 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.574123 22329 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.581455 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:59.582258 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:04:59.583861 21875 leader_election.cc:343] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.584890 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:59.586066 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.578558 22143 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.588708 22143 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.589141 22143 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:59.593703 21798 leader_election.cc:343] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.595899 22128 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:59.582072 21904 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.595767 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:04:59.607036 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 104870us
W20260709 13:04:59.626492 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 56939.7us
I20260709 13:04:59.627863 21799 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:59.629115 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:59.628806 22144 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.641927 22023 tablet_bootstrap.cc:492] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:04:59.642403 22023 ts_tablet_manager.cc:1403] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.320s	user 0.013s	sys 0.023s
I20260709 13:04:59.638689 21976 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:59.646056 22144 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.657378 22143 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.659034 21980 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:04:59.659524 22144 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:59.663281 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44505.5us
I20260709 13:04:59.659488 21904 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:04:59.662456 22144 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.667392 22143 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.663775 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:04:59.671849 21948 leader_election.cc:343] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.672233 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:59.680480 22023 raft_consensus.cc:359] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.681175 22023 raft_consensus.cc:385] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.681430 22023 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.683133 22024 tablet_bootstrap.cc:654] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.682054 22023 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.686828 22144 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.690551 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:59.691469 21980 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:04:59.691784 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:04:59.693593 22382 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.695118 22390 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.697160 22144 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.697260 22390 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.697667 22390 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.699826 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:04:59.701407 22025 tablet_bootstrap.cc:654] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.704156 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:59.704906 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:59.705570 21904 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.707492 22379 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.716272 22023 ts_tablet_manager.cc:1434] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 13:04:59.716614 22379 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:04:59.718154 22379 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:59.718577 21798 leader_election.cc:343] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:59.721560 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 85541.3us
I20260709 13:04:59.722077 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:59.723541 22023 tablet_bootstrap.cc:492] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
W20260709 13:04:59.730221 21799 leader_election.cc:343] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.730630 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:59.731271 22142 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.739481 22142 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.739863 22142 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.724831 22144 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.743070 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:59.743340 22142 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.748212 22024 tablet_bootstrap.cc:492] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:04:59.748656 22024 ts_tablet_manager.cc:1403] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.203s	user 0.009s	sys 0.006s
I20260709 13:04:59.746904 22144 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.751157 22144 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.750705 21904 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
W20260709 13:04:59.725103 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 115857us
I20260709 13:04:59.743989 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:59.758049 21907 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.766593 21799 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:04:59.770207 22024 raft_consensus.cc:359] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.770952 22024 raft_consensus.cc:385] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.771216 22024 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.772645 22024 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.775086 22024 ts_tablet_manager.cc:1434] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:04:59.776032 22024 tablet_bootstrap.cc:492] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:04:59.778879 22142 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.779937 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.780526 21903 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:04:59.782413 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:04:59.792074 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:04:59.793740 21873 leader_election.cc:343] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.794113 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:04:59.795370 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:59.796416 22142 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.796749 22142 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.797011 22142 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:59.776961 21949 leader_election.cc:343] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.843644 22316 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.851717 22316 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.866194 22388 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.866775 22388 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:04:59.877740 22388 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:04:59.920653 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 126928us
I20260709 13:04:59.812642 22379 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.929138 22142 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.932511 22025 tablet_bootstrap.cc:492] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:04:59.932960 22025 ts_tablet_manager.cc:1403] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.367s	user 0.019s	sys 0.012s
W20260709 13:04:59.924338 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 152750us
I20260709 13:04:59.924966 22375 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:04:59.941218 22023 tablet_bootstrap.cc:654] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:59.941179 21798 leader_election.cc:343] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.944662 22142 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:04:59.943739 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:59.948684 21909 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.957858 21909 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:59.927917 22144 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.958834 22390 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.958464 21731 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.961033 21731 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.959419 22316 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:04:59.961441 21907 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:04:59.967404 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:59.968139 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:04:59.968340 22142 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.968806 21909 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:04:59.968883 22142 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:04:59.969743 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:04:59.969746 22142 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.966540 22375 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:04:59.981058 22024 tablet_bootstrap.cc:654] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.981276 22392 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.981709 22392 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:04:59.985633 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:04:59.990546 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:04:59.991206 21907 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.982215 22316 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.995993 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:04:59.997361 21832 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:04:59.995277 22401 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.996861 22316 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.051690 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:00.034224 22316 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.044906 22144 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:00.071771 22024 tablet_bootstrap.cc:492] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:05:00.072278 22024 ts_tablet_manager.cc:1403] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.296s	user 0.013s	sys 0.001s
I20260709 13:05:00.089563 22395 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:00.095255 22025 raft_consensus.cc:359] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.095949 22025 raft_consensus.cc:385] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.096243 22025 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.096827 22025 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.097716 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:00.098489 21902 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:00.099666 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53280.2us
I20260709 13:05:00.106482 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:00.107270 21978 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.108371 22375 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.113229 22025 ts_tablet_manager.cc:1434] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.179s	user 0.008s	sys 0.004s
W20260709 13:05:00.114766 21798 leader_election.cc:343] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.121176 21907 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:00.124397 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:00.125206 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:00.125865 21825 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.126444 22025 tablet_bootstrap.cc:492] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:05:00.127864 22143 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.128419 22389 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:00.129292 22023 tablet_bootstrap.cc:492] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:05:00.129696 22023 ts_tablet_manager.cc:1403] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.407s	user 0.012s	sys 0.051s
I20260709 13:05:00.130492 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:00.094740 22401 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:00.132886 22143 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:00.134814 22143 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.139456 22023 raft_consensus.cc:359] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.139704 22024 raft_consensus.cc:359] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.140306 22023 raft_consensus.cc:385] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.140816 22024 raft_consensus.cc:385] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.140884 22023 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.141252 22024 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.143991 22316 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.147109 22024 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.152163 22316 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:00.153060 22023 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.165745 22024 ts_tablet_manager.cc:1434] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.003s
W20260709 13:05:00.172092 21949 leader_election.cc:343] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.177222 22023 ts_tablet_manager.cc:1434] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.004s
I20260709 13:05:00.182539 22024 tablet_bootstrap.cc:492] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:05:00.186602 22023 tablet_bootstrap.cc:492] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:05:00.187834 21825 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:00.191671 21902 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:00.199981 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:00.203254 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:00.195046 22129 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:05:00.206398 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:00.205725 22316 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.213155 22316 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:00.213982 22316 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.180840 22401 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.202785 21978 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:00.220801 22392 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:00.222931 22270 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.228003 21949 leader_election.cc:343] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:00.287824 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59875.4us
W20260709 13:05:00.288686 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57211.9us
W20260709 13:05:00.289667 21873 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:00.291712 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:00.296361 22270 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:00.389336 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 91740.4us
I20260709 13:05:00.394816 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:00.397622 21909 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.395815 22025 tablet_bootstrap.cc:700] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Time spent opening tablet: real 0.177s	user 0.004s	sys 0.016s
I20260709 13:05:00.401248 22270 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:00.405457 22025 tablet_bootstrap.cc:654] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.437291 22023 tablet_bootstrap.cc:654] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:00.438896 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 144028us
I20260709 13:05:00.441838 21909 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:00.445318 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:00.442469 22411 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.446821 22379 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.447815 22411 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.467412 21909 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:05:00.467839 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:00.510984 22390 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:00.512938 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49998.1us
I20260709 13:05:00.519177 22024 tablet_bootstrap.cc:654] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.507584 22388 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.532099 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:00.532807 21832 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:05:00.533912 22388 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:00.534890 22388 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.541718 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:00.542459 21907 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:00.535351 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:00.551298 22389 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.559166 22411 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:00.562793 21948 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:00.563253 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:00.559855 22395 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.571574 21798 leader_election.cc:343] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:00.573673 21798 consensus_peers.cc:597] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:00.570559 22401 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.584227 22401 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.584547 22331 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.584555 22401 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.568878 22316 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.586571 21728 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.589666 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:00.567683 22395 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.603132 22199 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:00.603442 22424 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.633949 22395 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:00.634536 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:00.636138 22424 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.609042 22401 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:00.665973 21873 leader_election.cc:343] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.651762 22424 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:00.687940 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 70489.4us
I20260709 13:05:00.695053 22024 tablet_bootstrap.cc:492] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:05:00.695689 22024 ts_tablet_manager.cc:1403] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.514s	user 0.012s	sys 0.020s
I20260709 13:05:00.730005 22025 tablet_bootstrap.cc:492] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:05:00.735958 22025 ts_tablet_manager.cc:1403] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.610s	user 0.029s	sys 0.046s
W20260709 13:05:00.738011 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57119.1us
W20260709 13:05:00.741011 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59208.9us
I20260709 13:05:00.749992 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:00.755014 22024 raft_consensus.cc:359] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.755796 22024 raft_consensus.cc:385] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.758641 22401 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:00.741227 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:00.756089 22024 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.762435 22023 tablet_bootstrap.cc:492] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:05:00.763052 22023 ts_tablet_manager.cc:1403] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.577s	user 0.004s	sys 0.027s
I20260709 13:05:00.763741 22024 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.772085 22418 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:00.774509 21975 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.786536 22024 ts_tablet_manager.cc:1434] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.004s
I20260709 13:05:00.787570 22024 tablet_bootstrap.cc:492] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:05:00.792253 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:00.800328 22143 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.804682 22023 raft_consensus.cc:359] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.805578 22023 raft_consensus.cc:385] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.805871 22023 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.806543 22023 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.808140 22023 ts_tablet_manager.cc:1434] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 13:05:00.812119 22331 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.814626 22023 tablet_bootstrap.cc:492] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:05:00.824580 22143 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.826643 21949 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:00.840180 22143 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.845584 22025 raft_consensus.cc:359] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.846661 22025 raft_consensus.cc:385] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.847054 22025 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.829093 22424 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.858222 22025 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:00.837402 22316 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:05:00.867873 22025 ts_tablet_manager.cc:1434] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.002s
I20260709 13:05:00.875700 21903 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:00.872169 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:00.886124 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:00.893530 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 48997.5us
I20260709 13:05:00.897396 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:00.882081 22424 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:00.913823 21798 leader_election.cc:343] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:00.907398 21873 leader_election.cc:343] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.913192 21825 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:05:00.944923 21798 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:00.971880 22432 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.973474 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:00.988639 22425 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.966032 22382 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.999049 22443 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:05:01.034615 22024 tablet_bootstrap.cc:700] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent opening tablet: real 0.111s	user 0.010s	sys 0.030s
I20260709 13:05:01.038044 22024 tablet_bootstrap.cc:654] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.039197 22023 tablet_bootstrap.cc:654] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.002481 22382 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.053885 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:01.054373 21949 consensus_peers.cc:597] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:01.063369 22382 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:01.072268 22144 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.072829 22144 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.075462 22144 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:01.089937 21731 catalog_manager.cc:5697] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.093879 22023 tablet_bootstrap.cc:492] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:05:01.094408 22023 ts_tablet_manager.cc:1403] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.280s	user 0.016s	sys 0.016s
I20260709 13:05:01.097008 22023 raft_consensus.cc:359] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.097669 22023 raft_consensus.cc:385] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.097934 22023 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.098630 22023 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.101646 22025 tablet_bootstrap.cc:492] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:05:01.102849 22023 ts_tablet_manager.cc:1434] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:01.104533 22024 tablet_bootstrap.cc:492] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:05:01.105558 22024 ts_tablet_manager.cc:1403] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.318s	user 0.024s	sys 0.030s
I20260709 13:05:01.108333 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.108381 22024 raft_consensus.cc:359] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.109117 22024 raft_consensus.cc:385] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.109102 21904 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 0.
I20260709 13:05:01.109560 22024 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.110196 22024 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.110728 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.111009 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:01.112056 22024 ts_tablet_manager.cc:1434] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:05:01.112520 22411 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.112932 22024 tablet_bootstrap.cc:492] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:05:01.114763 21978 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.126832 21730 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.128520 21730 catalog_manager.cc:5697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.130141 21730 catalog_manager.cc:5697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.132437 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:01.132901 22023 tablet_bootstrap.cc:492] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:05:01.135205 22025 tablet_bootstrap.cc:654] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:01.138463 21798 leader_election.cc:343] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.140021 22417 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.148517 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:01.148644 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:01.140512 22417 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.159312 22024 tablet_bootstrap.cc:654] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.162542 22417 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:01.169793 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:01.166477 22144 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.173811 22144 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.174152 22144 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.175000 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.180281 22128 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.182130 22023 tablet_bootstrap.cc:654] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:01.184144 21798 leader_election.cc:343] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:01.277274 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 93165.6us
I20260709 13:05:01.280114 22316 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:01.255002 22144 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.287784 22411 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.288275 22411 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.290150 22411 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:01.292265 21799 leader_election.cc:343] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.292610 21799 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:01.261581 22421 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.303097 22425 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.321712 21730 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.302778 22421 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.324245 21730 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.334513 22144 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:01.352102 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:01.368237 22421 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:01.380012 21798 leader_election.cc:343] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.386929 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:01.387645 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:01.390372 21875 leader_election.cc:343] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.396183 22025 tablet_bootstrap.cc:492] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:05:01.396620 22025 ts_tablet_manager.cc:1403] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.295s	user 0.014s	sys 0.036s
W20260709 13:05:01.398916 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53024.6us
I20260709 13:05:01.404589 22024 tablet_bootstrap.cc:492] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:05:01.405026 22024 ts_tablet_manager.cc:1403] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.292s	user 0.016s	sys 0.020s
W20260709 13:05:01.406461 21798 leader_election.cc:343] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.421222 22023 tablet_bootstrap.cc:492] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:05:01.421419 22025 raft_consensus.cc:359] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.421725 22023 ts_tablet_manager.cc:1403] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.290s	user 0.022s	sys 0.007s
I20260709 13:05:01.422827 22025 raft_consensus.cc:385] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.423115 22025 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.424894 22025 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.428885 22025 ts_tablet_manager.cc:1434] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.002s
I20260709 13:05:01.429652 22025 tablet_bootstrap.cc:492] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:05:01.429900 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:01.430546 21901 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.435909 22023 raft_consensus.cc:359] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.436383 22023 raft_consensus.cc:385] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.436602 22023 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.438006 22024 raft_consensus.cc:359] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.438753 22024 raft_consensus.cc:385] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.439010 22024 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.439495 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:01.439654 22024 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.440088 21981 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 0.
I20260709 13:05:01.441948 22024 ts_tablet_manager.cc:1434] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:05:01.442899 22024 tablet_bootstrap.cc:492] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:05:01.444208 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:01.444344 21901 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:01.445380 22023 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.445946 22199 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.446317 22199 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.446614 22199 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.447266 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.447923 22023 ts_tablet_manager.cc:1434] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:05:01.448793 22023 tablet_bootstrap.cc:492] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:05:01.454615 22199 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.455284 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:01.460646 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:01.464715 22199 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:01.464749 21799 leader_election.cc:343] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.463807 22417 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:01.465701 21875 leader_election.cc:343] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.465245 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:01.466827 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:01.467374 21981 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.468971 22270 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.468839 22417 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:01.471328 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:01.470942 22417 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.479691 21981 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:01.483603 22023 tablet_bootstrap.cc:654] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.484079 22025 tablet_bootstrap.cc:654] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.483891 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:01.485940 22199 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.486464 22199 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:01.487177 22024 tablet_bootstrap.cc:654] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.487429 22199 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.491483 22316 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.491986 22316 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.496454 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:01.497068 21833 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:05:01.498001 21949 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:01.493943 22316 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:01.498670 22392 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.498670 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.499133 22392 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.499451 22392 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:01.499997 21948 leader_election.cc:343] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.506556 22392 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.520059 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:01.520761 21833 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.527117 22316 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.527622 22316 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.529639 22316 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:01.531109 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.531790 21909 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:01.531648 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:01.532012 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:01.532414 22392 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:01.532789 21825 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 1: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:01.530036 21833 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
W20260709 13:05:01.533244 21948 leader_election.cc:343] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.534135 21949 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:01.535403 21949 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:01.536290 22316 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.536525 22392 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.543896 22025 tablet_bootstrap.cc:492] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:05:01.544327 22025 ts_tablet_manager.cc:1403] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.000s
I20260709 13:05:01.546066 22023 tablet_bootstrap.cc:492] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:05:01.546482 22023 ts_tablet_manager.cc:1403] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.098s	user 0.018s	sys 0.004s
I20260709 13:05:01.555027 21728 catalog_manager.cc:5697] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.558501 22316 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:01.559337 22316 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.563074 22025 raft_consensus.cc:359] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.563746 22025 raft_consensus.cc:385] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.565258 22023 raft_consensus.cc:359] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.566483 22023 raft_consensus.cc:385] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.566747 22023 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.567448 22023 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.564013 22025 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.571274 22023 ts_tablet_manager.cc:1434] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.001s
I20260709 13:05:01.571347 22024 tablet_bootstrap.cc:492] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:05:01.571827 22024 ts_tablet_manager.cc:1403] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.002s
I20260709 13:05:01.572109 22023 tablet_bootstrap.cc:492] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Bootstrap starting.
I20260709 13:05:01.574926 22392 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.574692 22024 raft_consensus.cc:359] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.575476 22024 raft_consensus.cc:385] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.575788 22024 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.576581 22024 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.568866 22025 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.578940 22024 ts_tablet_manager.cc:1434] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:05:01.579401 22023 tablet_bootstrap.cc:654] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.580065 22024 tablet_bootstrap.cc:492] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:05:01.587443 22024 tablet_bootstrap.cc:654] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.590049 22025 ts_tablet_manager.cc:1434] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 13:05:01.601641 22023 tablet_bootstrap.cc:492] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: No bootstrap required, opened a new log
I20260709 13:05:01.602075 22023 ts_tablet_manager.cc:1403] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.007s
I20260709 13:05:01.602125 22024 tablet_bootstrap.cc:492] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:05:01.602676 22024 ts_tablet_manager.cc:1403] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.009s
I20260709 13:05:01.605129 22023 raft_consensus.cc:359] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.605793 22023 raft_consensus.cc:385] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.606043 22023 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.606086 22024 raft_consensus.cc:359] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.606806 22024 raft_consensus.cc:385] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.607154 22024 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.606843 22023 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.607877 22024 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.610304 22024 ts_tablet_manager.cc:1434] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:05:01.611187 22024 tablet_bootstrap.cc:492] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:05:01.613045 22023 ts_tablet_manager.cc:1434] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:05:01.616459 22024 tablet_bootstrap.cc:654] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.617673 22025 tablet_bootstrap.cc:492] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Bootstrap starting.
I20260709 13:05:01.628180 21731 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.633800 22024 tablet_bootstrap.cc:492] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:05:01.634284 22024 ts_tablet_manager.cc:1403] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 13:05:01.636849 22024 raft_consensus.cc:359] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.637465 22024 raft_consensus.cc:385] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.637699 22024 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.639214 22025 tablet_bootstrap.cc:654] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.640256 22316 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.640772 22316 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.642714 22316 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:01.644927 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:01.646375 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.646907 21909 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
W20260709 13:05:01.648713 21949 leader_election.cc:343] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.648978 22024 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.650543 22024 ts_tablet_manager.cc:1434] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:05:01.651412 22024 tablet_bootstrap.cc:492] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Bootstrap starting.
I20260709 13:05:01.652027 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:01.652966 22128 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.653285 22128 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.653563 22128 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.665309 22128 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.668637 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:01.669852 21949 leader_election.cc:343] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.670289 22024 tablet_bootstrap.cc:654] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.678048 22379 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.678329 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:01.678794 21909 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.678544 22379 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.679877 21728 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.681231 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:01.681931 21825 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 1: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:01.677035 22128 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:01.685138 21909 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:01.686000 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:01.686875 22128 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.687294 22128 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:01.687745 22379 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:01.688040 22128 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.689441 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:01.690272 22025 tablet_bootstrap.cc:492] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: No bootstrap required, opened a new log
I20260709 13:05:01.690749 22025 ts_tablet_manager.cc:1403] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.003s
I20260709 13:05:01.691133 21873 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:01.692699 22379 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.698714 22025 raft_consensus.cc:359] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.699343 22025 raft_consensus.cc:385] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.699606 22025 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.700173 22025 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.701982 22025 ts_tablet_manager.cc:1434] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.000s
I20260709 13:05:01.704061 22024 tablet_bootstrap.cc:492] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: No bootstrap required, opened a new log
I20260709 13:05:01.704492 22024 ts_tablet_manager.cc:1403] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent bootstrapping tablet: real 0.053s	user 0.003s	sys 0.008s
I20260709 13:05:01.707352 22024 raft_consensus.cc:359] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.707963 22024 raft_consensus.cc:385] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.708220 22024 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.708889 22024 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.710997 22379 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.714445 22024 ts_tablet_manager.cc:1434] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:05:01.723464 21728 catalog_manager.cc:5697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.724684 22417 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.725204 22417 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.728147 22417 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:01.728581 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.729676 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:01.730386 21981 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:01.731218 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:01.732110 22417 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.737797 22417 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.738111 22459 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.738571 22459 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.740586 22459 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:01.741866 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:01.742395 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.743053 21909 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 1: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:01.743216 22459 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.743672 22459 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.743870 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:01.744575 22417 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.745962 22459 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:01.746470 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.747259 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:01.748376 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:01.749039 22459 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.751055 22417 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.774469 22128 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.774798 22128 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.776180 22128 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:01.776628 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:01.776961 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:01.777163 21825 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:05:01.777454 21909 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 0.
I20260709 13:05:01.778117 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:01.778780 22128 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.779093 22128 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.779348 22128 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.783986 22128 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.785406 22128 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:01.786024 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:01.786310 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:01.786633 21825 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.786952 21909 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.792673 21909 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:01.792673 21825 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:01.793778 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:01.794492 22128 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.795212 22128 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:01.795871 22128 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:01.804018 21730 catalog_manager.cc:5697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.882001 21825 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.936450 21981 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.962343 21978 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.970161 22459 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:01.983301 22270 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.105950 22379 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.107982 22445 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.129069 22316 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.130772 22316 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.153553 22316 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.154045 22128 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:02.218009 22392 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.231623 22486 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:02.503000 21780 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:03.013082 22417 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.013616 22417 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:03.016251 22417 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:03.017287 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:03.017870 21978 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:03.017864 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:03.018631 21909 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:03.019018 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:03.019896 22417 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:03.020238 22417 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.020522 22417 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.025384 22417 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:03.026773 22417 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:03.027439 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:03.027652 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:03.027880 21909 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.028182 21978 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.032590 21909 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:03.033442 21978 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:03.033692 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:03.034693 22417 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.035136 22417 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:03.035861 22417 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:03.045198 21731 catalog_manager.cc:5697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 0 to 2, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.522972 21903 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:03.524111 22144 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:03.558063 21978 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:03.562340 22417 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:04.367697 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:04.392439 22510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.392819 22512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:04.392995 22509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:04.393747 20694 server_base.cc:1061] running on GCE node
I20260709 13:05:04.394953 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:04.395226 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:04.395453 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602304395434 us; error 0 us; skew 500 ppm
I20260709 13:05:04.396042 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:04.399360 20694 webserver.cc:533] Webserver started at http://127.20.53.132:46727/ using document root <none> and password file <none>
I20260709 13:05:04.399899 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:04.400138 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:04.400497 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:04.401721 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-3-root/instance:
uuid: "0157b4f0725d4f92a53938c921db9efc"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-r056"
I20260709 13:05:04.407577 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:04.411396 22517 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.412293 20694 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:04.412621 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-3-root
uuid: "0157b4f0725d4f92a53938c921db9efc"
format_stamp: "Formatted at 2026-07-09 13:05:04 on dist-test-slave-r056"
I20260709 13:05:04.412951 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:04.451525 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:04.453055 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:04.454643 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:04.458855 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:04.459154 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.459421 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:04.459632 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:04.512038 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.132:38783
I20260709 13:05:04.512130 22579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.132:38783 every 8 connection(s)
I20260709 13:05:04.516389 20694 auto_leader_rebalancer-test.cc:384] add a tserver: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:04.528168 22580 heartbeater.cc:344] Connected to a master server at 127.20.53.190:38207
I20260709 13:05:04.528538 22580 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:04.529202 22580 heartbeater.cc:507] Master 127.20.53.190:38207 requested a full tablet report, sending...
I20260709 13:05:04.530912 21731 ts_manager.cc:194] Registered new tserver with Master: 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:04.532609 21731 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52738
I20260709 13:05:04.706705 21978 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:04.713296 21832 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:04.713414 21909 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:04.714658 22486 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.716972 22486 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:04.728415 21948 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 865ede4842b04242930bf2619bb09d16. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.728272 22486 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.729822 21909 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.730011 21832 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.740020 21978 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:04.743883 21731 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.762068 21832 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:04.762120 21909 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:04.762813 21948 consensus_peers.cc:597] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8957eea5c26d4180a331c4edcb3753b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.763574 22504 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.764529 22486 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.779687 22508 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.781497 21832 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.788559 21909 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.797360 21728 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.812736 21825 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:04.826541 21981 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:04.829413 22502 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:04.838470 21909 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:04.837711 22502 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.842722 21978 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.844862 22604 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:04.854851 21799 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ef872609f3d4b9ab42d0ccec83ae647. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.863530 21728 catalog_manager.cc:5697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.864164 21825 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:05:04.876235 21799 consensus_peers.cc:597] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61e3ce132d8a443eb412d1816ffc7579. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.879048 21978 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:04.880434 22502 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.881256 21903 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:04.884294 22417 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.899652 21909 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.906567 22502 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.912416 21903 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.919497 21978 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:04.934814 21728 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:05.258792 22610 ts_tablet_manager.cc:933] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:05.264703 22611 ts_tablet_manager.cc:933] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:05:05.265484 22610 tablet_copy_client.cc:323] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:05.284389 22611 tablet_copy_client.cc:323] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.129:39085
I20260709 13:05:05.294857 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 8957eea5c26d4180a331c4edcb3753b7 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:05.295445 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 8957eea5c26d4180a331c4edcb3753b7 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-8957eea5c26d4180a331c4edcb3753b7
I20260709 13:05:05.307111 22617 ts_tablet_manager.cc:933] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:05:05.312032 21993 tablet_copy_source_session.cc:215] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:05.314496 21844 tablet_copy_service.cc:140] P 479255846c5141b584b16aa253f587c7: Received BeginTabletCopySession request for tablet 61e3ce132d8a443eb412d1816ffc7579 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:52674)
I20260709 13:05:05.315423 21844 tablet_copy_service.cc:161] P 479255846c5141b584b16aa253f587c7: Beginning new tablet copy session on tablet 61e3ce132d8a443eb412d1816ffc7579 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:52674: session id = 0157b4f0725d4f92a53938c921db9efc-61e3ce132d8a443eb412d1816ffc7579
I20260709 13:05:05.316956 22617 tablet_copy_client.cc:323] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.129:39085
I20260709 13:05:05.320078 21843 tablet_copy_service.cc:140] P 479255846c5141b584b16aa253f587c7: Received BeginTabletCopySession request for tablet 0ef872609f3d4b9ab42d0ccec83ae647 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:52674)
I20260709 13:05:05.320654 21843 tablet_copy_service.cc:161] P 479255846c5141b584b16aa253f587c7: Beginning new tablet copy session on tablet 0ef872609f3d4b9ab42d0ccec83ae647 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:52674: session id = 0157b4f0725d4f92a53938c921db9efc-0ef872609f3d4b9ab42d0ccec83ae647
I20260709 13:05:05.324590 21844 tablet_copy_source_session.cc:215] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:05.325443 22610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8957eea5c26d4180a331c4edcb3753b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.330495 22611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e3ce132d8a443eb412d1816ffc7579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.348752 21843 tablet_copy_source_session.cc:215] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:05.354372 22611 tablet_copy_client.cc:806] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:05.355149 22611 tablet_copy_client.cc:670] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:05.360080 22617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef872609f3d4b9ab42d0ccec83ae647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.376081 22619 ts_tablet_manager.cc:933] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:05.381467 22611 tablet_copy_client.cc:538] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:05.384194 22619 tablet_copy_client.cc:323] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:05.385155 22610 tablet_copy_client.cc:806] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:05.385761 22610 tablet_copy_client.cc:670] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:05.386407 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 865ede4842b04242930bf2619bb09d16 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:05.386977 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 865ede4842b04242930bf2619bb09d16 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-865ede4842b04242930bf2619bb09d16
I20260709 13:05:05.392024 22610 tablet_copy_client.cc:538] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:05.392575 22611 tablet_bootstrap.cc:492] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:05.402855 21993 tablet_copy_source_session.cc:215] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:05.405862 22619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865ede4842b04242930bf2619bb09d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:05.409062 22610 tablet_bootstrap.cc:492] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:05.411746 22617 tablet_copy_client.cc:806] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:05.413781 22617 tablet_copy_client.cc:670] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:05.418886 22617 tablet_copy_client.cc:538] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:05.433199 22611 tablet_bootstrap.cc:492] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.442952 22611 tablet_bootstrap.cc:492] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:05.443661 22611 ts_tablet_manager.cc:1403] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.051s	user 0.030s	sys 0.002s
I20260709 13:05:05.437127 22617 tablet_bootstrap.cc:492] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:05.456264 22610 tablet_bootstrap.cc:492] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.457131 22610 tablet_bootstrap.cc:492] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:05.457736 22610 ts_tablet_manager.cc:1403] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.002s
I20260709 13:05:05.446900 22611 raft_consensus.cc:359] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:05.458357 22611 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:05.458945 22611 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:05.461091 22580 heartbeater.cc:499] Master 127.20.53.190:38207 was elected leader, sending a full tablet report...
I20260709 13:05:05.460543 22610 raft_consensus.cc:359] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:05.461634 22610 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:05.462329 22610 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:05.463372 22611 ts_tablet_manager.cc:1434] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:05:05.466670 21843 tablet_copy_service.cc:342] P 479255846c5141b584b16aa253f587c7: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-61e3ce132d8a443eb412d1816ffc7579 received from {username='slave'} at 127.0.0.1:52674
I20260709 13:05:05.467105 21843 tablet_copy_service.cc:434] P 479255846c5141b584b16aa253f587c7: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-61e3ce132d8a443eb412d1816ffc7579 on tablet 61e3ce132d8a443eb412d1816ffc7579 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:05.468905 22610 ts_tablet_manager.cc:1434] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:05:05.471709 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-8957eea5c26d4180a331c4edcb3753b7 received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:05.472111 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-8957eea5c26d4180a331c4edcb3753b7 on tablet 8957eea5c26d4180a331c4edcb3753b7 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:05.472141 22619 tablet_copy_client.cc:806] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:05.474897 22619 tablet_copy_client.cc:670] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:05.480748 22619 tablet_copy_client.cc:538] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:05.489097 22619 tablet_bootstrap.cc:492] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:05.513374 22617 tablet_bootstrap.cc:492] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.515693 22617 tablet_bootstrap.cc:492] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:05.517154 22617 ts_tablet_manager.cc:1403] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.009s
I20260709 13:05:05.520171 22617 raft_consensus.cc:359] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:05.520982 22617 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:05.521654 22617 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:05.524384 22617 ts_tablet_manager.cc:1434] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:05.527006 21843 tablet_copy_service.cc:342] P 479255846c5141b584b16aa253f587c7: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-0ef872609f3d4b9ab42d0ccec83ae647 received from {username='slave'} at 127.0.0.1:52674
I20260709 13:05:05.527403 21843 tablet_copy_service.cc:434] P 479255846c5141b584b16aa253f587c7: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-0ef872609f3d4b9ab42d0ccec83ae647 on tablet 0ef872609f3d4b9ab42d0ccec83ae647 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:05.535887 22619 tablet_bootstrap.cc:492] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.536722 22619 tablet_bootstrap.cc:492] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:05.537472 22619 ts_tablet_manager.cc:1403] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.009s
I20260709 13:05:05.540218 22619 raft_consensus.cc:359] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:05.541069 22619 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:05.541802 22619 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:05.543991 22619 ts_tablet_manager.cc:1434] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:05.545961 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-865ede4842b04242930bf2619bb09d16 received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:05.546382 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-865ede4842b04242930bf2619bb09d16 on tablet 865ede4842b04242930bf2619bb09d16 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:05.698276 22555 raft_consensus.cc:1217] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:05.703451 22555 raft_consensus.cc:1217] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:05.808207 22555 raft_consensus.cc:1217] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:05.867654 22555 raft_consensus.cc:1217] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:06.192499 22508 raft_consensus.cc:1064] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:06.195333 22508 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:06.202678 21832 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.203435 22555 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.203989 22626 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.205284 22486 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.205896 21904 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.207464 22486 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.211247 22417 raft_consensus.cc:1064] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:06.213289 22417 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:06.236539 22554 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.238302 22502 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:06.244846 22486 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.248915 21981 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.251562 22417 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.261723 22553 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.263077 21904 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.267051 22632 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.273087 22502 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.276824 21981 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.279850 21903 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.285166 21731 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.315755 21825 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.362728 22553 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.373502 21904 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.384811 22604 raft_consensus.cc:1064] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:06.387179 22604 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:06.393949 22553 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.394574 21977 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.395323 22632 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.396062 21904 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.398677 22604 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.399355 22626 raft_consensus.cc:1064] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:06.401818 22626 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:06.404363 22604 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.412515 21731 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.430902 21981 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:06.438052 21903 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.442113 22504 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.442716 22555 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.448333 22632 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.454907 21903 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.448760 21978 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.450018 22638 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:06.452414 22555 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.457985 21825 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:06.460162 22486 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.462090 22508 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.469570 22638 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.453013 22553 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.454663 21832 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.472633 22638 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.474129 22554 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.475669 21903 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.476718 22502 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.478667 22554 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.479370 21903 raft_consensus.cc:2955] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.481933 22604 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.500387 22417 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.505676 22552 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.497908 21731 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.513661 21904 raft_consensus.cc:2955] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.517582 21732 catalog_manager.cc:5697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.532593 21904 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.571074 21719 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 61e3ce132d8a443eb412d1816ffc7579 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:06.574417 21821 tablet_service.cc:1558] Processing DeleteTablet for tablet 8957eea5c26d4180a331c4edcb3753b7 with delete_type TABLET_DATA_TOMBSTONED (TS 479255846c5141b584b16aa253f587c7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40618
I20260709 13:05:06.589947 21728 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.616815 22654 tablet_replica.cc:333] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:05:06.629531 21825 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:06.630759 21832 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.639537 22553 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.640847 22652 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.642237 21904 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.621237 22626 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.646245 22641 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:06.661624 22654 raft_consensus.cc:2243] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.668308 21904 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.672284 22502 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.680231 22654 raft_consensus.cc:2272] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.697629 22552 raft_consensus.cc:2955] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.713567 21731 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.725136 21728 catalog_manager.cc:5697] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.729176 21719 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ef872609f3d4b9ab42d0ccec83ae647 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:06.736145 22654 ts_tablet_manager.cc:1916] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:06.756398 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8957eea5c26d4180a331c4edcb3753b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:06.757212 21904 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.766603 21970 tablet_service.cc:1558] Processing DeleteTablet for tablet 61e3ce132d8a443eb412d1816ffc7579 with delete_type TABLET_DATA_TOMBSTONED (TS 3d76b2c4699e43fba10eeb81a91e4913 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39160
I20260709 13:05:06.767346 22654 ts_tablet_manager.cc:1929] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:06.767747 21968 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ef872609f3d4b9ab42d0ccec83ae647 with delete_type TABLET_DATA_TOMBSTONED (TS 3d76b2c4699e43fba10eeb81a91e4913 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39160
I20260709 13:05:06.767832 22654 log.cc:1199] T 8957eea5c26d4180a331c4edcb3753b7 P 479255846c5141b584b16aa253f587c7: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/wals/8957eea5c26d4180a331c4edcb3753b7
I20260709 13:05:06.782202 21719 catalog_manager.cc:5028] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): tablet 8957eea5c26d4180a331c4edcb3753b7 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:06.783551 22552 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.803121 22658 tablet_replica.cc:333] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:05:06.803871 22658 raft_consensus.cc:2243] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.804383 22658 raft_consensus.cc:2272] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.807291 22658 ts_tablet_manager.cc:1916] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:06.810952 21978 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:06.818993 22552 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.821183 21828 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.821245 22508 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.822038 22658 ts_tablet_manager.cc:1929] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:06.822443 22658 log.cc:1199] T 61e3ce132d8a443eb412d1816ffc7579 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/wals/61e3ce132d8a443eb412d1816ffc7579
I20260709 13:05:06.824193 22508 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.827828 22658 tablet_replica.cc:333] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:05:06.828954 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet 61e3ce132d8a443eb412d1816ffc7579 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:06.829795 22508 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.833379 22552 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.836531 21828 raft_consensus.cc:2955] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.857998 21728 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:06.829795 22658 raft_consensus.cc:2243] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.862790 22658 raft_consensus.cc:2272] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.869103 22658 ts_tablet_manager.cc:1916] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:06.871369 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 865ede4842b04242930bf2619bb09d16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:06.877930 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet 865ede4842b04242930bf2619bb09d16 with delete_type TABLET_DATA_TOMBSTONED (TS ac1dd8ad9fc44263932ec57d9376a271 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45472
I20260709 13:05:06.880481 22659 tablet_replica.cc:333] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:05:06.881490 22659 raft_consensus.cc:2243] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.882485 22659 raft_consensus.cc:2272] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.886137 22659 ts_tablet_manager.cc:1916] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:06.894611 22658 ts_tablet_manager.cc:1929] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:06.895044 22658 log.cc:1199] T 0ef872609f3d4b9ab42d0ccec83ae647 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/wals/0ef872609f3d4b9ab42d0ccec83ae647
I20260709 13:05:06.896461 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet 0ef872609f3d4b9ab42d0ccec83ae647 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:06.899008 22659 ts_tablet_manager.cc:1929] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:06.899438 22659 log.cc:1199] T 865ede4842b04242930bf2619bb09d16 P ac1dd8ad9fc44263932ec57d9376a271: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/wals/865ede4842b04242930bf2619bb09d16
I20260709 13:05:06.900914 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet 865ede4842b04242930bf2619bb09d16 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
W20260709 13:05:07.454437 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 84006.4us
I20260709 13:05:07.950215 21977 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:07.958233 21832 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:07.958751 21948 consensus_peers.cc:597] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 911b6cb205984b78bafd3ecdcc02ef3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.959254 21902 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:07.959789 22626 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:07.960992 22657 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.970630 22656 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:07.971954 21832 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:07.975934 21902 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:07.987862 21825 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:05:07.996682 21799 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f4dac7f6b7b440d84e044b62b559aae. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.988917 21732 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.997815 21901 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:07.998445 21977 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:08.000129 22502 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:08.001175 22661 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:08.020521 22661 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.043309 21977 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.044526 21904 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.072614 21832 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.083139 21730 catalog_manager.cc:5697] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.091774 21981 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:08.091776 21799 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc0e6a6fba594f8db28b949dbce488c7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.092785 21904 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:08.093457 22674 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:08.094270 22661 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.104740 22672 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.106767 21904 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.107105 21977 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.124707 21825 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.124747 21730 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.133128 21981 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:08.133289 21799 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f5da3aecad04fb0982188c37426f599. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.136101 22604 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.142725 21904 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:08.145038 22604 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.149196 22604 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.150842 21977 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.155599 21904 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:08.165277 21732 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.446731 22681 ts_tablet_manager.cc:933] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:08.448791 22681 tablet_copy_client.cc:323] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:08.450519 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 911b6cb205984b78bafd3ecdcc02ef3c from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:08.451134 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 911b6cb205984b78bafd3ecdcc02ef3c from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-911b6cb205984b78bafd3ecdcc02ef3c
W20260709 13:05:08.454357 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800033ea0 after lost signal to thread 20697
W20260709 13:05:08.455387 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08000caca0 after lost signal to thread 21766
W20260709 13:05:08.456432 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08003200c0 after lost signal to thread 21858
W20260709 13:05:08.457280 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800320900 after lost signal to thread 21933
W20260709 13:05:08.458029 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3fe0 after lost signal to thread 22007
I20260709 13:05:08.458112 21993 tablet_copy_source_session.cc:215] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:05:08.459050 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800308ca0 after lost signal to thread 22579
I20260709 13:05:08.474529 22681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911b6cb205984b78bafd3ecdcc02ef3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.493127 22681 tablet_copy_client.cc:806] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:08.493845 22681 tablet_copy_client.cc:670] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:08.500999 22681 tablet_copy_client.cc:538] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:08.519927 22681 tablet_bootstrap.cc:492] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:08.533631 22683 ts_tablet_manager.cc:933] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:05:08.534983 22684 ts_tablet_manager.cc:933] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:05:08.547011 22683 tablet_copy_client.cc:323] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.129:39085
I20260709 13:05:08.549414 21843 tablet_copy_service.cc:140] P 479255846c5141b584b16aa253f587c7: Received BeginTabletCopySession request for tablet 9f4dac7f6b7b440d84e044b62b559aae from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:52674)
I20260709 13:05:08.549906 21843 tablet_copy_service.cc:161] P 479255846c5141b584b16aa253f587c7: Beginning new tablet copy session on tablet 9f4dac7f6b7b440d84e044b62b559aae from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:52674: session id = 0157b4f0725d4f92a53938c921db9efc-9f4dac7f6b7b440d84e044b62b559aae
I20260709 13:05:08.551492 22684 tablet_copy_client.cc:323] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.129:39085
I20260709 13:05:08.558782 21844 tablet_copy_service.cc:140] P 479255846c5141b584b16aa253f587c7: Received BeginTabletCopySession request for tablet cc0e6a6fba594f8db28b949dbce488c7 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:52674)
I20260709 13:05:08.559278 21844 tablet_copy_service.cc:161] P 479255846c5141b584b16aa253f587c7: Beginning new tablet copy session on tablet cc0e6a6fba594f8db28b949dbce488c7 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:52674: session id = 0157b4f0725d4f92a53938c921db9efc-cc0e6a6fba594f8db28b949dbce488c7
I20260709 13:05:08.584645 21843 tablet_copy_source_session.cc:215] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:08.587365 21844 tablet_copy_source_session.cc:215] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:08.591722 22683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4dac7f6b7b440d84e044b62b559aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.622205 22681 tablet_bootstrap.cc:492] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.630259 22681 tablet_bootstrap.cc:492] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:08.631024 22681 ts_tablet_manager.cc:1403] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.111s	user 0.022s	sys 0.003s
I20260709 13:05:08.645124 22681 raft_consensus.cc:359] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.648120 22681 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:08.649516 22683 tablet_copy_client.cc:806] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:08.650156 22683 tablet_copy_client.cc:670] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:08.651487 22681 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.632831 22684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0e6a6fba594f8db28b949dbce488c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.688009 22683 tablet_copy_client.cc:538] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:08.698007 22681 ts_tablet_manager.cc:1434] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.005s
I20260709 13:05:08.704357 22690 ts_tablet_manager.cc:933] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:05:08.711985 22683 tablet_bootstrap.cc:492] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:08.729697 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-911b6cb205984b78bafd3ecdcc02ef3c received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:08.730286 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-911b6cb205984b78bafd3ecdcc02ef3c on tablet 911b6cb205984b78bafd3ecdcc02ef3c with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:08.736065 22684 tablet_copy_client.cc:806] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:08.736593 22684 tablet_copy_client.cc:670] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:08.739357 22690 tablet_copy_client.cc:323] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.129:39085
I20260709 13:05:08.741755 21843 tablet_copy_service.cc:140] P 479255846c5141b584b16aa253f587c7: Received BeginTabletCopySession request for tablet 6f5da3aecad04fb0982188c37426f599 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:52674)
I20260709 13:05:08.742201 21843 tablet_copy_service.cc:161] P 479255846c5141b584b16aa253f587c7: Beginning new tablet copy session on tablet 6f5da3aecad04fb0982188c37426f599 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:52674: session id = 0157b4f0725d4f92a53938c921db9efc-6f5da3aecad04fb0982188c37426f599
I20260709 13:05:08.747732 21843 tablet_copy_source_session.cc:215] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:08.750285 22684 tablet_copy_client.cc:538] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:08.757225 22690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5da3aecad04fb0982188c37426f599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.759790 22684 tablet_bootstrap.cc:492] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:08.767961 22683 tablet_bootstrap.cc:492] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.769868 22683 tablet_bootstrap.cc:492] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:08.770589 22683 ts_tablet_manager.cc:1403] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.006s
I20260709 13:05:08.773582 22683 raft_consensus.cc:359] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.774467 22683 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:08.775306 22683 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.786391 22683 ts_tablet_manager.cc:1434] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:08.789147 21843 tablet_copy_service.cc:342] P 479255846c5141b584b16aa253f587c7: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-9f4dac7f6b7b440d84e044b62b559aae received from {username='slave'} at 127.0.0.1:52674
I20260709 13:05:08.789579 21843 tablet_copy_service.cc:434] P 479255846c5141b584b16aa253f587c7: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-9f4dac7f6b7b440d84e044b62b559aae on tablet 9f4dac7f6b7b440d84e044b62b559aae with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:08.809053 22690 tablet_copy_client.cc:806] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:08.810212 22690 tablet_copy_client.cc:670] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:08.813700 22690 tablet_copy_client.cc:538] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:08.822772 22690 tablet_bootstrap.cc:492] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:08.822994 22684 tablet_bootstrap.cc:492] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.823866 22684 tablet_bootstrap.cc:492] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:08.824506 22684 ts_tablet_manager.cc:1403] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.008s
I20260709 13:05:08.827551 22684 raft_consensus.cc:359] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.830427 22684 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:08.831112 22684 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.834244 22684 ts_tablet_manager.cc:1434] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:05:08.837242 21843 tablet_copy_service.cc:342] P 479255846c5141b584b16aa253f587c7: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-cc0e6a6fba594f8db28b949dbce488c7 received from {username='slave'} at 127.0.0.1:52674
I20260709 13:05:08.837687 21843 tablet_copy_service.cc:434] P 479255846c5141b584b16aa253f587c7: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-cc0e6a6fba594f8db28b949dbce488c7 on tablet cc0e6a6fba594f8db28b949dbce488c7 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:08.864917 22690 tablet_bootstrap.cc:492] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.865818 22690 tablet_bootstrap.cc:492] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:08.867069 22690 ts_tablet_manager.cc:1403] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.010s
I20260709 13:05:08.870373 22690 raft_consensus.cc:359] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.871385 22690 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:08.872124 22690 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:08.874998 22690 ts_tablet_manager.cc:1434] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:08.876914 21843 tablet_copy_service.cc:342] P 479255846c5141b584b16aa253f587c7: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-6f5da3aecad04fb0982188c37426f599 received from {username='slave'} at 127.0.0.1:52674
I20260709 13:05:08.877394 21843 tablet_copy_service.cc:434] P 479255846c5141b584b16aa253f587c7: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-6f5da3aecad04fb0982188c37426f599 on tablet 6f5da3aecad04fb0982188c37426f599 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:08.914644 22555 raft_consensus.cc:1217] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:08.973673 22555 raft_consensus.cc:1217] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:09.026156 22555 raft_consensus.cc:1217] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:09.118606 22555 raft_consensus.cc:1217] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:09.347018 22695 raft_consensus.cc:1064] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:09.349527 22695 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:09.356396 21904 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.357885 22555 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.358259 22656 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.371779 22662 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.379568 21832 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.381321 22662 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:09.389449 22604 raft_consensus.cc:1064] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:09.403591 22604 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:09.412560 21901 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.407013 22656 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.423406 21832 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.438532 21904 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.439255 22552 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.442840 22661 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.438532 22555 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.446907 22661 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.451340 21979 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.452605 21732 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.457850 22696 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.481626 22604 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.483184 21977 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.497426 22552 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.528398 21728 catalog_manager.cc:5697] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.545336 21902 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.575743 21832 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:09.576005 21977 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:09.585309 22552 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:09.587586 22552 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:09.590663 22626 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.591358 22604 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.605479 21901 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:09.607596 22662 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.617956 22662 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.624176 21977 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:09.630671 22696 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.634219 22552 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.634719 21977 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.644752 22661 raft_consensus.cc:1064] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:09.647220 22661 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:09.649518 21901 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.658804 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 911b6cb205984b78bafd3ecdcc02ef3c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:09.663563 22555 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.618602 22697 raft_consensus.cc:2955] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.665335 22696 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:09.679786 21728 catalog_manager.cc:5697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.682825 22552 raft_consensus.cc:2955] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.696131 21719 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f4dac7f6b7b440d84e044b62b559aae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:09.685549 21731 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.716847 21977 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.721187 22715 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.722129 21901 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.724498 22713 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.730937 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f4dac7f6b7b440d84e044b62b559aae with delete_type TABLET_DATA_TOMBSTONED (TS ac1dd8ad9fc44263932ec57d9376a271 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45472
I20260709 13:05:09.737751 22714 raft_consensus.cc:1064] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:09.738472 21821 tablet_service.cc:1558] Processing DeleteTablet for tablet 911b6cb205984b78bafd3ecdcc02ef3c with delete_type TABLET_DATA_TOMBSTONED (TS 479255846c5141b584b16aa253f587c7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40618
I20260709 13:05:09.740922 22714 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:09.762027 22720 tablet_replica.cc:333] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:05:09.768496 22720 raft_consensus.cc:2243] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.776108 22720 raft_consensus.cc:2272] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.775475 22717 tablet_replica.cc:333] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:05:09.782670 22717 raft_consensus.cc:2243] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.785512 22604 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.783720 22717 raft_consensus.cc:2272] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.787252 22720 ts_tablet_manager.cc:1916] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:09.794796 22717 ts_tablet_manager.cc:1916] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:09.803277 21901 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.820690 22555 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.841529 22720 ts_tablet_manager.cc:1929] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:09.843040 22552 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.846237 22696 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.851068 21978 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.852373 21977 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.855604 21728 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.842043 22720 log.cc:1199] T 911b6cb205984b78bafd3ecdcc02ef3c P 479255846c5141b584b16aa253f587c7: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/wals/911b6cb205984b78bafd3ecdcc02ef3c
I20260709 13:05:09.864079 21719 catalog_manager.cc:5028] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): tablet 911b6cb205984b78bafd3ecdcc02ef3c (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:09.878490 22604 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.881880 21904 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:09.885619 21833 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:09.886137 22696 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:09.899747 22552 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:09.901340 21902 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:09.902616 22714 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.916404 22697 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:09.916018 22552 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.919416 22696 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.925923 21902 raft_consensus.cc:2955] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.938513 22717 ts_tablet_manager.cc:1929] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:09.938949 21730 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.938975 22717 log.cc:1199] T 9f4dac7f6b7b440d84e044b62b559aae P ac1dd8ad9fc44263932ec57d9376a271: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/wals/9f4dac7f6b7b440d84e044b62b559aae
I20260709 13:05:09.947487 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet 9f4dac7f6b7b440d84e044b62b559aae (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:09.946635 22661 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.957290 21719 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cc0e6a6fba594f8db28b949dbce488c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:09.959226 21902 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.970530 22552 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.970641 21976 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.978267 21970 tablet_service.cc:1558] Processing DeleteTablet for tablet cc0e6a6fba594f8db28b949dbce488c7 with delete_type TABLET_DATA_TOMBSTONED (TS 3d76b2c4699e43fba10eeb81a91e4913 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39160
I20260709 13:05:09.990267 21728 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:09.997083 22725 tablet_replica.cc:333] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:05:10.010578 22725 raft_consensus.cc:2243] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.011319 22725 raft_consensus.cc:2272] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.014333 22725 ts_tablet_manager.cc:1916] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:10.023588 21832 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:10.030593 21976 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:10.030805 22552 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:10.031400 22725 ts_tablet_manager.cc:1929] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:10.031880 22725 log.cc:1199] T cc0e6a6fba594f8db28b949dbce488c7 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/wals/cc0e6a6fba594f8db28b949dbce488c7
I20260709 13:05:10.031924 22697 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:10.033994 22696 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:10.034298 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet cc0e6a6fba594f8db28b949dbce488c7 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:10.042135 21976 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:10.043108 22661 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:10.049259 22552 raft_consensus.cc:2955] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:10.059161 21719 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f5da3aecad04fb0982188c37426f599 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:10.060405 21731 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New cstate: current_term: 1 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:10.075320 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f5da3aecad04fb0982188c37426f599 with delete_type TABLET_DATA_TOMBSTONED (TS ac1dd8ad9fc44263932ec57d9376a271 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45472
I20260709 13:05:10.076370 22717 tablet_replica.cc:333] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:05:10.077523 22717 raft_consensus.cc:2243] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.078253 22717 raft_consensus.cc:2272] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.084136 22717 ts_tablet_manager.cc:1916] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:10.096029 22717 ts_tablet_manager.cc:1929] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:10.096371 22717 log.cc:1199] T 6f5da3aecad04fb0982188c37426f599 P ac1dd8ad9fc44263932ec57d9376a271: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/wals/6f5da3aecad04fb0982188c37426f599
I20260709 13:05:10.097999 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet 6f5da3aecad04fb0982188c37426f599 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:11.150547 21976 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:11.156605 21832 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:11.157714 21948 consensus_peers.cc:597] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 554595014abc431286bf4ba1922fc147. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:11.158005 22695 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.160715 21902 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:11.162362 22695 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.165870 22657 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.167721 21832 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.176316 21902 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.180733 21976 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:11.204452 21732 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.240758 21904 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:11.242937 22657 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:11.244729 21948 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14d5f024a39b4860be959c964acb51e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:11.244922 21832 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:11.267742 22695 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:11.284220 22727 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.287638 21901 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.352350 21832 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.324666 21732 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.387409 21901 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:11.410527 21976 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:11.412060 21832 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:11.412009 22506 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:11.413671 22636 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.434150 22506 raft_consensus.cc:2955] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.443576 21832 raft_consensus.cc:2955] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.447811 21976 raft_consensus.cc:2955] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
W20260709 13:05:11.454844 21874 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed07e2d846e24b06abb770ea1376b9fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:11.467051 21732 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.478298 21901 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:11.485558 21976 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:11.487373 21874 consensus_peers.cc:597] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 535de8a48bb34b5f9976321c2d08b8d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:11.487700 21832 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:11.488059 22506 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.489266 22748 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.505885 22748 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.508909 21833 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.536615 21728 catalog_manager.cc:5697] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.526497 21976 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:11.579085 22753 ts_tablet_manager.cc:933] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:11.590512 22753 tablet_copy_client.cc:323] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:11.592170 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 554595014abc431286bf4ba1922fc147 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:11.592747 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 554595014abc431286bf4ba1922fc147 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-554595014abc431286bf4ba1922fc147
I20260709 13:05:11.614033 21993 tablet_copy_source_session.cc:215] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:11.618417 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554595014abc431286bf4ba1922fc147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.654973 22753 tablet_copy_client.cc:806] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:11.655568 22753 tablet_copy_client.cc:670] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:11.659916 22753 tablet_copy_client.cc:538] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:11.669159 22753 tablet_bootstrap.cc:492] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:11.695420 22753 tablet_bootstrap.cc:492] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:11.696291 22753 tablet_bootstrap.cc:492] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:11.696943 22753 ts_tablet_manager.cc:1403] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.009s
I20260709 13:05:11.700052 22753 raft_consensus.cc:359] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:11.700940 22753 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:11.701607 22753 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:11.706120 22753 ts_tablet_manager.cc:1434] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:05:11.707811 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-554595014abc431286bf4ba1922fc147 received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:11.708259 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-554595014abc431286bf4ba1922fc147 on tablet 554595014abc431286bf4ba1922fc147 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:11.746608 22753 ts_tablet_manager.cc:933] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:11.748462 22753 tablet_copy_client.cc:323] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:11.750120 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 14d5f024a39b4860be959c964acb51e6 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:11.750739 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 14d5f024a39b4860be959c964acb51e6 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-14d5f024a39b4860be959c964acb51e6
I20260709 13:05:11.760057 21993 tablet_copy_source_session.cc:215] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:11.765231 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d5f024a39b4860be959c964acb51e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.787230 22753 tablet_copy_client.cc:806] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:11.787909 22753 tablet_copy_client.cc:670] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:11.794466 22753 tablet_copy_client.cc:538] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:11.807080 22753 tablet_bootstrap.cc:492] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:11.865665 22758 ts_tablet_manager.cc:933] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:11.875073 22753 tablet_bootstrap.cc:492] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:11.877339 22753 tablet_bootstrap.cc:492] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:11.878892 22758 tablet_copy_client.cc:323] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:05:11.912613 22753 ts_tablet_manager.cc:1403] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.013s
I20260709 13:05:11.924772 22753 raft_consensus.cc:359] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:11.935966 22753 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:11.938292 22753 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:11.957634 22753 ts_tablet_manager.cc:1434] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.003s
I20260709 13:05:11.965850 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-14d5f024a39b4860be959c964acb51e6 received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:11.966346 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-14d5f024a39b4860be959c964acb51e6 on tablet 14d5f024a39b4860be959c964acb51e6 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:11.971349 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet ed07e2d846e24b06abb770ea1376b9fb from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
I20260709 13:05:11.971849 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet ed07e2d846e24b06abb770ea1376b9fb from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-ed07e2d846e24b06abb770ea1376b9fb
I20260709 13:05:11.992537 21919 tablet_copy_source_session.cc:215] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:11.995527 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed07e2d846e24b06abb770ea1376b9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.013684 22758 tablet_copy_client.cc:806] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:12.014245 22758 tablet_copy_client.cc:670] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:12.017724 22758 tablet_copy_client.cc:538] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:12.027024 22758 tablet_bootstrap.cc:492] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:12.054769 22758 tablet_bootstrap.cc:492] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:12.055646 22758 tablet_bootstrap.cc:492] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:12.056272 22758 ts_tablet_manager.cc:1403] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.014s
I20260709 13:05:12.059197 22758 raft_consensus.cc:359] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:12.060011 22758 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:12.060663 22758 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:12.063090 22758 ts_tablet_manager.cc:1434] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:12.065490 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-ed07e2d846e24b06abb770ea1376b9fb received from {username='slave'} at 127.0.0.1:55690
I20260709 13:05:12.065940 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-ed07e2d846e24b06abb770ea1376b9fb on tablet ed07e2d846e24b06abb770ea1376b9fb with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:12.074607 22555 raft_consensus.cc:1217] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:12.096729 22758 ts_tablet_manager.cc:933] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:12.104434 22758 tablet_copy_client.cc:323] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:05:12.106192 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet 535de8a48bb34b5f9976321c2d08b8d6 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
I20260709 13:05:12.106746 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet 535de8a48bb34b5f9976321c2d08b8d6 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-535de8a48bb34b5f9976321c2d08b8d6
I20260709 13:05:12.115896 21919 tablet_copy_source_session.cc:215] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:12.119433 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535de8a48bb34b5f9976321c2d08b8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.140012 22758 tablet_copy_client.cc:806] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:12.140666 22758 tablet_copy_client.cc:670] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:12.145458 22758 tablet_copy_client.cc:538] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:12.153774 22758 tablet_bootstrap.cc:492] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:12.185475 22758 tablet_bootstrap.cc:492] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:12.186425 22758 tablet_bootstrap.cc:492] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:12.187201 22758 ts_tablet_manager.cc:1403] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.009s
I20260709 13:05:12.190397 22758 raft_consensus.cc:359] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:12.192199 22758 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:12.193042 22758 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:12.195783 22758 ts_tablet_manager.cc:1434] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:05:12.212816 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-535de8a48bb34b5f9976321c2d08b8d6 received from {username='slave'} at 127.0.0.1:55690
I20260709 13:05:12.216176 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-535de8a48bb34b5f9976321c2d08b8d6 on tablet 535de8a48bb34b5f9976321c2d08b8d6 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:12.343771 22555 raft_consensus.cc:1217] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:12.404096 22555 raft_consensus.cc:1217] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:12.628690 22695 raft_consensus.cc:1064] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:12.632392 22695 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:12.656632 21909 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:12.664376 22727 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.692123 21825 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:12.692955 22552 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:12.693481 22695 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.701362 22727 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.709887 22552 raft_consensus.cc:1217] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:05:12.831054 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 59443.6us
I20260709 13:05:12.832441 22742 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:12.844730 21901 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:12.848565 22552 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:12.863786 21728 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:05:12.877344 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 55180.1us
I20260709 13:05:12.910753 22506 raft_consensus.cc:1064] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:12.913429 22506 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:12.933434 22695 raft_consensus.cc:1064] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:12.935492 22695 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:12.932124 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 54328.7us
I20260709 13:05:12.943612 21832 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:12.950096 22552 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:12.951339 21825 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:12.951354 22636 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:12.953112 22636 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.956424 21978 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:12.963629 21977 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:12.965866 22748 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.983009 21901 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:12.983309 22555 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:12.984617 22739 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:12.986399 22772 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:12.987628 21901 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:12.988888 22555 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:12.988996 22773 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:12.993752 22739 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:12.994196 21902 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:12.996016 22727 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.001034 22748 raft_consensus.cc:2955] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.005872 22555 raft_consensus.cc:2955] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.010149 21832 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:13.015455 22742 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:13.029898 22553 raft_consensus.cc:2955] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.039136 21731 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.040827 21731 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:13.057485 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48124.9us
I20260709 13:05:13.059891 21832 raft_consensus.cc:2955] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.063910 21821 tablet_service.cc:1558] Processing DeleteTablet for tablet 554595014abc431286bf4ba1922fc147 with delete_type TABLET_DATA_TOMBSTONED (TS 479255846c5141b584b16aa253f587c7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40618
I20260709 13:05:13.075495 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 554595014abc431286bf4ba1922fc147 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:13.087924 22739 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.143193 22789 tablet_replica.cc:333] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:05:13.147166 21901 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:13.152307 21731 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.157686 22555 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:13.160727 21825 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.163251 22789 raft_consensus.cc:2243] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.164251 22553 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.165191 21832 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:13.165216 22789 raft_consensus.cc:2272] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.164701 22636 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:05:13.182075 22789 ts_tablet_manager.cc:1916] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:13.164251 21901 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.192245 22748 raft_consensus.cc:2955] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.195291 21978 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:13.195559 22555 raft_consensus.cc:2955] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.212669 21731 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.216692 22785 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:13.228343 22552 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:13.228829 21970 tablet_service.cc:1558] Processing DeleteTablet for tablet ed07e2d846e24b06abb770ea1376b9fb with delete_type TABLET_DATA_TOMBSTONED (TS 3d76b2c4699e43fba10eeb81a91e4913 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39160
I20260709 13:05:13.230274 21833 raft_consensus.cc:2955] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.232151 22695 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:13.247449 22552 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.251737 21832 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:13.246146 22727 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.253686 22773 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:13.263861 21832 raft_consensus.cc:2955] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.273974 22791 tablet_replica.cc:333] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:05:13.281375 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14d5f024a39b4860be959c964acb51e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:13.291554 22791 raft_consensus.cc:2243] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.293341 22791 pending_rounds.cc:70] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: Trying to abort 1 pending ops.
I20260709 13:05:13.297688 21731 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.305450 21718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ed07e2d846e24b06abb770ea1376b9fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:13.295899 22791 pending_rounds.cc:77] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635073686274048 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } } }
I20260709 13:05:13.306708 22791 raft_consensus.cc:2917] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:05:13.307149 22791 raft_consensus.cc:2889] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:05:13.307507 22791 raft_consensus.cc:2272] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.309875 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d5f024a39b4860be959c964acb51e6 with delete_type TABLET_DATA_TOMBSTONED (TS ac1dd8ad9fc44263932ec57d9376a271 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45472
I20260709 13:05:13.323174 22789 ts_tablet_manager.cc:1929] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:13.323648 22789 log.cc:1199] T 554595014abc431286bf4ba1922fc147 P 479255846c5141b584b16aa253f587c7: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/wals/554595014abc431286bf4ba1922fc147
I20260709 13:05:13.325805 21719 catalog_manager.cc:5028] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): tablet 554595014abc431286bf4ba1922fc147 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:13.331770 22636 raft_consensus.cc:1064] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:13.333889 22636 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:13.340801 22791 ts_tablet_manager.cc:1916] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:13.354257 22792 tablet_replica.cc:333] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:05:13.355472 22792 raft_consensus.cc:2243] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.355877 22552 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:13.358469 21978 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:13.360064 21832 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:13.362111 22636 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:13.363294 22790 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:13.365177 22748 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:13.370970 22791 ts_tablet_manager.cc:1929] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:13.373507 22791 log.cc:1199] T ed07e2d846e24b06abb770ea1376b9fb P 3d76b2c4699e43fba10eeb81a91e4913: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/wals/ed07e2d846e24b06abb770ea1376b9fb
I20260709 13:05:13.376569 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet ed07e2d846e24b06abb770ea1376b9fb (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:13.377815 22792 raft_consensus.cc:2272] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.382918 22792 ts_tablet_manager.cc:1916] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:13.390558 22748 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.401213 22792 ts_tablet_manager.cc:1929] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:13.401702 22792 log.cc:1199] T 14d5f024a39b4860be959c964acb51e6 P ac1dd8ad9fc44263932ec57d9376a271: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/wals/14d5f024a39b4860be959c964acb51e6
I20260709 13:05:13.402415 22552 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.403692 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet 14d5f024a39b4860be959c964acb51e6 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:13.424587 21728 catalog_manager.cc:5697] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.433203 21978 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.421098 21832 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.447172 21902 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:13.457921 22552 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:13.460122 22790 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:13.465204 21976 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:13.480872 22785 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:13.484500 22785 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.485707 22552 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.501231 21732 catalog_manager.cc:5697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.501885 21976 raft_consensus.cc:2955] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:13.510821 21718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 535de8a48bb34b5f9976321c2d08b8d6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:13.514343 21821 tablet_service.cc:1558] Processing DeleteTablet for tablet 535de8a48bb34b5f9976321c2d08b8d6 with delete_type TABLET_DATA_TOMBSTONED (TS 479255846c5141b584b16aa253f587c7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40618
I20260709 13:05:13.515224 22789 tablet_replica.cc:333] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:05:13.516076 22789 raft_consensus.cc:2243] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:13.516673 22789 raft_consensus.cc:2272] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:13.519949 22789 ts_tablet_manager.cc:1916] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:13.534523 22789 ts_tablet_manager.cc:1929] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:13.534816 22789 log.cc:1199] T 535de8a48bb34b5f9976321c2d08b8d6 P 479255846c5141b584b16aa253f587c7: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/wals/535de8a48bb34b5f9976321c2d08b8d6
I20260709 13:05:13.535979 21719 catalog_manager.cc:5028] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): tablet 535de8a48bb34b5f9976321c2d08b8d6 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:14.579417 21978 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:14.585767 21901 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:14.587368 21832 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:14.587998 21948 consensus_peers.cc:597] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a451fba336b41e5954a827976c17a50. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.588718 22773 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.589578 22695 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.604156 22695 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.606087 21901 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.607225 21825 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.618399 21905 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:14.626227 21731 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
W20260709 13:05:14.631078 21874 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bccfbbc2aaa5423fb599eeb56b38121c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.632599 21825 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:14.633846 22785 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.634855 21977 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:14.636059 22785 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.642753 22748 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.646195 21825 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.660356 21977 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.665079 21978 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:14.671193 21732 catalog_manager.cc:5697] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.685155 21901 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:14.686082 21948 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a439d1de6924cf49dda5333182516bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.687434 21825 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:14.687778 22803 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.692389 22803 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.698067 22695 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.699793 21901 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.701045 21825 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.712450 21905 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:14.718377 21728 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.726507 21978 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:14.728226 21874 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24f26969ffdf4e1eb377ceacb0750ca5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.730228 22748 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:14.729195 21825 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:14.733345 22811 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.746841 22785 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.750819 21825 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:14.768230 21728 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.779100 21978 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:15.084398 22819 ts_tablet_manager.cc:933] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:15.086297 22819 tablet_copy_client.cc:323] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:05:15.087790 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet bccfbbc2aaa5423fb599eeb56b38121c from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
I20260709 13:05:15.088295 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet bccfbbc2aaa5423fb599eeb56b38121c from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-bccfbbc2aaa5423fb599eeb56b38121c
I20260709 13:05:15.092942 21919 tablet_copy_source_session.cc:215] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:15.095233 22819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccfbbc2aaa5423fb599eeb56b38121c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.109867 22819 tablet_copy_client.cc:806] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:15.110419 22819 tablet_copy_client.cc:670] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:15.113847 22819 tablet_copy_client.cc:538] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:15.122222 22819 tablet_bootstrap.cc:492] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:15.146150 22819 tablet_bootstrap.cc:492] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:15.147312 22819 tablet_bootstrap.cc:492] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:15.148008 22819 ts_tablet_manager.cc:1403] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.007s
I20260709 13:05:15.150885 22819 raft_consensus.cc:359] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:15.151623 22819 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:15.152136 22819 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:15.154069 22823 ts_tablet_manager.cc:933] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:15.156777 22819 ts_tablet_manager.cc:1434] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:15.296192 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-bccfbbc2aaa5423fb599eeb56b38121c received from {username='slave'} at 127.0.0.1:55690
I20260709 13:05:15.296749 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-bccfbbc2aaa5423fb599eeb56b38121c on tablet bccfbbc2aaa5423fb599eeb56b38121c with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:15.299243 22819 ts_tablet_manager.cc:933] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:15.354460 22819 tablet_copy_client.cc:323] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:15.435113 22823 tablet_copy_client.cc:323] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
W20260709 13:05:15.441764 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 132144us
I20260709 13:05:15.442780 22821 ts_tablet_manager.cc:933] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:15.502521 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 9a451fba336b41e5954a827976c17a50 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:15.502765 21992 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 9a439d1de6924cf49dda5333182516bb from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:15.503132 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 9a451fba336b41e5954a827976c17a50 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-9a451fba336b41e5954a827976c17a50
I20260709 13:05:15.507071 21992 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 9a439d1de6924cf49dda5333182516bb from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-9a439d1de6924cf49dda5333182516bb
I20260709 13:05:15.519755 21992 tablet_copy_source_session.cc:215] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:15.535068 22823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a439d1de6924cf49dda5333182516bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:15.539482 22821 tablet_copy_client.cc:323] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:05:15.637915 21993 tablet_copy_source_session.cc:215] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:05:15.819408 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 255033us
I20260709 13:05:16.032833 22819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a451fba336b41e5954a827976c17a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.179679 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60024 (request call id 102) took 1032 ms. Trace:
I20260709 13:05:16.179997 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60024 (request call id 101) took 1049 ms. Trace:
I20260709 13:05:16.180424 22819 rpcz_store.cc:276] 0709 13:05:15.147742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.147847 (+   105us) service_pool.cc:224] Handling call
0709 13:05:15.299552 (+151705us) ts_tablet_manager.cc:934] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
0709 13:05:16.031695 (+732143us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:16.172105 (+140410us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:16.172245 (+   140us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:16.178898 (+  6653us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:16.179206 (+   308us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:16.179521 (+   315us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:16.179587 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":16603,"tablet-copy.queue_time_us":150968,"thread_start_us":43011,"threads_started":2}
I20260709 13:05:16.180526 22823 rpcz_store.cc:276] 0709 13:05:15.130291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.130422 (+   131us) service_pool.cc:224] Handling call
0709 13:05:15.154487 (+ 24065us) ts_tablet_manager.cc:934] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
0709 13:05:15.533503 (+379016us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:15.921989 (+388486us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:15.922132 (+   143us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:16.179271 (+257139us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:16.179565 (+   294us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:16.179847 (+   282us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:16.179915 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":11308,"tablet-copy.queue_time_us":23186,"thread_start_us":497070,"threads_started":2}
I20260709 13:05:16.182910 22819 tablet_copy_client.cc:806] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:16.183363 22823 tablet_copy_client.cc:806] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:16.183588 22819 tablet_copy_client.cc:670] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:16.183797 22823 tablet_copy_client.cc:670] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
W20260709 13:05:16.198302 21800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.003s	sys 0.018s
W20260709 13:05:16.199663 21800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.003s	sys 0.018s
I20260709 13:05:16.223130 22846 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.223500 22846 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:16.225342 21797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.000s	sys 0.007s
W20260709 13:05:16.225703 21797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.000s	sys 0.008s
I20260709 13:05:16.225342 22846 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.248997 22850 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:16.256513 22850 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.262157 22850 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.267660 22846 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:16.268316 22846 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.267762 22842 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:16.270285 22846 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.270633 22842 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.272573 22842 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:16.282544 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.017s	sys 0.024s
W20260709 13:05:16.282989 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.018s	sys 0.024s
W20260709 13:05:16.283300 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 887997us
I20260709 13:05:16.289021 22852 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:16.289598 22852 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:16.294059 22854 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:16.294232 22831 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.304106 22831 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.304840 22847 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.305385 22847 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.301934 22760 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:16.306111 22831 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:16.307539 22842 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:16.306633 22760 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:16.310381 22846 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.316464 22846 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.318400 22846 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.318836 22846 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.319239 22846 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.320773 22760 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:16.320996 22846 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.313189 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:16.308032 22842 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.325119 22760 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.328119 22760 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.325517 22846 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.330283 22846 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.315677 22847 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.345041 22847 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.345492 22847 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.348577 22846 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.349036 22846 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.349426 22846 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.349830 22828 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:16.326445 22854 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.364799 22854 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.365309 22854 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:16.365837 22854 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.368338 22854 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.356530 22847 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.369058 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.292059 22852 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:16.374356 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 69753.5us
I20260709 13:05:16.351368 22846 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:16.375288 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49025.7us
W20260709 13:05:16.375584 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 80129.8us
I20260709 13:05:16.343463 22842 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:16.376849 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47138.5us
I20260709 13:05:16.413398 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.414122 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.405016 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.418952 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.378198 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.398211 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.410981 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.411650 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:16.376641 22855 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:16.426640 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.428158 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:16.428529 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49870.7us
W20260709 13:05:16.430109 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46726.1us
I20260709 13:05:16.432138 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.343667 22760 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.412315 22828 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.450894 22760 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.451422 22760 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.454061 22828 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:16.454856 22760 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.457149 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.458701 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.459993 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.463407 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.425388 22855 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.466367 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet 24f26969ffdf4e1eb377ceacb0750ca5 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
I20260709 13:05:16.472389 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet 24f26969ffdf4e1eb377ceacb0750ca5 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-24f26969ffdf4e1eb377ceacb0750ca5
I20260709 13:05:16.473492 22819 tablet_copy_client.cc:538] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:16.478406 22823 tablet_copy_client.cc:538] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:16.482787 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.467448 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:16.483604 21825 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:16.467736 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:16.486071 22760 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.486567 22760 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:16.467954 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 50391.7us
I20260709 13:05:16.488422 22760 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.490911 22553 raft_consensus.cc:1217] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:16.497212 22819 tablet_bootstrap.cc:492] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:16.494565 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:16.501545 22826 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:16.507848 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.511322 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.529565 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.534549 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.501925 22826 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.544904 22760 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.545400 22760 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.550491 22830 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:16.544840 22826 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.554352 22760 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:16.558328 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.556878 22830 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.569067 22830 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:16.580997 21919 tablet_copy_source_session.cc:215] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:16.586071 22821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f26969ffdf4e1eb377ceacb0750ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.589599 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.606041 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:16.586127 22826 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.602797 22855 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:16.614503 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44075.7us
I20260709 13:05:16.615274 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.617551 22864 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.622522 22826 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:16.625639 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.626003 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:16.629045 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:16.629153 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.629498 22823 tablet_bootstrap.cc:492] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:16.634197 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.635154 22868 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.635504 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:16.638906 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:16.640077 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:57008 (request call id 30) took 1207 ms. Trace:
I20260709 13:05:16.640664 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:16.640592 22821 rpcz_store.cc:276] 0709 13:05:15.438751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.441422 (+  2671us) service_pool.cc:224] Handling call
0709 13:05:15.452338 (+ 10916us) ts_tablet_manager.cc:934] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
0709 13:05:16.584982 (+1132644us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:16.596016 (+ 11034us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:16.596107 (+    91us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:16.639364 (+ 43257us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:16.639661 (+   297us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:16.639966 (+   305us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:16.640021 (+    55us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":251,"tablet-copy.queue_time_us":125,"thread_start_us":80614,"threads_started":1}
I20260709 13:05:16.642182 22821 tablet_copy_client.cc:806] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:16.642774 22821 tablet_copy_client.cc:670] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:16.642844 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.644559 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:16.645583 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:16.648785 22826 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.646613 22821 tablet_copy_client.cc:538] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:16.650357 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.652592 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.659768 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.660609 22821 tablet_bootstrap.cc:492] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:16.661972 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.666000 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.668500 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.673444 22823 tablet_bootstrap.cc:492] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:16.674420 22823 tablet_bootstrap.cc:492] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:16.675081 22823 ts_tablet_manager.cc:1403] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.007s
I20260709 13:05:16.675007 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.677695 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.678153 22823 raft_consensus.cc:359] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.679069 22823 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:16.679744 22823 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.683290 21979 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:16.685534 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.688158 22855 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:16.689049 22855 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:16.689364 22855 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:16.690142 22855 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.690359 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.691223 22855 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.688508 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.717394 22819 tablet_bootstrap.cc:492] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:16.718310 22823 ts_tablet_manager.cc:1434] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:05:16.694749 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:16.723990 22819 tablet_bootstrap.cc:492] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:16.724646 22819 ts_tablet_manager.cc:1403] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.228s	user 0.022s	sys 0.004s
I20260709 13:05:16.726679 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-9a439d1de6924cf49dda5333182516bb received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:16.727142 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-9a439d1de6924cf49dda5333182516bb on tablet 9a439d1de6924cf49dda5333182516bb with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:16.727401 22819 raft_consensus.cc:359] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.728201 22819 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:16.721932 21875 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:16.737080 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.737808 22760 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.737843 22850 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.743276 21798 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.743957 22760 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.745050 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.745747 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:16.747293 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:16.748023 22852 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.749486 22760 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.747375 22850 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.728812 22819 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.755474 22819 ts_tablet_manager.cc:1434] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:05:16.758678 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-9a451fba336b41e5954a827976c17a50 received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:16.759114 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-9a451fba336b41e5954a827976c17a50 on tablet 9a451fba336b41e5954a827976c17a50 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:16.776136 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.777081 22862 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.778379 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.781071 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:16.782698 22859 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.779086 22862 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.789060 22821 tablet_bootstrap.cc:492] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:16.791154 22821 tablet_bootstrap.cc:492] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:16.791819 22821 ts_tablet_manager.cc:1403] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.131s	user 0.033s	sys 0.029s
I20260709 13:05:16.795185 22821 raft_consensus.cc:359] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.797868 22821 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:16.798580 22821 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:16.803601 22821 ts_tablet_manager.cc:1434] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:16.807082 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-24f26969ffdf4e1eb377ceacb0750ca5 received from {username='slave'} at 127.0.0.1:55690
I20260709 13:05:16.807516 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-24f26969ffdf4e1eb377ceacb0750ca5 on tablet 24f26969ffdf4e1eb377ceacb0750ca5 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:16.782359 21798 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.820350 22862 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.821519 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.822466 22853 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.822675 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.826391 22853 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.826875 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.828104 22853 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.828054 21798 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.830726 22853 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.830979 21798 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.832885 22853 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.838697 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.839376 22862 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.840646 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.841396 22862 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.842499 21798 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.843199 22862 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.846321 22852 raft_consensus.cc:1064] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:16.848953 22852 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:16.866142 22826 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:16.866724 22826 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:16.883920 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:16.885516 22826 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:16.887079 22850 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.891218 22553 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:16.889837 22552 raft_consensus.cc:1217] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:16.893795 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:16.895870 22849 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:16.900480 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:16.901481 22855 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:16.916854 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47837.6us
I20260709 13:05:16.919317 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:16.925462 22552 raft_consensus.cc:1217] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:16.934248 21983 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:16.937408 22855 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:16.941921 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:16.944310 22868 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.989018 21826 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:16.990948 22852 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.006021 22553 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.026803 21732 catalog_manager.cc:5697] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.017244 21979 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.031818 22855 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.076526 21826 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.276151 22553 raft_consensus.cc:1217] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:05:17.360659 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6320 after lost signal to thread 20697
W20260709 13:05:17.362512 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080029a640 after lost signal to thread 21766
W20260709 13:05:17.369488 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080032e020 after lost signal to thread 21858
W20260709 13:05:17.371259 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080032e8e0 after lost signal to thread 21933
W20260709 13:05:17.373723 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08003296e0 after lost signal to thread 22007
W20260709 13:05:17.378134 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08002b02a0 after lost signal to thread 22579
I20260709 13:05:17.463225 22852 raft_consensus.cc:1064] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:17.468012 22852 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:17.487548 21829 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:17.489180 21983 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:17.492473 22852 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:17.494206 22552 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:17.496554 22855 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:17.497285 22826 raft_consensus.cc:1064] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:17.500880 22826 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:17.513870 22855 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:17.564131 21834 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:17.565940 21906 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:17.565896 22867 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:17.569142 22553 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:17.573307 22849 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.575870 21826 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.589421 22826 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:17.591915 22826 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.610359 21731 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.601596 22553 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.628260 21979 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.693773 22830 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.708732 21900 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.712679 22552 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.716841 21829 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.748704 21900 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:17.758767 22552 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:17.759878 21730 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.760707 22855 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:17.763069 21829 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:17.764990 22855 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:17.773065 22552 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.773968 22850 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.792870 21979 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:17.793752 21906 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:17.789284 21729 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.825655 22553 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:17.827551 22849 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:17.829171 21834 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:17.830189 21970 tablet_service.cc:1558] Processing DeleteTablet for tablet 24f26969ffdf4e1eb377ceacb0750ca5 with delete_type TABLET_DATA_TOMBSTONED (TS 3d76b2c4699e43fba10eeb81a91e4913 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39160
I20260709 13:05:17.831409 22852 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:17.839668 22553 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:17.841118 22851 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.843003 22867 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:17.850113 22893 tablet_replica.cc:333] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:05:17.851502 22893 raft_consensus.cc:2243] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.852306 22893 raft_consensus.cc:2272] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.854063 22830 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.858985 22555 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.868657 22893 ts_tablet_manager.cc:1916] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:17.868381 21826 raft_consensus.cc:2955] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.876349 21729 catalog_manager.cc:5697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.882718 21834 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:17.895226 21718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bccfbbc2aaa5423fb599eeb56b38121c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:17.882032 21829 raft_consensus.cc:2955] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.903893 21718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 24f26969ffdf4e1eb377ceacb0750ca5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:17.925326 22893 ts_tablet_manager.cc:1929] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:17.926007 22893 log.cc:1199] T 24f26969ffdf4e1eb377ceacb0750ca5 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/wals/24f26969ffdf4e1eb377ceacb0750ca5
I20260709 13:05:17.928752 21970 tablet_service.cc:1558] Processing DeleteTablet for tablet bccfbbc2aaa5423fb599eeb56b38121c with delete_type TABLET_DATA_TOMBSTONED (TS 3d76b2c4699e43fba10eeb81a91e4913 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39160
I20260709 13:05:17.930539 22867 raft_consensus.cc:1064] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:17.931195 22893 tablet_replica.cc:333] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:05:17.931017 22552 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.947274 22867 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:17.950543 22826 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:17.959039 21826 raft_consensus.cc:2955] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.958321 22893 raft_consensus.cc:2243] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.965083 22852 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.965606 22852 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:17.966989 22893 raft_consensus.cc:2272] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.968334 22852 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:17.969446 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:17.970299 21729 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:17.978567 22893 ts_tablet_manager.cc:1916] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:17.985844 21829 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:17.987491 22896 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:17.991842 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a439d1de6924cf49dda5333182516bb with delete_type TABLET_DATA_TOMBSTONED (TS ac1dd8ad9fc44263932ec57d9376a271 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45472
W20260709 13:05:17.999068 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 62924.9us
I20260709 13:05:18.000190 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet 24f26969ffdf4e1eb377ceacb0750ca5 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:18.000983 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a439d1de6924cf49dda5333182516bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:18.001335 21900 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:18.003715 22552 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:18.007869 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:18.008401 21979 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:18.009119 22867 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.009622 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:18.010948 22852 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:18.011056 22867 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.011324 22852 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.011770 22852 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.027038 22852 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:18.029867 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:18.043239 22852 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:18.054895 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:18.055660 21974 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.053754 22899 tablet_replica.cc:333] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:05:18.058609 22899 raft_consensus.cc:2243] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.059409 22899 raft_consensus.cc:2272] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.060484 22867 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:18.066697 22899 ts_tablet_manager.cc:1916] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:18.068608 22893 ts_tablet_manager.cc:1929] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:18.069067 22893 log.cc:1199] T bccfbbc2aaa5423fb599eeb56b38121c P 3d76b2c4699e43fba10eeb81a91e4913: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/wals/bccfbbc2aaa5423fb599eeb56b38121c
I20260709 13:05:18.069844 21906 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:18.071056 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet bccfbbc2aaa5423fb599eeb56b38121c (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:18.082405 22552 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:18.084004 21974 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:18.108407 21728 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:18.111402 22899 ts_tablet_manager.cc:1929] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:18.111960 22899 log.cc:1199] T 9a439d1de6924cf49dda5333182516bb P ac1dd8ad9fc44263932ec57d9376a271: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/wals/9a439d1de6924cf49dda5333182516bb
I20260709 13:05:18.113490 21829 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:18.125895 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:18.127384 22852 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:18.128165 22852 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:18.129177 22852 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:18.137387 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet 9a439d1de6924cf49dda5333182516bb (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:18.162259 21728 catalog_manager.cc:5697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.169252 21979 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:18.174917 22552 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:18.176703 22895 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:18.186635 21903 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:18.191980 22867 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:18.195904 22552 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:18.197117 21903 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:18.188337 22895 raft_consensus.cc:2955] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:18.222342 21728 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:18.232877 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a451fba336b41e5954a827976c17a50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:18.234087 21821 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a451fba336b41e5954a827976c17a50 with delete_type TABLET_DATA_TOMBSTONED (TS 479255846c5141b584b16aa253f587c7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40618
I20260709 13:05:18.258981 22903 tablet_replica.cc:333] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:05:18.260179 22903 raft_consensus.cc:2243] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.260989 22903 raft_consensus.cc:2272] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.265939 22903 ts_tablet_manager.cc:1916] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:18.285292 22903 ts_tablet_manager.cc:1929] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:18.285853 22903 log.cc:1199] T 9a451fba336b41e5954a827976c17a50 P 479255846c5141b584b16aa253f587c7: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/wals/9a451fba336b41e5954a827976c17a50
I20260709 13:05:18.288180 21719 catalog_manager.cc:5028] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): tablet 9a451fba336b41e5954a827976c17a50 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:18.555073 21829 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.559755 21979 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:18.560340 21829 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:18.561008 22852 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.561920 22851 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.367044 21979 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:19.379237 21829 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:19.380807 22896 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.381489 21903 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:19.381688 21948 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa248ef2ee9049c9a1f86b77185b86a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.383271 22896 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.390565 22910 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.392877 21829 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.394567 21903 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.410962 21729 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.415632 21979 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:19.424067 21903 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:19.430619 22867 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.433807 21829 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:19.435135 22867 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:19.435968 21948 consensus_peers.cc:597] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f2f8130ad944310bea7f2f3d408309f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.455940 22896 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.458516 21906 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.466526 21826 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.490846 21979 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:19.505115 21728 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.517995 21906 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:19.519518 21948 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 094b605ab81240b687b2fd4857aee3c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.519634 21826 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:19.520089 22910 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.521154 22867 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.532604 22867 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.534461 21826 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.553607 21730 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.565027 21903 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:19.560613 21906 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
W20260709 13:05:19.585119 21874 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18adc37fa2ee428c9cdcfe76e72e77a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.585448 21974 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:19.589562 22851 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.601162 21826 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:19.616655 22851 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.615939 22923 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.629730 21826 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.629720 21974 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:19.644554 21730 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.901952 22928 ts_tablet_manager.cc:933] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:19.909174 22928 tablet_copy_client.cc:323] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:19.911845 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet fa248ef2ee9049c9a1f86b77185b86a3 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:19.912302 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet fa248ef2ee9049c9a1f86b77185b86a3 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-fa248ef2ee9049c9a1f86b77185b86a3
I20260709 13:05:19.923066 21993 tablet_copy_source_session.cc:215] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:19.928628 22928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa248ef2ee9049c9a1f86b77185b86a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:19.944893 22928 tablet_copy_client.cc:806] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:19.945514 22928 tablet_copy_client.cc:670] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:19.953495 22928 tablet_copy_client.cc:538] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:19.966266 22928 tablet_bootstrap.cc:492] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:19.979538 22930 ts_tablet_manager.cc:933] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:20.007032 22930 tablet_copy_client.cc:323] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:20.010234 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 094b605ab81240b687b2fd4857aee3c3 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:20.010748 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 094b605ab81240b687b2fd4857aee3c3 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-094b605ab81240b687b2fd4857aee3c3
I20260709 13:05:20.027683 22928 tablet_bootstrap.cc:492] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.028808 22928 tablet_bootstrap.cc:492] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:20.029541 22928 ts_tablet_manager.cc:1403] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.008s
I20260709 13:05:20.032847 22928 raft_consensus.cc:359] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:20.033717 22928 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:20.034410 22928 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:20.035085 21993 tablet_copy_source_session.cc:215] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:20.044970 22930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094b605ab81240b687b2fd4857aee3c3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:20.059736 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66141.3us
I20260709 13:05:20.060417 22935 ts_tablet_manager.cc:933] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:20.069931 22928 ts_tablet_manager.cc:1434] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.040s	user 0.012s	sys 0.004s
I20260709 13:05:20.071321 22935 tablet_copy_client.cc:323] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:20.071913 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-fa248ef2ee9049c9a1f86b77185b86a3 received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:20.072420 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-fa248ef2ee9049c9a1f86b77185b86a3 on tablet fa248ef2ee9049c9a1f86b77185b86a3 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:20.075062 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 1f2f8130ad944310bea7f2f3d408309f from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:20.075529 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 1f2f8130ad944310bea7f2f3d408309f from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-1f2f8130ad944310bea7f2f3d408309f
I20260709 13:05:20.083015 21993 tablet_copy_source_session.cc:215] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:20.086608 22935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2f8130ad944310bea7f2f3d408309f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.102011 22930 tablet_copy_client.cc:806] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:20.102530 22930 tablet_copy_client.cc:670] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:20.112818 22935 tablet_copy_client.cc:806] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:20.113411 22935 tablet_copy_client.cc:670] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:20.116887 22935 tablet_copy_client.cc:538] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:20.127041 22935 tablet_bootstrap.cc:492] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:20.153215 22935 tablet_bootstrap.cc:492] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.154181 22935 tablet_bootstrap.cc:492] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:20.154896 22935 ts_tablet_manager.cc:1403] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.021s
I20260709 13:05:20.157373 22928 ts_tablet_manager.cc:933] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:20.174786 22935 raft_consensus.cc:359] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:20.175781 22935 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:20.176494 22935 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:20.155027 22930 tablet_copy_client.cc:538] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:20.181799 22935 ts_tablet_manager.cc:1434] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:05:20.190656 22928 tablet_copy_client.cc:323] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:05:20.199491 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet 18adc37fa2ee428c9cdcfe76e72e77a4 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
I20260709 13:05:20.200091 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet 18adc37fa2ee428c9cdcfe76e72e77a4 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-18adc37fa2ee428c9cdcfe76e72e77a4
I20260709 13:05:20.204759 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-1f2f8130ad944310bea7f2f3d408309f received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:20.205175 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-1f2f8130ad944310bea7f2f3d408309f on tablet 1f2f8130ad944310bea7f2f3d408309f with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:20.207830 21919 tablet_copy_source_session.cc:215] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:20.210824 22930 tablet_bootstrap.cc:492] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:20.224561 22928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18adc37fa2ee428c9cdcfe76e72e77a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.240427 22928 tablet_copy_client.cc:806] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:20.241052 22928 tablet_copy_client.cc:670] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:20.244614 22928 tablet_copy_client.cc:538] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:20.253257 22928 tablet_bootstrap.cc:492] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:20.256223 22930 tablet_bootstrap.cc:492] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.264027 22930 tablet_bootstrap.cc:492] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:20.264729 22930 ts_tablet_manager.cc:1403] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.015s
I20260709 13:05:20.267673 22930 raft_consensus.cc:359] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:20.270256 22930 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:20.271507 22930 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:20.274641 22930 ts_tablet_manager.cc:1434] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:20.277781 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-094b605ab81240b687b2fd4857aee3c3 received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:20.278146 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-094b605ab81240b687b2fd4857aee3c3 on tablet 094b605ab81240b687b2fd4857aee3c3 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:20.281818 22552 raft_consensus.cc:1217] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:20.287595 22928 tablet_bootstrap.cc:492] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.288484 22928 tablet_bootstrap.cc:492] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:20.289171 22928 ts_tablet_manager.cc:1403] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.013s
I20260709 13:05:20.292006 22928 raft_consensus.cc:359] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:20.292827 22928 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:20.293473 22928 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:20.298573 22928 ts_tablet_manager.cc:1434] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:20.301016 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-18adc37fa2ee428c9cdcfe76e72e77a4 received from {username='slave'} at 127.0.0.1:55690
I20260709 13:05:20.301427 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-18adc37fa2ee428c9cdcfe76e72e77a4 on tablet 18adc37fa2ee428c9cdcfe76e72e77a4 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:20.497535 22552 raft_consensus.cc:1217] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:20.522915 22555 raft_consensus.cc:1217] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:20.681977 22555 raft_consensus.cc:1217] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:20.877728 22944 raft_consensus.cc:1064] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:20.880522 22944 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:20.888691 21903 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:20.890143 22944 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:20.893402 22555 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:20.894949 21826 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:20.897786 22896 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:20.904373 22896 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:20.946497 22867 raft_consensus.cc:1064] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:20.949337 22867 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:20.957651 22910 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:20.990819 21826 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:20.993145 22555 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:20.996726 21729 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.006855 22552 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:20.998605 21829 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.018335 22896 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.036692 21900 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:21.037755 21907 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.048096 22867 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:05:21.064347 22950 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:21.096395 22949 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.115535 22552 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.123847 21900 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.131906 22896 raft_consensus.cc:1064] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:21.139191 22896 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:21.152793 21829 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.161679 22938 raft_consensus.cc:1064] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:21.165859 21825 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:21.167917 22552 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:21.169368 21900 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:21.169443 22938 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:21.172860 22950 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.173885 22896 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.176537 22910 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.210891 21728 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.264485 21979 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:21.274762 21829 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:21.276455 22910 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:21.281198 22555 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:21.282675 22949 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:21.293967 22896 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.314522 22555 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.323848 21829 raft_consensus.cc:2955] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.341686 21728 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.358404 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet fa248ef2ee9049c9a1f86b77185b86a3 with delete_type TABLET_DATA_TOMBSTONED (TS ac1dd8ad9fc44263932ec57d9376a271 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45472
I20260709 13:05:21.357784 21974 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:21.369266 22553 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:21.371436 21826 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:21.372889 22938 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.374205 22923 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.378432 22944 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.388967 21832 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.411012 22555 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:21.412792 21900 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:21.415480 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa248ef2ee9049c9a1f86b77185b86a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:21.420037 21974 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:21.422559 22949 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:21.431113 22963 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:05:21.440243 21728 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.444093 22965 tablet_replica.cc:333] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:05:21.449265 21906 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.452898 22923 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.453395 22965 raft_consensus.cc:2243] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.454140 22965 raft_consensus.cc:2272] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.458825 22950 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:21.462324 22965 ts_tablet_manager.cc:1916] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:21.468750 22949 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.473054 22554 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.475200 22552 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.485631 22938 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.505488 22553 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.530076 21829 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.546700 22965 ts_tablet_manager.cc:1929] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:21.547255 22965 log.cc:1199] T fa248ef2ee9049c9a1f86b77185b86a3 P ac1dd8ad9fc44263932ec57d9376a271: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/wals/fa248ef2ee9049c9a1f86b77185b86a3
I20260709 13:05:21.548940 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet fa248ef2ee9049c9a1f86b77185b86a3 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:21.550273 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f2f8130ad944310bea7f2f3d408309f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:21.550576 21907 raft_consensus.cc:2955] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.556448 21979 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.552320 21730 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.570858 21728 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.575955 21821 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f2f8130ad944310bea7f2f3d408309f with delete_type TABLET_DATA_TOMBSTONED (TS 479255846c5141b584b16aa253f587c7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40618
I20260709 13:05:21.587975 21979 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:21.591760 22969 tablet_replica.cc:333] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:05:21.592835 22969 raft_consensus.cc:2243] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.593446 22969 raft_consensus.cc:2272] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.595654 21907 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:21.600131 22969 ts_tablet_manager.cc:1916] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:21.603502 21829 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:21.601902 22554 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:21.606189 22950 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:21.609615 22554 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:21.613008 21832 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:21.614225 22867 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:21.614472 22926 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:21.617256 22923 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:21.622642 22949 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.624347 21832 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.626019 22926 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.631850 21826 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.636274 22553 raft_consensus.cc:2955] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.641378 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 094b605ab81240b687b2fd4857aee3c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:21.653064 21732 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.654382 22554 raft_consensus.cc:2955] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:21.663100 21718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18adc37fa2ee428c9cdcfe76e72e77a4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:21.669349 22969 ts_tablet_manager.cc:1929] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:21.669920 22969 log.cc:1199] T 1f2f8130ad944310bea7f2f3d408309f P 479255846c5141b584b16aa253f587c7: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/wals/1f2f8130ad944310bea7f2f3d408309f
I20260709 13:05:21.671761 21728 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.677747 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet 094b605ab81240b687b2fd4857aee3c3 with delete_type TABLET_DATA_TOMBSTONED (TS ac1dd8ad9fc44263932ec57d9376a271 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45472
I20260709 13:05:21.678645 22965 tablet_replica.cc:333] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:05:21.679564 22965 raft_consensus.cc:2243] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.680234 22965 raft_consensus.cc:2272] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.687072 21719 catalog_manager.cc:5028] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): tablet 1f2f8130ad944310bea7f2f3d408309f (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:21.688040 22965 ts_tablet_manager.cc:1916] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:21.691339 21970 tablet_service.cc:1558] Processing DeleteTablet for tablet 18adc37fa2ee428c9cdcfe76e72e77a4 with delete_type TABLET_DATA_TOMBSTONED (TS 3d76b2c4699e43fba10eeb81a91e4913 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39160
I20260709 13:05:21.718534 22971 tablet_replica.cc:333] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:05:21.723905 22965 ts_tablet_manager.cc:1929] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:21.724334 22965 log.cc:1199] T 094b605ab81240b687b2fd4857aee3c3 P ac1dd8ad9fc44263932ec57d9376a271: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/wals/094b605ab81240b687b2fd4857aee3c3
I20260709 13:05:21.725924 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet 094b605ab81240b687b2fd4857aee3c3 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:21.728585 22971 raft_consensus.cc:2243] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.729341 22971 raft_consensus.cc:2272] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.732786 22971 ts_tablet_manager.cc:1916] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:21.744638 22971 ts_tablet_manager.cc:1929] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:21.744958 22971 log.cc:1199] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 3d76b2c4699e43fba10eeb81a91e4913: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/wals/18adc37fa2ee428c9cdcfe76e72e77a4
I20260709 13:05:21.746381 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet 18adc37fa2ee428c9cdcfe76e72e77a4 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:22.805792 21906 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:22.818403 21983 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:22.819876 21874 consensus_peers.cc:597] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 503591d3d16047368f003bcc9f73d8a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.821012 21832 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:22.821892 22941 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.822809 22923 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.838662 22941 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:22.840507 21983 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:22.867862 21728 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:22.906204 21832 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:22.912998 21983 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:22.931840 21906 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:22.934122 21826 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:22.936780 22949 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:22.941993 21948 consensus_peers.cc:597] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd4225b745e54206b600f5380ed664be. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.943339 22949 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.947736 22976 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:22.958027 21826 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:22.968292 21983 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:22.973449 21729 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.999601 21832 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:23.010468 22990 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:23.016953 21906 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:23.022536 22976 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:23.025362 21948 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 402a4aa48c774bb6919a83e05b1a61ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.025704 21907 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
W20260709 13:05:23.128401 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 74749.2us
I20260709 13:05:23.136729 22988 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:23.152196 21900 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:23.184561 21907 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:23.188993 21729 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:23.200984 21826 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
W20260709 13:05:23.202482 21874 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bdbae418d5246588152f31784da5bec. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.208302 21829 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:23.215798 22981 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:23.224578 21983 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:23.228989 22981 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:23.253886 22923 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:23.264925 21983 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:23.268424 21826 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:23.295706 21729 catalog_manager.cc:5697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.355877 22998 ts_tablet_manager.cc:933] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:23.357975 22998 tablet_copy_client.cc:323] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:23.359589 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet dd4225b745e54206b600f5380ed664be from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:23.360152 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet dd4225b745e54206b600f5380ed664be from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-dd4225b745e54206b600f5380ed664be
I20260709 13:05:23.369917 21993 tablet_copy_source_session.cc:215] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:23.377362 22998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4225b745e54206b600f5380ed664be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:23.441406 23000 ts_tablet_manager.cc:933] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:23.449513 23000 tablet_copy_client.cc:323] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:05:23.451236 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet 503591d3d16047368f003bcc9f73d8a2 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
I20260709 13:05:23.451802 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet 503591d3d16047368f003bcc9f73d8a2 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-503591d3d16047368f003bcc9f73d8a2
I20260709 13:05:23.461503 21919 tablet_copy_source_session.cc:215] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:23.465930 23000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503591d3d16047368f003bcc9f73d8a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:23.471817 22998 tablet_copy_client.cc:806] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:23.472431 22998 tablet_copy_client.cc:670] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:23.484009 22998 tablet_copy_client.cc:538] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:23.487535 23000 tablet_copy_client.cc:806] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:23.488222 23000 tablet_copy_client.cc:670] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:23.492156 23000 tablet_copy_client.cc:538] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:23.499017 22998 tablet_bootstrap.cc:492] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:23.502960 23000 tablet_bootstrap.cc:492] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:23.538092 23000 tablet_bootstrap.cc:492] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:23.539116 23000 tablet_bootstrap.cc:492] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:23.539891 23000 ts_tablet_manager.cc:1403] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.003s
I20260709 13:05:23.543183 23000 raft_consensus.cc:359] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:23.544118 23000 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:23.544881 23000 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:23.547286 22998 tablet_bootstrap.cc:492] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:23.548223 22998 tablet_bootstrap.cc:492] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:23.548878 22998 ts_tablet_manager.cc:1403] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.004s
I20260709 13:05:23.551741 22998 raft_consensus.cc:359] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:23.552561 22998 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:23.553205 22998 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:23.579252 22998 ts_tablet_manager.cc:1434] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.008s
I20260709 13:05:23.580948 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-dd4225b745e54206b600f5380ed664be received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:23.581398 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-dd4225b745e54206b600f5380ed664be on tablet dd4225b745e54206b600f5380ed664be with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:23.580605 23000 ts_tablet_manager.cc:1434] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.040s	user 0.023s	sys 0.005s
I20260709 13:05:23.584009 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-503591d3d16047368f003bcc9f73d8a2 received from {username='slave'} at 127.0.0.1:55690
I20260709 13:05:23.584393 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-503591d3d16047368f003bcc9f73d8a2 on tablet 503591d3d16047368f003bcc9f73d8a2 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:23.587949 23000 ts_tablet_manager.cc:933] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:23.593191 23000 tablet_copy_client.cc:323] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:23.594774 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 402a4aa48c774bb6919a83e05b1a61ee from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:23.595301 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 402a4aa48c774bb6919a83e05b1a61ee from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-402a4aa48c774bb6919a83e05b1a61ee
I20260709 13:05:23.606137 21993 tablet_copy_source_session.cc:215] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:23.609649 23000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402a4aa48c774bb6919a83e05b1a61ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:23.628799 23000 tablet_copy_client.cc:806] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:23.629407 23000 tablet_copy_client.cc:670] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:23.634832 23000 tablet_copy_client.cc:538] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:23.653074 23000 tablet_bootstrap.cc:492] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:23.665516 22998 ts_tablet_manager.cc:933] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:23.681706 22998 tablet_copy_client.cc:323] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:05:23.683270 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet 9bdbae418d5246588152f31784da5bec from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
I20260709 13:05:23.683777 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet 9bdbae418d5246588152f31784da5bec from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-9bdbae418d5246588152f31784da5bec
I20260709 13:05:23.691285 21919 tablet_copy_source_session.cc:215] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:23.692095 23000 tablet_bootstrap.cc:492] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:23.692965 23000 tablet_bootstrap.cc:492] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:23.693651 23000 ts_tablet_manager.cc:1403] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.001s
I20260709 13:05:23.698625 23000 raft_consensus.cc:359] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:23.701027 23000 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:23.701676 23000 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:23.704787 22998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bdbae418d5246588152f31784da5bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:23.746201 23000 ts_tablet_manager.cc:1434] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.003s
I20260709 13:05:23.722115 22998 tablet_copy_client.cc:806] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:23.748502 22998 tablet_copy_client.cc:670] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:23.748632 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-402a4aa48c774bb6919a83e05b1a61ee received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:23.749063 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-402a4aa48c774bb6919a83e05b1a61ee on tablet 402a4aa48c774bb6919a83e05b1a61ee with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:23.756354 22998 tablet_copy_client.cc:538] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:23.771487 22998 tablet_bootstrap.cc:492] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:23.791886 22998 tablet_bootstrap.cc:492] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:23.792788 22998 tablet_bootstrap.cc:492] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:23.793462 22998 ts_tablet_manager.cc:1403] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.006s
I20260709 13:05:23.796360 22998 raft_consensus.cc:359] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:23.797164 22998 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:23.797755 22998 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:23.802645 22998 ts_tablet_manager.cc:1434] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:23.804420 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-9bdbae418d5246588152f31784da5bec received from {username='slave'} at 127.0.0.1:55690
I20260709 13:05:23.804804 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-9bdbae418d5246588152f31784da5bec on tablet 9bdbae418d5246588152f31784da5bec with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:23.813688 22554 raft_consensus.cc:1217] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:23.988060 22554 raft_consensus.cc:1217] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:24.152642 22554 raft_consensus.cc:1217] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:24.179786 22554 raft_consensus.cc:1217] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:24.193289 22950 raft_consensus.cc:1064] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:24.195907 22950 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:24.203487 21906 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.205822 21832 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.209096 22554 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.210875 22950 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:24.212275 23009 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.213348 22990 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:24.255822 23012 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:05:24.267267 23009 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.272277 21906 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.272094 22554 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.288453 21829 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.288748 21729 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:24.365921 21983 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:24.377076 22553 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:24.378329 21900 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:24.382086 23013 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:24.383111 22950 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:24.394503 22950 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.398865 21900 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.404877 22553 raft_consensus.cc:2955] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.415963 21728 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.438073 21821 tablet_service.cc:1558] Processing DeleteTablet for tablet dd4225b745e54206b600f5380ed664be with delete_type TABLET_DATA_TOMBSTONED (TS 479255846c5141b584b16aa253f587c7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40618
I20260709 13:05:24.451920 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd4225b745e54206b600f5380ed664be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:24.457500 23021 tablet_replica.cc:333] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:05:24.460127 23021 raft_consensus.cc:2243] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.460927 23021 raft_consensus.cc:2272] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.472205 23021 ts_tablet_manager.cc:1916] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:24.484812 23021 ts_tablet_manager.cc:1929] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:24.485145 23021 log.cc:1199] T dd4225b745e54206b600f5380ed664be P 479255846c5141b584b16aa253f587c7: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/wals/dd4225b745e54206b600f5380ed664be
I20260709 13:05:24.486349 21719 catalog_manager.cc:5028] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): tablet dd4225b745e54206b600f5380ed664be (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:24.562386 22950 raft_consensus.cc:1064] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:24.564855 22950 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:24.582121 22981 raft_consensus.cc:1064] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:24.584518 22981 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:24.587080 21829 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.587879 21906 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.589447 23009 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.590214 22553 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.595098 23013 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.597415 23013 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.609591 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:24.636209 22554 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.637645 22941 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.640671 22941 raft_consensus.cc:1064] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:24.642930 22941 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:24.643724 21983 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.645160 22977 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.649626 21826 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.655802 22977 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.685452 23009 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.729828 21826 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.740983 22553 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.742885 21728 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.745740 21900 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.750998 23036 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.792905 21832 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:05:24.802153 23028 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:05:24.811444 22981 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:05:24.814836 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 71051.6us
W20260709 13:05:24.816836 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 69952.3us
W20260709 13:05:24.817989 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65785.8us
I20260709 13:05:24.821846 21979 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:24.799103 23032 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:05:24.830817 23038 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.832252 22554 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.843676 21979 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.851578 22553 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.851330 21829 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.923597 23032 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.928514 21826 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.942785 22552 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.944285 21976 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:24.947999 21974 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.960871 21826 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:24.963331 22950 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:24.966766 21732 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.973524 23013 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.954061 21730 catalog_manager.cc:5697] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index 2 to 3, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:24.983441 21826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:24.984151 21826 raft_consensus.cc:606] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:24.989883 21829 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:25.005934 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 402a4aa48c774bb6919a83e05b1a61ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:25.021924 22555 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:25.027422 21906 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.034483 21730 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.040211 23013 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:25.058363 22555 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:25.054059 22554 raft_consensus.cc:2955] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:25.061245 23032 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:25.065984 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet 402a4aa48c774bb6919a83e05b1a61ee with delete_type TABLET_DATA_TOMBSTONED (TS ac1dd8ad9fc44263932ec57d9376a271 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45472
I20260709 13:05:25.070904 21979 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:25.069728 22981 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:25.072926 21979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:25.073470 21979 raft_consensus.cc:606] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Received request to transfer leadership to TS 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:25.074314 23035 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:25.080114 21979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:25.080677 21979 raft_consensus.cc:606] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:25.083999 21979 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:25.087394 22555 raft_consensus.cc:2955] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:25.095944 22990 raft_consensus.cc:993] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 0157b4f0725d4f92a53938c921db9efc to start an election
I20260709 13:05:25.096484 22990 raft_consensus.cc:1081] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Signalling peer 0157b4f0725d4f92a53938c921db9efc to start an election
I20260709 13:05:25.099756 21906 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.109457 21718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 503591d3d16047368f003bcc9f73d8a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:25.114037 22553 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:25.115492 23030 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:25.116663 21728 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index 3 to 4, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.101971 21974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:25.117868 21974 raft_consensus.cc:606] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:05:25.117309 21829 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:25.118217 23051 tablet_replica.cc:333] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:05:25.101459 22554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:60024
I20260709 13:05:25.119980 22554 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.119921 23030 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:25.120520 22554 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.126821 22554 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.127414 22981 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:25.135524 22555 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:25.130867 21829 raft_consensus.cc:2955] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:25.140790 21718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9bdbae418d5246588152f31784da5bec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:25.144846 21974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:25.145398 21974 raft_consensus.cc:606] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Received request to transfer leadership to TS 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:25.146654 22554 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:25.147505 21821 tablet_service.cc:1558] Processing DeleteTablet for tablet 503591d3d16047368f003bcc9f73d8a2 with delete_type TABLET_DATA_TOMBSTONED (TS 479255846c5141b584b16aa253f587c7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40618
I20260709 13:05:25.147258 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:25.148559 21979 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:25.148872 21979 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:25.149699 21979 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.150686 21979 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.151156 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:25.151715 21832 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.158021 21832 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:25.164992 21979 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:25.166360 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:25.167294 23048 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:25.167824 23048 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:25.168841 23048 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.184346 23052 tablet_replica.cc:333] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:05:25.185452 23052 raft_consensus.cc:2243] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.186319 23052 raft_consensus.cc:2272] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.192337 21979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:25.192945 21979 raft_consensus.cc:606] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Received request to transfer leadership to TS 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:25.187054 21730 catalog_manager.cc:5697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 3 to 4, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New cstate: current_term: 1 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:25.195781 23052 ts_tablet_manager.cc:1916] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:25.210618 23051 raft_consensus.cc:2243] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.211138 23052 ts_tablet_manager.cc:1929] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:25.211480 23051 raft_consensus.cc:2272] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.211675 23052 log.cc:1199] T 503591d3d16047368f003bcc9f73d8a2 P 479255846c5141b584b16aa253f587c7: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/wals/503591d3d16047368f003bcc9f73d8a2
I20260709 13:05:25.217873 23051 ts_tablet_manager.cc:1916] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:25.238065 21719 catalog_manager.cc:5028] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): tablet 503591d3d16047368f003bcc9f73d8a2 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:25.246388 23013 raft_consensus.cc:993] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 0157b4f0725d4f92a53938c921db9efc to start an election
I20260709 13:05:25.246908 23013 raft_consensus.cc:1081] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Signalling peer 0157b4f0725d4f92a53938c921db9efc to start an election
I20260709 13:05:25.248383 22555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:60024
I20260709 13:05:25.248886 22555 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.249231 22555 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.254830 21970 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bdbae418d5246588152f31784da5bec with delete_type TABLET_DATA_TOMBSTONED (TS 3d76b2c4699e43fba10eeb81a91e4913 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39160
I20260709 13:05:25.255044 23051 ts_tablet_manager.cc:1929] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:25.255465 23051 log.cc:1199] T 402a4aa48c774bb6919a83e05b1a61ee P ac1dd8ad9fc44263932ec57d9376a271: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/wals/402a4aa48c774bb6919a83e05b1a61ee
I20260709 13:05:25.255268 22555 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.257589 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet 402a4aa48c774bb6919a83e05b1a61ee (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:25.262827 21906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bdbae418d5246588152f31784da5bec"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39266
I20260709 13:05:25.263412 21906 raft_consensus.cc:606] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:25.263787 21906 raft_consensus.cc:630] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Rejecting request to transfer leadership because tablet server 3d76b2c4699e43fba10eeb81a91e4913 is not a voter in the active config
I20260709 13:05:25.264640 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:25.265136 21829 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.265724 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:25.266260 21979 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:25.266533 21979 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:25.266906 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:05:25.267202 21979 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.268185 21979 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.269146 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:25.279597 21730 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.284541 23040 raft_consensus.cc:993] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:05:25.292199 21979 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:25.292534 23040 raft_consensus.cc:1081] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:05:25.293278 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:25.294025 23048 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:25.294279 21974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:05:25.294543 23048 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:25.294803 21974 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.295138 21974 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.295395 23048 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.300458 22555 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:25.306576 23055 tablet_replica.cc:333] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:05:25.307657 23055 raft_consensus.cc:2243] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.308899 23055 raft_consensus.cc:2272] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.313002 21829 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:25.314703 22990 raft_consensus.cc:993] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:05:25.418977 23055 ts_tablet_manager.cc:1916] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:25.443885 22990 raft_consensus.cc:1081] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Signalling peer 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:05:25.446723 21732 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.449208 22950 raft_consensus.cc:993] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:05:25.449738 23039 raft_consensus.cc:1081] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Signalling peer ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:05:25.451545 21900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:45488
I20260709 13:05:25.452090 21900 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.452437 21900 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.454705 21974 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:25.456552 21974 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:25.460721 21900 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:25.480856 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:25.481155 21900 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:25.481456 21905 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.483456 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:25.483843 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:25.483994 21829 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:25.484369 21974 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:25.484401 21829 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:25.484865 21974 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:25.485482 21829 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:25.487308 21826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75"
dest_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:40638
I20260709 13:05:25.487816 21826 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.488147 21826 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.495672 21974 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:25.507884 21905 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:25.508605 21974 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:25.513762 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 163025us
I20260709 13:05:25.518616 21826 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:25.519474 21974 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:25.520370 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:25.524577 23057 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:25.525135 23057 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:25.526199 23057 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:25.530933 21826 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:25.532496 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:25.536015 21900 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:25.536826 23039 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:25.537344 23039 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:25.538475 21829 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.538199 23039 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:25.540663 23055 ts_tablet_manager.cc:1929] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:25.541075 23055 log.cc:1199] T 9bdbae418d5246588152f31784da5bec P 3d76b2c4699e43fba10eeb81a91e4913: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/wals/9bdbae418d5246588152f31784da5bec
I20260709 13:05:25.549475 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:25.550091 21906 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.546384 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet 9bdbae418d5246588152f31784da5bec (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:05:25.559818 21829 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:25.560006 21906 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:25.561611 21907 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:25.566018 22950 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:25.573616 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:25.585937 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 75166.2us
I20260709 13:05:25.590157 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:25.595664 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:25.596215 21826 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.584285 23060 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:25.596740 23060 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:25.597560 23060 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:25.612952 21826 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
W20260709 13:05:25.647991 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 67863.8us
I20260709 13:05:25.648458 21732 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:25.659154 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 86329us
I20260709 13:05:25.699384 21976 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:25.699774 21976 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:25.705345 21979 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:25.842818 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 179298us
W20260709 13:05:25.828150 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 133724us
I20260709 13:05:25.727684 21976 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:25.867050 21732 catalog_manager.cc:5697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.875124 21976 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.880779 21826 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:25.881212 21828 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:25.859616 21730 catalog_manager.cc:5697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.887863 23048 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:25.891252 21979 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:25.913185 23048 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:25.947384 23079 raft_consensus.cc:993] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 0157b4f0725d4f92a53938c921db9efc to start an election
I20260709 13:05:25.947911 22990 raft_consensus.cc:1081] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Signalling peer 0157b4f0725d4f92a53938c921db9efc to start an election
I20260709 13:05:25.951756 22553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:60024
I20260709 13:05:25.952261 22553 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.952611 22553 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.954988 23047 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:25.955071 23048 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:25.965945 22553 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.968815 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:25.969340 21907 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.971077 21976 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:25.972059 22553 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:25.974566 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:25.989238 21983 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:25.989547 21983 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:25.990267 21983 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:25.991715 21983 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.979104 21907 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:25.995303 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:25.996107 23047 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:26.006561 23013 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 13:05:26.008715 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57619us
I20260709 13:05:28.654894 23097 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.656118 23097 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:26.653998 23048 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.008s	sys 0.076s
W20260709 13:05:27.856374 23087 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.374s	user 0.002s	sys 0.008s
I20260709 13:05:28.658666 23099 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:28.659126 23087 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.176s	user 0.002s	sys 0.008s
I20260709 13:05:28.520180 23092 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:05:28.659531 23048 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.678s	user 0.009s	sys 0.076s
I20260709 13:05:28.660785 23092 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.660061 23099 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.664659 23092 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.665323 23092 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.648059 23094 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.667600 23094 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.648662 23096 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.670341 23092 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.673801 23092 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.669914 23096 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.681017 23097 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.649722 23093 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:26.397953 23047 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:28.542426 23095 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.699036 23093 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.689911 23096 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.714869 23095 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.716701 23093 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.717787 23095 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.665304 23099 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.720032 23047 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.754349 23094 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.748539 23100 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.755858 23100 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.759231 23095 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.760134 23095 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.763223 23092 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.763849 23093 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.764039 23097 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.764633 23093 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.764976 23098 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.765036 23097 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.765799 23098 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.766342 23096 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.763957 23092 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.767194 23096 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.776031 23099 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.781368 23097 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.781234 23099 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.783629 23093 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.785890 23092 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.787094 23095 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.788166 23098 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.789294 23100 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.794961 23096 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.796867 23099 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:28.775934 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 70829us
I20260709 13:05:28.814112 23111 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.814934 23111 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.819618 23111 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.828058 23087 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:28.829737 23089 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.831204 23048 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.829615 23108 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.831840 23048 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.831565 23089 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.832203 23111 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.835500 23111 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.836414 23100 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.836817 23089 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:28.837155 23100 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.837692 23111 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.839279 23100 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.839767 23100 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.842293 23108 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.846974 23048 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.834517 23047 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.848083 23047 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.853303 23109 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:28.851058 23108 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:28.850994 23104 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.859078 23112 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.859086 23111 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.859297 23104 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.862285 23099 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.861004 23111 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.862913 23099 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.864405 23111 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.859125 23047 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.829523 23087 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.854022 23109 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.865022 23099 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.868364 23095 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.868772 23111 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.869040 23095 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.869498 23111 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.845024 23100 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.871480 23093 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.872095 23093 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.872566 23111 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.873266 23100 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.874878 23093 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.864835 23104 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.875361 23092 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.877970 23101 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.878981 23092 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.879081 23101 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.884434 23101 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.892745 23092 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.878013 23095 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.870776 23099 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.894819 23109 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.894663 23099 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.896987 23099 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.860345 23112 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.899645 23112 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.902992 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:28.903335 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:28.903715 21903 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:28.903914 21900 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:28.905283 23087 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.908309 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:28.908955 21903 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:28.914938 23104 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:26.045994 21983 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:28.918381 23104 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.928359 23087 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:28.930636 23115 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.930898 23047 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.931231 23115 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.931493 23047 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.934767 23047 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.935019 23115 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.937408 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:28.932703 23108 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.929000 23087 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.938781 23108 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.941032 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:28.941890 23104 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.942155 23089 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.938057 21900 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
W20260709 13:05:28.928390 21873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.066s	user 0.133s	sys 0.220s
I20260709 13:05:28.935940 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:28.935727 23048 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.946908 21905 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:28.945127 23109 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.936179 23100 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.947849 23109 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.948520 23100 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.942915 23089 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.950119 23109 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:28.951443 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:28.957617 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:28.959636 22555 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:28.959877 21903 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
W20260709 13:05:28.952647 21873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.090s	user 0.133s	sys 0.221s
W20260709 13:05:28.960666 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 3.09801e+06us
I20260709 13:05:28.960836 23089 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.946918 23048 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.961620 23089 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:28.950390 21983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 42) took 2964 ms (client timeout 1539 ms). Trace:
W20260709 13:05:28.962325 21983 rpcz_store.cc:269] 0709 13:05:25.972328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.974360 (+  2032us) service_pool.cc:224] Handling call
0709 13:05:28.929455 (+2955095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:28.962849 23087 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:28.950593 23104 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.963346 23048 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.963378 23115 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.964592 23115 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.968155 23089 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.963939 23104 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:28.970352 23089 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:05:28.964053 23108 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:28.950812 23100 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.971873 23104 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.968510 23115 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:28.986325 23108 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:28.983590 23115 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:28.989198 23109 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:28.992923 23113 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:28.993127 23116 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.989888 23104 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:28.999096 23114 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:28.991971 23089 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.000272 23116 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.021934 23089 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.006783 23108 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.000881 23109 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.042794 23115 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:29.055949 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 74806.8us
I20260709 13:05:29.042609 23113 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:29.059458 22519 connection.cc:256] RPC call timeout handler was delayed by -1.580052515000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:05:29.060129 23121 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:29.063882 23119 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.064507 23119 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.066743 23119 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.062616 23089 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.054565 23104 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.070559 21730 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.058303 23114 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.075372 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:29.076538 23114 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.079221 23125 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.079999 23104 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.083741 23113 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.078352 23115 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.079851 23125 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.090157 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.091745 22553 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.093278 23124 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:29.093529 22519 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.539s (SENT) [suppressed 4 similar messages]
I20260709 13:05:29.094434 23113 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.096699 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.097019 23116 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.098596 23117 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.098958 23116 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.092259 23114 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.103924 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.106823 22552 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.093974 23124 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.099231 23117 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.109279 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.109849 22553 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.097112 23113 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.101300 23123 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.093752 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.099589 23116 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.102836 23118 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.119292 23122 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.125079 23131 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.124979 23128 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.125676 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.125029 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.126616 22553 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.127036 22555 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.124403 23127 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.127434 23117 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.119082 23114 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.123706 23124 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.128340 23124 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.128849 23117 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.129263 23114 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.128940 23124 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.129534 23117 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.111963 23108 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.119993 23109 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.130890 23114 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.089084 23121 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.124603 23125 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.111407 23104 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.122246 23120 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.139000 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.139740 23013 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.139890 23098 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.140599 23114 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.126346 23128 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:28.950461 23047 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.153942 22555 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.131410 23124 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.135186 23094 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.165014 23094 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.165663 23129 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.139770 23096 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.166445 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.188418 21907 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:29.118769 23133 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.192668 22520 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.193655 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.195251 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.125658 23122 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.196313 23135 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.196739 23119 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.197160 23119 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:29.197319 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 103836us
I20260709 13:05:29.197530 23119 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.198504 23108 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.199013 23108 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.199457 23108 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.203217 23122 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.203747 23122 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.204046 23119 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.204332 23122 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.206156 23122 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.206549 23119 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.206693 23122 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.123411 23118 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.186717 23125 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.123358 23123 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.125804 23131 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.190507 23098 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.189327 23013 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.213017 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.164104 23104 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.213310 23096 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.127831 23127 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.214103 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.214193 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.214473 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.193449 23047 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.213910 23116 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.217006 21906 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:29.237466 21907 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:29.196951 23135 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.166450 23129 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.207332 23048 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:29.261420 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 69387.8us
I20260709 13:05:29.262106 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.263545 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.264189 21905 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:29.268199 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.209564 23122 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.269964 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.218292 23114 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.293548 23130 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.295018 23122 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.296809 23127 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.297348 23129 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.298980 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.301180 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.240835 23098 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.268872 23097 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.262636 23048 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.263540 23124 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.304945 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.308125 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.240674 23125 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.278327 23118 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.278549 22551 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.301582 23093 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.315869 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.303438 23111 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.322860 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:29.308357 23048 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.324307 21900 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.307106 23097 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.294341 23130 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.303587 23113 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.322471 23095 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.301815 23106 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.325539 23105 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.324235 23093 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.318356 23119 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.208514 23120 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.322525 23109 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.323774 23100 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.329591 23097 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.329192 23118 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.323866 23117 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.324129 23111 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.217615 23133 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.337954 23093 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.330499 23095 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.335044 23101 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.333508 23124 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.330288 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.346683 23100 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.338152 23119 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.325572 23138 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.354487 23111 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.351084 23109 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:29.364470 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 87598.6us
I20260709 13:05:29.360249 23095 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.362782 23119 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.360203 23101 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.351289 23128 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.369933 23117 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.367591 23137 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.371349 23132 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.372516 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.366333 23098 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.361153 23106 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.369422 23013 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.374720 23120 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.359043 23131 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.377660 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.350750 23105 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.381971 23104 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.383987 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.364807 23118 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.376408 23101 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.392172 23137 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.402529 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.405490 23125 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.407356 23121 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.410326 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.367417 23138 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.411032 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.387992 23123 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.385144 23096 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.388738 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.388545 23117 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.388790 23135 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.391186 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.391353 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.384820 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.391832 21976 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.420847 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.384739 23047 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.393678 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.382400 23108 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.421864 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.422286 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.423211 23115 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.423286 22520 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.387360 23128 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.423672 23115 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.423811 23124 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.424081 23115 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.411047 21826 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:29.382378 23100 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.385581 23098 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.392498 23132 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.431164 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.433115 21832 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:29.429912 23089 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.433336 23098 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.430075 23047 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.424111 23128 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.435262 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.440440 23089 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.455902 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.388091 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.462961 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.463333 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.463037 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.455735 23047 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.464274 21983 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.651901 23108 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.655964 21902 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:29.485954 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.666564 21980 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.657327 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:29.559769 23109 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.561033 23137 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.667635 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.562131 23048 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.630290 23138 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.630498 23097 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.481860 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.479146 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.457712 23089 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.464857 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.483150 23133 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:29.669378 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.538676 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.560029 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.653113 21900 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:29.695115 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.696925 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.670729 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:29.483292 21974 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:29.682607 23047 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.524685 23094 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.709576 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.710563 23133 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:29.710894 23095 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.711150 23133 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:29.629868 23132 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.612733 23098 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.686379 22554 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:29.712955 23095 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.686265 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.713967 23098 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.714465 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.700594 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.686810 23117 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.686975 21909 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:29.687469 23105 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.687995 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.688779 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.689148 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.689833 23097 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.690680 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:29.692699 21826 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:29.668844 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.693447 21825 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:29.486939 23096 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.484043 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.685794 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.536248 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.676977 23128 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.706069 21908 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:29.706799 23118 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.707466 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.707563 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.670800 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.668957 23108 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:05:29.560294 23106 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.791066 21976 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:29.698860 21829 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:29.714740 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:29.789294 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.715298 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:29.715804 21981 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:29.750250 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.790067 21906 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
W20260709 13:05:29.794111 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 78879.7us
I20260709 13:05:29.750247 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.794859 21900 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:29.602553 23130 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:29.795836 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:29.800479 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:29.696130 23138 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:29.797245 21830 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:29.804184 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.790480 23096 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:29.810756 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.802425 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:29.810787 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.815828 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.817787 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:29.815434 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.814939 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.833048 21900 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:29.838148 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.841652 21907 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:29.842551 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.842968 21976 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:29.846241 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:29.846756 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44410.4us
I20260709 13:05:29.843149 21977 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.847568 21949 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:29.848481 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.850008 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.850414 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.805197 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.851938 21828 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:29.852867 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.817230 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.853415 21828 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:29.854092 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.854324 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.854537 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.854728 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.854879 21828 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:29.855233 22550 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:29.816313 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.855790 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.855515 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.851235 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.855286 21829 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:29.856587 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.819181 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.797937 23047 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.819358 23048 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:29.805092 23119 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:29.821247 23111 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.080734 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.082852 21825 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:30.048718 21907 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.078848 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.077150 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:29.855801 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.076910 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.087476 22548 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:30.087765 21828 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
W20260709 13:05:30.076838 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08001711a0 after lost signal to thread 20697
I20260709 13:05:30.088641 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:30.089097 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080020e720 after lost signal to thread 21766
I20260709 13:05:30.088918 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.078287 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:30.090303 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080022a500 after lost signal to thread 21858
I20260709 13:05:30.080801 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.090878 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:30.091347 22576 debug-util.cc:398] Leaking SignalData structure 0x7b0800289bc0 after lost signal to thread 21933
I20260709 13:05:30.081701 21832 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:29.827945 23096 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.936215 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:29.959971 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:29.781287 21980 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:30.092187 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.090911 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.945652 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.094499 21983 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:29.818583 23087 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:29.818455 23145 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:29.905463 23143 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.818452 23101 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:30.096419 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa3c0 after lost signal to thread 22007
I20260709 13:05:29.886447 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:30.106792 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080031eac0 after lost signal to thread 22008
I20260709 13:05:29.988806 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.095184 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.855247 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.107174 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.101554 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.107707 21833 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:30.096720 23128 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.110313 22554 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:29.906680 23133 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.105304 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.050091 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.105564 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:29.987140 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.927000 23139 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:30.090281 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.106959 21978 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:30.105847 23143 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:30.127386 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:29.819847 23115 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.111764 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:30.107873 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080031df20 after lost signal to thread 22579
I20260709 13:05:30.109642 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.117421 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.119030 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.110257 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.125906 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.132964 21826 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:30.126768 21903 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:30.124117 23137 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.926532 23138 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.143365 23138 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.143843 23138 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:30.144179 23138 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:30.144495 23138 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:30.109030 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.128015 21829 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
W20260709 13:05:30.131484 22576 debug-util.cc:398] Leaking SignalData structure 0x7b0800309900 after lost signal to thread 22580
I20260709 13:05:30.103731 23118 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:05:30.130080 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.138420 21976 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.140622 21827 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.141161 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:30.146498 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080031a400 after lost signal to thread 23060
I20260709 13:05:30.148514 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.114867 23128 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.122952 23135 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.127422 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.131242 23143 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.158917 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.159427 21982 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:30.135499 23137 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.162302 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.118462 23145 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:30.165071 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.153432 23128 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.167225 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.167747 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.156093 23135 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:30.159000 23130 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.165167 23137 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.178232 21901 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.176668 22551 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:30.188905 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.160058 23089 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.173251 23135 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.170267 23047 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.175103 23130 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.203696 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.209704 22552 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:30.213184 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.193753 23115 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.214068 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.203393 23130 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.208170 23111 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.208551 23119 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:30.235893 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 118578us
W20260709 13:05:30.221479 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 102516us
I20260709 13:05:30.251384 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.252578 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.253240 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.260706 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.263852 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.253948 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.260281 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.268437 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.270776 23152 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.269876 23151 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.263542 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.274823 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.275656 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.279513 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:30.276392 23093 consensus_meta.cc:287] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.907s	user 0.019s	sys 0.010s
I20260709 13:05:30.280652 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.280905 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.286646 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.286895 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.277807 23152 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:30.287294 21983 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:30.287528 23152 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.280661 23093 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.288475 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.250572 23145 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.295258 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.295876 21902 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:30.297569 23093 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.298823 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.278728 23151 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:30.299813 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.300961 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.301685 23153 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:30.303522 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50310.9us
I20260709 13:05:30.309664 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.313444 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.315452 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.296200 23133 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:30.317461 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.308000 23151 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.323035 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.322979 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.312811 23118 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.309553 23153 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.319763 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.319047 23133 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.336534 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.321997 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.320590 23106 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.314862 23150 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.323254 23089 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.334920 23153 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:30.338943 23133 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:30.335162 23118 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.347759 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.351151 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.353103 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.354034 22547 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:30.356396 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.357281 22551 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:30.339591 23106 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:30.358139 23117 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.358374 23106 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.358745 23117 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.351953 23118 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.342804 23150 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.369756 23132 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.370225 23132 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:30.371639 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.374559 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.377848 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.378638 21904 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:30.378316 23132 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.378834 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.379398 23132 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.380968 23135 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.365247 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.382992 23139 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:30.383437 23139 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:30.386662 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.379534 21906 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:30.395607 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:30.401676 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 81966.7us
W20260709 13:05:30.402556 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 67606.8us
I20260709 13:05:30.403224 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.404168 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.411605 23154 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.411880 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.412575 23154 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.412928 23154 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.413269 23154 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.415072 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.416247 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.416607 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.402040 23143 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.418730 23117 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.419770 23143 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.420394 23143 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.420724 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.421006 21982 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.421813 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.422248 22549 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.420753 23143 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:30.417409 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.425387 21904 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:30.373193 23150 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.421819 23128 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.426636 22550 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.422739 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.428135 21908 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:05:30.428289 23148 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.165s	user 0.001s	sys 0.001s
I20260709 13:05:30.387313 21828 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:30.430562 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.446597 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.454526 23160 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:30.415735 23093 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:30.458709 21904 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.425617 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.425223 23105 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.462404 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.463167 21829 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.464253 21909 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.428267 23128 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.429121 23143 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.468989 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.469159 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.471973 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.466925 23093 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.474471 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.474896 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.465822 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.468062 23105 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.483326 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.490475 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.458227 23154 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.490868 23093 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.495633 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.497856 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.480465 23115 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.502799 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.506155 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.491015 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.507422 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.508059 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.508525 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.509735 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.510291 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.511291 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.511641 23101 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.507526 21827 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.513491 21901 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.513803 23130 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.503945 23115 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:30.514981 23115 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.515022 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.515874 23130 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.508580 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.516484 21906 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:30.517999 21828 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.492483 23105 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.484244 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.522040 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.484380 23135 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.479403 23138 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.479112 23119 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:05:30.482769 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.546590 21908 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:30.546693 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.489970 23137 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.536652 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.536685 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.538127 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:30.543382 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 109288us
I20260709 13:05:30.545287 23133 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.548632 23154 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.552184 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.492741 23096 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.569404 23096 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.570194 21905 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:30.572177 23047 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.572085 23152 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.572446 23143 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.539268 23162 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:05:30.560534 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.563295 21825 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:30.564388 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 91742.7us
W20260709 13:05:30.565551 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 93631.4us
I20260709 13:05:30.566680 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.563990 23137 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.582882 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:30.587388 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.583699 21730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 120) took 1647 ms. Trace:
W20260709 13:05:30.579033 23157 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:05:30.590786 21974 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:30.593212 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.594655 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.595772 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.596163 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.597711 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.598306 21906 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:30.592123 23154 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.599004 23154 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.599495 23154 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.601151 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.602836 21902 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.561594 23135 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:05:30.604996 21903 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.606012 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:30.565382 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59180.6us
I20260709 13:05:30.574079 23152 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.608960 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.610272 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.610774 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.613021 22554 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:30.610762 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.613579 23164 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.614635 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 35) took 1145 ms. Trace:
I20260709 13:05:30.586578 23128 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.613986 23164 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:30.622720 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.626658 23137 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.614957 21905 rpcz_store.cc:276] 0709 13:05:29.459746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.459908 (+   162us) service_pool.cc:224] Handling call
0709 13:05:30.604747 (+1144839us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540034a654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:30.604866 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037276032}
I20260709 13:05:30.603488 23143 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.630259 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.606932 23160 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.636989 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.638588 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:30.644701 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 122030us
I20260709 13:05:30.645527 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:30.646829 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.647835 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:30.650408 21978 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:30.621717 23128 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.650048 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:30.638429 23159 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:05:30.633656 23109 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.618933 23162 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:05:30.673924 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.620250 23130 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:05:30.676249 23160 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:30.627841 23106 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.677037 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.668536 23128 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.664813 23093 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.677166 23098 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:30.665797 23115 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.667106 23097 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.677891 23075 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.664989 23101 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.673735 23139 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.588460 21730 rpcz_store.cc:276] 0709 13:05:28.932495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.932871 (+   376us) service_pool.cc:224] Handling call
0709 13:05:30.580215 (+1647344us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:29.375320 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:29.377885 (+  2565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:29.377943 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:05:29.377985 (+    42us) tablet.cc:662] Decoding operations
0709 13:05:29.380883 (+  2898us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:29.380974 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:29.381006 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:29.381276 (+   270us) tablet.cc:701] Row locks acquired
0709 13:05:29.381322 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:05:29.381473 (+   151us) write_op.cc:270] Start()
0709 13:05:29.381639 (+   166us) write_op.cc:276] Timestamp: P: 1783602329381416 usec, L: 0
0709 13:05:29.381677 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:05:29.525291 (+143614us) log.cc:844] Serialized 536 byte log entry
0709 13:05:30.262606 (+737315us) op_driver.cc:464] REPLICATION: finished
0709 13:05:30.414418 (+151812us) write_op.cc:301] APPLY: starting
0709 13:05:30.414513 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:30.414616 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:30.414737 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:30.436326 (+ 21589us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:30.462077 (+ 25751us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:30.462135 (+    58us) write_op.cc:312] APPLY: finished
0709 13:05:30.480017 (+ 17882us) log.cc:844] Serialized 23 byte log entry
0709 13:05:30.496679 (+ 16662us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:30.502930 (+  6251us) write_op.cc:454] Released schema lock
0709 13:05:30.529945 (+ 27015us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:30.546524 (+ 16579us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:30.546559 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19079,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":107294,"apply.run_cpu_time_us":2770,"apply.run_wall_time_us":132089,"num_ops":1,"prepare.queue_time_us":208399,"prepare.run_cpu_time_us":37821,"prepare.run_wall_time_us":433794,"raft.queue_time_us":355662,"raft.run_cpu_time_us":27750,"raft.run_wall_time_us":123500,"replication_time_us":841552,"thread_start_us":752979,"threads_started":4,"wal-append.queue_time_us":313360}]]}
I20260709 13:05:30.679510 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.649030 23117 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.614526 23161 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:05:30.640081 23137 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.698072 23075 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:30.703943 23075 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.703864 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.699801 23101 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.704692 23101 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.713837 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.718667 22553 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.719086 22555 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:30.734773 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 97819.5us
I20260709 13:05:30.734856 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.735965 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.737495 22554 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.738610 21978 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:30.698202 23097 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.743083 23133 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.707093 23138 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:30.745276 23169 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 13:05:30.746032 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.747380 21833 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.734256 23109 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.755889 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.758200 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.737145 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.757104 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.744419 22549 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.763221 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.744226 23097 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.766574 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.760231 23138 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:30.767623 23138 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.770361 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.758669 23093 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.774479 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:30.706859 23164 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.792984 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.768940 23150 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.791376 21983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:30.805493 21983 raft_consensus.cc:606] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Received request to transfer leadership to TS 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:30.805537 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.760869 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:30.807126 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 54811.8us
I20260709 13:05:30.807849 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:30.808099 23075 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.808971 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:30.808892 23118 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.809300 23106 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.809937 21827 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.810110 21904 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.810318 23089 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.810818 23145 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.810923 23139 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.811255 23145 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:30.811628 23145 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.788434 23153 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.769882 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.793175 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:30.764273 23095 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.758263 23152 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:05:30.766482 21828 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:30.775573 23138 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.814816 22555 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:30.798596 23111 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:30.817473 23111 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:30.786026 23174 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.818421 23153 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.817940 23111 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:30.791317 23165 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.818127 23174 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.770429 23175 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:30.787081 23105 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.816110 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:30.821744 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 173997us
I20260709 13:05:30.821892 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.823184 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.790874 23093 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:30.767017 23137 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.817564 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.826285 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.821588 23098 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:05:30.827661 23139 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.809944 23047 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.832263 21834 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:30.804333 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.814181 23095 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:30.787328 23151 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.842114 21826 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.836854 23093 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.831385 23165 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:30.835522 23096 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.838907 23095 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.852828 21948 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:30.845280 23168 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.854336 23168 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:30.854431 23151 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.854791 23168 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.837427 23139 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:30.825398 23175 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:30.849125 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.849380 23156 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.849300 23101 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.850311 21975 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:30.851079 23174 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:30.850842 23138 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:30.851869 23118 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.884982 23162 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.885382 23162 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:30.886206 23162 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.852448 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.852897 23096 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:30.856191 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:30.856410 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.845366 23115 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.856397 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.826315 23154 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.895224 21830 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.896273 23154 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.858978 23175 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:30.858999 23143 raft_consensus.cc:993] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 0157b4f0725d4f92a53938c921db9efc to start an election
I20260709 13:05:30.859172 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.860859 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:30.874555 23138 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.876446 23101 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.863245 23075 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.879166 23139 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.858115 23152 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.919360 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.881108 23150 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.882238 23105 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.843232 23128 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.872043 23135 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:05:30.883369 23156 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:30.883692 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:30.864480 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:30.890590 23170 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.891012 21831 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.891919 23096 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.957613 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:30.892271 23106 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.959494 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.855752 23165 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:30.906243 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.905964 23097 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.907531 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.907279 23145 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.914237 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.914338 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:30.916610 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.908553 23138 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:30.917269 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.917922 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.908464 23111 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.974548 23105 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.974916 23150 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:30.975047 23105 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:30.949301 22554 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.921056 23176 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 13:05:30.975047 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76689.6us
I20260709 13:05:30.921536 23075 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:05:30.977409 21901 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.977813 23075 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.978057 23097 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.978227 23075 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:30.945363 23154 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:05:30.979002 23154 consensus_queue.cc:1243] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:30.979156 23075 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.912748 23133 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:05:30.911623 23143 raft_consensus.cc:1081] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Signalling peer 0157b4f0725d4f92a53938c921db9efc to start an election
I20260709 13:05:30.911966 23162 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.953743 23093 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.902634 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.912914 23153 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:05:30.954602 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.990923 23128 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.955197 21907 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:30.956660 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.957296 23170 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:30.963490 23166 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.963661 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.963927 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:30.964166 23047 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:30.995038 23135 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.995627 23047 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:30.995321 23170 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.956635 21974 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:30.996030 23135 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.967623 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:30.996523 23135 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:30.996683 23170 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.967805 23096 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:30.972889 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 58624.6us
I20260709 13:05:30.998416 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:30.999931 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:30.976015 23105 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.003077 23135 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.981307 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:30.992630 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 119222us
I20260709 13:05:30.980465 23151 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.008533 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.008805 23151 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.009086 21902 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:31.009186 23151 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:30.984756 23175 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:30.982568 23111 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:30.987845 23133 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.016834 23133 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:31.017141 23160 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.987936 23075 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.988904 23138 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.017674 23133 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.018608 23138 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.018828 23133 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.020103 23176 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.020453 23176 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:30.989521 23139 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.991948 23093 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:30.992748 23119 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.022533 23119 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:31.022969 23119 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.023311 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.024487 23089 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.024847 23089 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:30.965615 21828 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:31.024508 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.996037 23047 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:30.992697 23166 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:31.027415 23166 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:30.980540 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.028833 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:31.029105 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 48643.4us
I20260709 13:05:31.029307 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:31.005905 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.007689 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.029851 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.030707 21904 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:31.007818 21905 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.010234 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.014483 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:31.014490 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 174686us
I20260709 13:05:31.016068 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.010190 23151 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.016382 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.025224 23089 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.025269 23145 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:31.041867 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:30.993300 23095 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.068269 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:31.073422 23152 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:31.074039 23152 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:31.082604 21828 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:31.035089 23115 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.036769 23130 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.027484 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.123433 21909 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.088644 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.119694 23111 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.031064 23168 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.122773 21902 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:31.069934 23174 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.094789 23135 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.021291 23176 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.118968 23151 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.095861 23115 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:31.027362 23047 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.120741 23153 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.072273 23109 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:05:31.129709 23145 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.139549 23164 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.131081 23111 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:31.145061 23106 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:31.133370 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 44811.3us
I20260709 13:05:31.155239 21901 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.159355 21873 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.144335 23133 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.135907 23093 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.091988 23152 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.147724 23115 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.165074 23182 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.147148 23096 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:31.161585 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.170264 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.174346 23093 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:05:31.174702 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.175439 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.176308 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.175580 23156 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.177201 23156 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.177416 23175 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:31.160681 23111 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.160311 23106 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:31.164038 23047 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:31.198828 23106 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.200022 23106 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.203682 23095 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:31.169574 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 139529us
I20260709 13:05:31.169307 23101 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.209131 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.211664 23145 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.212086 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.212936 23145 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.223919 23180 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:05:31.243233 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:31.238134 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 196335us
I20260709 13:05:31.245736 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:31.248246 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 411814us
I20260709 13:05:31.256094 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.257544 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.246456 23119 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:31.260824 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 231015us
I20260709 13:05:31.261792 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.259342 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.264721 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.270614 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.272029 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.255174 23105 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:31.258597 23109 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.277719 21948 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.259207 23168 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:31.282544 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:05:31.275393 23179 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
I20260709 13:05:31.268175 23143 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.274998 23161 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.266638 23138 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.268245 23133 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:05:31.307108 23186 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:05:31.297701 23101 raft_consensus.cc:2764] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:31.326452 23109 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.326634 23181 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.327028 23109 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:31.327497 23187 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.325879 23115 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.328243 23185 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.303128 23143 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.317391 23130 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.328094 23109 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.309880 23132 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:05:31.349438 23115 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:31.334477 23161 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:05:31.356405 23161 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.356755 23161 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:31.356940 23119 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:31.347491 22550 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.350566 23153 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.335026 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:05:31.381032 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47105.4us
W20260709 13:05:31.385874 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 356614us
I20260709 13:05:31.357585 23161 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.368848 23153 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:31.389267 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:05:31.393149 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 133851us
I20260709 13:05:31.395800 21798 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.396929 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.398640 21833 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.386050 23135 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.403685 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.388309 23176 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:31.409262 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 148964us
I20260709 13:05:31.375392 23111 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.404827 23118 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.416720 23133 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:31.418303 23183 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:05:31.419587 23128 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.421065 23105 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:31.422003 23105 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.422689 23153 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.424275 23153 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.394747 23164 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.425277 21901 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:31.425686 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.414116 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.426476 23152 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.426821 23152 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:31.427165 23152 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.425211 23164 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:31.428539 23164 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.397898 23109 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.414355 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.436529 21909 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:31.437493 23154 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:31.397625 23143 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:05:31.438601 23143 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:31.439702 23181 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:31.440073 23181 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:31.440099 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.442792 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.443015 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.441051 23181 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.443894 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:31.444319 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 161879us
I20260709 13:05:31.444593 21834 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:31.444912 23138 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.445322 23138 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:31.445434 23111 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:31.405467 23135 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:31.446221 23138 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.447227 23101 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.447537 23138 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.431227 23133 raft_consensus.cc:2955] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:31.449326 23165 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.450789 23154 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.452845 21905 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:31.453256 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.453413 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.453565 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.454263 21907 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.452236 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.455891 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.454895 21833 raft_consensus.cc:2955] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:05:31.459617 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.459976 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.444540 23181 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:31.446091 23135 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.462049 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.447232 21980 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:31.481947 21909 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.460199 23174 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.465062 21875 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.476593 23111 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.461211 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:31.441910 23156 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:05:31.459316 23190 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.492028 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.458132 23139 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.489231 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.452471 23132 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.496575 23098 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.500363 21901 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.502087 23132 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.501570 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.502599 23111 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.520869 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.522941 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.523912 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.523829 23177 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.527195 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.486367 22550 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.530282 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.530480 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.534662 23193 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.534932 23117 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.521202 23161 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.535276 23154 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.556203 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:31.557034 21834 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:31.535336 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.554052 23160 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.535672 23098 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.558943 23160 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:31.539232 21730 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.495889 23185 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.528403 23186 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.486006 23199 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:05:31.550865 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.502097 21828 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:31.543915 23089 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.560480 23154 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:31.528925 23174 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.555935 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.545785 23075 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.545296 23182 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.571141 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.575387 22552 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.553551 23197 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:05:31.574772 23194 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:05:31.578860 23089 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:05:31.579499 23133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54248 (request call id 12) took 1810 ms. Trace:
I20260709 13:05:31.580338 21728 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:31.549809 23132 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:05:31.559796 23160 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.587548 23165 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:31.592227 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.569620 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.614403 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:31.615967 21982 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:31.589928 23118 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.575762 23177 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.581390 23154 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.595570 23093 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.611059 23132 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:31.599668 23133 rpcz_store.cc:276] 0709 13:05:29.769370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.778452 (+  9082us) service_pool.cc:224] Handling call
0709 13:05:30.297411 (+518959us) log.cc:844] Serialized 506 byte log entry
0709 13:05:31.579401 (+1281990us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1829,"raft.queue_time_us":86486,"raft.run_cpu_time_us":2619,"raft.run_wall_time_us":179012,"thread_start_us":144740,"threads_started":2,"wal-append.queue_time_us":64761}
I20260709 13:05:31.638875 23132 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:31.590663 23182 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:31.613144 23166 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.616936 23165 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.615665 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.617692 21978 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:31.618753 23075 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.620834 23109 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.626576 23160 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.627851 21907 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:31.628441 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.648396 21975 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:31.629021 21901 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:31.630067 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:31.651183 21909 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:31.643139 23199 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.652400 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.631237 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.655458 21908 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:31.631793 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.655654 23132 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.631978 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.634855 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.605927 23189 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:05:31.638132 21974 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:31.638381 23093 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:31.675282 23093 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.640225 23182 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.681449 23182 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:31.618947 23162 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.000s
I20260709 13:05:31.491609 23188 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
I20260709 13:05:31.642870 23165 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:31.647984 23089 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.647298 23109 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:31.654554 22550 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.656854 23132 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:31.663187 23145 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.670806 21905 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:31.670992 23135 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.658744 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.651590 23199 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:31.692459 23096 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.690120 23093 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.711853 21977 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:05:31.724651 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66009.7us
I20260709 13:05:31.604257 23195 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.267s
W20260709 13:05:31.730249 23200 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:05:31.726213 23089 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.730875 21981 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.729382 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.730122 23145 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:31.735532 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:31.743897 22520 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.745543 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:31.728080 23096 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:31.752377 23047 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:05:31.757246 23096 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.752506 23119 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.758404 23096 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.761265 23097 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.761755 23097 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.766106 23191 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.742537 23135 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:31.761461 23199 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.776888 23164 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.762295 23130 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.784217 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:31.768047 23180 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:05:31.778683 23175 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.786110 23075 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.786504 23175 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:31.786604 23075 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:31.769438 23165 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.782989 23097 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:31.783196 23191 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:31.784422 21981 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:31.778775 23119 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.782495 23162 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.777853 23089 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:31.752236 23115 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.796810 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:31.740743 23109 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.795739 23162 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:31.796460 23075 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.799209 23109 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.799832 23075 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.799606 23162 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.800452 23119 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:31.805107 23119 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:31.795933 23089 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:31.767798 23154 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.805437 23119 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:05:31.817799 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 262178us
I20260709 13:05:31.803556 23193 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.824867 22552 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:31.827543 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 367964us
W20260709 13:05:31.831805 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.829067 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.841086 21906 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.820283 23162 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.846393 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:31.846266 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.823619 23164 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:31.797976 23175 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:31.852831 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.854598 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.846275 23156 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.843246 23152 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.868657 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.856086 23188 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.878226 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.853863 23191 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.880473 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:31.881392 21827 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.868060 23093 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:31.857404 23138 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:05:31.889433 21834 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:31.870505 21982 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:31.891351 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:31.895668 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.889650 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.898198 22552 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.897569 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:31.858876 23160 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:05:31.895040 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 322290us
I20260709 13:05:31.900774 21909 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:31.901278 21909 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:31.885500 23164 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.877337 23203 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.928030 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:31.935076 21834 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.902467 21828 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.850831 23089 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:31.938462 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.939988 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.854638 23119 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:31.929973 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.930699 21903 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.933635 21902 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:31.885775 23202 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.929309 23188 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:31.937440 21909 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.944715 21909 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:31.945020 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.944974 22552 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.948205 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.948874 21979 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:31.948288 21978 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:31.949633 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.950235 21978 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:31.875082 23204 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:05:31.953595 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.954412 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.937561 23156 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:31.939188 23181 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:31.956857 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.954975 21975 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.942375 22554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:60024
I20260709 13:05:31.969671 22554 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:31.970872 23204 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.971397 23204 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:31.958081 21974 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.970017 22554 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.958880 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.959715 21908 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.974421 21976 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:31.953632 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.977993 21828 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:31.939224 23154 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:31.955981 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.980366 21979 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.960811 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:31.963907 21834 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:31.965441 21909 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:31.967948 21798 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:31.950644 23203 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:31.982386 21909 pending_rounds.cc:85] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 1
I20260709 13:05:31.982985 21983 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:31.967873 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:31.960788 23119 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:31.972329 23204 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.975551 21827 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:31.983829 21978 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.985265 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:31.991376 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.968636 23089 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:31.982899 21909 pending_rounds.cc:107] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:31.996491 21983 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.996634 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:31.998204 23201 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:05:32.000448 21948 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 864ca05a434d488c83f87f71e27dfa63. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:32.001068 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:31.979280 23181 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:32.002228 23196 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:05:31.951184 23188 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:31.996088 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:32.004841 21974 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.994830 21909 raft_consensus.cc:2889] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:32.007908 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:32.008663 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.011687 21980 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.011827 23188 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:31.973582 23156 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.012502 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:32.012578 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:32.022903 21827 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:32.023911 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:31.993561 23203 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.012797 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:32.027845 23203 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:32.028481 23181 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:32.006847 23176 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.028820 21977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:32.029363 21977 raft_consensus.cc:606] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:32.029691 21977 raft_consensus.cc:614] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:32.030499 23156 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:32.007771 23202 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:32.032225 21977 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.032836 23199 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.033289 21977 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.006543 23139 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:32.037249 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.036059 23176 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.039058 21975 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:32.039290 23176 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:32.040170 23176 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.041327 23175 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.036424 21798 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.009346 23186 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.010010 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:05:32.056514 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.057963 23191 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.058247 23150 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.058943 23150 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:32.059583 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.063508 23135 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:32.063931 23135 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:32.064307 23135 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.064420 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:32.065091 21827 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:32.066954 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:32.067629 21828 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:32.067865 23118 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.068377 23118 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:32.066954 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:32.070299 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.072650 23150 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:32.074540 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.075846 23186 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:32.034782 23152 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:32.089598 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 81721.5us
I20260709 13:05:32.088043 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:32.091223 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54865us
I20260709 13:05:32.041851 23139 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:32.094748 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:32.096755 23161 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:32.089088 23106 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:32.097572 23106 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:32.097918 23106 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.095793 22554 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.103466 23154 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.103668 21974 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:32.103989 23154 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:32.104044 21978 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:32.109725 22554 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:32.110677 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:32.111213 21978 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:32.099234 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 101855us
I20260709 13:05:32.111912 21978 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:32.113775 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:32.114847 21902 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.115406 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:32.116976 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:32.117159 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:32.105696 23151 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:32.076761 23186 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.123917 21979 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:32.117942 21903 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:32.118348 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.125845 21979 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.121531 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:32.122325 21830 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.122797 21974 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.127956 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:32.141746 21834 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:32.143460 23203 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.129957 23075 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:05:32.144171 23096 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.144764 23097 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:32.142038 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:32.145918 21979 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:32.146402 21979 pending_rounds.cc:85] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 1
I20260709 13:05:32.146106 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.146237 23198 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:32.146699 21979 pending_rounds.cc:107] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:32.146960 21979 raft_consensus.cc:2889] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:32.147392 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.147631 23198 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.148166 23115 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.148346 23198 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:32.148651 23115 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:32.145886 23096 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.144841 23075 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.149119 23139 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:32.158021 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:32.124102 23151 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:32.163908 23209 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:32.149557 23115 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.149307 23198 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:32.195978 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.215982 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.216804 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.217103 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.217516 21826 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:32.218310 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.218485 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.218644 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.219992 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.222512 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.125568 21978 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.235950 21831 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
W20260709 13:05:32.236435 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 93744.4us
I20260709 13:05:32.237008 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.199340 21981 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:32.205785 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:32.207671 23185 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:32.208050 21903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39266
I20260709 13:05:32.243664 21903 raft_consensus.cc:606] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:32.201862 23075 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:32.208407 23152 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:05:32.210965 23151 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.199987 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.200047 23207 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:05:32.199790 22550 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.239476 21826 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.239604 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.240748 21827 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:05:32.198995 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 63600.8us
I20260709 13:05:32.242635 21825 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:32.245170 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:32.250447 23215 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:05:32.251082 23212 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:05:32.291894 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.286410 23195 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:05:32.254266 23203 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.252789 23106 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.293541 23093 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.293830 23203 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:32.293980 23093 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:32.294782 23203 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.171053 23154 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.294943 23093 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.296343 23093 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.253721 23119 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.258296 23156 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.298388 23119 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.298913 23156 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.300388 23119 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:32.300796 23156 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:32.302215 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.271341 23075 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.304728 23075 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.272193 23098 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.251124 23118 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.307662 23118 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.309252 21833 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:32.273550 23175 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.274936 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:32.276381 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:32.277312 21974 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:32.253934 21732 catalog_manager.cc:5697] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.274091 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:32.310159 23139 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.320330 21829 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:32.289043 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.332772 21826 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:32.334291 23194 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.334570 21826 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.334712 23194 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:32.289376 21827 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:32.235666 23188 consensus_queue.cc:1175] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0157b4f0725d4f92a53938c921db9efc" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:05:32.205595 23096 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:32.335884 23194 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.337940 23096 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.338886 23194 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.339005 23096 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.295233 23106 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:32.310881 21834 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:32.311373 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 115177us
I20260709 13:05:32.311530 23089 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.345868 23089 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:32.346864 23089 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.274144 21830 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
W20260709 13:05:32.350790 23214 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:05:32.313218 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:32.359304 21979 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:32.315582 23135 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.327880 23098 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:32.328188 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51903us
I20260709 13:05:32.368094 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:32.369554 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:32.328647 23182 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:05:32.329030 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54185us
I20260709 13:05:32.329380 23165 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.330212 23175 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.331087 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.312743 21828 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:32.381961 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:32.255167 21832 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:32.287382 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.351307 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:32.355562 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.358803 21909 raft_consensus.cc:2955] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
W20260709 13:05:32.383796 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 96488.7us
I20260709 13:05:32.386435 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:32.358847 23139 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.392910 21979 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:32.367002 23098 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:32.394258 21978 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.398658 21979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554595014abc431286bf4ba1922fc147"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:32.399231 21979 raft_consensus.cc:606] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:32.399549 21979 raft_consensus.cc:614] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:32.400673 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.401894 21831 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:32.382248 23195 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.380880 23175 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:32.325484 23151 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.386499 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.412750 21830 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.388104 23207 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.372854 23106 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:05:32.391052 23188 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.380224 23162 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:05:32.422559 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:32.439754 22554 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:32.394553 21827 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:32.442667 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:32.439851 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:32.393806 23191 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:32.410342 23152 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.445185 21905 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:32.395164 23118 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:05:32.396945 23139 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.440802 23195 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.411177 23199 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:05:32.474555 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.475016 21978 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:32.450104 23191 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.446502 23188 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:32.448199 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:32.452396 23207 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.479043 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:32.451534 23161 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:32.482018 23217 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.163s	user 0.005s	sys 0.000s
I20260709 13:05:32.487738 21830 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
W20260709 13:05:32.489321 23213 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.290s	user 0.002s	sys 0.000s
I20260709 13:05:32.493448 23139 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:32.495092 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:32.495368 23135 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:32.498943 22550 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:32.502776 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:32.510192 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 129403us
W20260709 13:05:32.511734 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 142258us
I20260709 13:05:32.507606 23191 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.454216 23156 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:05:32.527812 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:32.528936 21832 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:32.516247 23198 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.510052 23161 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.536495 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:32.537103 23097 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.476934 23175 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.537132 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90821f4436f045a0a3847b276293f36f"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:32.538080 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.532588 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:32.533627 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:32.453908 23098 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.557834 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.555873 21831 raft_consensus.cc:606] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:32.559114 21831 raft_consensus.cc:614] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:32.545493 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:32.560336 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:05:32.567323 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.569545 21978 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.570538 21979 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:32.517515 23165 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:32.513659 23207 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.547319 23161 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.579638 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:32.579943 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.581892 23098 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.582847 23152 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.572207 23075 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.566033 23182 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.558074 23093 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.586573 23093 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:32.587061 23182 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.587809 23182 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:32.587512 23093 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.589028 23182 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.532495 21827 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:32.544493 23139 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:05:32.556679 23198 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:32.581295 23175 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.597913 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.545083 23195 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:05:32.613335 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:32.600436 23135 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.613018 23152 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.621950 23165 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.611292 23180 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.617087 23162 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:32.638216 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:32.635802 23138 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.642786 21908 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.646782 21827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:32.647507 21827 raft_consensus.cc:606] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:32.647929 21827 raft_consensus.cc:614] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:32.648289 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.622345 23135 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.648947 21981 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.641060 23138 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:32.650312 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:32.650664 23135 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:32.651779 23153 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.651973 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:32.651938 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:32.652439 23198 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.653013 21902 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:32.654754 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:32.657007 23219 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:05:32.655550 22552 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:32.628422 23151 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:32.668193 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.670560 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:32.671898 23106 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.671962 23164 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:32.672554 23164 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.672917 23164 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.599920 23188 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:32.641685 23162 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.692055 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:32.701681 21903 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.706450 21907 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.688905 23162 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.714318 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:32.723620 21974 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.725267 21976 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.668982 23138 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:32.731564 23138 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.739529 23191 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:32.748944 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.745177 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:32.753073 21976 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.714336 23207 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:32.761940 21974 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:32.754004 23191 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:32.776237 23191 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:32.796937 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:32.846532 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 81709us
I20260709 13:05:32.851859 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:32.741050 23118 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:05:32.863349 21907 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.852981 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:32.771577 23193 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:05:32.868772 23185 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:32.880458 21828 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.872896 23150 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:05:32.913097 21831 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:32.911780 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 332233us
I20260709 13:05:32.902578 23226 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.879629 23161 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:32.911276 23154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.038s	sys 0.068s
W20260709 13:05:32.945132 23154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.038s	sys 0.068s
W20260709 13:05:32.945931 23204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.006s	sys 0.017s
W20260709 13:05:32.943293 23115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.014s	sys 0.010s
I20260709 13:05:32.961967 23231 ts_tablet_manager.cc:933] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:32.968834 23115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.014s	sys 0.011s
I20260709 13:05:32.944306 23226 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:32.984907 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 62506.3us
W20260709 13:05:32.979523 23203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.012s	sys 0.021s
W20260709 13:05:32.965749 23204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.006s	sys 0.017s
I20260709 13:05:33.005295 21976 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:33.006719 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:32.973147 23145 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:05:32.998612 23203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.013s	sys 0.021s
I20260709 13:05:33.025239 23135 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.025730 23135 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.028059 23135 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.029611 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:33.030239 22552 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:33.031522 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:33.018545 23115 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:33.032373 23135 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:33.032620 23115 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:05:33.035141 23233 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:05:33.035349 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.035269 23115 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.032753 23135 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.038745 23135 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.040285 21908 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:33.045142 23239 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:33.049008 23162 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.053197 21831 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:33.057478 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:33.055099 23096 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.060010 23096 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:33.054966 23235 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:05:33.023084 23151 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.062956 23151 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.065281 23151 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:33.067063 23226 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.081692 21975 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.082353 23161 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.081729 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:33.083644 23199 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:33.084129 21905 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:33.084921 23175 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:33.086336 23165 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:33.086747 23165 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:33.087280 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:33.087831 22552 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.087483 23165 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.089680 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:33.090422 21831 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:33.091786 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:33.090813 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:33.094460 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:05:33.095621 21873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.006s	sys 0.025s
W20260709 13:05:33.095927 21873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.006s	sys 0.025s
W20260709 13:05:33.096494 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.101142 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:33.101682 21901 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:33.089039 23201 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:05:33.096585 23215 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:33.075677 23152 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:33.104298 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:33.117957 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:33.089263 23240 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:33.127313 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:33.130496 21832 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:33.156386 21905 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:33.132212 21976 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
W20260709 13:05:33.142058 21978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.082s	sys 0.104s
W20260709 13:05:33.157366 21978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.082s	sys 0.104s
W20260709 13:05:33.145776 23075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.015s	sys 0.022s
I20260709 13:05:33.097922 23098 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:33.096761 23161 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.101953 23151 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:33.102402 23182 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:33.167742 21977 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:33.182070 21902 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:33.160419 23075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.015s	sys 0.023s
I20260709 13:05:33.154208 23160 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.158356 23227 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:33.167088 23097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.012s	sys 0.019s
I20260709 13:05:33.195382 21900 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:33.195118 23075 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:33.157878 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:33.126533 23153 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:05:33.200783 21903 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:33.178887 23151 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.179708 21828 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:33.178548 23182 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:33.205868 23097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.013s	sys 0.019s
I20260709 13:05:33.158907 23152 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.223307 23075 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.224701 23152 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:33.219055 23250 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:05:33.213924 23227 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:33.213778 23151 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:33.222491 23180 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.002s
I20260709 13:05:33.238571 23180 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:33.212685 22550 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:33.218005 21975 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:33.238010 21977 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:33.204861 23226 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:05:33.221498 23182 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.188565 23161 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:33.243078 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.206351 23160 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.220939 23097 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:33.287978 23231 tablet_copy_client.cc:323] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:05:33.286945 23227 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.244406 23180 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:33.266528 23164 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.593s	user 0.004s	sys 0.007s
I20260709 13:05:33.291393 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:33.293116 22552 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:33.249101 23162 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.296895 23135 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.297161 23160 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.248191 23198 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:05:33.328414 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet 864ca05a434d488c83f87f71e27dfa63 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:05:33.333814 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet 864ca05a434d488c83f87f71e27dfa63 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-864ca05a434d488c83f87f71e27dfa63
I20260709 13:05:33.328579 23243 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:33.334436 23243 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.334872 23243 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:33.328670 23247 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.165s	user 0.001s	sys 0.001s
I20260709 13:05:33.343144 21901 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:33.319193 23161 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:33.319669 23093 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:33.295086 23191 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:05:33.356257 21974 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.004s	sys 0.035s
I20260709 13:05:33.322090 23180 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:33.357232 21974 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.004s	sys 0.035s
W20260709 13:05:33.357647 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 176075us
I20260709 13:05:33.323594 23164 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.345259 23093 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:33.370836 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:33.368853 23153 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.406889 23151 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.407603 23135 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.411676 21901 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:33.412425 23151 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:33.391461 23161 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.413160 23161 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.414815 21993 tablet_copy_source_session.cc:215] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:33.412876 23093 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:33.421502 23261 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:05:33.355357 23097 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.409530 23153 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.433529 23165 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.436122 23180 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.437794 23145 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:33.450151 23145 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.445290 23243 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.452530 23145 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.454617 21730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33508 (request call id 198) took 2016 ms. Trace:
I20260709 13:05:33.455170 21730 rpcz_store.cc:276] 0709 13:05:31.438552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.438702 (+   150us) service_pool.cc:224] Handling call
0709 13:05:33.454544 (+2015842us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:31.938703 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:31.990554 (+ 51851us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:31.990585 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:05:31.990604 (+    19us) tablet.cc:662] Decoding operations
0709 13:05:32.033764 (+ 43160us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:32.035681 (+  1917us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:32.043057 (+  7376us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:32.058760 (+ 15703us) tablet.cc:701] Row locks acquired
0709 13:05:32.058780 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:05:32.058932 (+   152us) write_op.cc:270] Start()
0709 13:05:32.059056 (+   124us) write_op.cc:276] Timestamp: P: 1783602332058874 usec, L: 0
0709 13:05:32.059079 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:05:32.063711 (+  4632us) log.cc:844] Serialized 536 byte log entry
0709 13:05:32.486925 (+423214us) op_driver.cc:464] REPLICATION: finished
0709 13:05:32.899580 (+412655us) write_op.cc:301] APPLY: starting
0709 13:05:32.903542 (+  3962us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:32.908862 (+  5320us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:32.946895 (+ 38033us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:32.969480 (+ 22585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:32.982239 (+ 12759us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:32.986013 (+  3774us) write_op.cc:312] APPLY: finished
0709 13:05:33.000744 (+ 14731us) log.cc:844] Serialized 23 byte log entry
0709 13:05:33.000979 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:33.001087 (+   108us) write_op.cc:454] Released schema lock
0709 13:05:33.001135 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:33.001565 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:33.001604 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6499,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":377624,"apply.run_cpu_time_us":2618,"apply.run_wall_time_us":123109,"num_ops":1,"prepare.queue_time_us":335916,"prepare.run_cpu_time_us":22503,"prepare.run_wall_time_us":209441,"raft.queue_time_us":197107,"raft.run_cpu_time_us":30444,"raft.run_wall_time_us":425580,"replication_time_us":427703,"thread_start_us":799128,"threads_started":4,"wal-append.queue_time_us":98518}]]}
I20260709 13:05:33.478515 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:33.556964 21983 raft_consensus.cc:2368] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3.
I20260709 13:05:33.440272 23093 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:33.460523 23262 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.121s	user 0.001s	sys 0.001s
I20260709 13:05:33.504299 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:33.480132 23145 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.478516 23243 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.529955 23096 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:33.535822 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 382224us
I20260709 13:05:33.546142 23161 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:33.543044 23153 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.547258 23164 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.617277 23135 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.620637 22550 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.610137 23151 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.666422 22519 leader_election.cc:400] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3.
I20260709 13:05:33.672629 22519 leader_election.cc:403] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:33.680231 23231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864ca05a434d488c83f87f71e27dfa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.663686 23198 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.693638 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:33.672613 23135 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.695194 22550 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:33.695441 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:33.696069 21979 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:33.696182 23193 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.696864 21982 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:33.696929 23193 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.699425 23193 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.696287 23135 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:33.700702 23182 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.675617 23151 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.705210 23151 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.670964 23153 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.710490 23153 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.712857 23153 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.642237 23145 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.715349 23145 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.715943 23145 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.716467 23145 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.718307 23198 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.720811 23198 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.721414 23198 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:05:33.735008 21872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.017s	sys 0.013s
W20260709 13:05:33.735496 21872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.017s	sys 0.013s
I20260709 13:05:33.739394 23266 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:33.737972 23096 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.736250 23151 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:33.746537 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.038s
W20260709 13:05:33.749600 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.000s	sys 0.038s
W20260709 13:05:33.749976 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 568831us
I20260709 13:05:33.749771 23096 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.746986 23266 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.753110 23096 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.758384 23266 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.750646 23151 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.761601 23151 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:33.764338 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.765172 23096 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:33.765444 23165 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.765746 23096 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:33.766083 23165 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.768030 23096 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.768990 23165 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:33.778328 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:33.786659 23229 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.879s	user 0.004s	sys 0.010s
I20260709 13:05:33.796991 23165 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:33.798736 21827 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:33.799793 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:33.800181 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:33.800381 21907 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:33.800710 21900 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.801651 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:33.802316 21902 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.806794 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:33.807358 21907 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:33.813427 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:33.817713 21902 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:33.819259 21904 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:33.819732 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:33.821451 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:33.849684 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 70418.3us
I20260709 13:05:33.851296 21903 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:33.821875 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:33.840256 21900 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:33.852612 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:33.853490 21976 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:33.856428 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:33.857352 21979 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:33.851754 21905 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.823079 23135 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.826313 23241 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:05:33.821468 23244 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:05:33.810953 23243 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.824180 23164 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:33.806124 23096 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.831907 23207 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:33.839017 21800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.032s	sys 0.038s
I20260709 13:05:33.815155 23145 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:33.862715 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:33.850035 23156 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:33.864867 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:33.866828 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:33.843142 23198 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3.
I20260709 13:05:33.846954 23151 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.843179 23139 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:33.849129 23182 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:33.871075 23176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.015s	sys 0.055s
I20260709 13:05:33.905223 21798 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:33.842357 23115 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.914832 21831 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:33.864676 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:33.915102 21800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.033s	sys 0.038s
I20260709 13:05:33.909173 23207 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.924888 21905 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
W20260709 13:05:33.931948 23176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.015s	sys 0.055s
I20260709 13:05:33.873034 23135 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.957041 23207 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.906466 23243 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.909003 23164 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.931264 23161 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:33.967643 23191 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.010s	sys 0.019s
I20260709 13:05:33.914844 23096 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:33.993954 21827 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.925623 23156 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.994881 23182 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.015908 23182 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.931797 23151 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.015142 23241 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:34.017493 23199 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:33.933197 23139 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:33.954300 23264 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:34.008878 23191 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.011s	sys 0.019s
W20260709 13:05:34.049672 21906 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.032s	sys 0.008s
W20260709 13:05:34.050079 21906 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.032s	sys 0.008s
W20260709 13:05:34.029834 21799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.000s	sys 0.033s
I20260709 13:05:33.952975 23115 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:34.014751 23223 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.020s	sys 0.026s
I20260709 13:05:34.046864 23151 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:34.054502 21799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.000s	sys 0.033s
W20260709 13:05:34.030141 23160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.002s	sys 0.026s
I20260709 13:05:34.010804 23161 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:34.076568 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 636830us
I20260709 13:05:34.086426 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.087200 21907 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:05:34.066450 21975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.026s	sys 0.020s
W20260709 13:05:34.079165 23160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.003s	sys 0.026s
I20260709 13:05:34.093288 23118 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:34.097342 21975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.026s	sys 0.020s
I20260709 13:05:34.100759 23118 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.102039 23160 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.102591 23160 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.103307 23118 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.104590 23160 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.051230 23150 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:34.108685 22555 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.060s	sys 0.117s
W20260709 13:05:34.114619 22555 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.060s	sys 0.117s
W20260709 13:05:34.079684 23223 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.020s	sys 0.026s
I20260709 13:05:34.114774 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.115545 21900 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:34.080309 23151 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.034276 23241 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.050222 23199 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:34.118137 23075 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.012s	sys 0.039s
I20260709 13:05:34.104596 23118 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:34.163585 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.129607 23150 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:34.163833 23075 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.014s	sys 0.039s
I20260709 13:05:34.153383 23277 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.346091 23207 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.484023 23277 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.485301 23207 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:34.455930 23266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.004s	sys 0.012s
W20260709 13:05:34.485922 23266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.004s	sys 0.012s
I20260709 13:05:34.374655 21978 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:34.487010 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1182) took 1306 ms. Trace:
I20260709 13:05:34.487332 21978 rpcz_store.cc:276] 0709 13:05:33.180964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.187117 (+  6153us) service_pool.cc:224] Handling call
0709 13:05:34.374204 (+1187087us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:05:34.374436 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.486764 (+112328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.486939 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10127616}
I20260709 13:05:34.338804 23115 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.153316 23285 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.488543 23285 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.489353 23277 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:34.249794 23245 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:05:34.324319 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.490321 23285 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:34.420121 22519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.017s	sys 0.049s
I20260709 13:05:34.358695 21732 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 217) took 2120 ms. Trace:
I20260709 13:05:34.346850 23161 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.491555 23161 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.492233 23161 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.166610 23151 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.233839 23278 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:34.494562 23278 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.495644 23151 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.319082 23096 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:34.154251 23098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.022s	sys 0.055s
W20260709 13:05:34.496423 23098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.291s	user 0.027s	sys 0.065s
I20260709 13:05:34.496686 23161 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.387310 23244 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.451756 21949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.009s
I20260709 13:05:34.357503 21728 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 121) took 2857 ms. Trace:
I20260709 13:05:34.497464 23244 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.220932 23265 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.499631 23244 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.336025 23241 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.340118 23156 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.499993 23265 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:34.250197 23164 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.313678 23135 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.066646 23264 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.504531 23264 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:34.453496 21977 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.001s	sys 0.012s
W20260709 13:05:34.505345 21977 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.002s	sys 0.012s
I20260709 13:05:34.308051 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.339502 23182 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.336989 23139 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:34.245925 23097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.000s	sys 0.016s
W20260709 13:05:34.508914 23097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.000s	sys 0.016s
W20260709 13:05:34.455264 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.033s	sys 0.032s
W20260709 13:05:34.509614 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.033s	sys 0.032s
I20260709 13:05:34.510403 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:34.511071 23150 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.511751 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:34.512652 23161 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.512842 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:34.454990 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.018s	sys 0.038s
I20260709 13:05:34.513129 23161 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.395087 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1208) took 1027 ms. Trace:
W20260709 13:05:34.513785 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.019s	sys 0.038s
W20260709 13:05:34.516189 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 611036us
I20260709 13:05:34.516793 23161 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.337872 23231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60024 (request call id 356) took 1953 ms. Trace:
I20260709 13:05:34.520859 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.521574 21980 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:34.400830 23298 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.523530 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.520972 23231 rpcz_store.cc:276] 0709 13:05:32.384623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.384774 (+   151us) service_pool.cc:224] Handling call
0709 13:05:32.979794 (+595020us) ts_tablet_manager.cc:934] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
0709 13:05:33.424372 (+444578us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:34.045016 (+620644us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:34.045125 (+   109us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:34.220109 (+174984us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:34.309095 (+ 88986us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:34.337683 (+ 28588us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:34.337751 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":38072,"tablet-copy.queue_time_us":499692,"thread_start_us":262355,"threads_started":2}
I20260709 13:05:34.524133 21980 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:34.524472 23231 tablet_copy_client.cc:806] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:34.525063 23231 tablet_copy_client.cc:670] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:34.464615 23271 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.229039 23118 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.527252 23118 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.315340 23199 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.433725 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 78) took 1023 ms. Trace:
I20260709 13:05:34.335839 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.307113 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.457227 23295 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:34.349792 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.235230 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:34.466850 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 132184us
W20260709 13:05:34.466807 22521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.000s	sys 0.017s
W20260709 13:05:34.468400 21909 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.005s	sys 0.014s
W20260709 13:05:34.470515 21974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.014s	sys 0.004s
I20260709 13:05:34.473042 23301 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:34.455377 21800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.019s	sys 0.026s
I20260709 13:05:34.475173 23243 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:34.530968 21900 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:34.530500 21975 rpcz_store.cc:276] 0709 13:05:33.410080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.411320 (+  1240us) service_pool.cc:224] Handling call
0709 13:05:33.420364 (+  9044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.420718 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.420747 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.421266 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.101442 (+680176us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:34.101488 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.101761 (+   273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.433493 (+331732us) raft_consensus.cc:1685] finished
0709 13:05:34.433522 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.433667 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2805,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":1707,"thread_start_us":679759,"threads_started":1,"wal-append.queue_time_us":1010519}
I20260709 13:05:34.537144 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:34.538496 23207 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.538585 23264 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:34.539268 23264 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.539513 21904 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:34.539657 23264 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:34.540910 21909 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.005s	sys 0.014s
I20260709 13:05:34.541703 23295 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:34.497192 23278 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.491330 21732 rpcz_store.cc:276] 0709 13:05:32.237890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.238083 (+   193us) service_pool.cc:224] Handling call
0709 13:05:34.358630 (+2120547us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:33.232923 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:33.237566 (+  4643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:33.237602 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:05:33.237623 (+    21us) tablet.cc:662] Decoding operations
0709 13:05:33.237972 (+   349us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:33.238031 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:33.238062 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:33.238282 (+   220us) tablet.cc:701] Row locks acquired
0709 13:05:33.238300 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:05:33.238440 (+   140us) write_op.cc:270] Start()
0709 13:05:33.238542 (+   102us) write_op.cc:276] Timestamp: P: 1783602333238390 usec, L: 0
0709 13:05:33.238563 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:05:33.239166 (+   603us) log.cc:844] Serialized 536 byte log entry
0709 13:05:33.295809 (+ 56643us) op_driver.cc:464] REPLICATION: finished
0709 13:05:33.425425 (+129616us) write_op.cc:301] APPLY: starting
0709 13:05:33.429165 (+  3740us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:33.454884 (+ 25719us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:33.472930 (+ 18046us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:33.473146 (+   216us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:33.473303 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:33.473360 (+    57us) write_op.cc:312] APPLY: finished
0709 13:05:33.473580 (+   220us) log.cc:844] Serialized 23 byte log entry
0709 13:05:33.473775 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:33.473869 (+    94us) write_op.cc:454] Released schema lock
0709 13:05:33.473915 (+    46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":883463,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":127229,"apply.run_cpu_time_us":1882,"apply.run_wall_time_us":48831,"num_ops":1,"prepare.queue_time_us":913083,"prepare.run_cpu_time_us":2485,"prepare.run_wall_time_us":6511,"replication_time_us":49135,"thread_start_us":833717,"threads_started":1}]]}
I20260709 13:05:34.543766 23295 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:34.544512 21827 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:05:34.545321 21800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.020s	sys 0.026s
I20260709 13:05:34.546718 23105 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:34.547226 23105 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:34.547962 21828 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.548980 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.477734 23227 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.549703 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:34.549626 23227 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.550323 21829 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.533373 23265 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:34.551738 23227 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:34.549252 21974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.014s	sys 0.005s
I20260709 13:05:34.459895 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 54) took 1036 ms. Trace:
I20260709 13:05:34.552503 23278 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.491137 22519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.023s	sys 0.049s
I20260709 13:05:34.540370 23301 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.553025 23278 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:34.553539 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 910321us
I20260709 13:05:34.496717 23098 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:34.365326 23228 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:34.554467 22521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.000s	sys 0.018s
I20260709 13:05:34.554569 23228 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:34.555608 23228 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.556602 23228 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.557670 23191 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:34.549311 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.497630 21728 rpcz_store.cc:276] 0709 13:05:31.500112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.500223 (+   111us) service_pool.cc:224] Handling call
0709 13:05:34.357419 (+2857196us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:32.235467 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:32.439708 (+204241us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:32.440932 (+  1224us) write_op.cc:435] Acquired schema lock
0709 13:05:32.442604 (+  1672us) tablet.cc:662] Decoding operations
0709 13:05:32.507161 (+ 64557us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:32.509291 (+  2130us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:32.511290 (+  1999us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:32.530489 (+ 19199us) tablet.cc:701] Row locks acquired
0709 13:05:32.532645 (+  2156us) write_op.cc:260] PREPARE: finished
0709 13:05:32.547257 (+ 14612us) write_op.cc:270] Start()
0709 13:05:32.565859 (+ 18602us) write_op.cc:276] Timestamp: P: 1783602332542971 usec, L: 0
0709 13:05:32.572503 (+  6644us) op_driver.cc:348] REPLICATION: starting
0709 13:05:32.906725 (+334222us) log.cc:844] Serialized 536 byte log entry
0709 13:05:33.016267 (+109542us) op_driver.cc:464] REPLICATION: finished
0709 13:05:33.097969 (+ 81702us) write_op.cc:301] APPLY: starting
0709 13:05:33.100414 (+  2445us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:33.127037 (+ 26623us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:33.178704 (+ 51667us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:33.215207 (+ 36503us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:33.225563 (+ 10356us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540037bed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd9e28 00007fb762a14581 00007fb762a13d58 00007fb762a189f1 00007fb762a189a9 00007fb762a18939 00007fb762a18901 00007fb762a17b2d 000000000038f354 000000000038f199
0709 13:05:33.230126 (+  4563us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:33.235561 (+  5435us) write_op.cc:312] APPLY: finished
0709 13:05:33.248708 (+ 13147us) log.cc:844] Serialized 23 byte log entry
0709 13:05:33.257054 (+  8346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:33.297923 (+ 40869us) write_op.cc:454] Released schema lock
0709 13:05:33.357405 (+ 59482us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:33.415395 (+ 57990us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:33.417249 (+  1854us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73685,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":59104,"apply.run_cpu_time_us":11149,"apply.run_wall_time_us":307227,"num_ops":1,"prepare.queue_time_us":522763,"prepare.run_cpu_time_us":11089,"prepare.run_wall_time_us":1022537,"replication_time_us":427199,"spinlock_wait_cycles":629706112}]]}
I20260709 13:05:34.558735 21833 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:34.513893 21906 rpcz_store.cc:276] 0709 13:05:33.367278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.384441 (+ 17163us) service_pool.cc:224] Handling call
0709 13:05:33.384858 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.385197 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.385227 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.410160 (+ 24933us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.050876 (+640716us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:34.050919 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.050982 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.394871 (+343889us) raft_consensus.cc:1685] finished
0709 13:05:34.394891 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.395022 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7130,"raft.queue_time_us":6814,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8458,"thread_start_us":624739,"threads_started":1,"wal-append.queue_time_us":975222}
I20260709 13:05:34.559609 23156 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.560160 23156 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:34.561038 23156 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:34.562592 23151 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:34.562862 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:34.497474 21949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.006s	sys 0.009s
I20260709 13:05:34.563560 22555 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:34.538983 23207 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.552703 21834 rpcz_store.cc:276] 0709 13:05:33.424283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.424557 (+   274us) service_pool.cc:224] Handling call
0709 13:05:33.424852 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.923778 (+498926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.923822 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.941055 (+ 17233us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.287613 (+346558us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b48000030d8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:05:34.459478 (+171865us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:34.459515 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.459579 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.459616 (+    37us) raft_consensus.cc:1685] finished
0709 13:05:34.459627 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.459829 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180528,"raft.queue_time_us":78226,"raft.run_cpu_time_us":20327,"raft.run_wall_time_us":781547,"spinlock_wait_cycles":4612352,"thread_start_us":949378,"threads_started":2,"wal-append.queue_time_us":401569}
I20260709 13:05:34.523211 23298 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:05:34.461810 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.004s	sys 0.014s
W20260709 13:05:34.565943 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.004s	sys 0.015s
I20260709 13:05:34.565892 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:34.566735 22550 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.567072 23298 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.567807 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:05:34.565709 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52957.9us
I20260709 13:05:34.568776 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:34.569583 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:34.570883 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:34.571534 23299 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.572738 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.573029 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:34.573328 21906 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:34.573554 22550 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:34.573611 22553 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:34.574441 23098 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.525633 23271 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.576614 23186 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.577299 23271 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.577782 23154 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.578773 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.579099 23266 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.579174 23109 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:34.579640 23266 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:34.580010 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:34.579923 23109 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:34.581482 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.583065 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:34.229578 21902 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:34.583645 21827 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:34.461386 21947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.008s
W20260709 13:05:34.584618 21947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.005s	sys 0.008s
I20260709 13:05:34.562966 23151 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.585426 23151 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.586360 23154 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:34.564023 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 628526us
I20260709 13:05:34.588387 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:34.577109 23186 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.384552 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:34.591629 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:34.591867 23186 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.579331 21900 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:34.471416 23303 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:34.594632 23265 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.594449 23303 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:34.595239 23301 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:34.595675 23265 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:34.596760 23265 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:34.597215 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:34.597806 22547 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:34.596784 23303 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:34.599052 23105 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:34.601572 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:34.603852 23300 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:34.603989 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:34.604930 23193 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:34.605343 23193 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:34.605262 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:34.606751 23285 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:34.607092 23285 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:34.607445 23285 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.604295 23300 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.610348 23300 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.605934 23193 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.526739 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.614629 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:34.616461 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.643177 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:34.644589 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.645004 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.645401 21904 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:34.645675 21976 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:34.646234 21900 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.573637 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:34.647863 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:34.647986 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 74405.3us
I20260709 13:05:34.617733 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.649103 21906 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:05:34.619266 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47651.3us
I20260709 13:05:34.621982 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.623049 22555 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:34.651090 21903 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:34.623955 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:34.581586 23266 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:34.627995 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.628932 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.616456 21829 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:34.635250 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.635529 23207 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.637578 23291 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:34.638474 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:34.639063 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.660559 22552 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.642009 23150 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.639710 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.640293 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.582062 23109 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.640901 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.641507 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.637888 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.623062 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.651661 21974 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.651670 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:34.653966 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.654374 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.656704 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:34.658658 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.659376 21983 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:34.639120 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.605108 23278 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.663820 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.664978 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:34.588416 23154 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:34.665518 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:34.867089 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.925000 21832 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:34.844072 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.926851 21976 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:34.905782 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:34.906258 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.831769 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.672108 21900 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:34.929721 21982 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:34.928550 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:34.930599 22552 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:34.932757 21905 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:34.933506 22553 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:34.834787 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.935287 21977 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:34.652722 23228 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:34.652839 23185 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.937947 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:05:34.930670 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 265208us
I20260709 13:05:34.941094 21825 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 2: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:34.941848 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.656594 23243 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:34.653462 23299 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:34.649966 23105 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:34.656713 23298 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.953807 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.924232 21826 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:34.660545 23097 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:34.660234 23161 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.963609 21976 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:34.886366 21980 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:34.655985 23199 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:34.666581 23303 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.807962 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:34.659713 23227 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.352s
I20260709 13:05:34.823166 23315 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.926004 23164 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.818285 23180 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.603993 23151 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.885990 23156 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.661384 23118 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.846771 23264 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.326407 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.093735 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.332710 21828 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:05:35.305728 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 654064us
I20260709 13:05:35.306133 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.008073 23299 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:35.039646 21949 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.542s (SENT) [suppressed 4 similar messages]
I20260709 13:05:34.886147 23139 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:34.701870 23291 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.364439 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:35.368456 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:34.926460 23241 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:35.411192 21981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.016s	sys 0.032s
I20260709 13:05:35.409691 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:34.962780 23243 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:35.418249 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 53897.5us
I20260709 13:05:34.943341 23109 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:35.456856 21976 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
W20260709 13:05:35.165496 23316 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:05:34.986141 23289 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.445s
I20260709 13:05:35.409016 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:35.459043 21981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.016s	sys 0.033s
I20260709 13:05:34.819633 23300 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.460632 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.470543 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.471084 21828 raft_consensus.cc:2410] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:35.407130 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.453053 21979 raft_consensus.cc:2368] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:35.461539 21825 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:34.943442 23301 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:35.033257 23284 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:05:35.458083 23278 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.062482 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.481099 21831 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
W20260709 13:05:35.465288 22519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.019s	sys 0.017s
W20260709 13:05:35.482474 22519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.019s	sys 0.018s
W20260709 13:05:35.482802 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 544896us
I20260709 13:05:34.963567 23295 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:35.464426 21833 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:35.471242 21977 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:35.480263 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:35.399225 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66275.9us
I20260709 13:05:34.962350 21975 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:35.031031 22547 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:35.391738 23161 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:34.769142 23150 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.464284 23294 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:35.121097 23298 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:35.094374 23097 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.005565 23185 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:34.962309 23228 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.031325 23105 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.370332 23199 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.370131 23164 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.390450 23303 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.481734 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.495934 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.548470 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:35.463073 21974 consensus_meta.cc:287] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.003s
I20260709 13:05:35.548776 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.562997 21974 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:35.501616 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.564280 21982 raft_consensus.cc:2410] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:05:35.550235 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.000s	sys 0.024s
W20260709 13:05:35.565734 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.000s	sys 0.024s
I20260709 13:05:35.467558 23243 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:35.566097 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 904910us
I20260709 13:05:35.563194 21977 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:35.565294 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.572247 21982 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
W20260709 13:05:35.476838 23115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.018s
I20260709 13:05:35.466368 23109 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:35.469204 23296 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:35.398198 23156 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.570142 23207 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:35.585743 23207 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:35.585798 23139 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:35.586244 23207 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.586414 23139 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.589186 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.582090 23291 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.590279 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.573305 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.564515 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:35.579177 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.575321 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.514014 21830 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:05:35.512873 23198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.022s	sys 0.048s
I20260709 13:05:35.581966 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.594197 21974 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:35.590802 23264 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:35.605193 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.542037 23135 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.597821 21979 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:35.601738 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.602375 21831 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:35.556416 23295 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:35.364822 23180 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:35.598449 23285 consensus_meta.cc:287] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.991s	user 0.006s	sys 0.005s
I20260709 13:05:35.597811 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.611984 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:35.576706 23115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.004s	sys 0.018s
I20260709 13:05:35.611862 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:35.579536 23324 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:05:35.615697 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:35.617542 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.484303 23154 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:35.585340 23323 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:05:35.459358 23241 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:35.584870 23327 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:05:35.578860 23109 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:35.604651 23193 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.956s	user 0.005s	sys 0.004s
W20260709 13:05:35.599915 23198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.022s	sys 0.054s
I20260709 13:05:35.634728 23199 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.636039 23105 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:35.636439 21981 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.694069 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 251) took 1125 ms. Trace:
I20260709 13:05:35.637137 23139 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.694559 23330 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:35.694458 22554 rpcz_store.cc:276] 0709 13:05:34.568351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.570239 (+  1888us) service_pool.cc:224] Handling call
0709 13:05:34.570529 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:34.570718 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.570744 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.571115 (+   371us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.694632 (+123517us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:34.694704 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.694794 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.693860 (+999066us) raft_consensus.cc:1685] finished
0709 13:05:35.693879 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.693997 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":123159,"threads_started":1,"wal-append.queue_time_us":647089}
I20260709 13:05:35.638136 23098 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.696156 23098 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.644037 23156 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:35.644608 23161 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.646719 23303 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:35.648474 21980 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
W20260709 13:05:35.649974 23326 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:05:35.490769 23278 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.615931 23295 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.383216 23315 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.650995 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.651228 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:35.697458 23193 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.691177 23154 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.746978 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1166) took 1226 ms. Trace:
I20260709 13:05:35.730577 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.568032 23294 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.652256 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1260) took 1104 ms. Trace:
I20260709 13:05:35.629840 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:35.656474 23151 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:35.605072 23186 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:35.657650 23300 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.627331 23135 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.661649 23164 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:35.662554 23321 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:05:35.663341 23320 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:05:35.664758 23150 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:35.806483 21982 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:05:35.668525 21827 consensus_meta.cc:287] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.084s	user 0.007s	sys 0.001s
I20260709 13:05:35.784103 23186 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.674825 23332 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:35.677343 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:35.677186 23185 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.811563 23135 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:35.679749 23289 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:35.812288 23289 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.814248 23289 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:35.682710 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1248) took 1107 ms. Trace:
I20260709 13:05:35.814771 21834 rpcz_store.cc:276] 0709 13:05:34.574816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.574953 (+   137us) service_pool.cc:224] Handling call
0709 13:05:34.575214 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:34.575491 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.575515 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.575916 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.692194 (+116278us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:34.692893 (+   699us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.693139 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.693234 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.682449 (+989215us) raft_consensus.cc:1685] finished
0709 13:05:35.682474 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.682624 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":6927,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":219,"thread_start_us":115891,"threads_started":1,"wal-append.queue_time_us":1104359}
I20260709 13:05:35.483673 23301 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.684986 21979 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.688217 23097 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.688967 21907 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:05:35.699679 21873 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.012s	sys 0.006s
I20260709 13:05:35.701153 23298 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:35.705716 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 666059us
I20260709 13:05:35.696698 23139 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:35.689718 23308 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.751463 21978 rpcz_store.cc:276] 0709 13:05:34.520219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.531504 (+ 11285us) service_pool.cc:224] Handling call
0709 13:05:34.531762 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:34.570377 (+ 38615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.570408 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.570808 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.843505 (+272697us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:34.843559 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.844884 (+  1325us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.746694 (+901810us) raft_consensus.cc:1685] finished
0709 13:05:35.746726 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.746910 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69964,"raft.queue_time_us":114285,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9364,"thread_start_us":272327,"threads_started":1,"wal-append.queue_time_us":373879}
I20260709 13:05:35.765823 21830 rpcz_store.cc:276] 0709 13:05:34.548295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.611844 (+ 63549us) service_pool.cc:224] Handling call
0709 13:05:35.652034 (+1040190us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54001d74d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:35.652193 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842123008}
I20260709 13:05:35.719126 23156 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:35.700457 23105 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:35.807744 21827 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:35.811578 23294 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.766058 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.842244 21979 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:35.720424 23303 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:35.730340 23319 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.236s	user 0.001s	sys 0.002s
I20260709 13:05:35.719973 23075 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:35.785221 21829 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:35.845232 23075 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.742081 23278 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.747814 23180 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.748871 23098 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:35.739673 23241 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:35.765955 23118 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.630713 23285 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.810026 21977 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
W20260709 13:05:35.826560 21873 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.013s	sys 0.006s
W20260709 13:05:35.892485 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 844734us
W20260709 13:05:35.894969 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.828410 21834 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.833331 21978 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.740972 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1249) took 1127 ms. Trace:
I20260709 13:05:35.896303 21833 rpcz_store.cc:276] 0709 13:05:34.613613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.613740 (+   127us) service_pool.cc:224] Handling call
0709 13:05:35.740759 (+1127019us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54002887d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:35.740897 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109213568}
I20260709 13:05:35.836691 23164 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.810133 23186 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.839321 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:35.903224 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 63987us
I20260709 13:05:35.904107 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:35.843214 21832 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:35.847399 21979 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:35.757834 21831 raft_consensus.cc:606] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:35.833189 23228 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.851737 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1232) took 1229 ms. Trace:
I20260709 13:05:35.906674 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:35.911616 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 340359us
I20260709 13:05:35.807124 23243 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.809728 23332 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.896091 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1257) took 1279 ms. Trace:
W20260709 13:05:35.847079 21827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1255) took 1300 ms (client timeout 1542 ms). Trace:
I20260709 13:05:35.848644 23303 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.899725 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.923830 21833 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:35.836591 23308 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.914414 21826 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:35.915555 21949 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:35.917023 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:35.840631 23139 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:05:35.918987 21834 rpcz_store.cc:276] 0709 13:05:34.618510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.827671 (+1209161us) service_pool.cc:224] Handling call
0709 13:05:35.828016 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.895762 (+ 67746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.896026 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:35.929575 21832 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.773731 21728 catalog_manager.cc:5697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:05:35.900012 23241 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.910887 21907 rpcz_store.cc:276] 0709 13:05:34.622726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.622853 (+   127us) service_pool.cc:224] Handling call
0709 13:05:35.851545 (+1228692us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b5400308754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:35.851672 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1758635264}
I20260709 13:05:35.925163 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:35.943897 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:35.945400 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:05:35.897773 22521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.014s	sys 0.015s
I20260709 13:05:35.840339 23156 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.903066 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:35.940843 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.908921 23180 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.942148 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:35.972198 21834 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:35.932510 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:35.909024 23098 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:35.953126 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1266) took 1312 ms. Trace:
I20260709 13:05:35.843626 23105 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.976109 21829 rpcz_store.cc:276] 0709 13:05:34.640224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.944362 (+304138us) service_pool.cc:224] Handling call
0709 13:05:35.952976 (+1008614us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540017edd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:35.953068 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037870464}
I20260709 13:05:35.977788 23105 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:35.982530 23303 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:35.983098 23303 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:35.983464 23303 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.983582 23105 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:35.983825 23303 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.984057 23105 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:35.984309 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1258) took 1365 ms. Trace:
I20260709 13:05:35.984593 23105 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.984696 21833 rpcz_store.cc:276] 0709 13:05:34.618829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.983604 (+1364775us) service_pool.cc:224] Handling call
0709 13:05:35.983885 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.984037 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.984061 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.984100 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:35.984127 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.984172 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.984262 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:35.919844 23289 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:05:35.919466 23207 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.987010 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1259) took 1322 ms. Trace:
I20260709 13:05:35.922416 23332 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:35.987483 21830 rpcz_store.cc:276] 0709 13:05:34.664411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.982974 (+1318563us) service_pool.cc:224] Handling call
0709 13:05:35.983253 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.986528 (+  3275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.986574 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.986638 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:35.986685 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.986771 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.986926 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2894}
I20260709 13:05:35.989348 23156 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:35.913103 23164 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:35.990978 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 63353.9us
I20260709 13:05:35.969774 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1273) took 1327 ms. Trace:
I20260709 13:05:35.994006 21826 rpcz_store.cc:276] 0709 13:05:34.642081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.724773 (+1082692us) service_pool.cc:224] Handling call
0709 13:05:35.969590 (+244817us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400020154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:35.969711 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374020992}
I20260709 13:05:35.995273 23308 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:35.918931 23135 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:35.995839 23308 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:35.996383 23135 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.971186 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:35.996948 23135 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:35.978382 23334 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:05:35.954248 23115 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:05:35.988003 23207 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.999207 23135 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:35.968560 23241 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:35.980438 23098 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.981494 23243 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.982157 23244 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:35.982259 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1263) took 1342 ms. Trace:
I20260709 13:05:35.926741 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:35.989825 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1260) took 1140 ms. Trace:
I20260709 13:05:35.991798 23164 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:35.992349 23180 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.967768 23265 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.065109 23265 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.065476 23265 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.066644 23180 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.067281 23180 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.067799 23180 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:35.931546 21728 catalog_manager.cc:5697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 2 to 3, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.071007 21728 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:05:36.072911 21728 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.999912 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:36.000718 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:36.074535 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 74701.4us
W20260709 13:05:36.074612 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 73953.6us
I20260709 13:05:36.075541 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:36.076730 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:36.001188 23156 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.077239 23150 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:36.077617 23150 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.978914 23315 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:36.078466 23315 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.079077 23315 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.081369 23315 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:36.003101 23289 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.987969 23139 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:36.008502 23295 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.092566 23295 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:36.092717 23185 raft_consensus.cc:993] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:05:36.093111 23295 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.093307 23185 raft_consensus.cc:1081] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:05:36.093484 23295 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.093909 23295 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.094269 23330 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.095727 21974 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:36.008668 23303 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.081954 23315 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.009367 23075 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.010672 23301 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:36.018675 23105 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.019906 23285 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:35.924275 23228 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:05:35.999001 23115 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:05:36.023470 21947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.013s	sys 0.009s
W20260709 13:05:35.921662 21827 rpcz_store.cc:269] 0709 13:05:34.546905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.582828 (+ 35923us) service_pool.cc:224] Handling call
0709 13:05:35.843937 (+1261109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:36.023583 23290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.022s	sys 0.036s
I20260709 13:05:36.097329 23315 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:36.025055 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 386002us
W20260709 13:05:36.108505 23290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.023s	sys 0.037s
I20260709 13:05:36.108641 23315 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.108950 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:36.110198 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:36.025493 22519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.019s	sys 0.039s
W20260709 13:05:36.112080 22519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.019s	sys 0.040s
I20260709 13:05:36.113652 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:36.099288 23182 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:36.042557 23296 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:36.043484 21831 rpcz_store.cc:276] 0709 13:05:34.639464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.981319 (+1341855us) service_pool.cc:224] Handling call
0709 13:05:35.981674 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.981864 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.981911 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.981962 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:35.982004 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.982069 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.982199 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:36.119606 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:36.101097 23075 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.077966 23150 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.005352 23109 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.084565 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:36.086712 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 160024us
I20260709 13:05:36.082512 23289 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.090837 23139 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.969444 21832 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:36.107290 23198 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:36.098229 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 491595us
W20260709 13:05:36.098578 23328 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.017s	sys 0.042s
I20260709 13:05:36.054513 23135 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.063117 21830 rpcz_store.cc:276] 0709 13:05:34.849095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.988878 (+1139783us) service_pool.cc:224] Handling call
0709 13:05:35.989222 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.989426 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.989465 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.989520 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:35.989569 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.989640 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.989762 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:36.085616 23244 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.095739 23164 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.094897 23330 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:36.105489 21947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.013s	sys 0.009s
I20260709 13:05:36.016536 23193 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.070099 23180 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.026194 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1255) took 1410 ms. Trace:
I20260709 13:05:36.153230 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:36.020879 23154 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:36.116711 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.158095 22554 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:36.117367 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:36.159010 21982 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:36.102869 23336 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:36.073282 23265 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.104971 23115 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:36.128502 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:36.132038 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:36.089418 21728 catalog_manager.cc:5697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:36.133772 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49295.6us
I20260709 13:05:36.133639 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:36.118948 23290 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.117700 23243 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.141676 21825 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:36.155503 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:36.137755 23328 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.017s	sys 0.042s
I20260709 13:05:36.156731 21828 rpcz_store.cc:276] 0709 13:05:34.616065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.615509 (+999444us) service_pool.cc:224] Handling call
0709 13:05:35.615770 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.025681 (+409911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.025709 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:36.025749 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:36.025784 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.025982 (+   198us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.026117 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38675,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":409555,"threads_started":1}
I20260709 13:05:36.164811 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:36.135121 23139 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.137619 23231 tablet_copy_client.cc:538] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:36.168138 23097 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:36.198145 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:36.199208 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:36.174690 21728 catalog_manager.cc:5697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 2 to 3, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:05:36.123600 23182 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.140653 23278 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:36.175799 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47390.5us
I20260709 13:05:36.174606 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:36.141464 23164 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.172976 23180 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:36.180976 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 47404.7us
I20260709 13:05:36.139621 23135 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:36.127746 23075 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.138255 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:36.142714 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.168943 23336 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.171597 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.141635 23244 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.198146 23097 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:36.204442 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:36.211675 23193 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:36.201370 21728 catalog_manager.cc:5697] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 2, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 1 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.140102 23198 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.178542 23294 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:36.206502 21828 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:36.219013 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:36.178156 23227 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.183271 23290 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.178377 23161 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.178705 23338 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:36.198271 23185 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:36.197400 23301 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.234064 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:36.235150 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:36.237088 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:36.238533 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:36.213893 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 260540us
I20260709 13:05:36.211373 23278 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.204598 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:36.175709 23332 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.216815 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.195659 23342 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:05:36.202133 23243 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.199455 23296 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.226109 23191 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.247042 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:36.203402 23118 raft_consensus.cc:2764] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:05:36.461822 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 257437us
I20260709 13:05:36.226531 23135 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.256842 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:36.244761 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:36.463961 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 179114us
I20260709 13:05:36.221185 23164 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.456709 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:36.279311 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.423280 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1275) took 1507 ms. Trace:
I20260709 13:05:36.466723 21728 catalog_manager.cc:5697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:05:36.244472 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:36.449767 23343 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:05:36.197798 23341 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:36.553349 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1262) took 1519 ms. Trace:
I20260709 13:05:36.561554 22555 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.237792 23336 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.563019 21974 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:36.563346 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:36.359973 22550 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:36.229031 23298 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.583285 21728 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:05:36.584733 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.619752 21900 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:36.620694 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.482599 21978 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:36.485687 23227 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.575417 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:36.578299 23294 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:36.486776 23303 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:36.238730 23241 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:36.581310 21826 rpcz_store.cc:276] 0709 13:05:34.915687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.995026 (+1079339us) service_pool.cc:224] Handling call
0709 13:05:35.995308 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.995517 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:36.226123 (+230606us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.422938 (+196815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:36.422999 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:36.423036 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.423101 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.423224 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":455338,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"thread_start_us":423311,"threads_started":2}
I20260709 13:05:36.552182 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.598888 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.651666 22553 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:36.606074 21828 rpcz_store.cc:276] 0709 13:05:35.034219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.199912 (+1165693us) service_pool.cc:224] Handling call
0709 13:05:36.200193 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.553049 (+352856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.553284 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:36.598678 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 59) took 1939 ms. Trace:
I20260709 13:05:36.359668 23160 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:36.610373 22554 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:36.315104 23315 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.319494 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:36.596961 23351 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.453362 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.485494 23278 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.453872 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.318073 23098 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.428721 23105 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.360615 23154 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:36.359169 23346 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:36.254091 21827 raft_consensus.cc:2376] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3. Re-sending same reply.
W20260709 13:05:36.315282 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 91061.1us
I20260709 13:05:36.621804 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.595013 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1270) took 1953 ms. Trace:
I20260709 13:05:36.727174 21834 rpcz_store.cc:276] 0709 13:05:34.641317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.993871 (+1352554us) service_pool.cc:224] Handling call
0709 13:05:35.994134 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.994333 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:36.470311 (+475978us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.594610 (+124299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:36.594670 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:36.594722 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.594804 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.594945 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":456333,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":68341,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":24925,"thread_start_us":599448,"threads_started":3}
I20260709 13:05:36.566847 21830 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:36.625790 23227 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.734325 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.748970 23333 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.749490 23333 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.749924 23333 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.619288 21728 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:36.653445 21829 rpcz_store.cc:276] 0709 13:05:34.658847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.977170 (+1318323us) service_pool.cc:224] Handling call
0709 13:05:35.977524 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.977752 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:36.250936 (+273184us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.598355 (+347419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:36.598409 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:36.598456 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.598515 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.598623 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":472577,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"thread_start_us":600458,"threads_started":2}
I20260709 13:05:36.232256 23347 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.758816 23347 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.761678 23347 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.658476 21908 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:36.565907 23357 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:05:36.763098 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.763856 21908 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:36.662109 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.765116 22553 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
W20260709 13:05:36.662834 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 441762us
I20260709 13:05:36.485858 23290 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.774924 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:36.775646 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.777220 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:36.778357 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.780431 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.582698 23161 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.612264 22547 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:36.561259 23301 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.785075 23301 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:36.614686 23352 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:36.549834 23185 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.785907 23352 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.788661 23352 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:36.791531 23161 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:36.566466 23338 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.797029 23338 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.626022 23109 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.616966 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.317714 23115 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.798125 23115 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.651098 23289 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.720229 21904 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:36.672680 22548 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:36.758841 21728 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:36.803721 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.803675 21728 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:36.804827 21904 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:36.810966 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.633388 23298 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.707784 23342 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:36.855693 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 242249us
I20260709 13:05:36.716063 23265 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.889235 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:36.821746 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.822606 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:36.867357 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:36.871227 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 101845us
I20260709 13:05:36.736749 23193 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.747048 23330 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:36.629881 23199 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.725832 23098 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:36.669649 23160 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:36.649777 23097 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:36.729272 23154 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.034708 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:37.033946 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 144781us
W20260709 13:05:37.021466 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 111325us
I20260709 13:05:37.073272 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.962905 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:37.073699 23199 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:37.074702 23199 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:37.046062 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 171629us
I20260709 13:05:37.034361 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:37.077055 23193 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.856103 23182 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:36.889906 23156 consensus_meta.cc:287] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.000s
I20260709 13:05:37.025424 23358 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:37.000736 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:36.908968 23351 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.080144 23098 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.910637 23303 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.975060 23342 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.080528 21904 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:37.123040 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:37.123710 21904 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:37.081797 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:36.814607 23328 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:36.981807 23294 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.055081 22555 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:37.073604 21908 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
W20260709 13:05:37.085172 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 509748us
I20260709 13:05:37.088017 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:37.142598 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 54679.1us
I20260709 13:05:37.144243 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:37.148166 23375 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:05:37.148942 23243 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:37.101960 23193 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.096843 21829 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:37.099086 22552 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:05:37.240841 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.082125 23154 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:37.106009 23186 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.187s	user 0.004s	sys 0.006s
I20260709 13:05:37.108222 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:37.117139 23360 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.401s	user 0.000s	sys 0.000s
I20260709 13:05:37.091296 21974 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:36.733629 23346 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.107447 23358 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:37.110975 23156 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.113394 23098 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.273241 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:37.275835 23368 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.445s	user 0.000s	sys 0.001s
I20260709 13:05:37.150240 23191 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.151582 23301 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.150722 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:37.237658 23354 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:37.237915 23352 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:37.137676 23303 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.258013 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:37.258872 23186 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.307874 23298 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:37.298317 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:37.316561 21831 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:37.286594 23358 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.375586 21903 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.124614 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:37.319141 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:37.376720 21908 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.282806 23332 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:37.311682 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.358953 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.007s	sys 0.024s
W20260709 13:05:37.386564 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.008s	sys 0.024s
W20260709 13:05:37.387161 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 823821us
W20260709 13:05:37.329078 21907 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.007s	sys 0.005s
W20260709 13:05:37.363584 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.005s	sys 0.011s
W20260709 13:05:37.397789 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.005s	sys 0.011s
W20260709 13:05:37.358831 21832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.008s	sys 0.007s
W20260709 13:05:37.320952 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 239216us
W20260709 13:05:37.403221 21832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.010s	sys 0.007s
I20260709 13:05:37.309022 23191 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.384443 21904 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:05:37.404415 23370 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.534s	user 0.001s	sys 0.000s
W20260709 13:05:37.405009 23384 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:05:37.403815 21907 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.011s	sys 0.007s
I20260709 13:05:37.407661 21825 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:05:37.362453 23139 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.149s	user 0.007s	sys 0.023s
I20260709 13:05:37.315384 23352 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.387931 21798 leader_election.cc:400] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
W20260709 13:05:37.328198 23341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.005s	sys 0.007s
I20260709 13:05:37.404424 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:37.403625 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:37.413704 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 61) took 2405 ms. Trace:
I20260709 13:05:37.326647 23315 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:37.323448 23185 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:37.414227 21832 rpcz_store.cc:276] 0709 13:05:35.007880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.199902 (+1192022us) service_pool.cc:224] Handling call
0709 13:05:36.205422 (+  5520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.205602 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:36.597997 (+392395us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.413366 (+815369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.413417 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:37.413456 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.413516 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.413636 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17410,"prepare.queue_time_us":245472,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"thread_start_us":1177524,"threads_started":2}
I20260709 13:05:37.386821 22551 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:37.434676 21982 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.424790 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:37.421973 21974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554595014abc431286bf4ba1922fc147"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:59764
I20260709 13:05:37.435949 21974 raft_consensus.cc:606] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:37.428674 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:37.428469 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:37.436319 21974 raft_consensus.cc:614] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:37.436714 21906 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
W20260709 13:05:37.437287 21906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1299) took 1195 ms (client timeout 1564 ms). Trace:
I20260709 13:05:37.437319 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:37.437796 21906 rpcz_store.cc:269] 0709 13:05:36.241894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.242008 (+   114us) service_pool.cc:224] Handling call
0709 13:05:37.428342 (+1186334us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5800003098. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:37.437207 (+  8865us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40272256}
I20260709 13:05:37.439049 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:37.439730 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:37.440016 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:37.416503 21799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.004s	sys 0.027s
I20260709 13:05:37.430625 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:37.441509 21799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.005s	sys 0.027s
I20260709 13:05:37.441895 21976 raft_consensus.cc:2410] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:37.431309 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:37.431404 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:37.442663 21977 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:37.443256 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:37.436131 22552 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:37.443509 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:37.443540 21798 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:37.419389 23341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.008s	sys 0.009s
I20260709 13:05:37.412881 23352 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.445008 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:37.238606 23328 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.444612 21977 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.447839 22554 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:37.448015 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:37.438979 23244 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.127s	user 0.009s	sys 0.009s
I20260709 13:05:37.448402 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:37.449007 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:37.450804 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:37.416749 23332 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:37.485513 23348 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:37.486481 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 64) took 1270 ms. Trace:
W20260709 13:05:37.433873 22518 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.073s	sys 0.089s
W20260709 13:05:37.549451 22518 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.073s	sys 0.091s
I20260709 13:05:37.550659 23291 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.551156 23291 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.552278 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:37.553170 21977 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:37.508579 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:37.554193 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:37.372681 23354 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.529145 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:37.529475 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:37.418848 23364 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.530735 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:37.533077 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 84140.4us
I20260709 13:05:37.447613 23341 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:37.446594 23241 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:37.428469 23301 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.537680 21908 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:37.539412 21974 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:37.447265 23265 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:37.411774 23139 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.435074 23376 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.448525 23330 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:37.549005 23295 consensus_meta.cc:287] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.446s	user 0.009s	sys 0.000s
I20260709 13:05:37.554888 21977 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:37.628549 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:37.629693 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:37.539141 21905 rpcz_store.cc:276] 0709 13:05:36.216144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.217381 (+  1237us) service_pool.cc:224] Handling call
0709 13:05:36.233540 (+ 16159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.235328 (+  1788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.235370 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.235874 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.622857 (+386983us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:37.107832 (+484975us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.108106 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.108198 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.486250 (+378052us) raft_consensus.cc:1685] finished
0709 13:05:37.486267 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.486400 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52029,"prepare.queue_time_us":630726,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":55773,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":42016,"thread_start_us":446887,"threads_started":2,"wal-append.queue_time_us":549279}
I20260709 13:05:37.555562 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:37.631083 21832 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.557760 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:37.554421 21976 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:37.634644 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:37.635299 21976 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.487751 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:37.507956 23182 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:05:37.560029 21906 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:37.531296 23244 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.571076 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:37.560617 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 112289us
I20260709 13:05:37.572842 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:37.511125 23289 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:37.553369 23308 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:37.658095 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 66) took 1428 ms. Trace:
W20260709 13:05:37.677105 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 104339us
I20260709 13:05:37.552273 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:37.559949 23348 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.561233 23390 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:37.689165 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 144130us
I20260709 13:05:37.558907 23160 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:37.553412 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:37.574013 23371 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:37.649503 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:37.488459 23185 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.553172 23332 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.627436 23291 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:37.657406 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 60) took 2992 ms. Trace:
I20260709 13:05:37.589545 23241 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.664204 21903 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
W20260709 13:05:37.660151 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 514284us
I20260709 13:05:37.647737 23330 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.566695 21979 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:37.677240 21901 rpcz_store.cc:276] 0709 13:05:36.230059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.230234 (+   175us) service_pool.cc:224] Handling call
0709 13:05:36.230552 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.230777 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.230812 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.231261 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.564513 (+333252us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:36.591953 (+ 27440us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.657613 (+1065660us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18003b6c20. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287
0709 13:05:37.657739 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.657817 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.657856 (+    39us) raft_consensus.cc:1685] finished
0709 13:05:37.657936 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.658045 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23438,"prepare.queue_time_us":302195,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":78844,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":29154,"spinlock_wait_cycles":36557696,"thread_start_us":621371,"threads_started":3,"wal-append.queue_time_us":451556}
W20260709 13:05:37.684466 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 113626us
W20260709 13:05:37.658342 23340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.004s	sys 0.008s
W20260709 13:05:37.679992 23363 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:37.605167 23346 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:37.567746 23309 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:37.627833 23351 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:37.806981 21909 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:37.690662 23387 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:37.807430 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:37.869091 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:37.869836 21905 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:05:37.809710 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 128324us
I20260709 13:05:37.606189 23265 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:37.681128 23308 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:37.812261 21902 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.012s	sys 0.023s
I20260709 13:05:37.658628 23342 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:37.815099 21906 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:37.648018 23295 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.806286 23301 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.834398 21833 rpcz_store.cc:276] 0709 13:05:34.664888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.985718 (+1320830us) service_pool.cc:224] Handling call
0709 13:05:35.986025 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.022186 (+ 36161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.022228 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.024557 (+  2329us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.331854 (+307297us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:36.331909 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.332012 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.657094 (+1325082us) raft_consensus.cc:1685] finished
0709 13:05:37.657126 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.657326 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":546,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1169,"thread_start_us":302525,"threads_started":1,"wal-append.queue_time_us":1501179}
I20260709 13:05:37.601451 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:37.827571 23290 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.058s	user 0.018s	sys 0.021s
I20260709 13:05:37.844107 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:37.649158 23376 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.836771 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1314) took 1234 ms. Trace:
I20260709 13:05:37.590142 23364 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.865247 23309 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.826150 23371 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.851754 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:37.900677 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:37.700340 23289 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.844949 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:37.842234 23241 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.862486 21832 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:37.881007 23308 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.919814 21978 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:05:37.920885 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 76035.7us
I20260709 13:05:37.810297 23390 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:37.841939 23186 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:37.835968 23199 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.761s	user 0.017s	sys 0.010s
I20260709 13:05:37.602936 23298 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.830753 21830 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:37.829370 22551 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:37.835620 23303 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:37.932204 23379 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:05:37.845338 23075 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:37.881711 21902 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.016s	sys 0.027s
I20260709 13:05:37.882189 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:37.890681 23401 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.891706 23397 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 13:05:37.867986 23333 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.118s	user 0.010s	sys 0.014s
W20260709 13:05:37.865572 23340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.143s	user 0.007s	sys 0.008s
I20260709 13:05:37.901592 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:37.900473 21903 rpcz_store.cc:276] 0709 13:05:36.602299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.298020 (+695721us) service_pool.cc:224] Handling call
0709 13:05:37.836713 (+538693us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:37.903543 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:37.916011 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:37.878548 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:37.921921 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:37.878734 23265 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.923998 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:37.972502 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 56552us
I20260709 13:05:37.874039 23348 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:37.974754 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52955.5us
I20260709 13:05:37.976975 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:37.976780 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:37.932072 22553 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:37.934334 23378 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.976904 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:37.938768 21982 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.015s
I20260709 13:05:37.978142 21903 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:37.939730 21976 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:37.909250 23371 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.906795 23309 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.881621 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:37.937866 23199 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:37.878624 23350 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.172s
I20260709 13:05:37.905535 23290 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:37.960134 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 88862.1us
I20260709 13:05:37.939500 23160 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.925935 23390 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.957245 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:37.992619 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:37.956454 23372 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:05:37.886665 23387 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.944746 21979 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
W20260709 13:05:37.971561 23115 consensus_meta.cc:287] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.173s	user 0.010s	sys 0.002s
I20260709 13:05:37.978585 21982 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:38.008316 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:38.009086 21982 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:37.987222 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:37.987309 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:37.991003 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:37.992739 21834 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:38.011405 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:37.941521 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1196) took 2458 ms. Trace:
I20260709 13:05:37.994271 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:38.013329 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:38.011909 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:38.012583 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:38.014022 21903 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.014303 21982 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:38.011654 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:37.988181 23391 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.852092 23341 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.018392 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.024722 21833 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:38.020556 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:38.025475 23380 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.990423 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:37.988384 23346 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:38.016353 23336 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.390s	user 0.012s	sys 0.020s
I20260709 13:05:37.990674 23351 raft_consensus.cc:2764] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:38.022837 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:37.977587 23333 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:37.991880 23303 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:38.015221 21975 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:37.976292 23328 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:38.024116 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:38.006646 23387 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.987330 23401 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:37.993793 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 149699us
I20260709 13:05:37.991046 23348 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.989984 23298 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:05:38.015388 23160 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.034606 21903 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:38.060870 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1312) took 1498 ms. Trace:
I20260709 13:05:38.036070 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:38.061473 21903 rpcz_store.cc:276] 0709 13:05:36.562272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.993943 (+1431671us) service_pool.cc:224] Handling call
0709 13:05:38.060773 (+ 66830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.038686 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:38.048722 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:38.019871 22546 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:38.027968 23383 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:37.973349 23395 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.332s
I20260709 13:05:38.062765 21982 raft_consensus.cc:2410] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:38.038514 23346 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:38.064018 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:38.068097 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:38.068979 21903 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:38.069500 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1310) took 1626 ms. Trace:
I20260709 13:05:38.069664 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:38.069831 21903 rpcz_store.cc:276] 0709 13:05:36.443438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.067578 (+1624140us) service_pool.cc:224] Handling call
0709 13:05:38.069455 (+  1877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.070693 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:38.032769 23303 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:38.024953 23332 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:38.025512 23382 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.076329 23303 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.076575 23410 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:38.077071 23410 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.077383 23410 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.078428 23350 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:38.078801 23350 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:38.079150 23350 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.080013 23309 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.081158 21905 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:38.038962 23378 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.040592 23330 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:38.042309 23295 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:38.064615 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:38.073233 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:38.111289 21833 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:38.076016 23383 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:38.085981 23150 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.944s	user 0.006s	sys 0.006s
I20260709 13:05:38.096462 23346 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.098203 23199 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:38.099197 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1286) took 2099 ms. Trace:
W20260709 13:05:38.103206 23193 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.831s	user 0.022s	sys 0.011s
I20260709 13:05:38.104197 23231 tablet_bootstrap.cc:492] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:05:38.106801 23298 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:38.033026 23336 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.064843 23291 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.115998 21906 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:38.088482 23289 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:38.128728 23191 consensus_meta.cc:287] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.712s	user 0.021s	sys 0.004s
W20260709 13:05:38.087174 23388 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.410s	user 0.001s	sys 0.001s
I20260709 13:05:38.134902 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:38.135274 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 65660.2us
I20260709 13:05:38.013281 21980 rpcz_store.cc:276] 0709 13:05:35.476491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.759952 (+283461us) service_pool.cc:224] Handling call
0709 13:05:35.807737 (+ 47785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.829680 (+ 21943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.832021 (+  2341us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:35.907184 (+ 75163us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.494269 (+587085us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:36.565541 (+ 71272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.583389 (+ 17848us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.934717 (+1351328us) raft_consensus.cc:1685] finished
0709 13:05:37.934740 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.934878 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":408121,"threads_started":1,"wal-append.queue_time_us":1562988}
I20260709 13:05:38.159025 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:38.109987 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:38.140153 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.140585 23386 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.125s
I20260709 13:05:38.066352 23406 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:38.086422 23380 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:38.146423 21826 rpcz_store.cc:276] 0709 13:05:35.999993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.703526 (+703533us) service_pool.cc:224] Handling call
0709 13:05:37.071672 (+368146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.094190 (+ 22518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.094259 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.111725 (+ 17466us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.336095 (+224370us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:37.336151 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.336245 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.098868 (+762623us) raft_consensus.cc:1685] finished
0709 13:05:38.098900 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.099123 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21738,"raft.queue_time_us":21968,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":39286,"thread_start_us":70964,"threads_started":1,"wal-append.queue_time_us":905205}
I20260709 13:05:38.067391 23328 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:38.160799 21833 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:38.162103 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:38.149116 23364 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:38.159835 21980 raft_consensus.cc:2368] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:38.033491 23391 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.155035 23291 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.167990 23333 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:38.152496 23298 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:38.151960 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44204us
I20260709 13:05:38.179275 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:38.157214 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.143383 23150 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.165566 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:38.152168 23193 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.163789 23309 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:38.167008 23380 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:38.170903 23328 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:38.197661 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:38.186229 23352 consensus_meta.cc:287] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.657s	user 0.005s	sys 0.004s
I20260709 13:05:38.198757 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.196730 23380 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.182286 23347 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:38.199575 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 65) took 1972 ms. Trace:
I20260709 13:05:38.180460 23382 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:38.198768 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:38.187310 22550 raft_consensus.cc:2368] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
I20260709 13:05:38.185250 23298 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.198776 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.188545 23290 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:38.201431 23309 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:38.207237 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:38.207921 21909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1298) took 1966 ms (client timeout 2100 ms). Trace:
W20260709 13:05:38.211320 22548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 366) took 3568 ms (client timeout 2364 ms). Trace:
W20260709 13:05:38.211589 23227 consensus_meta.cc:287] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.391s	user 0.018s	sys 0.006s
W20260709 13:05:38.221323 21909 rpcz_store.cc:269] 0709 13:05:36.241558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.241681 (+   123us) service_pool.cc:224] Handling call
0709 13:05:36.962760 (+721079us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b5800003098. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9eee 0000000000375939 00007fb763f2d1e0 00007fb763ff60c4 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:38.207739 (+1244979us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400077954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:38.207865 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814635264}
I20260709 13:05:38.164269 23191 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:38.214331 23164 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.610s	user 0.013s	sys 0.008s
I20260709 13:05:38.199191 23328 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.215126 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:38.190049 23098 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.873s	user 0.000s	sys 0.019s
I20260709 13:05:38.205215 21902 rpcz_store.cc:276] 0709 13:05:36.227515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.227731 (+   216us) service_pool.cc:224] Handling call
0709 13:05:36.228381 (+   650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.430314 (+201933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.430358 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.504281 (+ 73923us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.715655 (+211374us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:37.948044 (+1232389us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.956333 (+  8289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.956410 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.199386 (+242976us) raft_consensus.cc:1685] finished
0709 13:05:38.199403 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.199522 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8054,"prepare.queue_time_us":650912,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":546,"raft.queue_time_us":251602,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":18920,"thread_start_us":1427113,"threads_started":3,"wal-append.queue_time_us":832614}
W20260709 13:05:38.218266 22547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 368) took 2095 ms (client timeout 2137 ms). Trace:
I20260709 13:05:38.209898 23241 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.213433 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:38.198856 23182 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:38.213253 23358 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.003s
I20260709 13:05:38.236032 23098 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.231997 23164 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.224210 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1309) took 1857 ms. Trace:
I20260709 13:05:38.222612 23401 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:38.220481 23309 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:05:38.228261 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49024.8us
I20260709 13:05:38.205248 23347 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:38.233047 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.218860 23386 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:38.223140 22548 rpcz_store.cc:269] 0709 13:05:34.642981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.660099 (+ 17118us) service_pool.cc:224] Handling call
0709 13:05:35.610435 (+950336us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:38.211121 (+2600686us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54002debd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:38.211239 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966317184}
I20260709 13:05:38.225744 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:38.220391 23382 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.205013 23352 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.239286 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:38.244818 23098 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:38.249506 21904 raft_consensus.cc:2368] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
I20260709 13:05:38.250720 21833 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
W20260709 13:05:38.243027 23278 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.518s	user 0.010s	sys 0.000s
I20260709 13:05:38.251582 21977 raft_consensus.cc:2368] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:38.244496 21909 rpcz_store.cc:276] 0709 13:05:36.366617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.223616 (+1856999us) service_pool.cc:224] Handling call
0709 13:05:38.223817 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.223930 (+   113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.223944 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.224006 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:38.224033 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.224084 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.224167 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:38.247437 23135 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.650s	user 0.016s	sys 0.010s
I20260709 13:05:38.272378 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1240) took 1170 ms. Trace:
I20260709 13:05:38.231073 23227 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.274956 21909 rpcz_store.cc:276] 0709 13:05:37.102329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.271479 (+1169150us) service_pool.cc:224] Handling call
0709 13:05:38.271778 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.271998 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.272035 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.272090 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:38.272132 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.272201 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.272319 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.184655 23406 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.262359 23347 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.239724 23418 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:38.282159 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.282559 21982 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:38.284096 21833 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:38.285056 21900 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:38.273370 23401 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:38.270985 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1294) took 1180 ms. Trace:
I20260709 13:05:38.239009 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:38.234696 22547 rpcz_store.cc:269] 0709 13:05:36.116726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.122559 (+  5833us) service_pool.cc:224] Handling call
0709 13:05:38.211842 (+2089283us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400545954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:38.211974 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830720896}
I20260709 13:05:38.202399 23383 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.243207 23308 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.266996 23386 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:38.275290 23182 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:05:38.289266 23412 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:05:38.240307 23358 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.276365 23278 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.242429 23350 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.277895 23135 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.296002 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.283299 23418 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:38.291990 23336 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:38.301319 21903 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:38.296809 23330 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:38.303207 21833 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:38.293838 23401 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:38.298537 23386 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:38.295715 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61620.4us
I20260709 13:05:38.310791 21834 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:38.311785 21906 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:38.312199 21831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1288) took 2306 ms (client timeout 2677 ms). Trace:
W20260709 13:05:38.312572 21831 rpcz_store.cc:269] 0709 13:05:36.000802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.195832 (+195030us) service_pool.cc:224] Handling call
0709 13:05:36.238372 (+ 42540us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800010598. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:38.306751 (+2068379us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54001d79d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:38.306868 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735584384}
I20260709 13:05:38.313431 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.303074 23418 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.314224 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.293138 23309 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.316399 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:38.317026 21833 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.287963 21827 rpcz_store.cc:276] 0709 13:05:37.090791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.098361 (+  7570us) service_pool.cc:224] Handling call
0709 13:05:38.214983 (+1116622us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b5800010598. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:38.267732 (+ 52749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18452864}
I20260709 13:05:38.319826 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.315708 23391 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:38.314566 23330 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:38.322286 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 62) took 2104 ms. Trace:
I20260709 13:05:38.323165 21831 raft_consensus.cc:2410] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:38.325165 23406 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:38.319264 23164 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:38.326051 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.322685 21907 rpcz_store.cc:276] 0709 13:05:36.215449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.222363 (+  6914us) service_pool.cc:224] Handling call
0709 13:05:36.222684 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.236094 (+ 13410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.236135 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.236588 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.585393 (+348805us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:37.411392 (+825999us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.411594 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.411677 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.243407 (+831730us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b18002da3c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:05:38.312804 (+ 69397us) raft_consensus.cc:1685] finished
0709 13:05:38.319150 (+  6346us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.319286 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13046,"prepare.queue_time_us":447916,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":2478,"raft.queue_time_us":137690,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":100708,"spinlock_wait_cycles":113427200,"thread_start_us":1023299,"threads_started":2,"wal-append.queue_time_us":728726}
I20260709 13:05:38.308220 23303 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.325361 23330 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:38.369846 23308 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:38.324355 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:38.337393 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:38.337515 23352 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:38.338601 23401 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.817976 23350 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:38.896663 23265 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.909s	user 0.008s	sys 0.002s
I20260709 13:05:38.732882 23278 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:38.765180 23382 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:38.919245 23265 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.405189 23241 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:38.949004 23298 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.733s	user 0.006s	sys 0.005s
I20260709 13:05:38.959149 23135 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:38.418286 23391 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:38.960117 23391 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:38.960594 23391 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:38.908223 23328 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
W20260709 13:05:38.700094 23422 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
W20260709 13:05:38.412082 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 92628.4us
I20260709 13:05:38.412031 23410 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.923179 23358 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:38.949641 23298 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:38.978250 23303 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.000411 23410 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.049280 23265 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.057122 23298 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:38.969812 23328 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.059515 23139 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:39.080271 23427 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:05:39.058125 23371 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.063s	user 0.008s	sys 0.005s
I20260709 13:05:39.103601 23371 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.115738 23328 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.125573 23231 tablet_bootstrap.cc:700] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Time spent opening tablet: real 0.122s	user 0.001s	sys 0.001s
W20260709 13:05:39.140199 23380 consensus_meta.cc:287] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.939s	user 0.003s	sys 0.015s
I20260709 13:05:39.140792 23380 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.143172 23380 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:39.145135 23347 consensus_meta.cc:287] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.859s	user 0.004s	sys 0.012s
I20260709 13:05:39.145583 23347 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:39.148803 23418 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.005s
I20260709 13:05:39.148823 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.150516 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1284) took 1012 ms. Trace:
I20260709 13:05:39.150667 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 62) took 3818 ms. Trace:
I20260709 13:05:39.150934 21831 rpcz_store.cc:276] 0709 13:05:38.137768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.330610 (+192842us) service_pool.cc:224] Handling call
0709 13:05:39.150349 (+819739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.152961 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.153931 21831 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 1.
I20260709 13:05:39.155565 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.156179 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1266) took 1233 ms. Trace:
I20260709 13:05:39.156458 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1287) took 1017 ms. Trace:
W20260709 13:05:39.156852 23390 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.143s	user 0.013s	sys 0.002s
I20260709 13:05:39.156585 21832 rpcz_store.cc:276] 0709 13:05:37.923082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.926398 (+  3316us) service_pool.cc:224] Handling call
0709 13:05:37.931735 (+  5337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.937294 (+  5559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.937342 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.937833 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:05:38.017715 (+ 79882us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:38.017867 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.017936 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.155702 (+1137766us) raft_consensus.cc:1685] finished
0709 13:05:39.155741 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.155984 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5122,"raft.queue_time_us":8422,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6402,"thread_start_us":49172,"threads_started":1,"wal-append.queue_time_us":114708}
I20260709 13:05:39.158710 23371 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:39.159409 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.160243 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1293) took 1009 ms. Trace:
I20260709 13:05:39.160540 21832 rpcz_store.cc:276] 0709 13:05:38.151137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.159115 (+1007978us) service_pool.cc:224] Handling call
0709 13:05:39.160188 (+  1073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.161509 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
W20260709 13:05:39.162040 23386 consensus_meta.cc:287] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.842s	user 0.001s	sys 0.014s
I20260709 13:05:39.156849 21831 rpcz_store.cc:276] 0709 13:05:38.138552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.155089 (+1016537us) service_pool.cc:224] Handling call
0709 13:05:39.156399 (+  1310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.168131 23386 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.169247 21831 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:39.169958 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1267) took 1246 ms. Trace:
W20260709 13:05:39.167098 23428 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:05:39.170555 21831 rpcz_store.cc:276] 0709 13:05:37.927035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.168450 (+1241415us) service_pool.cc:224] Handling call
0709 13:05:39.168942 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.169691 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.169880 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.172603 21831 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:39.157711 23390 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.173213 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1276) took 1242 ms. Trace:
I20260709 13:05:39.173732 21832 raft_consensus.cc:606] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:39.174273 21832 raft_consensus.cc:614] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:39.173663 21831 rpcz_store.cc:276] 0709 13:05:37.930599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.171662 (+1241063us) service_pool.cc:224] Handling call
0709 13:05:39.172209 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.172954 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.173167 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.176708 23390 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.177196 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1278) took 1246 ms. Trace:
I20260709 13:05:39.177697 21831 rpcz_store.cc:276] 0709 13:05:37.931157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.175916 (+1244759us) service_pool.cc:224] Handling call
0709 13:05:39.176374 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.176829 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.176856 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.176924 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:39.176955 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.177009 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.177149 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.180473 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1280) took 1043 ms. Trace:
I20260709 13:05:39.181025 21831 rpcz_store.cc:276] 0709 13:05:38.136699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.178883 (+1042184us) service_pool.cc:224] Handling call
0709 13:05:39.179470 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.179978 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.180010 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.180091 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:39.180173 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.180250 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.180395 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:39.182921 21833 consensus_meta.cc:287] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.865s	user 0.021s	sys 0.000s
I20260709 13:05:39.183447 21833 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:39.184336 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1279) took 1048 ms. Trace:
I20260709 13:05:39.184991 21833 rpcz_store.cc:276] 0709 13:05:38.136381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.306272 (+169891us) service_pool.cc:224] Handling call
0709 13:05:39.184258 (+877986us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:39.187054 23387 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.123s	user 0.015s	sys 0.005s
I20260709 13:05:39.187500 23347 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.187711 23387 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.188432 21833 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:39.189410 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1291) took 1038 ms. Trace:
I20260709 13:05:39.189851 21833 rpcz_store.cc:276] 0709 13:05:38.150775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.186366 (+1035591us) service_pool.cc:224] Handling call
0709 13:05:39.186791 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.189096 (+  2305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.189343 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.149659 23418 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.193249 23418 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.194634 23391 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:39.200858 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 75053.8us
I20260709 13:05:39.202514 23386 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.151265 21828 rpcz_store.cc:276] 0709 13:05:35.332528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.652769 (+1320241us) service_pool.cc:224] Handling call
0709 13:05:36.653135 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.103889 (+450754us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:37.115512 (+ 11623us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.375217 (+259705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.375271 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:37.375313 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.145816 (+1770503us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400030054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:39.145914 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.150343 (+  4429us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29491,"prepare.queue_time_us":11485,"prepare.run_cpu_time_us":3164,"prepare.run_wall_time_us":10922,"raft.queue_time_us":21159,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10840,"spinlock_wait_cycles":1036124544,"thread_start_us":247324,"threads_started":1,"wal-append.queue_time_us":531701,"wal-append.run_cpu_time_us":1053,"wal-append.run_wall_time_us":1034546}
I20260709 13:05:39.204478 21828 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:39.205519 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1294) took 1046 ms. Trace:
I20260709 13:05:39.205955 21828 rpcz_store.cc:276] 0709 13:05:38.159526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.203690 (+1044164us) service_pool.cc:224] Handling call
0709 13:05:39.204150 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.204920 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.205144 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.206519 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1285) took 1068 ms. Trace:
I20260709 13:05:39.207119 21831 rpcz_store.cc:276] 0709 13:05:38.138000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.182285 (+1044285us) service_pool.cc:224] Handling call
0709 13:05:39.205514 (+ 23229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.205988 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.206029 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.206108 (+    79us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:39.206209 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.206291 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.206435 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.208657 21901 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:39.197960 23391 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.210364 23387 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.211900 23383 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.212101 23278 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:39.212728 23383 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.213011 23278 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:39.215636 23383 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.215864 21909 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:39.216629 23278 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.217455 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1241) took 2114 ms. Trace:
I20260709 13:05:39.218410 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.218534 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.220047 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.220077 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.221154 21831 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:39.221498 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.222302 21828 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.222424 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.223549 21831 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:39.223702 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:39.225184 21907 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:39.225631 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:39.225915 23429 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:39.217810 21909 rpcz_store.cc:276] 0709 13:05:37.102664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.276743 (+1174079us) service_pool.cc:224] Handling call
0709 13:05:38.289606 (+ 12863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.216331 (+926725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.217197 (+   866us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400236ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:39.217352 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129129344}
I20260709 13:05:39.226555 23429 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:39.227087 23429 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.227052 23330 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.230387 23330 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.230872 23330 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.226020 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1242) took 2123 ms. Trace:
I20260709 13:05:39.243907 21907 rpcz_store.cc:276] 0709 13:05:37.103107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.214043 (+2110936us) service_pool.cc:224] Handling call
0709 13:05:39.224741 (+ 10698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.225688 (+   947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.225945 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.248381 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1244) took 2144 ms. Trace:
I20260709 13:05:39.242642 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1243) took 2139 ms. Trace:
I20260709 13:05:39.249913 21909 rpcz_store.cc:276] 0709 13:05:37.103390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.227443 (+2124053us) service_pool.cc:224] Handling call
0709 13:05:39.228043 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.228458 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.231828 (+  3370us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.242446 (+ 10618us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:39.242483 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.242524 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.242604 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.249197 21907 rpcz_store.cc:276] 0709 13:05:37.103687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.247200 (+2143513us) service_pool.cc:224] Handling call
0709 13:05:39.247673 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.248021 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.248048 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.248105 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:39.248134 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.248185 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.248309 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.254253 21828 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
W20260709 13:05:39.254429 21974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1217) took 1822 ms (client timeout 2102 ms). Trace:
I20260709 13:05:39.255631 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:39.255759 23429 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.258443 23429 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.259068 23429 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.255760 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1292) took 1104 ms. Trace:
I20260709 13:05:39.259550 23429 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 3 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:05:39.259948 21975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.031s	sys 0.062s
W20260709 13:05:39.260349 21975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.031s	sys 0.063s
I20260709 13:05:39.261430 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1221) took 1828 ms. Trace:
I20260709 13:05:39.260996 23429 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:39.254830 21974 rpcz_store.cc:269] 0709 13:05:37.431991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.444795 (+ 12804us) service_pool.cc:224] Handling call
0709 13:05:39.254031 (+1809236us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b540005a5d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.254200 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128729472}
I20260709 13:05:39.261785 21975 rpcz_store.cc:276] 0709 13:05:37.432822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.277165 (+844343us) service_pool.cc:224] Handling call
0709 13:05:38.291786 (+ 14621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.301074 (+  9288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.302946 (+  1872us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:38.327531 (+ 24585us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.260831 (+933300us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:39.260919 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.261095 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.261159 (+    64us) raft_consensus.cc:1685] finished
0709 13:05:39.261180 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.261336 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":915027,"threads_started":1,"wal-append.queue_time_us":758584}
I20260709 13:05:39.277400 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1224) took 1844 ms. Trace:
I20260709 13:05:39.259974 21833 rpcz_store.cc:276] 0709 13:05:38.150978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.190771 (+1039793us) service_pool.cc:224] Handling call
0709 13:05:39.191359 (+   588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.191787 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.191817 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:39.192512 (+   695us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.209090 (+ 16578us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:39.209141 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.209252 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.255523 (+ 46271us) raft_consensus.cc:1685] finished
0709 13:05:39.255545 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.255683 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":16133,"threads_started":1,"wal-append.queue_time_us":52088}
I20260709 13:05:39.280356 23330 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.277917 21975 rpcz_store.cc:276] 0709 13:05:37.433402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.275946 (+1842544us) service_pool.cc:224] Handling call
0709 13:05:39.276417 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.276898 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.276943 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.277033 (+    90us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:39.277078 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.277161 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.277312 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.283785 23330 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.283924 21975 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:39.286196 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.286736 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1225) took 1853 ms. Trace:
I20260709 13:05:39.286863 21833 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.287151 21975 rpcz_store.cc:276] 0709 13:05:37.433551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.282947 (+1849396us) service_pool.cc:224] Handling call
0709 13:05:39.283442 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.286451 (+  3009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.286670 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.289353 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1190) took 1717 ms. Trace:
I20260709 13:05:39.289737 21975 rpcz_store.cc:276] 0709 13:05:37.572239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.288052 (+1715813us) service_pool.cc:224] Handling call
0709 13:05:39.288516 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.288871 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.288904 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.288969 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:39.289085 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.289159 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.289286 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.292078 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1195) took 1677 ms. Trace:
I20260709 13:05:39.292454 21975 rpcz_store.cc:276] 0709 13:05:37.614819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.290845 (+1676026us) service_pool.cc:224] Handling call
0709 13:05:39.291325 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.291678 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.291726 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.291793 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:39.291844 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.291918 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.292029 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.298719 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1223) took 1865 ms. Trace:
I20260709 13:05:39.299052 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1202) took 1678 ms. Trace:
I20260709 13:05:39.299233 21974 rpcz_store.cc:276] 0709 13:05:37.433224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.274284 (+1841060us) service_pool.cc:224] Handling call
0709 13:05:39.274904 (+   620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.275470 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.275511 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:39.276151 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.296652 (+ 20501us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:39.296700 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.296766 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.298493 (+  1727us) raft_consensus.cc:1685] finished
0709 13:05:39.298511 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.298647 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":20091,"threads_started":1,"wal-append.queue_time_us":20213}
I20260709 13:05:39.301642 21833 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:39.301859 21974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:05:39.302611 21974 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:39.303118 21974 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.302958 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:39.299495 21975 rpcz_store.cc:276] 0709 13:05:37.620388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.293508 (+1673120us) service_pool.cc:224] Handling call
0709 13:05:39.293915 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.298700 (+  4785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.298727 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.298788 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:39.298816 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.298882 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.298992 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.304061 23330 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:39.304656 23330 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:39.305097 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1204) took 1668 ms. Trace:
I20260709 13:05:39.305553 21975 rpcz_store.cc:276] 0709 13:05:37.636943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.303845 (+1666902us) service_pool.cc:224] Handling call
0709 13:05:39.304332 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.304753 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.304784 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.304841 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:39.304884 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.304941 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.305042 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.305768 23330 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.310916 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1205) took 1673 ms. Trace:
I20260709 13:05:39.311371 21975 rpcz_store.cc:276] 0709 13:05:37.637623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.306802 (+1669179us) service_pool.cc:224] Handling call
0709 13:05:39.310136 (+  3334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.310510 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.310552 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.310613 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:39.310667 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.310739 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.310863 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.313396 21975 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:39.314288 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1207) took 1626 ms. Trace:
I20260709 13:05:39.314692 21975 rpcz_store.cc:276] 0709 13:05:37.687794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.312617 (+1624823us) service_pool.cc:224] Handling call
0709 13:05:39.313111 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.314034 (+   923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.314243 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.316994 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1209) took 1504 ms. Trace:
I20260709 13:05:39.317492 21975 rpcz_store.cc:276] 0709 13:05:37.812752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.315673 (+1502921us) service_pool.cc:224] Handling call
0709 13:05:39.316101 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.316541 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.316592 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.316662 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:39.316695 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.316791 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.316935 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.318427 23395 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:39.318825 23395 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:39.320135 23395 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.271661 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.322099 21828 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.326256 23395 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.329983 23354 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.351985 21828 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:39.356658 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:39.357306 21974 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.370357 23330 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:39.371269 21975 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:39.371304 23330 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:39.372834 23330 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:39.373735 21834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1270) took 1444 ms (client timeout 1852 ms). Trace:
W20260709 13:05:39.374341 21834 rpcz_store.cc:269] 0709 13:05:37.928779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.011179 (+ 82400us) service_pool.cc:224] Handling call
0709 13:05:39.373277 (+1362098us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54001d83d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.373529 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680734976}
I20260709 13:05:39.379032 23075 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.379894 23075 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.382534 23075 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.384032 23386 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.384652 23386 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.385644 21974 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.386324 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39186 (request call id 1203) took 1765 ms. Trace:
I20260709 13:05:39.386684 21974 rpcz_store.cc:276] 0709 13:05:37.621032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.300975 (+1679943us) service_pool.cc:224] Handling call
0709 13:05:39.386199 (+ 85224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.391321 23402 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.392038 23402 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.388818 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 93) took 1528 ms. Trace:
I20260709 13:05:39.393071 21974 rpcz_store.cc:276] 0709 13:05:37.860079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.387619 (+1527540us) service_pool.cc:224] Handling call
0709 13:05:39.388143 (+   524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.388448 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.388477 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.388529 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:39.388565 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.388630 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.388757 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.394768 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.395603 21907 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.395964 23354 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.396623 23354 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:39.398734 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.399341 23354 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.403344 23402 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.414940 21909 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:39.418605 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.419384 21909 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:39.425037 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.426433 23198 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.426642 23386 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.427366 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.428179 21909 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:39.429296 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.429905 21909 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.430557 23291 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.432343 23193 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.437090 21976 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.449044 21907 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:39.450122 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:39.457775 21825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1292) took 3238 ms (client timeout 1798 ms). Trace:
W20260709 13:05:39.458439 21825 rpcz_store.cc:269] 0709 13:05:36.219355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.256578 (+ 37223us) service_pool.cc:224] Handling call
0709 13:05:39.454676 (+3198098us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b540017e3d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.457553 (+  2877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924491648}
I20260709 13:05:39.463841 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.465436 21909 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:39.470118 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.471560 21909 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:05:39.472618 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 828519us
I20260709 13:05:39.476105 21976 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:39.476573 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.478561 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.479430 21907 raft_consensus.cc:2393] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:39.479342 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.483057 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.480792 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:38.425997 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.490252 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1288) took 1351 ms. Trace:
I20260709 13:05:39.490602 21827 rpcz_store.cc:276] 0709 13:05:38.138818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.418100 (+279282us) service_pool.cc:224] Handling call
0709 13:05:39.490064 (+1071964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:39.491964 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.493660 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:39.494318 22546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 262) took 3116 ms (client timeout 1718 ms). Trace:
I20260709 13:05:39.494787 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:39.494927 22546 rpcz_store.cc:269] 0709 13:05:36.378133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.565490 (+187357us) service_pool.cc:224] Handling call
0709 13:05:39.493811 (+2928321us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54004920d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.494021 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2794953088}
I20260709 13:05:39.494395 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.496227 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:39.499965 22550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 373) took 2730 ms (client timeout 1859 ms). Trace:
W20260709 13:05:39.500348 22550 rpcz_store.cc:269] 0709 13:05:36.769152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.776909 (+  7757us) service_pool.cc:224] Handling call
0709 13:05:39.499561 (+2722652us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000aa0d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.499736 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3186887936}
I20260709 13:05:39.503755 21909 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:39.504786 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.505810 21907 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:39.505903 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.506876 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.507035 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.507512 21907 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:39.507567 21909 raft_consensus.cc:2376] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2. Re-sending same reply.
I20260709 13:05:39.508399 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.509140 21907 raft_consensus.cc:2368] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:39.509922 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.511024 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.512090 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.512691 21907 raft_consensus.cc:2376] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2. Re-sending same reply.
I20260709 13:05:39.513221 23097 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.513584 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.508460 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.514882 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.515581 21909 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:39.516356 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.517395 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.518507 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.519732 21909 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:39.520665 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.521140 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:39.519207 21907 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:39.522290 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.522920 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:39.523614 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.524534 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:39.523343 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.525859 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.526670 23374 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:39.528297 23374 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.530912 23374 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.531461 23374 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:39.532027 23374 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.532652 23376 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:39.535482 23367 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 2.165s	user 0.007s	sys 0.001s
I20260709 13:05:39.541591 23264 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:39.542120 23264 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:39.541869 23374 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.542536 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1192) took 4075 ms. Trace:
I20260709 13:05:39.542888 23227 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.543105 23264 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.544102 23374 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:39.542977 21981 rpcz_store.cc:276] 0709 13:05:35.467165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.694027 (+226862us) service_pool.cc:224] Handling call
0709 13:05:35.694345 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.126877 (+432532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.126905 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.131368 (+  4463us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.290958 (+159590us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:36.290999 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.291071 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.534808 (+3243737us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:05:39.542064 (+  7256us) raft_consensus.cc:1685] finished
0709 13:05:39.542088 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.542353 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117132,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":30442368,"thread_start_us":569344,"threads_started":2,"wal-append.queue_time_us":1117378}
I20260709 13:05:39.544665 23374 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:39.545053 23374 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:39.535315 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.526751 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.547111 21907 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:39.547058 21909 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:39.548164 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.548849 21909 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:39.549639 21908 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:39.550278 23357 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.550745 23357 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.539027 23443 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.551738 23443 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:39.551074 21909 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:39.552073 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.539209 21799 leader_election.cc:400] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:39.552175 23443 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.553606 21909 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:39.546057 23374 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.555056 23374 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.556061 23244 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.556627 23264 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:39.552665 21799 leader_election.cc:403] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:39.557703 23264 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:39.558691 23264 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.559098 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:39.560114 23264 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.561024 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:39.563472 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:39.564958 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1211) took 1742 ms. Trace:
I20260709 13:05:39.565364 21975 rpcz_store.cc:276] 0709 13:05:37.822706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.318554 (+1495848us) service_pool.cc:224] Handling call
0709 13:05:39.318908 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.371958 (+ 53050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.564709 (+192751us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b540001e5d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:39.564884 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119764736}
I20260709 13:05:39.568372 23408 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.573963 23374 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:39.574501 23374 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:39.577158 23374 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.575711 23264 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.578498 23264 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.578898 23264 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:39.580458 21982 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1196) took 1964 ms (client timeout 2220 ms). Trace:
W20260709 13:05:39.580919 21982 rpcz_store.cc:269] 0709 13:05:37.615494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.131725 (+516231us) service_pool.cc:224] Handling call
0709 13:05:39.580067 (+1448342us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400413f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.580285 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288843008}
I20260709 13:05:39.582546 21980 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:05:39.587708 21976 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1206) took 1941 ms (client timeout 1758 ms). Trace:
W20260709 13:05:39.588063 21976 rpcz_store.cc:269] 0709 13:05:37.646943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.990764 (+343821us) service_pool.cc:224] Handling call
0709 13:05:39.587526 (+1596762us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003fa054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.587649 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3279258368}
I20260709 13:05:39.589000 21974 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:39.593911 23264 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.597369 23264 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:39.597584 21829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.290s	user 0.026s	sys 0.060s
W20260709 13:05:39.597877 21829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.027s	sys 0.061s
I20260709 13:05:39.598095 23264 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.598492 23264 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:39.598960 23264 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.599604 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 66) took 2089 ms. Trace:
I20260709 13:05:39.600874 23443 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.603804 23408 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:39.604111 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34370 (request call id 4) took 1444 ms. Trace:
I20260709 13:05:39.604529 21832 rpcz_store.cc:276] 0709 13:05:38.159896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.161265 (+1001369us) service_pool.cc:224] Handling call
0709 13:05:39.603927 (+442662us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b540008a554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd8853 00007fb763fa660a 00007fb75d52c7d4 00007fb75d52c762 00007fb75d52c691 00007fb75d52c60c 00007fb75d52b8c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.604032 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26146688}
I20260709 13:05:39.606077 23264 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.599926 21829 rpcz_store.cc:276] 0709 13:05:37.509996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.510157 (+   161us) service_pool.cc:224] Handling call
0709 13:05:38.306965 (+796808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.307159 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.307185 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:38.307597 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.598293 (+1290696us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:39.598347 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.598422 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.598467 (+    45us) raft_consensus.cc:1685] finished
0709 13:05:39.598479 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.599375 (+   896us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54001d79d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.599554 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831593856,"thread_start_us":1290360,"threads_started":1,"wal-append.queue_time_us":817897}
I20260709 13:05:39.609261 23264 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:39.610859 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1245) took 2506 ms (client timeout 2127 ms). Trace:
W20260709 13:05:39.611263 21905 rpcz_store.cc:269] 0709 13:05:37.103961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.870543 (+766582us) service_pool.cc:224] Handling call
0709 13:05:39.610482 (+1739939us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540020add4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.610667 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253990656}
I20260709 13:05:39.612481 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.613018 21905 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:39.621057 21977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1200) took 2001 ms (client timeout 1539 ms). Trace:
W20260709 13:05:39.628695 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 1.2842e+06us
I20260709 13:05:39.630936 23443 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:39.630088 21905 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
W20260709 13:05:39.633203 21983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1182) took 4226 ms (client timeout 3003 ms). Trace:
I20260709 13:05:39.635629 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.640401 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.640942 21905 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.643204 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:39.645934 23443 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:39.646566 23443 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:39.647739 23443 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.647789 21905 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:39.651257 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:39.651556 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.652043 23399 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.652220 21905 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.652603 23399 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:39.653573 23399 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:39.621574 21977 rpcz_store.cc:269] 0709 13:05:37.619028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.629463 (+ 10435us) service_pool.cc:224] Handling call
0709 13:05:39.620563 (+1991100us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54002c7c54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.620835 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428413312}
W20260709 13:05:39.633960 21983 rpcz_store.cc:269] 0709 13:05:35.406478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.408740 (+  2262us) service_pool.cc:224] Handling call
0709 13:05:39.632750 (+4224010us) spinlock_profiling.cc:243] Waited 4.02 s on lock 0x7b5400225bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.632973 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9246402944}
I20260709 13:05:39.660193 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1222) took 2227 ms. Trace:
I20260709 13:05:39.665081 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:39.668762 23244 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.669270 23244 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.669703 23244 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.681758 23371 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:39.683419 23309 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:39.683851 23309 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:39.684839 23309 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.686507 23309 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.690673 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:39.691668 21983 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:39.692322 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:39.692834 21874 leader_election.cc:336] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Timed out: RequestConsensusVote RPC to 127.20.53.132:38783 timed out after 1.936s (SENT)
I20260709 13:05:39.693001 21829 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:39.693328 21874 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:39.694108 23371 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:39.694141 21908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1311) took 3209 ms (client timeout 3143 ms). Trace:
W20260709 13:05:39.696014 21908 rpcz_store.cc:269] 0709 13:05:36.511609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.006228 (+1494619us) service_pool.cc:224] Handling call
0709 13:05:39.693959 (+1687731us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002382d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.694082 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3503837952}
I20260709 13:05:39.697098 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.698223 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.698585 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:39.698843 21908 raft_consensus.cc:2368] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3.
I20260709 13:05:39.698994 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:39.699816 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.700169 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:39.700920 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.699818 21976 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:05:39.701514 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.701467 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.703258 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.704063 21908 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.708036 21832 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:39.708365 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:39.709326 23371 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:39.705384 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:39.709347 21825 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:39.712112 23357 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:39.717177 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.717996 21825 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:39.719224 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.720116 21830 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:39.721035 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.721774 21832 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:39.724121 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:39.727974 23418 raft_consensus.cc:2764] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:39.728137 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:39.728364 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1308) took 3412 ms. Trace:
I20260709 13:05:39.660630 21980 rpcz_store.cc:276] 0709 13:05:37.433026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.303812 (+870786us) service_pool.cc:224] Handling call
0709 13:05:39.582053 (+1278241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.583055 (+  1002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.659943 (+ 76888us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400413f50. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.660115 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2938846976}
I20260709 13:05:39.730993 23330 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.731405 23330 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.731828 23330 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:39.732896 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.728261 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.728828 21906 rpcz_store.cc:276] 0709 13:05:36.315749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.155485 (+1839736us) service_pool.cc:224] Handling call
0709 13:05:38.155680 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.312974 (+157294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.727958 (+1414984us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540034b554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:39.728206 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358584192}
I20260709 13:05:39.735937 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.736508 21906 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:39.736780 22520 connection.cc:256] RPC call timeout handler was delayed by -1.9341230490000498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
I20260709 13:05:39.737912 23437 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:39.738848 23198 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:39.739923 23198 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:39.742992 21905 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:39.740283 23198 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:39.762542 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.758277 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.772313 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.773176 21831 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.775372 21905 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:39.776415 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.775437 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:39.777859 21874 leader_election.cc:336] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Timed out: RequestConsensusVote RPC to 127.20.53.132:38783 timed out after 2.046s (SENT)
I20260709 13:05:39.782578 21874 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:39.781304 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.785672 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.788887 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.789372 21905 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:39.794276 21825 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.799598 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:39.800292 21980 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:39.800423 22519 connection.cc:256] RPC call timeout handler was delayed by -1.1180109090000769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 13:05:39.802495 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:39.803285 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:39.808115 21825 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:39.751968 23244 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.810990 21832 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:39.812704 21908 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:39.811779 21829 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:39.814453 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:39.816627 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:39.817343 23198 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.818089 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:39.818812 22546 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:39.819038 23198 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.819690 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:39.820470 22550 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:39.821210 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:39.822829 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:39.823266 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:39.823751 22547 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:39.825130 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:39.826329 22546 raft_consensus.cc:2368] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
W20260709 13:05:39.826375 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 65718.4us
I20260709 13:05:39.828189 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:39.828941 23383 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.829397 23383 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:39.809657 23097 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:39.830237 23383 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:39.831301 21901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1248) took 2726 ms (client timeout 2116 ms). Trace:
W20260709 13:05:39.831753 21901 rpcz_store.cc:269] 0709 13:05:37.104805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.851476 (+746671us) service_pool.cc:224] Handling call
0709 13:05:39.831069 (+1979593us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540019ee54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.831242 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2996105984}
I20260709 13:05:39.832837 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.825192 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:39.830579 22519 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:39.833400 21906 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:39.833525 21901 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:39.885110 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.886634 21901 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:39.887676 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.888598 21901 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:39.888830 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.889498 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:39.863093 21948 connection.cc:256] RPC call timeout handler was delayed by -1.0022769519999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30350000000000005s for a response
I20260709 13:05:39.863183 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:39.890069 21825 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.891768 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.889523 21832 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:39.893072 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.893729 21906 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:39.893076 21901 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:39.893393 21832 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:39.868237 21826 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.867955 21909 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:39.896363 21908 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:39.896833 21905 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:39.899200 23296 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:39.898986 21832 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:39.905355 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 144871us
W20260709 13:05:39.901350 21799 leader_election.cc:336] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Timed out: RequestConsensusVote RPC to 127.20.53.132:38783 timed out after 1.722s (SENT)
W20260709 13:05:39.911844 21874 leader_election.cc:336] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Timed out: RequestConsensusVote RPC to 127.20.53.132:38783 timed out after 2.085s (SENT)
I20260709 13:05:39.917515 23296 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.919092 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:39.919617 21907 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.920053 23296 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.918308 23198 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:39.920689 23198 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:39.921051 23198 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:39.926548 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 96133.2us
W20260709 13:05:39.926731 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 124211us
I20260709 13:05:39.931511 23244 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:39.932960 22519 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:05:39.933945 21799 leader_election.cc:336] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Timed out: RequestConsensusVote RPC to 127.20.53.132:38783 timed out after 1.718s (SENT)
I20260709 13:05:39.934372 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:39.934588 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:39.935531 23399 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.935799 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:05:39.936825 21900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1302) took 3693 ms (client timeout 1786 ms). Trace:
W20260709 13:05:39.937400 21900 rpcz_store.cc:269] 0709 13:05:36.242794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.733994 (+491200us) service_pool.cc:224] Handling call
0709 13:05:39.936353 (+3202359us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54003ca854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.936591 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3564068608}
I20260709 13:05:39.939843 21874 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:39.944362 21907 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:39.938596 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:39.833338 23437 consensus_queue.cc:1175] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:05:39.950634 23296 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:39.950946 23228 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:39.951131 23296 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:39.951821 23296 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.951905 23386 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:39.926142 23191 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:39.963091 21832 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.951934 23228 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:39.980587 23228 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:39.980765 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.981864 21834 raft_consensus.cc:2368] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3.
I20260709 13:05:39.982944 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.981690 23228 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.991114 23228 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.991255 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:39.988198 21903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 67) took 2577 ms (client timeout 2975 ms). Trace:
I20260709 13:05:39.984810 23330 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:39.989320 21980 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:39.989440 21902 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:39.971163 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.991487 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:39.992089 23454 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:05:39.992637 23460 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.992895 23191 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:39.999396 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:39.988265 21832 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
W20260709 13:05:39.998868 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 84631.7us
W20260709 13:05:39.996300 21903 rpcz_store.cc:269] 0709 13:05:37.411020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.070492 (+659472us) service_pool.cc:224] Handling call
0709 13:05:39.987741 (+1917249us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540020bcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:39.988014 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528920960}
I20260709 13:05:40.005658 21831 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
W20260709 13:05:40.007124 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 95311.9us
I20260709 13:05:40.008334 21825 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
W20260709 13:05:40.000049 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 64317.4us
I20260709 13:05:39.998202 23371 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:05:39.980713 23150 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:40.010462 23354 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.010577 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.011116 23354 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:40.012138 23354 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:39.962759 23386 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:05:40.017493 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:39.993652 23399 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.018378 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.016459 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.020159 21826 raft_consensus.cc:2410] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:40.004633 23460 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.024618 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.010553 23371 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.026618 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.027218 21826 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:40.025065 21834 raft_consensus.cc:2376] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2. Re-sending same reply.
I20260709 13:05:40.031433 23383 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.033038 23383 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:40.033579 21979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1212) took 2204 ms (client timeout 1525 ms). Trace:
I20260709 13:05:40.034006 23383 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:40.033968 21979 rpcz_store.cc:269] 0709 13:05:37.832195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.843778 (+ 11583us) service_pool.cc:224] Handling call
0709 13:05:40.033270 (+2189492us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b5400059bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:40.033400 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116676992}
I20260709 13:05:40.034343 23150 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:40.035504 23374 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.035566 23150 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.035969 23443 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.036077 23150 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:40.035993 23374 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:40.036635 23371 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:40.040738 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.041833 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:05:40.043010 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 43693.8us
I20260709 13:05:40.036589 23443 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:40.046680 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.049873 23244 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.037717 23374 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.051421 23374 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.051291 23443 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.051959 23330 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:40.052810 23443 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.054670 23198 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.055287 23371 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.056658 23371 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.056962 23198 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:40.037429 23150 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.058547 23150 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.059885 21825 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:40.060887 21732 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.062285 23191 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:40.063519 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1321) took 2968 ms. Trace:
I20260709 13:05:40.019946 23296 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.063455 21732 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 2, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.026376 23460 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.061810 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:40.065619 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.064024 21902 rpcz_store.cc:276] 0709 13:05:37.095496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.236869 (+1141373us) service_pool.cc:224] Handling call
0709 13:05:39.989091 (+1752222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.006725 (+ 17634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.063297 (+ 56572us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b540020bcd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:40.063456 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4025163136}
I20260709 13:05:40.071370 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:40.068383 23296 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:40.071516 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.072255 22546 raft_consensus.cc:2368] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:05:40.073159 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.074501 23462 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.075367 23462 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:40.078508 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59118.1us
I20260709 13:05:40.080760 23437 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:40.081554 23437 consensus_queue.cc:1243] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:40.082285 23437 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.082650 23437 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:40.083518 23437 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.084738 23437 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.087320 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:40.087993 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1227) took 1905 ms. Trace:
I20260709 13:05:40.075466 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.088466 21974 rpcz_store.cc:276] 0709 13:05:38.182905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.395716 (+1212811us) service_pool.cc:224] Handling call
0709 13:05:39.588833 (+193117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.589348 (+   515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.087806 (+498458us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003fa050. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:40.087935 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443114368}
I20260709 13:05:40.089624 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.090696 21829 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:40.091714 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.093063 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.095714 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.105577 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.106914 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.108180 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.109797 21833 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:40.111258 21833 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:40.101194 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:40.112514 21904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1320) took 3300 ms (client timeout 1859 ms). Trace:
I20260709 13:05:40.113164 21830 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:40.114741 21830 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:40.115433 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:40.116117 21830 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:40.116973 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:40.112959 21904 rpcz_store.cc:269] 0709 13:05:36.811994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.404188 (+592194us) service_pool.cc:224] Handling call
0709 13:05:40.112114 (+2707926us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b5400237dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:40.112322 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1913127808}
I20260709 13:05:40.118436 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:40.119266 21902 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:40.120834 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:40.121733 21904 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:40.122531 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:40.123318 21902 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
W20260709 13:05:40.105734 21798 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 2.116s (SENT) [suppressed 53 similar messages]
I20260709 13:05:40.121886 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:40.126770 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 110439us
I20260709 13:05:40.067566 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:40.134773 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.141350 21949 leader_election.cc:400] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3.
I20260709 13:05:40.141687 21949 leader_election.cc:403] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:05:40.155323 21830 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:40.155202 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.159420 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.160019 21833 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.164346 21834 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:40.164273 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.164604 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.165663 21829 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 2: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:40.165724 21826 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:40.161626 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.170557 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:40.171557 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.172582 23463 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:40.173107 23463 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:40.173264 23198 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:40.174104 23463 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.178493 23464 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.182207 21979 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:40.182736 21979 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:40.183768 21979 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.184896 21732 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 2, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.162853 23460 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.187520 23154 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.187879 23154 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:40.188208 23460 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:40.188629 23154 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.189896 23154 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.161574 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:40.190958 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.191529 21904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96da242efa5849aab4168785047cff48"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:39266
I20260709 13:05:40.168689 23386 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.192448 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.195205 23227 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.168083 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:40.184937 21979 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.197296 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:40.198876 21904 raft_consensus.cc:606] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.200861 21904 raft_consensus.cc:614] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:40.199827 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 148756us
W20260709 13:05:40.201843 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.205065 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.206123 21828 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:40.212009 22554 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:05:40.215817 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59450us
I20260709 13:05:40.217092 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.217556 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:40.217926 21980 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.223889 22547 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:05:40.224159 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:40.224653 21976 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:40.224923 22546 raft_consensus.cc:2368] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:05:40.200039 23227 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:40.227339 23227 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.229431 23227 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.230504 22550 raft_consensus.cc:2410] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:40.236054 23443 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.236550 23443 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.238490 23303 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:40.211012 23354 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.241739 23354 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:40.249969 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.251282 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "0157b4f0725d4f92a53938c921db9efc"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:40.210707 23386 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:40.252131 21834 raft_consensus.cc:606] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Received request to transfer leadership to TS 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:40.264071 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.252357 23228 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.250051 23371 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.271783 21732 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 2, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.273551 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:40.274474 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:40.274672 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.275053 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:40.275655 21827 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:40.275964 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.276765 22548 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 3 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:40.277828 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.262307 23395 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.278637 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.279038 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.260670 23354 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.279976 22548 raft_consensus.cc:2368] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:40.280292 21904 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:40.281514 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:40.282438 23465 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:40.282682 22553 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:40.269943 21980 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:40.275271 22546 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.267800 21833 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:40.279286 22555 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:40.257736 23443 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:40.275740 22547 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.270510 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:40.256166 23464 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3.
I20260709 13:05:40.294230 21833 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:40.295949 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.295397 23475 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:40.297219 21828 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.274554 21830 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:40.305867 21831 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:40.282866 23465 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:40.305809 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.307551 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:40.307652 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.310995 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.291039 23303 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:40.316305 22553 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:40.318928 22555 raft_consensus.cc:2368] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:40.296653 23228 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:05:40.325546 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44132.3us
I20260709 13:05:40.302932 23371 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:05:40.327651 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 63613.1us
W20260709 13:05:40.315290 23471 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:05:40.308725 23465 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.302691 23150 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:05:40.340454 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44615.7us
I20260709 13:05:40.279104 23386 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.329135 23243 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.353116 23303 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.309530 23475 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:40.356987 23475 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.357278 23303 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:40.359588 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.366853 21902 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:05:40.308385 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.342047 23395 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:05:40.383958 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:40.384212 23395 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.384687 22551 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.386579 23098 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:05:40.375615 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:40.390795 21980 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:40.359125 23301 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:40.396632 23243 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.398892 23243 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:40.401333 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:40.401618 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.402200 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.403062 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.384637 23395 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:40.404534 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.384543 23296 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.402406 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:40.387794 23098 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.405980 21909 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:40.363804 23303 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:40.420739 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 62151.6us
I20260709 13:05:40.428717 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:40.429989 21903 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:40.376201 23154 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:05:40.422276 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:40.395406 23301 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:40.397583 23463 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:40.422271 23231 tablet_bootstrap.cc:492] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:40.440639 21976 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:40.441185 21978 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:40.444078 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.444365 23301 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.441936 22546 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:40.445431 23301 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.445915 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.446508 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.447134 21983 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.447054 23278 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:40.447993 23278 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.448318 23278 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:40.448658 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.400116 23243 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.449071 23278 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.447430 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.447163 22547 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:40.404280 23418 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:05:40.450088 21977 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.452135 21980 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:40.423038 23098 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:40.453686 21832 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:05:40.409667 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 112841us
I20260709 13:05:40.406585 23475 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.460278 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:40.438905 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.471772 21979 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:05:40.474733 21979 pending_rounds.cc:85] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 4
I20260709 13:05:40.472806 21902 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:40.476766 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.476760 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.478302 21982 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:40.479856 21980 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.442817 23228 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.481200 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:40.484699 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.450091 23278 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.451906 23477 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:40.477308 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:40.438093 23383 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:05:40.488691 21903 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:40.496621 21981 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:40.494987 22554 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:40.475355 21979 pending_rounds.cc:107] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:05:40.512095 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.513404 23354 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.515108 23243 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:40.516392 21976 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:40.517248 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08001cdba0 after lost signal to thread 20697
I20260709 13:05:40.517479 21983 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
W20260709 13:05:40.518368 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08001537a0 after lost signal to thread 21766
W20260709 13:05:40.518759 22004 debug-util.cc:398] Leaking SignalData structure 0x7b0800153660 after lost signal to thread 21780
I20260709 13:05:40.519492 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:40.519948 22004 debug-util.cc:398] Leaking SignalData structure 0x7b080026ef00 after lost signal to thread 21858
W20260709 13:05:40.521154 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08001fd840 after lost signal to thread 21933
I20260709 13:05:40.522796 22548 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:40.523922 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.524374 23463 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:40.524878 23485 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.525836 23485 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:40.526422 23478 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:05:40.526484 23485 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.466495 23464 raft_consensus.cc:2764] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:05:40.512125 21979 raft_consensus.cc:2889] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:40.524614 23354 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:40.535910 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 131447us
W20260709 13:05:40.539366 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 62684.5us
I20260709 13:05:40.539436 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:40.540593 21979 raft_consensus.cc:2368] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:40.541473 22554 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:40.543236 21977 raft_consensus.cc:2410] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:40.438544 23371 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.547667 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:40.534262 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcc00 after lost signal to thread 22007
I20260709 13:05:40.553809 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:40.557303 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:40.557961 21906 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.553956 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:40.559027 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:40.554620 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57684.7us
I20260709 13:05:40.538079 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:40.536098 23296 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:40.510903 23244 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:05:40.556296 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcc20 after lost signal to thread 22008
I20260709 13:05:40.567497 23291 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:40.530232 23465 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.570487 21977 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:40.577019 22553 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:40.523939 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:40.560828 23231 tablet_bootstrap.cc:492] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:05:40.577903 22519 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:40.568560 23418 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:40.579528 21906 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:40.580432 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.580333 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.496196 23395 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.660796 22552 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:05:40.667905 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 90087.6us
W20260709 13:05:40.658310 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.569214 22547 raft_consensus.cc:2376] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3. Re-sending same reply.
I20260709 13:05:40.670965 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:40.671357 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 112393us
W20260709 13:05:40.673977 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.674449 21977 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:05:40.676785 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.559953 23354 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:05:40.554840 23477 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:05:40.555260 23472 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:05:40.577431 23390 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:05:40.688714 23395 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.688846 23484 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.708352 23490 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:40.709661 23490 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:40.694870 23296 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.710969 23244 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:40.711439 23244 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:40.711875 23231 ts_tablet_manager.cc:1403] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 2.608s	user 0.046s	sys 0.035s
I20260709 13:05:40.689368 23300 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:05:40.693534 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.679929 23198 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:40.713642 21874 leader_election.cc:400] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:05:40.717494 21874 leader_election.cc:403] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:40.718421 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:40.719431 21979 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:40.721069 21983 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:05:40.721113 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.685098 23228 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:40.675729 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 151871us
W20260709 13:05:40.696487 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd4e0 after lost signal to thread 22579
I20260709 13:05:40.691201 23463 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:40.731190 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.738358 23383 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:40.720777 23386 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.739033 21728 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33528 (request call id 221) took 5182 ms. Trace:
I20260709 13:05:40.739288 23386 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:05:40.739183 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.741341 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.692013 23402 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:05:40.747399 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.679108 23418 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:05:40.732187 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd500 after lost signal to thread 22580
I20260709 13:05:40.754400 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:40.733880 23198 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:40.761252 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.773010 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:40.776495 21979 raft_consensus.cc:2376] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2. Re-sending same reply.
W20260709 13:05:40.776784 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 63488.4us
I20260709 13:05:40.750669 23463 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:40.798475 23463 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.799060 23490 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:40.785705 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.796584 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.749948 23475 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:40.809103 23243 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.809563 23243 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:40.810669 23418 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:40.812395 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:40.749328 23386 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.814133 23386 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.814404 23243 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.815697 23243 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.818228 23485 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:40.781961 23227 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.002s
I20260709 13:05:40.818725 23154 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.819191 23154 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:40.820115 23154 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.821403 23154 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.779642 23264 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 13:05:40.822372 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 61227.5us
I20260709 13:05:40.757754 23150 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:40.758662 23191 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:05:40.826129 23493 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.826910 23493 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:40.827229 23198 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.827406 23493 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.734556 23228 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.821914 23465 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:40.840070 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.825889 23490 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
W20260709 13:05:40.838132 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 302903us
I20260709 13:05:40.849745 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.731822 23098 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.731313 23244 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.858413 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:40.830855 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49685us
I20260709 13:05:40.836998 23475 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:40.864804 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:40.854194 23399 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:40.739530 21728 rpcz_store.cc:276] 0709 13:05:35.556916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.557077 (+   161us) service_pool.cc:224] Handling call
0709 13:05:40.738830 (+5181753us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:37.552656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:37.874456 (+321800us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:37.874505 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:05:37.874535 (+    30us) tablet.cc:662] Decoding operations
0709 13:05:37.876066 (+  1531us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:37.876150 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:37.876192 (+    42us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:05:37.877610 (+  1418us) tablet.cc:701] Row locks acquired
0709 13:05:37.877632 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:05:37.877819 (+   187us) write_op.cc:270] Start()
0709 13:05:37.877958 (+   139us) write_op.cc:276] Timestamp: P: 1783602337877763 usec, L: 0
0709 13:05:37.877983 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:05:37.966678 (+ 88695us) log.cc:844] Serialized 4849 byte log entry
0709 13:05:38.213121 (+246443us) op_driver.cc:464] REPLICATION: finished
0709 13:05:38.306613 (+ 93492us) write_op.cc:301] APPLY: starting
0709 13:05:38.306691 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:38.397659 (+ 90968us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:38.397841 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:38.989197 (+591356us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:38.995279 (+  6082us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:05:38.996147 (+   868us) write_op.cc:312] APPLY: finished
0709 13:05:38.998412 (+  2265us) log.cc:844] Serialized 89 byte log entry
0709 13:05:39.001676 (+  3264us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:39.001971 (+   295us) write_op.cc:454] Released schema lock
0709 13:05:39.002023 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:39.002408 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:39.002439 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7130,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":89153,"apply.run_cpu_time_us":7640,"apply.run_wall_time_us":695743,"num_ops":12,"prepare.queue_time_us":531204,"prepare.run_cpu_time_us":32758,"prepare.run_wall_time_us":512558,"raft.queue_time_us":98992,"raft.run_cpu_time_us":27250,"raft.run_wall_time_us":95032,"replication_time_us":319667,"thread_start_us":478247,"threads_started":4,"wal-append.queue_time_us":108496,"wal-append.run_cpu_time_us":36763,"wal-append.run_wall_time_us":1918549}]]}
I20260709 13:05:40.836711 23460 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:05:40.878070 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.848690 22551 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:40.866266 23191 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:40.871318 23477 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:05:40.900357 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:40.857987 23418 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:05:40.904433 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 126146us
I20260709 13:05:40.905892 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:40.908576 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:40.909075 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.911664 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.918535 21977 raft_consensus.cc:2368] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:40.870398 23475 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:40.871199 23399 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.883869 23472 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:05:40.926561 21976 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:40.929808 21976 pending_rounds.cc:85] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 1
I20260709 13:05:40.928143 22520 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:40.910650 23390 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.914040 23464 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.934943 23464 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:40.932310 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:40.912695 23418 consensus_queue.cc:1243] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:40.928838 23504 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:40.935882 23464 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:40.936666 23504 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.937240 23504 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:40.937079 23464 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.940420 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:40.981787 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.982105 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 58937.8us
I20260709 13:05:40.982577 21977 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.000056 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:40.930146 21976 pending_rounds.cc:107] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
W20260709 13:05:41.004153 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.934157 23463 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:41.012172 21976 raft_consensus.cc:2917] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
W20260709 13:05:41.015750 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 75426.6us
W20260709 13:05:41.020484 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 123870us
I20260709 13:05:41.021270 21948 leader_election.cc:400] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3.
W20260709 13:05:41.021330 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 109012us
I20260709 13:05:41.023233 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:41.020160 23498 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:41.008924 23371 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.044957 23371 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.045691 23244 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:41.046500 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.047232 23371 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:41.047672 23301 consensus_meta.cc:287] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.001s
I20260709 13:05:41.048173 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.048605 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.049275 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.049679 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.050457 21982 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:41.050549 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.030870 23278 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:05:41.049342 21980 raft_consensus.cc:2368] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:41.033308 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:41.052809 23489 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:41.053200 23499 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:41.053259 23489 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:41.037050 23231 raft_consensus.cc:359] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:41.053781 23499 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.054116 23231 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:05:41.054319 23499 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:41.054952 23231 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:41.055581 23264 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:41.056651 23098 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.059465 23475 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:41.008952 23460 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:41.060770 23399 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:41.047613 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.062788 21981 raft_consensus.cc:2376] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4. Re-sending same reply.
I20260709 13:05:40.946717 23390 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:41.065099 23390 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:41.066056 23492 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.241s	user 0.000s	sys 0.003s
I20260709 13:05:41.053905 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.039083 23150 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:41.025434 23228 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:41.053872 23495 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:05:41.053025 21976 raft_consensus.cc:2889] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:41.041765 23303 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:41.042732 22551 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:41.052722 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:41.086094 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:41.026568 23191 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:41.084235 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:41.088629 21974 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:41.086866 21828 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:41.083156 23418 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:41.096654 23399 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.097043 23399 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:41.054335 23489 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.098272 21903 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:41.098907 23489 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:41.106817 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.110620 21907 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:41.111074 21825 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.110687 21983 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:41.112524 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 106717us
I20260709 13:05:41.112672 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:41.127820 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 74000us
I20260709 13:05:41.128237 21980 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:41.128533 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:41.132565 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:41.135023 21828 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.079653 23303 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:41.141109 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.068796 23296 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.104182 23504 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.107957 23475 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.150482 21908 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:41.152153 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:41.152832 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.131175 23354 consensus_queue.cc:1243] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:05:41.155208 21903 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.145211 23493 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:41.169068 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.170111 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.136363 23330 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:05:41.154485 23465 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.178154 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54248 (request call id 13) took 9498 ms. Trace:
I20260709 13:05:41.151268 23418 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:41.165418 23498 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:05:41.213440 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 184800us
I20260709 13:05:41.147676 23485 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:05:41.210662 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:41.164965 23301 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:05:41.219660 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50706.1us
I20260709 13:05:41.155200 23296 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.183279 21976 rpcz_store.cc:276] 0709 13:05:31.669252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.710720 (+ 41468us) service_pool.cc:224] Handling call
0709 13:05:31.852898 (+142178us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54001fb420. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef5b520 00007fb75efe4b42 00007fb75efe3800 00007fb763fa4d29 00007fb75d5231d4 00007fb75d523162 00007fb75d523091 00007fb75d52300c 00007fb75d5222c2 00007fb75d31948c
0709 13:05:31.958848 (+105950us) log.cc:844] Serialized 506 byte log entry
0709 13:05:32.040385 (+ 81537us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b18002e9540. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75ef37b0b 00007fb75efbcb63 00007fb75efe4752 00007fb763fa4d29
0709 13:05:32.247054 (+206669us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54001fb420. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef5eb26 00007fb75ef5849a 00007fb75ef57714 00007fb75ef37eaa 00007fb75ef3ed53 00007fb75ef3ecd9 00007fb75ef3ec69 00007fb75ef3ec31 00007fb75ef3ddfd 000000000038f354
0709 13:05:32.488477 (+241423us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:05:41.158851 (+8670374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40736,"raft.queue_time_us":47416,"raft.run_cpu_time_us":11025,"raft.run_wall_time_us":275211,"spinlock_wait_cycles":606792448,"thread_start_us":47246,"threads_started":1,"wal-append.queue_time_us":146864,"wal-append.run_cpu_time_us":5348,"wal-append.run_wall_time_us":1437240}
I20260709 13:05:41.184491 23383 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:41.220930 23520 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.169862 23487 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:05:41.225859 23303 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:41.231932 23504 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:41.219363 23354 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.207244 23463 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:41.235814 23150 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.236230 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.236600 21977 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:41.238034 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:41.252122 21977 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:41.238984 23231 ts_tablet_manager.cc:1434] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.527s	user 0.003s	sys 0.006s
W20260709 13:05:41.255039 23231 ts_tablet_manager.cc:1467] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Tablet startup took 542ms
W20260709 13:05:41.221958 23497 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:05:41.258410 21980 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:41.242728 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:41.209873 23465 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:41.259620 21831 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:05:41.260456 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 9206e3439eb54425a3de6b25e0d8b36a: Aborted: Op aborted by new leader
I20260709 13:05:41.260375 23465 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.257014 23291 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:05:41.264257 23303 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:41.265604 23499 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.253190 21977 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.253859 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:41.267810 21827 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:41.267746 23520 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:41.269114 23520 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.269822 23520 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:41.270008 21974 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:41.270200 23520 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:41.270340 23493 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:41.270802 23493 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:41.251482 23463 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:41.271405 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.271050 23520 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:41.271072 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.271749 23493 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.272675 23520 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:41.273337 23493 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:41.273375 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.256984 21979 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:41.267092 23489 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:41.271827 23463 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:41.254359 23437 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:41.252393 21908 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
W20260709 13:05:41.276265 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.276767 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.279608 21979 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:41.243160 23383 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:41.280465 21977 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:41.249277 23098 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:41.301327 23418 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:41.302464 23524 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:05:41.256846 23472 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.331694 21977 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:05:41.332201 21977 pending_rounds.cc:85] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 1
I20260709 13:05:41.332674 21977 pending_rounds.cc:107] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:05:41.280072 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.295585 23193 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:05:41.336141 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.333791 21977 raft_consensus.cc:2889] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:41.280541 23154 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:41.356213 23484 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 13:05:41.357153 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.342727 21909 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:41.347635 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.353549 23514 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.355162 23244 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:41.289999 23386 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:41.262481 23390 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:05:41.295171 23489 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:41.325685 23498 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:41.363919 23514 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.365442 21977 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:41.326822 23443 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:41.367136 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.353942 23193 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.333638 23098 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:41.378116 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:05:41.381841 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55115.5us
W20260709 13:05:41.382973 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.383821 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.333822 23475 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:05:41.333132 23402 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:05:41.389492 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.375030 23264 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:41.335049 23472 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.369439 23244 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:41.408231 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.414695 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.387480 23374 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:41.431327 21979 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:41.397420 23463 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:41.372651 23386 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.395232 23390 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:05:41.440810 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 93126.3us
I20260709 13:05:41.444617 21798 leader_election.cc:400] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:41.445024 21798 leader_election.cc:403] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:41.406836 23523 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.446195 23523 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:41.448545 23522 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:05:41.448724 23443 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.449291 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:41.449218 23443 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:41.449911 23529 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:41.429592 23264 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:41.451288 23443 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:41.451066 23489 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.451548 23264 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.406599 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.453754 21975 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:05:41.459046 23527 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:05:41.370122 23399 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:41.465235 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.386044 23193 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.467793 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:41.472502 21909 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:05:41.461066 23495 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:41.473774 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:41.475569 21832 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:41.440539 23374 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:41.483006 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.430419 23291 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:05:41.483917 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:41.484253 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.495278 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.496058 21981 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:05:41.511330 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 79240f02176941bdb28ac4ee2d3f446e: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:05:41.486779 23374 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:41.516175 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.517026 21981 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:41.484320 23408 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:41.473626 23443 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:41.496877 23296 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:41.547612 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.509096 23390 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.587781 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.518530 23408 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.515257 23399 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.488317 23098 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:41.599926 21979 raft_consensus.cc:2410] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:05:41.592861 23532 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:41.580091 23499 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:41.606684 21981 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:41.591750 23408 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:41.610316 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.611444 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.619009 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.627410 21981 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
W20260709 13:05:41.629647 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 145455us
I20260709 13:05:41.630395 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:41.635538 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.637024 23530 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:05:41.637102 23472 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:41.255404 23231 ts_tablet_manager.cc:1469] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Trace:
0709 13:05:32.384623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.384774 (+   151us) service_pool.cc:224] Handling call
0709 13:05:32.979794 (+595020us) ts_tablet_manager.cc:934] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
0709 13:05:33.424372 (+444578us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:34.045016 (+620644us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:34.045125 (+   109us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:34.220109 (+174984us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:34.309095 (+ 88986us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:34.337683 (+ 28588us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:34.337751 (+    68us) inbound_call.cc:177] Queueing success response
0709 13:05:38.103697 (+3765946us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:05:40.712251 (+2608554us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:05:40.894761 (+182510us) tablet_replica.cc:261] Starting instrumentation
0709 13:05:40.895420 (+   659us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":38072,"mutex_wait_us":7068,"raft.queue_time_us":5253,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"tablet-copy.queue_time_us":499692,"tablet-download-pool.queue_time_us":888,"tablet-download-pool.run_cpu_time_us":1141,"tablet-download-pool.run_wall_time_us":1603204,"thread_start_us":262355,"threads_started":2}
I20260709 13:05:41.616037 21827 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
W20260709 13:05:41.638569 23533 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:05:41.628873 23514 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:41.675346 21873 leader_election.cc:336] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 2.102s (SENT)
I20260709 13:05:41.675776 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:41.678499 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.671482 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.679083 21982 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:41.672333 21983 raft_consensus.cc:2410] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:41.679996 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.680101 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:41.656693 23528 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:05:41.681236 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.684286 21980 raft_consensus.cc:2410] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:41.684209 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.685082 21981 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:41.685736 21974 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:41.686233 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.687479 23383 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:41.683449 23514 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.688665 23383 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:41.688834 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:41.687518 23541 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:41.667274 23154 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:41.666549 23193 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:41.694583 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:41.707516 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.695372 23154 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:41.709796 23193 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:41.709900 23154 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.709952 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.711238 23443 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.711596 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.712361 21976 raft_consensus.cc:2410] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:41.713101 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:41.713783 23443 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.693621 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.714123 21976 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:05:41.714345 23535 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:05:41.727386 23546 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:41.727931 23523 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:41.491660 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:41.715608 23514 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.733731 23514 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.735607 23514 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:41.736595 23244 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:41.738677 23539 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
W20260709 13:05:41.740442 23538 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:05:41.715831 21975 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.741993 23485 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.742636 23485 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.714989 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:41.747507 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:41.752313 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.745795 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.754371 21982 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
W20260709 13:05:41.717964 23464 consensus_meta.cc:287] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.001s
I20260709 13:05:41.758656 21798 leader_election.cc:400] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:41.745131 23485 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:41.760848 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 398468us
I20260709 13:05:41.773320 21900 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:41.779675 23460 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:41.794605 21901 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:05:41.794992 21901 pending_rounds.cc:85] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 4
I20260709 13:05:41.795249 21901 pending_rounds.cc:107] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:05:41.795532 21901 raft_consensus.cc:2889] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:41.823449 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49575.3us
W20260709 13:05:41.823985 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.796795 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 297347us
I20260709 13:05:41.829207 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:41.828197 21732 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 122) took 5214 ms. Trace:
I20260709 13:05:41.832419 23551 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:41.759295 23487 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.841806 21977 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:41.872953 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:41.884291 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.885131 21981 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:41.884436 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:41.882735 21902 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:41.892328 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:41.833628 23386 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:41.834983 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-864ca05a434d488c83f87f71e27dfa63 received from {username='slave'} at 127.0.0.1:54264
I20260709 13:05:41.882815 21975 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:41.890861 23193 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.906136 23193 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:41.865809 23374 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:41.906657 23547 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:41.882607 23489 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:41.887421 23487 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.908221 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:41.833628 23549 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:05:41.909624 21981 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:41.863729 21732 rpcz_store.cc:276] 0709 13:05:36.613800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.614033 (+   233us) service_pool.cc:224] Handling call
0709 13:05:41.828139 (+5214106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:40.476641 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:40.480625 (+  3984us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:40.480680 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:05:40.480709 (+    29us) tablet.cc:662] Decoding operations
0709 13:05:40.481460 (+   751us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:40.481553 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:40.481580 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:05:40.482105 (+   525us) tablet.cc:701] Row locks acquired
0709 13:05:40.482157 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:05:40.526362 (+ 44205us) write_op.cc:270] Start()
0709 13:05:40.526529 (+   167us) write_op.cc:276] Timestamp: P: 1783602340526287 usec, L: 0
0709 13:05:40.526573 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:05:40.527250 (+   677us) log.cc:844] Serialized 1682 byte log entry
0709 13:05:41.103681 (+576431us) op_driver.cc:464] REPLICATION: finished
0709 13:05:41.184442 (+ 80761us) write_op.cc:301] APPLY: starting
0709 13:05:41.209149 (+ 24707us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:41.209339 (+   190us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:41.210824 (+  1485us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:41.273924 (+ 63100us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:41.274231 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:05:41.274278 (+    47us) write_op.cc:312] APPLY: finished
0709 13:05:41.354892 (+ 80614us) log.cc:844] Serialized 41 byte log entry
0709 13:05:41.355087 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:41.355194 (+   107us) write_op.cc:454] Released schema lock
0709 13:05:41.355257 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:41.355672 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:41.355700 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":433795,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":80488,"apply.run_cpu_time_us":3683,"apply.run_wall_time_us":171196,"num_ops":4,"prepare.queue_time_us":127516,"prepare.run_cpu_time_us":54503,"prepare.run_wall_time_us":272812,"raft.queue_time_us":167308,"raft.run_cpu_time_us":8753,"raft.run_wall_time_us":58468,"replication_time_us":576919,"thread_start_us":396900,"threads_started":4,"wal-append.queue_time_us":326271}]]}
I20260709 13:05:41.895006 23514 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:41.895617 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 296402us
I20260709 13:05:41.916800 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-864ca05a434d488c83f87f71e27dfa63 on tablet 864ca05a434d488c83f87f71e27dfa63 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:41.925490 22547 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:41.906805 21730 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.927158 23278 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:41.927606 23193 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:41.927882 21730 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 2, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.929445 23374 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:41.898454 23264 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:41.931139 21979 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:41.932687 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:41.934116 21978 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:41.934808 21730 catalog_manager.cc:5697] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:41.941761 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.941576 21730 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.968338 21730 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.919778 23489 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:41.917644 23487 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:41.971148 23550 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:05:41.998363 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:42.002346 21974 raft_consensus.cc:2376] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3. Re-sending same reply.
I20260709 13:05:41.921562 23514 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.017446 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.018240 21974 raft_consensus.cc:2368] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:05:42.016712 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:41.993270 21730 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 3 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.020372 21730 catalog_manager.cc:5697] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.943208 23264 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:42.036936 23565 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:41.991710 23460 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:05:42.022542 21730 catalog_manager.cc:5697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:05:42.014592 23552 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:42.053486 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 169442us
I20260709 13:05:42.025400 23557 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.060402 21974 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:42.059929 21798 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:42.056322 23554 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:05:41.998929 23408 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.065579 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:42.069489 21832 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:42.073606 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:42.074254 21981 raft_consensus.cc:2376] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2. Re-sending same reply.
I20260709 13:05:42.075090 21798 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:42.081532 21833 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:42.066005 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:05:42.086726 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.090018 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.090734 21909 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
W20260709 13:05:42.093529 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.102118 23566 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:05:42.102507 23503 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.103145 23503 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:42.104676 23560 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:05:42.089954 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.114375 21979 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:42.115203 21902 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:42.116371 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:42.061733 23552 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.067934 23571 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:42.121485 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.122030 21902 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:42.122805 21905 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:42.123670 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:42.124855 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:42.127578 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.128222 21982 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:42.128305 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:42.128407 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53351.8us
I20260709 13:05:42.130867 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:42.097072 23572 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.131947 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.133054 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:42.131534 23498 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.133960 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:42.134621 21908 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:42.129475 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:42.144536 21908 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:42.136442 21905 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:42.133850 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.147784 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:42.132505 23572 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.105397 23503 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.150580 21798 leader_election.cc:400] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:42.150959 21798 leader_election.cc:403] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:05:42.154583 21948 connection.cc:256] RPC call timeout handler was delayed by -2.3983881450000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:05:42.141665 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 55327.3us
I20260709 13:05:42.142976 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.146000 21900 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:42.143551 21901 raft_consensus.cc:2376] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3. Re-sending same reply.
I20260709 13:05:42.135490 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:42.131560 23567 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:42.156809 21903 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:42.155557 21902 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:42.130091 23487 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.160205 23487 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.127533 23571 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.170364 23150 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:42.171041 23150 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3.
I20260709 13:05:42.171072 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:42.171314 23552 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.064386 23557 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.070328 23489 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.166484 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:42.177228 23564 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:05:42.183071 21901 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.183761 21903 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:42.186228 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:42.188680 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:42.174146 23408 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.195178 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 85) took 1166 ms. Trace:
I20260709 13:05:42.198226 21906 rpcz_store.cc:276] 0709 13:05:41.028385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.052424 (+ 24039us) service_pool.cc:224] Handling call
0709 13:05:42.195001 (+1142577us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b540020bcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:42.195126 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965784320}
I20260709 13:05:42.150123 23498 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.176116 23571 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:42.157648 23437 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:05:42.156679 23154 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.203157 23523 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.203869 23523 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:42.206283 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.209435 23557 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:42.211439 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.212040 23399 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.002s
I20260709 13:05:42.212520 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.215098 23557 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.216003 23514 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.215575 23557 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.216645 23264 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.190582 23526 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:42.215575 23383 consensus_meta.cc:287] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.003s
I20260709 13:05:42.222003 23485 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.178865 23487 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.222658 23485 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.224298 23487 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:42.202304 23098 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:42.219417 22547 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:42.219172 23523 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.225210 23485 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:42.226408 23523 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:42.227051 23463 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.000s
I20260709 13:05:42.228279 23556 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:42.230265 23154 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.234275 23191 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:42.236142 23460 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:42.237131 23460 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:05:42.238727 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 50143.5us
I20260709 13:05:42.241937 23498 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:42.237959 23460 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.244175 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:42.244871 22553 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:42.246793 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:42.247193 23557 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.250298 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.251119 21983 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:42.253298 23498 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.253741 23503 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.256371 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:42.257329 23503 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.258654 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.259392 21831 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
W20260709 13:05:42.260898 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.252398 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:42.264170 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:42.265897 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:42.271571 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:42.249339 23390 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.250558 23098 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:42.299855 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 141119us
I20260709 13:05:42.291390 21873 leader_election.cc:400] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:05:42.302379 21873 leader_election.cc:403] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:42.279918 23460 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.337322 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:42.318781 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.336161 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:42.343979 21834 raft_consensus.cc:606] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:42.303045 23098 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.351999 22520 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:42.308775 23386 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.266994 23557 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:42.337780 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 182533us
I20260709 13:05:42.286651 23498 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:42.266970 23571 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.335595 23487 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.289424 23514 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:05:42.312945 23523 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
W20260709 13:05:42.370545 21948 connection.cc:256] RPC call timeout handler was delayed by -1.9115541979999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 13:05:42.370924 21948 connection.cc:256] RPC call timeout handler was delayed by -1.79718814499995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2364s for a response
W20260709 13:05:42.371212 21948 connection.cc:256] RPC call timeout handler was delayed by -1.04754726200008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 13:05:42.279191 23526 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:42.358641 23543 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:05:42.359726 23098 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.306324 23390 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.366694 23503 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:05:42.389485 23390 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.366184 23557 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.391142 23557 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.400100 23571 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.357955 23193 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.369828 23583 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:42.383576 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:42.384289 23579 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.365753 23498 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.373533 23487 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.386868 23542 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:42.387475 22551 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:42.376286 23526 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:42.417455 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 267066us
I20260709 13:05:42.419272 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:42.420852 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:42.421633 21906 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:42.425593 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:42.428701 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.421754 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.430433 21902 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.429440 21908 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.437886 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.427558 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:42.439642 21905 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:42.444854 21906 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.406975 23583 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.460700 23583 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.410353 23193 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.462584 23386 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.463057 23386 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.464242 23193 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.465026 23386 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.472409 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:42.472931 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:42.417738 23390 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:42.455462 22552 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:42.475837 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.479626 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.429297 23498 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.480216 21904 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.427721 23526 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.473536 23493 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:05:42.476397 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:42.449216 23534 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.489861 23489 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:42.488992 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:42.495393 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:42.499389 22553 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:42.486402 23464 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:42.510550 21798 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:42.506825 21905 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.449884 23264 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:42.496759 23390 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.517474 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:42.518440 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:42.526285 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:42.510520 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.509675 23464 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.514348 23489 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:42.547039 23154 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.547098 23580 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:42.574932 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 267460us
W20260709 13:05:42.579977 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53800.1us
I20260709 13:05:42.522042 23551 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:42.516914 23193 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:05:42.506039 23534 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.530606 23383 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:42.527603 23514 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:42.554679 23570 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:42.540167 23264 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.578529 23464 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:42.584170 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:42.595067 21905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:39266
I20260709 13:05:42.555243 23576 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:42.600517 23576 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:42.583802 23408 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:42.601181 23576 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.601547 23408 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.521757 23571 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:05:42.588299 23551 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.609284 23551 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.611222 23472 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.611706 23472 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.613516 23534 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:42.613960 23570 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:42.592957 23580 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:42.584875 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 146055us
I20260709 13:05:42.582029 23489 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.599675 21905 raft_consensus.cc:606] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:05:42.528581 23557 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.576150 23244 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.647964 23244 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.603327 23408 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:42.591811 23587 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:05:42.591089 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 117892us
I20260709 13:05:42.596830 23383 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.614379 23582 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:42.644755 21830 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:42.648217 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:42.607381 23098 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.664496 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.665557 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.666148 21825 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:42.668287 21905 raft_consensus.cc:614] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:42.668336 21833 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:42.671348 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:42.673285 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:42.673806 22552 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:42.680265 21834 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:42.681154 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.651523 22549 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:42.712103 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.712855 21832 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:42.613516 23472 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:42.688444 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:42.615797 23570 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.696817 23557 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.679858 23150 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.700001 23098 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:42.649874 23583 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.599725 23514 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.665880 23383 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.706251 23399 raft_consensus.cc:993] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:05:42.706979 23523 raft_consensus.cc:2764] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:05:42.710341 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.714082 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.747786 21833 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:42.650019 23244 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:42.652136 23485 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:42.722877 23582 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:42.693408 23464 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.715214 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.750869 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.713933 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.764230 23551 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.765331 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.765539 21979 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:42.766467 23551 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.728120 23487 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:42.766762 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.767396 21982 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:42.767572 21834 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:42.722440 23520 raft_consensus.cc:476] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:05:42.746913 21828 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
W20260709 13:05:42.768350 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 295496us
I20260709 13:05:42.768724 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.729362 23472 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.727828 23493 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:05:42.776922 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.806151 21833 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:42.813712 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.736469 23150 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.837565 23150 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.838913 23484 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.768872 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:42.839613 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:42.840099 22547 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.839540 23484 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:42.841450 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet edb7f62b920e42349d56d878295176b2: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:05:42.842496 23574 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:42.824282 21828 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:42.843086 23574 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.757792 23485 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.804188 23264 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:42.845258 23485 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:42.846820 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:42.823040 21827 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:42.812980 23399 raft_consensus.cc:1081] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:05:42.827157 21829 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.810362 23472 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.827735 23583 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.831362 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:42.833828 23514 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:42.834749 23582 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.819032 23580 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.843533 23574 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:42.849273 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:42.850116 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.863020 21983 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:42.864276 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:42.864925 21983 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:42.850980 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.851270 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.851630 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:42.866847 21980 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.866816 21977 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.831363 23489 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.852555 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.867734 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.868566 21977 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:42.853117 23484 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:42.854501 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:42.819474 23526 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.856096 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.867724 21976 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.869343 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.870662 21977 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.866438 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:42.856740 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.826344 23576 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.871634 21979 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.876096 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:42.876775 21829 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.879518 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:42.879824 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:42.880074 21976 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.880923 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:42.882480 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:42.885524 23472 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:42.873955 23485 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:42.886787 23485 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.889159 23485 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:42.889883 23576 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.890442 21825 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:42.895925 21980 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:42.898783 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:42.900133 21976 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:42.900712 21983 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:42.864425 23602 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.906154 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:42.909734 21976 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.869275 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:42.867976 23493 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:05:42.918591 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 194320us
I20260709 13:05:42.862748 23443 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:05:42.903676 23150 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:42.913281 23437 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.931419 23150 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.931810 23150 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:42.931737 23437 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:42.933786 23437 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.862246 23408 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.935232 23489 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:42.936029 23408 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.937584 23498 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.939495 23498 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.940347 23526 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:42.918114 23602 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.943993 21982 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:42.944744 21832 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:42.949163 21798 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:42.970747 23278 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:42.971176 21829 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:42.973639 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:42.959133 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.975144 23609 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.983520 23609 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.985668 21976 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:42.976884 23264 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.971215 23278 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:42.987828 23278 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.989084 23278 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.991379 23464 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:42.955225 23602 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:42.998956 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:42.999102 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:42.999820 21828 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:42.999922 23374 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:43.000260 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:43.001570 21827 raft_consensus.cc:2410] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:43.001703 21834 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:42.974246 23616 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:42.918715 23493 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:42.918562 23579 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:43.003913 23579 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.004364 23579 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.955914 23484 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:42.944881 23606 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.957091 23383 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.977909 22547 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:42.982291 23485 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.982887 23547 raft_consensus.cc:2764] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:43.000415 23374 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:43.003850 23493 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:42.974344 23498 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:42.976254 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45062.4us
I20260709 13:05:43.015960 21828 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
W20260709 13:05:43.018023 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 292697us
I20260709 13:05:43.018134 21831 raft_consensus.cc:606] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:43.019989 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.023607 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.023882 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:43.024612 21909 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:43.025292 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.026305 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.027184 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:42.954931 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 85721us
I20260709 13:05:43.029289 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.026067 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:43.009213 23484 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:43.034574 21900 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:43.035668 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.011795 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:43.043917 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.048398 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:43.014479 23609 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:43.061272 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:43.086304 23503 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.089140 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:43.090149 23616 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:05:43.092291 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:43.092845 21908 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.036520 23536 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:43.094621 23536 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:43.095726 23536 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.037400 23484 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:43.036821 23523 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:43.036798 23583 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.101361 23150 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.090931 23615 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:43.091078 23374 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.043473 23464 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:43.107249 21908 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
W20260709 13:05:43.108203 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61296.8us
I20260709 13:05:43.011865 23606 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:43.109166 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 65317.6us
I20260709 13:05:43.053555 21909 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
W20260709 13:05:43.114305 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 95105.2us
I20260709 13:05:43.120256 21948 leader_election.cc:400] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
I20260709 13:05:43.120553 21948 leader_election.cc:403] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:43.120390 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.017704 23485 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.121279 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:43.051637 23520 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:05:43.114007 23613 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.124447 23399 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:43.124922 23399 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:43.126106 23606 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:43.125732 23399 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.127264 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:43.129307 23330 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:43.129696 23330 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.130024 23330 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:43.053882 23493 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:43.125813 23574 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.121268 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:43.133003 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.134865 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.135221 21983 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:43.140025 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:43.135982 21980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:05:43.135890 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:43.110566 23523 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.141770 21833 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:43.136415 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:43.140635 21828 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.142475 21825 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:43.140185 21978 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.143801 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.140693 21980 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.144479 21980 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.114869 23615 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.151815 21980 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.118762 22547 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:43.155788 21976 raft_consensus.cc:2410] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:43.153995 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:43.157577 21875 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:43.151319 21828 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:43.160413 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:43.147588 23613 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:43.147208 23523 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.165014 21983 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.165654 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.164886 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:43.161384 23472 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:43.171427 21980 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:43.138594 23583 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:43.159575 23534 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:43.156212 23615 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.161516 23374 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:43.174427 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.174522 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.153299 23612 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
I20260709 13:05:43.181129 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.164783 23602 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:43.191329 23625 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:05:43.191470 23602 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:43.192580 23602 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.194944 23383 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:43.198159 21978 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:43.185941 21977 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:43.157270 23503 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:05:43.153127 23498 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:05:43.203018 23583 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.166675 23264 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:43.207010 23498 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.207271 23264 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:43.207473 23498 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:43.208251 23264 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.188746 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.168362 23408 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.209952 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.168656 23616 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:05:43.210579 21983 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.174084 23613 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:43.218091 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.201489 21798 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.206563 23503 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:43.225885 23503 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:43.206496 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.208390 23498 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.205809 23579 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.173821 21975 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:43.166939 23592 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:43.199823 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.210827 23616 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:43.210520 23408 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.220749 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.222131 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.234659 21976 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:43.223415 23613 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.179163 23609 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:43.224634 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:43.187743 23534 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:43.178802 23526 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.228507 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.230854 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.231228 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.235816 21974 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:43.265285 21983 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:43.267381 21825 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:43.262290 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.278647 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.279217 21976 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:43.279397 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:43.282125 21978 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:43.230149 23592 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.291100 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.291182 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.291589 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.289224 21980 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:43.355048 21974 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:43.355108 21977 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:43.233594 23570 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:43.358227 21976 raft_consensus.cc:2376] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3. Re-sending same reply.
I20260709 13:05:43.361940 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.363669 21977 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:05:43.232353 23616 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:43.365300 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.273016 23150 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:43.364306 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.364136 21977 pending_rounds.cc:85] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 4
I20260709 13:05:43.368777 21977 pending_rounds.cc:107] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:05:43.369051 21977 raft_consensus.cc:2889] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:43.372108 21976 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:43.372609 21976 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:43.373421 21976 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.374454 21976 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.370513 22550 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:43.288951 23609 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:43.376645 23609 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.294934 23503 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.379359 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.353916 23592 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.290787 23526 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.356386 23498 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.380909 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.379570 21975 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:43.361070 23443 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:43.384927 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.388727 21977 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.391197 21976 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:05:43.391485 21978 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:43.391908 21976 pending_rounds.cc:85] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 4
I20260709 13:05:43.392385 21976 pending_rounds.cc:107] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:05:43.392865 21976 raft_consensus.cc:2889] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:43.396006 21976 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:43.401937 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.394753 23534 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:43.435065 23630 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:05:43.443455 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:43.444082 22550 raft_consensus.cc:2376] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3. Re-sending same reply.
I20260709 13:05:43.420320 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.444991 21908 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:43.394138 23503 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.437453 23330 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.446221 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:43.447818 22550 raft_consensus.cc:2368] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3.
I20260709 13:05:43.417716 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.448482 23330 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:43.449421 23614 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:43.449826 23614 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:43.405056 23485 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:43.450228 23614 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.451376 23484 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.450012 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.453624 23484 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:43.453827 21982 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:43.414561 23616 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.454747 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.454991 22547 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:43.455379 21982 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.455557 23616 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:43.460100 23244 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.462471 23585 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:43.463512 21981 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:43.417829 21900 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.419893 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.465456 21909 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:43.418653 21901 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:43.468007 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.471037 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:43.473555 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.475478 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.476104 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:43.476665 21908 raft_consensus.cc:2410] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:05:43.477943 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.478036 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.480247 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.482072 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:43.482779 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:43.473646 22552 raft_consensus.cc:1217] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:43.483355 21906 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:43.485317 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.486755 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.489938 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.490548 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.491055 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.492794 21982 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:43.493222 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:43.493860 22553 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:43.491917 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.497467 21974 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:05:43.497829 21974 pending_rounds.cc:85] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 4
I20260709 13:05:43.498054 21974 pending_rounds.cc:107] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:05:43.498314 21974 raft_consensus.cc:2889] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:43.500401 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:43.501092 22551 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:43.440762 23523 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.510830 21906 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
W20260709 13:05:43.429701 23624 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.303s	user 0.000s	sys 0.009s
I20260709 13:05:43.515007 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.527495 21982 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:43.527827 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:43.528342 21904 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:43.530405 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.530692 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:43.531503 21828 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:43.531900 21828 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:43.461995 23574 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:43.516229 21974 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:43.398623 23443 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:43.431876 23408 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:43.524394 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:43.548828 21909 raft_consensus.cc:2410] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:43.525391 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:43.462872 23585 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:43.536285 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.553761 21983 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:43.516372 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:43.521589 21977 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:43.544767 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.497257 23617 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.505649 23390 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:43.515901 23580 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:43.558799 23443 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.545367 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:43.505062 23523 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:43.560056 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.563645 21948 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.575851 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:43.579309 23526 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:43.536521 23514 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:43.586859 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.526743 23616 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.604928 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:43.762152 21982 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:43.605743 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:43.419224 23593 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 13:05:43.528864 23609 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:43.632925 21904 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:43.592842 23614 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.638674 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:43.594022 23585 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:43.642460 23493 consensus_meta.cc:287] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.002s
I20260709 13:05:43.642995 22547 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:05:43.644418 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 153416us
I20260709 13:05:43.655192 21908 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:43.662536 21979 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:43.784152 21873 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.617993 21983 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
W20260709 13:05:43.679051 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 115519us
I20260709 13:05:43.785604 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.787245 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:43.680796 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.657668 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:43.771557 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.562322 23592 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.792645 21976 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:43.793165 21976 pending_rounds.cc:85] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 1
I20260709 13:05:43.793476 21976 pending_rounds.cc:107] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:43.793789 21976 raft_consensus.cc:2889] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:43.794783 21907 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.747603 23514 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:43.677270 23570 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:43.800757 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 143202us
I20260709 13:05:43.803539 21909 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:43.804262 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.805807 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.806757 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:43.799321 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.810827 22519 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:43.747819 23520 raft_consensus.cc:2764] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:43.792021 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.822638 21905 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:43.711855 23617 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:05:43.792840 23612 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.790247 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:43.801862 23514 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.798592 23484 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:43.829589 23616 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:43.821396 23585 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.823323 23386 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:43.818969 23526 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:05:43.825052 23556 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:43.830798 23374 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 13:05:43.845563 23614 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:43.825587 23646 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:43.835955 23609 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:43.851699 23536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.039s	sys 0.038s
I20260709 13:05:43.863495 21825 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:43.844036 22550 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:43.867837 21907 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:43.843644 23520 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:43.851322 23386 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:05:43.867478 23536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.040s	sys 0.039s
I20260709 13:05:43.873257 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:43.873754 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.852855 23556 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:43.881080 23556 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.883668 23609 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:43.884109 23609 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.884475 23609 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:43.886890 23437 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.887600 23437 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.891840 23437 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:43.893299 23609 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:43.895058 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 89356.7us
I20260709 13:05:43.896656 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:43.898573 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:05:43.923269 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 131399us
I20260709 13:05:43.924443 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.926793 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.929062 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:05:43.931177 23643 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:05:43.926403 23641 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:05:43.935004 23644 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:05:43.936900 23609 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:43.937470 23615 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.001s
I20260709 13:05:43.938275 23614 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.943532 23653 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:43.943884 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:43.944017 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.944316 23653 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.945860 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.947858 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.922390 23646 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.923676 23593 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:43.950060 23609 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.957297 23614 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.861939 23570 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.965703 23520 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:05:43.967366 23526 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:43.968116 23386 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:43.970774 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:43.971735 23526 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.972950 23592 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:43.974813 23503 consensus_meta.cc:287] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:05:43.969960 23593 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.975698 23593 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:43.937919 23615 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:43.981523 23615 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:43.983901 23615 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:43.946483 23484 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:43.983117 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:05:43.985736 23649 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:43.948135 22547 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:43.998807 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:05:44.001801 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.987428 23615 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:44.007083 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:44.006719 23484 raft_consensus.cc:2764] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:05:44.010087 23652 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:44.010510 23652 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:44.010850 23652 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.000177 23485 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:05:43.962082 23514 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:44.015537 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:43.998155 23503 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:05:44.018357 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:44.019977 21903 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:44.020072 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:44.001153 23526 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:05:44.020725 23484 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:44.021956 23653 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:44.019126 23485 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:44.025342 23638 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.621s	user 0.001s	sys 0.000s
I20260709 13:05:44.028156 23602 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:44.034263 23520 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:44.034850 23593 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:44.035105 21902 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:05:44.037668 22547 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:44.026831 23484 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.039623 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:44.039794 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:44.038908 23484 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:44.042513 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:44.044543 21902 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:44.044485 23615 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:44.046631 23593 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:44.050670 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.059903 23615 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:44.057474 23520 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:44.065481 23443 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.066596 23615 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:44.068051 23653 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:44.071168 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:44.073884 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:44.075627 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:44.076543 21907 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:44.076576 21906 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.079219 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:44.079736 21982 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:44.079775 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:44.081069 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:44.081586 21978 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:44.081782 21902 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:44.090523 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:44.083606 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:44.092311 21826 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:44.096359 21982 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:44.097391 23639 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:44.097599 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:44.097807 22547 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:44.098187 21974 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.098065 21948 leader_election.cc:400] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3.
I20260709 13:05:44.098888 21948 leader_election.cc:403] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:44.097900 23639 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:44.099514 23485 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3.
I20260709 13:05:44.100642 23639 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:44.101341 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:44.102056 23485 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:44.103955 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:44.082244 23570 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:05:44.105762 23614 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:44.106856 23485 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:44.107251 23485 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.107617 23485 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.112358 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:44.113006 21829 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:44.095096 23592 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:05:44.118006 21902 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:44.090523 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:44.122710 21906 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:44.123347 21974 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:44.105453 23652 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:44.124084 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:44.082244 23520 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:44.125293 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:44.128656 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:44.082769 23386 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:44.135591 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:44.136595 21901 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:44.072438 23374 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:05:44.139706 21978 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:44.143522 21980 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:44.126137 23653 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:44.118067 23485 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:44.140159 23437 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:44.196704 21980 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:44.140756 23520 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:44.135095 23493 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:05:44.187551 23612 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:44.213089 21983 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:05:44.140878 23570 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:05:44.205029 23437 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.146678 23639 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:05:44.186000 23653 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.222607 23437 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:44.228615 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 99994.2us
I20260709 13:05:44.233733 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:44.235071 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:44.237820 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:44.238873 23593 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:44.228212 23653 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.222394 23484 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:44.222419 23520 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:44.254206 23617 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:44.294564 23659 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:05:44.305860 23656 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:05:44.703954 23653 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:44.286386 23244 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.199833 23244 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.202134 23690 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.202653 23690 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:46.204452 21903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1371) took 2568 ms (client timeout 3119 ms). Trace:
I20260709 13:05:46.204658 23690 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:46.204835 21903 rpcz_store.cc:269] 0709 13:05:43.636291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.638422 (+  2131us) service_pool.cc:224] Handling call
0709 13:05:46.204305 (+2565883us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54002387d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:46.204400 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557185792}
I20260709 13:05:44.254436 23386 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:46.208405 23386 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:44.256778 23593 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:46.212653 23593 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:44.240752 23612 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:05:44.241256 23662 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:05:46.264493 23662 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:46.264843 23662 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:46.265306 23694 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.265713 23609 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.265596 23662 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.265808 23694 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.266372 23609 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.266899 23662 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.267761 23602 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:46.267984 23694 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.268136 23602 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:46.268250 23609 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.268764 23609 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:46.269207 23609 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:46.269080 23602 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.270685 23602 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.271549 23609 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:44.709906 23653 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:44.714882 23677 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:46.274565 23677 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:46.276726 23677 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:44.718478 23679 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:44.742791 21828 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:44.743983 23503 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:44.744175 23683 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.277648 23503 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:46.277384 23679 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.277796 23683 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.278898 23503 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.279965 23679 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.280097 23503 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.280369 23683 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:45.593842 21946 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.000s	sys 0.018s
I20260709 13:05:45.595062 23685 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:46.280938 21946 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.368s	user 0.000s	sys 0.019s
I20260709 13:05:46.281081 23685 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.282536 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1368) took 1565 ms. Trace:
I20260709 13:05:46.282650 23493 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.283205 23685 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.283344 23613 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.283619 23612 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.283833 23613 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.284196 23612 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:45.596406 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1350) took 2460 ms. Trace:
I20260709 13:05:45.597584 23684 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.286410 23680 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.283218 23493 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.285360 21830 rpcz_store.cc:276] 0709 13:05:43.135742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.146677 (+ 10935us) service_pool.cc:224] Handling call
0709 13:05:43.178491 (+ 31814us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.209737 (+ 31246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.209778 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.210298 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.289023 (+ 78725us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:43.334889 (+ 45866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.364763 (+ 29874us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:43.433532 (+ 68769us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b48000030d8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:05:45.596043 (+2162511us) raft_consensus.cc:1685] finished
0709 13:05:45.596072 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.596346 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5780,"raft.run_cpu_time_us":1502,"raft.run_wall_time_us":213943,"spinlock_wait_cycles":17749248,"thread_start_us":48150,"threads_started":1,"wal-append.queue_time_us":336110,"wal-append.run_cpu_time_us":54559,"wal-append.run_wall_time_us":2441345}
I20260709 13:05:46.286994 23680 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:45.601825 23688 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.288789 23493 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.288926 23688 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.289278 23493 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:45.620155 23579 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:45.708566 21855 debug-util.cc:398] Leaking SignalData structure 0x7b080017c200 after lost signal to thread 20694
W20260709 13:05:46.290230 21855 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5c60 after lost signal to thread 20697
I20260709 13:05:45.866633 23693 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.290696 23693 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:46.291246 21855 debug-util.cc:398] Leaking SignalData structure 0x7b080018ff00 after lost signal to thread 21766
I20260709 13:05:46.282934 21829 rpcz_store.cc:276] 0709 13:05:44.717196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.717369 (+   173us) service_pool.cc:224] Handling call
0709 13:05:44.717659 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:46.280671 (+1563012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.280699 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:46.280736 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:46.280762 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.282282 (+  1520us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54001d6ad4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:46.282326 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.282477 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3594194176}
I20260709 13:05:46.292388 23614 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.864661 23692 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.292701 23693 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.292816 23614 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.293321 23693 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.292964 23692 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:45.878990 23696 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.294415 23696 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.295228 23614 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.295702 23614 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.296103 23614 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.296742 23696 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:45.908030 23484 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:45.912216 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.653s	user 0.013s	sys 0.017s
W20260709 13:05:46.297550 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.039s	user 0.015s	sys 0.018s
W20260709 13:05:46.297837 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 2.03883e+06us
I20260709 13:05:46.296104 21828 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:46.301741 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.919871 23646 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.935233 23330 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:45.924491 23592 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:45.938499 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1386) took 1860 ms. Trace:
I20260709 13:05:45.956596 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 398) took 1712 ms. Trace:
I20260709 13:05:45.958638 23557 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:45.970806 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1380) took 1850 ms. Trace:
I20260709 13:05:45.953527 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1372) took 2316 ms. Trace:
I20260709 13:05:45.973023 23699 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.976783 23534 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:45.978688 23485 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:45.984241 23700 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:45.986888 23701 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:45.988482 23633 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 2.584s	user 0.001s	sys 0.013s
I20260709 13:05:45.990269 23191 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:05:46.026432 21873 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.620s (SENT) [suppressed 26 similar messages]
W20260709 13:05:45.994398 23437 consensus_meta.cc:287] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.753s	user 0.021s	sys 0.007s
I20260709 13:05:46.028883 23464 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.027593 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34370 (request call id 7) took 3297 ms. Trace:
I20260709 13:05:46.031791 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1367) took 2515 ms. Trace:
I20260709 13:05:46.036471 23570 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.038012 23689 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.039736 21978 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:05:46.041076 23402 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.041801 23460 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.043463 23703 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.045222 23686 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.053699 23705 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.062523 23562 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.063838 23706 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.076810 23710 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:46.079241 21826 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:46.080627 23708 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.083089 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:46.088721 21949 connection.cc:256] RPC call timeout handler was delayed by -1.5317035620000752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 13:05:46.089315 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:46.090853 23682 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.088238 23681 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.104123 23443 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.096793 23709 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:46.097031 23657 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 2.031s	user 0.004s	sys 0.015s
W20260709 13:05:46.106879 21798 connection.cc:256] RPC call timeout handler was delayed by -1.3565201079999269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 13:05:46.285820 23613 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.094508 23702 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.115113 23711 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.125125 23712 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.318785 21730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 218) took 5972 ms. Trace:
I20260709 13:05:46.302405 23646 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:46.130863 21980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1312) took 2047 ms (client timeout 1620 ms). Trace:
W20260709 13:05:46.319362 21980 rpcz_store.cc:269] 0709 13:05:44.083289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.083417 (+   128us) service_pool.cc:224] Handling call
0709 13:05:46.130591 (+2047174us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b5400226fd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:46.130777 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117735808}
I20260709 13:05:46.293784 23693 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.148216 23714 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.320755 23646 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.164381 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1309) took 2085 ms. Trace:
I20260709 13:05:46.320699 23714 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.163100 23715 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.322962 23714 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.321357 21975 rpcz_store.cc:276] 0709 13:05:44.079110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.082051 (+  2941us) service_pool.cc:224] Handling call
0709 13:05:44.112680 (+ 30629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.113040 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.113078 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.113578 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.197276 (+ 83698us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:44.210356 (+ 13080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.216612 (+  6256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:46.164146 (+1947534us) raft_consensus.cc:1685] finished
0709 13:05:46.164170 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.164325 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1105,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":71636,"threads_started":1,"wal-append.queue_time_us":104896,"wal-append.run_cpu_time_us":8493,"wal-append.run_wall_time_us":1479549}
I20260709 13:05:46.172065 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1313) took 2083 ms. Trace:
I20260709 13:05:46.303071 21902 rpcz_store.cc:276] 0709 13:05:44.120268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.120364 (+    96us) service_pool.cc:224] Handling call
0709 13:05:44.133726 (+ 13362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.134051 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.134078 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.143220 (+  9142us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.241387 (+ 98167us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:44.241619 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.241681 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.970489 (+1728808us) raft_consensus.cc:1685] finished
0709 13:05:45.970520 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.970732 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7268,"thread_start_us":26973,"threads_started":1,"wal-append.queue_time_us":515779,"wal-append.run_cpu_time_us":1668,"wal-append.run_wall_time_us":1004519}
I20260709 13:05:46.323973 23715 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.324349 21983 rpcz_store.cc:276] 0709 13:05:44.089059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.089557 (+   498us) service_pool.cc:224] Handling call
0709 13:05:44.112029 (+ 22472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.216188 (+104159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.171830 (+1955642us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54000b7a54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:46.172010 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231719808}
I20260709 13:05:46.173544 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 268) took 2252 ms. Trace:
I20260709 13:05:46.325024 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:46.173583 23514 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.183161 23716 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:46.352632 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.313310 21949 connection.cc:256] RPC call timeout handler was delayed by -1.3564001060000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
I20260709 13:05:46.354260 21949 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:46.191953 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1299) took 2582 ms. Trace:
I20260709 13:05:46.313606 21834 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.199128 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1355) took 2713 ms. Trace:
I20260709 13:05:46.357118 21832 rpcz_store.cc:276] 0709 13:05:43.485444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.485610 (+   166us) service_pool.cc:224] Handling call
0709 13:05:43.515109 (+ 29499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.700894 (+1185785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.700926 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.700964 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:44.701002 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.198860 (+1497858us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b540011d854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:46.198912 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.199068 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1819848960}
I20260709 13:05:46.201987 23244 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.209278 23386 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.221979 23687 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:05:46.224121 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1374) took 2751 ms (client timeout 1748 ms). Trace:
I20260709 13:05:46.231870 23600 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.233173 23198 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.234988 22551 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:46.244263 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1382) took 2121 ms. Trace:
I20260709 13:05:46.307494 23593 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.258497 23520 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.261817 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1316) took 2020 ms. Trace:
I20260709 13:05:46.311847 23609 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.289309 23680 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.360494 23679 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:46.291013 23688 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:45.604888 23615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.535s	user 0.010s	sys 0.007s
I20260709 13:05:45.869342 23695 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.308362 23437 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.042269 23291 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.318537 23711 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:46.145512 23629 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 2.783s	user 0.009s	sys 0.019s
I20260709 13:05:46.319064 23712 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:46.142470 21904 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.918s	user 0.015s	sys 0.046s
I20260709 13:05:46.302729 22554 rpcz_store.cc:276] 0709 13:05:44.244299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.244428 (+   129us) service_pool.cc:224] Handling call
0709 13:05:44.244775 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.258595 (+ 13820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.258637 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.259172 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.954970 (+1695798us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:45.955010 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.955087 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.956358 (+  1271us) raft_consensus.cc:1685] finished
0709 13:05:45.956379 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.956515 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1563,"raft.queue_time_us":1668,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":22423,"thread_start_us":16055,"threads_started":1,"wal-append.queue_time_us":16660}
I20260709 13:05:46.175622 23617 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:05:46.179936 23636 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 2.678s	user 0.009s	sys 0.012s
I20260709 13:05:46.304244 21909 rpcz_store.cc:276] 0709 13:05:43.636680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.637149 (+   469us) service_pool.cc:224] Handling call
0709 13:05:43.637478 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:43.803928 (+166450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.953260 (+2149332us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400077454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:45.953439 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381461760}
W20260709 13:05:46.302136 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.305073 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:46.308734 21828 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:46.312984 21833 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:05:46.354681 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 328256us
I20260709 13:05:46.311470 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1318) took 2068 ms. Trace:
I20260709 13:05:46.304632 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:46.307096 23534 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:46.306824 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 43796.9us
I20260709 13:05:46.308643 21831 rpcz_store.cc:276] 0709 13:05:42.730572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.831217 (+100645us) service_pool.cc:224] Handling call
0709 13:05:46.027402 (+3196185us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400032354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd8853 00007fb763fa660a 00007fb75d52c7d4 00007fb75d52c762 00007fb75d52c691 00007fb75d52c60c 00007fb75d52b8c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:46.027508 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360562048}
I20260709 13:05:46.307965 21729 catalog_manager.cc:5697] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 2, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.355170 21976 rpcz_store.cc:276] 0709 13:05:43.609240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.610430 (+  1190us) service_pool.cc:224] Handling call
0709 13:05:43.611185 (+   755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:43.794385 (+183200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.191682 (+2397297us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54002c7754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:46.191891 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416181504}
I20260709 13:05:46.308768 21825 rpcz_store.cc:276] 0709 13:05:43.515953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.516718 (+   765us) service_pool.cc:224] Handling call
0709 13:05:43.516991 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:43.867162 (+350171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.031484 (+2164322us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b540011e754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:46.031715 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790740224}
I20260709 13:05:46.359968 23613 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:46.308482 21875 connection.cc:256] RPC call timeout handler was delayed by -1.1799158339999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
I20260709 13:05:46.392042 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:46.393250 21905 rpcz_store.cc:269] 0709 13:05:43.473098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.473250 (+   152us) service_pool.cc:224] Handling call
0709 13:05:46.223912 (+2750662us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54002f5dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:46.224056 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799816576}
I20260709 13:05:46.393455 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:46.312271 23708 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.409169 23198 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.397609 21834 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:46.310231 23460 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.309468 23689 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.314471 23485 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.314101 23681 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.396461 23690 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.312944 23692 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.307926 23585 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.306531 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.251685 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1314) took 2162 ms. Trace:
I20260709 13:05:46.308349 23654 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.409229 21981 rpcz_store.cc:276] 0709 13:05:44.241800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.241941 (+   141us) service_pool.cc:224] Handling call
0709 13:05:44.242322 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.242564 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:44.287784 (+ 45220us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.261491 (+1973707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:46.261548 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:46.261590 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.261655 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.261764 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":466225,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":959,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":51,"thread_start_us":29787,"threads_started":1}
I20260709 13:05:46.421622 23609 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.434792 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:46.527244 21909 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.527858 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.528077 23681 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.528326 23198 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.528594 23681 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.529026 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.529078 23681 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.529064 21980 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:05:46.530180 21828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1361) took 3371 ms (client timeout 1544 ms). Trace:
I20260709 13:05:46.530496 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:46.530704 21828 rpcz_store.cc:269] 0709 13:05:43.158572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.158694 (+   122us) service_pool.cc:224] Handling call
0709 13:05:43.530495 (+371801us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800010598. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:46.295938 (+2765443us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b5800660bd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef3a0aa 00007fb75efbc447 00007fb75efd4fe7 00007fb75efd67de 00007fb75efe227c 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c
0709 13:05:46.530102 (+234164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23662720}
I20260709 13:05:46.421242 23520 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.318480 23702 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.404670 21900 rpcz_store.cc:276] 0709 13:05:44.122948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.123059 (+   111us) service_pool.cc:224] Handling call
0709 13:05:44.123313 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.206495 (+ 83182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.206538 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.217478 (+ 10940us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.249769 (+ 32291us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:44.249822 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.243775 (+1993953us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b540020a8d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:46.243819 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:46.243871 (+    52us) raft_consensus.cc:1685] finished
0709 13:05:46.243889 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.244191 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7849,"spinlock_wait_cycles":190281600,"thread_start_us":22459,"threads_started":1,"wal-append.queue_time_us":62716,"wal-append.run_cpu_time_us":9023,"wal-append.run_wall_time_us":1420756}
I20260709 13:05:46.536904 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.304557 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:46.286419 23684 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.310295 23526 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.359061 23579 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.319147 21730 rpcz_store.cc:276] 0709 13:05:40.346805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.364853 (+ 18048us) service_pool.cc:224] Handling call
0709 13:05:46.318732 (+5953879us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:42.392147 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:42.392901 (+   754us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:42.392956 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:05:42.392981 (+    25us) tablet.cc:662] Decoding operations
0709 13:05:42.394080 (+  1099us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:42.394148 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:42.401185 (+  7037us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:05:42.539385 (+138200us) tablet.cc:701] Row locks acquired
0709 13:05:42.547597 (+  8212us) write_op.cc:260] PREPARE: finished
0709 13:05:42.586308 (+ 38711us) write_op.cc:270] Start()
0709 13:05:42.592732 (+  6424us) write_op.cc:276] Timestamp: P: 1783602342584519 usec, L: 0
0709 13:05:42.597179 (+  4447us) op_driver.cc:348] REPLICATION: starting
0709 13:05:42.710641 (+113462us) log.cc:844] Serialized 3248 byte log entry
0709 13:05:43.380626 (+669985us) op_driver.cc:464] REPLICATION: finished
0709 13:05:43.800849 (+420223us) write_op.cc:301] APPLY: starting
0709 13:05:43.812866 (+ 12017us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:43.827931 (+ 15065us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:43.847141 (+ 19210us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:43.870633 (+ 23492us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:43.927133 (+ 56500us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:05:43.942256 (+ 15123us) write_op.cc:312] APPLY: finished
0709 13:05:43.953771 (+ 11515us) log.cc:844] Serialized 65 byte log entry
0709 13:05:43.953953 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.954091 (+   138us) write_op.cc:454] Released schema lock
0709 13:05:43.954141 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:43.954498 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.954530 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40596,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":381957,"apply.run_cpu_time_us":4316,"apply.run_wall_time_us":163780,"num_ops":8,"prepare.queue_time_us":199253,"prepare.run_cpu_time_us":44850,"prepare.run_wall_time_us":677769,"raft.queue_time_us":184425,"raft.run_cpu_time_us":28657,"raft.run_wall_time_us":146457,"replication_time_us":783296,"thread_start_us":732984,"threads_started":4,"wal-append.queue_time_us":436322,"wal-append.run_cpu_time_us":32265,"wal-append.run_wall_time_us":2922061}]]}
I20260709 13:05:46.549551 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.307118 23612 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.387323 23484 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.387151 23653 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.387080 23685 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.307710 23498 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.306854 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.515954 23715 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.393692 23374 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:46.392832 23582 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.393839 23677 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:46.302508 23330 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.297911 23614 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.398434 23683 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:46.310006 23402 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.540601 23613 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.309005 23570 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.302637 23592 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.314338 23443 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.308578 23464 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.302956 23557 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.318363 23493 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.302630 21908 rpcz_store.cc:276] 0709 13:05:44.078190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.078299 (+   109us) service_pool.cc:224] Handling call
0709 13:05:44.078572 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.095291 (+ 16719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.095321 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.124763 (+ 29442us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.194946 (+ 70183us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:44.250646 (+ 55700us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.281395 (+ 30749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.281495 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.938290 (+1656795us) raft_consensus.cc:1685] finished
0709 13:05:45.938309 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.938441 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1267230,"prepare.queue_time_us":513609,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":46787,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":10721,"thread_start_us":89610,"threads_started":2,"wal-append.queue_time_us":93868}
I20260709 13:05:46.311292 23710 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.418788 23593 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.531131 21981 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:44.700958 23652 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.580802 23613 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.409543 23600 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.532523 21977 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:46.531613 21979 rpcz_store.cc:276] 0709 13:05:44.089631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.089744 (+   113us) service_pool.cc:224] Handling call
0709 13:05:44.090148 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.090503 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.090532 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.090938 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.226575 (+135637us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:44.288358 (+ 61783us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.251388 (+1963030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.251473 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:46.251511 (+    38us) raft_consensus.cc:1685] finished
0709 13:05:46.251523 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.251635 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":482007,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":15030,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":158,"thread_start_us":132976,"threads_started":2,"wal-append.queue_time_us":105535}
W20260709 13:05:46.292723 21855 debug-util.cc:398] Leaking SignalData structure 0x7b080036de60 after lost signal to thread 21858
I20260709 13:05:46.572777 23719 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.508466 21983 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:46.532763 21978 rpcz_store.cc:276] 0709 13:05:44.243497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.243600 (+   103us) service_pool.cc:224] Handling call
0709 13:05:44.243875 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:46.309651 (+2065776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.311212 (+  1561us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54003a52d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:46.311402 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4129588096}
I20260709 13:05:46.537680 21905 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:46.538151 21902 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:46.591188 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:46.536283 23639 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.313867 23682 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.538585 23690 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.597023 23682 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.538914 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.310803 23562 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:46.540736 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 147358us
I20260709 13:05:46.304785 23699 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.436589 21982 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.546433 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:46.435453 21904 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.212s	user 0.016s	sys 0.047s
I20260709 13:05:46.550657 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.544796 23654 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.542071 21729 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.553965 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:46.310295 23703 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:46.609606 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.426539 23679 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.539850 23485 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.609922 21976 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:46.609647 23654 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.611478 23679 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.611814 23485 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.307741 23701 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.553750 23437 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.521636 23675 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.508705 23680 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.614192 23680 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.616344 23680 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.314407 23709 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:46.424913 23615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.356s	user 0.010s	sys 0.007s
I20260709 13:05:46.307520 23700 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.555289 23653 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.549168 23264 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:46.618392 23264 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.618635 23700 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.310557 23705 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.619978 23653 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.310425 23686 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.621182 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1387) took 2542 ms. Trace:
I20260709 13:05:46.570700 23681 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.308167 23191 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.559276 23498 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.360838 23716 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.621533 21904 rpcz_store.cc:276] 0709 13:05:44.078467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.078584 (+   117us) service_pool.cc:224] Handling call
0709 13:05:44.078892 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.086185 (+  7293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.086228 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.096023 (+  9795us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.211879 (+115856us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:46.126971 (+1915092us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b4800261e58. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:05:46.605687 (+478716us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.620844 (+ 15157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.620911 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:46.620947 (+    36us) raft_consensus.cc:1685] finished
0709 13:05:46.621024 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.621131 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6900,"prepare.queue_time_us":496918,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":18188,"raft.run_cpu_time_us":12273,"raft.run_wall_time_us":2029889,"spinlock_wait_cycles":14185344,"thread_start_us":2424885,"threads_started":3,"wal-append.queue_time_us":100785,"wal-append.run_cpu_time_us":1573,"wal-append.run_wall_time_us":1001612}
I20260709 13:05:46.623715 23498 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.572961 22552 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.405834 23687 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.632236 23687 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.633916 21901 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:46.635489 21830 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:46.544925 23585 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.311046 23706 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.427249 23695 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.637739 23585 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.431850 23291 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:46.578980 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 260895us
I20260709 13:05:46.553947 23579 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.639760 23695 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.552299 23526 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.640833 23579 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.641723 23526 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.555469 23484 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.646589 23484 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.557859 23685 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.585474 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:46.585453 21855 debug-util.cc:398] Leaking SignalData structure 0x7b080036df40 after lost signal to thread 21859
I20260709 13:05:46.648133 21979 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:46.535380 21909 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:46.572783 23711 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:46.585731 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 217005us
I20260709 13:05:46.591843 21978 raft_consensus.cc:2368] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:46.567230 23374 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.584239 23693 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.596473 23570 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.566823 23582 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.543629 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:46.664570 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 121009us
I20260709 13:05:46.600000 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.568763 23677 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.614106 23675 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.618746 23264 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:46.563377 21948 connection.cc:256] RPC call timeout handler was delayed by -1.3110567069999206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
I20260709 13:05:46.667294 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edb7f62b920e42349d56d878295176b2"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:46.667582 21900 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:46.667879 21831 raft_consensus.cc:606] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:46.668217 21831 raft_consensus.cc:614] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:46.609653 21729 catalog_manager.cc:5697] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 4, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 4 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.669384 21729 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 2 to 3, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.568143 23715 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:46.532207 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:46.660046 21909 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:46.665719 21905 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:46.676429 21906 raft_consensus.cc:2368] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
I20260709 13:05:46.643199 22552 raft_consensus.cc:2410] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:46.671357 21729 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 2 to 3, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.678314 23708 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.678714 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.674276 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.681030 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.657740 23493 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.648891 23616 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:46.684281 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:46.680316 21729 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 4, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:46.599459 23719 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.674748 23463 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:46.692704 21729 catalog_manager.cc:5697] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 2, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.598105 23639 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.699337 23582 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.706000 21900 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:46.706073 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:46.567780 23617 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.663304 23710 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.714519 21979 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:46.712306 21729 catalog_manager.cc:5697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 3, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.718534 21729 catalog_manager.cc:5697] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:05:46.668500 23579 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 13:05:46.702095 21855 debug-util.cc:398] Leaking SignalData structure 0x7b08003692a0 after lost signal to thread 21933
I20260709 13:05:46.722479 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.325312 22550 rpcz_store.cc:276] 0709 13:05:43.921303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.921727 (+   424us) service_pool.cc:224] Handling call
0709 13:05:43.930596 (+  8869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.931018 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.931049 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.931500 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.992860 (+ 61360us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:43.992930 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.993040 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.305237 (+312197us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:05:46.166160 (+1860923us) raft_consensus.cc:1685] finished
0709 13:05:46.173228 (+  7068us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.173461 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1640,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"spinlock_wait_cycles":9395968,"thread_start_us":60893,"threads_started":1,"wal-append.queue_time_us":61315,"wal-append.run_cpu_time_us":4731,"wal-append.run_wall_time_us":1712009}
I20260709 13:05:46.694773 23689 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.733618 22554 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:46.734223 23724 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.734233 23710 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:46.683259 23715 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.684813 23526 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:05:46.717979 23534 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:46.745949 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 72932.2us
I20260709 13:05:46.717988 23653 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.746624 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:46.719834 23680 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.751657 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:46.734762 23712 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.721762 23484 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.700538 23616 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.756582 21980 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:46.752419 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.768062 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.768880 21829 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:46.749826 21979 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 2: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:46.755223 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.753499 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.770216 21825 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:46.769963 21828 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:46.771111 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.771420 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.771939 21828 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:46.772091 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.772621 21825 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:46.772696 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.773224 21828 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:46.773377 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.754405 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.774202 21833 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:46.769946 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.774904 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.775489 21833 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:46.724643 23493 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:46.739506 21975 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:46.762032 23330 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.761730 23678 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 13:05:46.762267 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.762508 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.755102 23685 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.755304 23702 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.764655 23484 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.761126 23463 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.766749 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.767266 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.775009 21829 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:46.759958 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.773943 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.779976 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.743872 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.729776 23684 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:46.792026 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 190237us
I20260709 13:05:46.748605 23689 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:05:46.724573 23693 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:05:46.805606 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.749387 23570 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:05:46.748248 23386 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:05:46.802886 23330 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:05:46.742614 23732 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:05:46.808919 23677 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.765911 23680 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.809258 23493 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:46.809691 23485 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.809751 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.760689 23686 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.810391 22548 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:46.812657 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:46.766371 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:46.829967 21826 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:05:46.830011 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 91382.1us
W20260709 13:05:46.834631 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.802928 23464 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.788132 23681 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.743047 23402 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.837918 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:46.803880 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.803292 23592 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.760691 23653 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.760007 23724 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.841806 23719 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.936180 23460 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.833432 23443 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.837368 23463 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:46.964097 21831 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:46.979370 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.964665 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:46.964905 23702 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:46.935853 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:46.981827 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 144007us
I20260709 13:05:46.964824 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.962867 23681 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:46.965479 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 152918us
I20260709 13:05:46.983776 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:46.984599 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:46.900755 23729 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:46.964828 23570 consensus_queue.cc:1243] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:05:46.833177 23699 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.966578 23493 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.886831 23701 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.910928 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.902562 23709 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.934907 23703 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.981731 23702 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:46.902335 23557 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:46.906060 23484 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:46.835678 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57180.4us
W20260709 13:05:46.970705 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 255385us
W20260709 13:05:46.903723 23662 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.000s
I20260709 13:05:46.975915 23485 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:46.985827 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.979728 22549 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:46.990123 22553 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:46.991091 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.996915 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:46.999635 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:46.985601 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:46.995760 23191 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.012817 23689 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:46.967201 23680 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:46.835000 23244 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.962316 23716 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:47.058806 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:47.098606 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 113629us
W20260709 13:05:47.331151 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 366506us
I20260709 13:05:47.333525 22554 raft_consensus.cc:2368] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:47.331944 21905 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:47.337939 21833 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:47.338476 21902 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:47.343405 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.344604 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.343415 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.345286 21982 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:05:47.345713 21982 pending_rounds.cc:85] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 1
I20260709 13:05:47.346030 21982 pending_rounds.cc:107] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:05:47.346477 21982 raft_consensus.cc:2889] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.347167 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.347890 21905 raft_consensus.cc:2410] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:46.991685 23719 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:46.996171 23690 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:47.342339 23617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.015s	sys 0.010s
I20260709 13:05:47.350507 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:47.350769 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.330294 23562 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:46.988168 23677 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:47.013957 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.352516 21979 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:47.353281 23463 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.351410 23715 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:47.355499 21905 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:47.350057 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:47.355543 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.013295 23600 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.337625 23244 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.332449 23702 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.007690 23464 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.191823 23737 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.187s
I20260709 13:05:47.355919 23719 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.333174 23639 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:47.349754 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 364200us
I20260709 13:05:47.337977 23402 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.333734 23689 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:47.367336 21798 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:47.356719 21976 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:47.369302 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.383929 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:47.384636 21979 raft_consensus.cc:2376] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4. Re-sending same reply.
I20260709 13:05:47.385628 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.097736 23675 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:47.013238 23724 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:47.358024 23617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.016s	sys 0.010s
I20260709 13:05:47.374717 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.354732 23716 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:47.359366 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.403512 21978 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:47.376369 23463 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.366231 23677 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:47.370329 23681 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:47.381615 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:47.381654 23719 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.380410 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:47.388971 23402 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:47.387202 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:47.389724 23689 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.377949 23464 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:47.390381 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.390693 23616 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.387490 21979 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
W20260709 13:05:47.395116 23264 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.000s
I20260709 13:05:47.356493 23709 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:05:47.405953 23716 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:47.403580 21977 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:47.404897 23715 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.406626 21948 leader_election.cc:400] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
I20260709 13:05:47.427048 21948 leader_election.cc:403] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:47.408413 23677 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.378816 23653 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:47.407508 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.428465 21981 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:47.429394 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.429827 21981 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:47.430435 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.430845 21981 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:47.431389 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.431780 21981 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:47.373847 23690 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:05:47.408866 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:47.409175 21902 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:47.434113 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.434598 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:47.375270 21855 debug-util.cc:398] Leaking SignalData structure 0x7b0800364b80 after lost signal to thread 22007
I20260709 13:05:47.409941 21826 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.412442 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.392300 23639 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:47.435860 21977 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:47.415386 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.404062 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.412070 23662 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:47.413931 21798 leader_election.cc:400] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:47.436400 21976 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:47.416917 23737 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.442087 21977 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:47.437641 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.439129 21798 leader_election.cc:403] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:47.416118 23464 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.438063 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:47.448884 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.438932 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:47.428181 23716 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.469465 23688 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:47.474834 23579 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:47.476238 23703 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:47.448426 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:47.442790 21979 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:47.477854 21833 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.471030 21831 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:47.478773 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.436676 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.479792 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:47.479924 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.480269 21825 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.449635 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:47.411008 23684 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:05:47.449954 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:47.470160 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:47.481686 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.427909 23715 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:47.452484 21826 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:47.483336 21828 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:47.484268 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:47.484863 21831 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.485352 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.486228 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.482273 21829 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.489820 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:47.433673 23724 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
W20260709 13:05:47.490865 23750 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:05:47.491040 23749 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:05:47.491832 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.492415 23244 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.483012 23712 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.493491 23712 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:47.493842 23712 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.437393 23639 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:47.494393 23639 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.495498 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1394) took 1194 ms. Trace:
I20260709 13:05:47.495846 21906 rpcz_store.cc:276] 0709 13:05:46.300905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.676967 (+376062us) service_pool.cc:224] Handling call
0709 13:05:46.677220 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:46.683561 (+  6341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.683602 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:46.694706 (+ 11104us) log.cc:844] Serialized 26 byte log entry
0709 13:05:46.828048 (+133342us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:46.837055 (+  9007us) log.cc:844] Serialized 14 byte log entry
0709 13:05:47.494993 (+657938us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b1800478960. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:05:47.495153 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.495226 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:47.495267 (+    41us) raft_consensus.cc:1685] finished
0709 13:05:47.495334 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.495446 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8158,"prepare.queue_time_us":10962,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":7768,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":11550,"spinlock_wait_cycles":48948608,"thread_start_us":105454,"threads_started":1,"wal-append.queue_time_us":249281}
I20260709 13:05:47.499230 23278 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:47.499589 23278 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:47.500334 23278 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:47.501454 23278 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.437702 23662 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:47.502749 21825 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:47.504129 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.505159 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.489203 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:47.441332 23484 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.490149 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.529423 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.529695 21978 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:47.483991 23715 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.428732 23264 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.518661 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:47.531123 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.453367 23737 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:47.511384 23679 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:47.523128 23741 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:47.524720 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.506613 23662 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.526392 23716 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:47.521749 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 531021us
I20260709 13:05:47.521001 23724 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.528064 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.529908 23485 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:47.506554 23719 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.561616 21831 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:47.574012 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.574683 21831 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:47.532050 23484 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.575441 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.576053 21903 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:47.577404 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.549669 23700 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.519078 21855 debug-util.cc:398] Leaking SignalData structure 0x7b080034d600 after lost signal to thread 22579
I20260709 13:05:47.506420 23654 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:47.527794 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:47.556406 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.581861 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:47.582610 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 54884.1us
I20260709 13:05:47.583220 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.583398 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:47.535523 23701 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:47.579443 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.555922 21833 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:47.559334 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.571977 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.585223 21906 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:47.585918 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.586262 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.584431 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.560724 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.587704 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.587945 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.589136 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.589706 21905 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:47.528208 21829 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
W20260709 13:05:47.590281 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 120182us
I20260709 13:05:47.591372 22521 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:47.591409 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 152507us
I20260709 13:05:47.590519 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.535755 23737 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.546888 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.593166 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:47.593259 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:47.600061 21833 raft_consensus.cc:2368] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:47.591029 21980 raft_consensus.cc:2368] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:05:47.593541 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.593010 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.574052 23386 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:47.609517 23386 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.611472 23386 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.577291 23724 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:47.595713 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:47.594910 21829 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:47.575441 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.588629 21909 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:47.522725 21825 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:47.556402 23696 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.578241 23484 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.603646 23616 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:47.604480 21874 leader_election.cc:400] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:47.595151 23562 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:47.606395 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.598939 23556 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:47.608232 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.625988 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.593461 23740 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:47.630445 21874 leader_election.cc:403] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:47.605283 23702 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.591883 23701 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:47.633625 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.636072 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:47.627863 23753 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:05:47.600208 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:47.648059 21906 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:47.601549 21905 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:47.600787 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:47.590135 23700 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.631680 23724 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:47.652000 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51710.9us
I20260709 13:05:47.652427 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.653003 21833 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
W20260709 13:05:47.653681 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 49322.9us
I20260709 13:05:47.650676 21901 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:47.592985 23654 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.634475 23556 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:47.613358 23386 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.657188 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.653829 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:47.664446 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.649506 22547 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:47.647234 23562 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:47.671698 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.672397 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.678397 21981 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 1.
I20260709 13:05:47.680472 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.683229 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.686410 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.687388 21977 raft_consensus.cc:2410] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:47.692034 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.632589 23696 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.693514 21903 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:47.654071 23724 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.692844 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.696422 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.701201 21983 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:47.662556 23681 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:47.667400 23556 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.653426 23759 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:47.669790 23679 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:47.657083 23758 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.667996 23690 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.697166 21975 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:47.712411 21904 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:47.694728 23653 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.674036 23493 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.696156 23703 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:47.710733 23679 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:47.719540 23700 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.700853 23579 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:47.670738 23386 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.724516 23703 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.745775 23703 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.746973 23402 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:47.752002 23526 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:47.752395 23526 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:47.753221 23526 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:47.755554 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.756699 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.758534 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.759057 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.759351 21831 raft_consensus.cc:2368] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:47.760921 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.757843 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.761426 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.761967 21975 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:47.762902 23464 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:47.764043 21983 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:47.709756 23760 raft_consensus.cc:1064] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:05:47.763134 23526 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.723613 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:05:47.766952 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 43497.2us
I20260709 13:05:47.766541 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:47.767917 21975 raft_consensus.cc:2376] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3. Re-sending same reply.
I20260709 13:05:47.768611 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:47.722265 23493 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:47.770671 23493 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.702664 23701 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:47.774072 23677 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:47.771580 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.720446 23653 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:47.778462 23653 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.706452 23688 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:47.743129 23679 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.745834 23579 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:47.780479 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:47.705942 23681 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.724059 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:47.802903 21833 raft_consensus.cc:2376] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4. Re-sending same reply.
I20260709 13:05:47.785332 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:47.714730 23690 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:47.715829 23264 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.807034 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.807833 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.797616 23716 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:47.809599 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 111) took 1136 ms. Trace:
I20260709 13:05:47.809978 21900 rpcz_store.cc:276] 0709 13:05:46.673289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.674027 (+   738us) service_pool.cc:224] Handling call
0709 13:05:47.809457 (+1135430us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b5400078354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:47.809550 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59682688}
I20260709 13:05:47.703596 23639 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.821091 21875 leader_election.cc:400] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:47.821465 21875 leader_election.cc:403] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:05:47.744679 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:47.799970 23600 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:47.822366 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:47.791956 23654 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.802116 23579 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.797377 23688 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.805209 23681 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.804133 23740 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.811268 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:47.808713 23719 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:47.852443 22555 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:47.852928 23689 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.854336 21832 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:47.861017 23484 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.829978 21834 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:47.827260 23600 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:47.820204 23700 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:47.824973 23498 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.836319 23464 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:47.821488 23677 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.826771 23695 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.823987 23693 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:47.836400 23688 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.843194 23740 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:47.846830 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:47.818945 23690 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.885473 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1384) took 1588 ms. Trace:
I20260709 13:05:47.810832 23562 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:47.894223 23600 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:47.892026 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 69762us
I20260709 13:05:47.904322 21907 rpcz_store.cc:276] 0709 13:05:46.297058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.301558 (+  4500us) service_pool.cc:224] Handling call
0709 13:05:46.301823 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:46.668849 (+367026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.668874 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:46.669262 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:05:46.722265 (+ 53003us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:46.722299 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.885111 (+1162812us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54003c9454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:47.885156 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:47.885199 (+    43us) raft_consensus.cc:1685] finished
0709 13:05:47.885211 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.885421 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2284,"raft.queue_time_us":8838,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10115,"spinlock_wait_cycles":838059776,"thread_start_us":33383,"threads_started":1,"wal-append.queue_time_us":74000,"wal-append.run_cpu_time_us":1875,"wal-append.run_wall_time_us":1001905}
I20260709 13:05:47.908779 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.865556 23724 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:47.843691 23654 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.894814 23498 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.834571 23757 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.829068 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.884757 23534 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:47.875434 23386 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.824900 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 404) took 1109 ms. Trace:
I20260709 13:05:47.938023 23534 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:47.903786 23740 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.887682 23712 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:47.940359 23757 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:47.865675 23715 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:47.897330 23702 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:47.963171 21979 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:47.917910 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:47.907115 23693 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:05:47.940979 23755 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:05:47.941519 22546 rpcz_store.cc:276] 0709 13:05:46.715299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.717708 (+  2409us) service_pool.cc:224] Handling call
0709 13:05:47.744475 (+1026767us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:47.824813 (+ 80338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25298816}
I20260709 13:05:47.979303 21977 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:47.945616 23705 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:47.935457 23526 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:47.977658 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59837.5us
I20260709 13:05:47.948334 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:47.935712 23498 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.937295 23617 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:05:48.076759 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.074946 21906 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:48.076463 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.069556 23526 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:47.943665 23534 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:48.098894 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.101986 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:48.079396 23639 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:48.106598 23770 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:05:48.074571 23773 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:48.098829 21975 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:48.103286 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:48.112114 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.095952 23526 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.125191 21875 leader_election.cc:400] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:48.099221 23689 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:48.141528 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.113694 23773 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.123127 23639 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:48.129468 23585 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:48.178020 21798 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.136322 23779 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.163007 23639 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.109282 23693 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.163743 23773 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.196825 23758 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:48.198572 23708 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:48.208346 23778 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:48.213419 23690 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:48.222746 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 107506us
I20260709 13:05:48.206422 23639 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.190007 23724 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:48.234130 21873 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.620s (SENT)
I20260709 13:05:48.205240 23779 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:48.244891 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1370) took 3526 ms. Trace:
I20260709 13:05:48.215238 23520 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.246536 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.216369 21830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff74442193fb468c966c8842f014e361"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:48.257318 21828 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.223659 23585 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:48.224957 23712 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.263579 23695 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:48.250615 21827 rpcz_store.cc:276] 0709 13:05:44.718505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.132002 (+1413497us) service_pool.cc:224] Handling call
0709 13:05:46.132435 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:46.593502 (+461067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.595041 (+  1539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:46.595100 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:46.595147 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.244620 (+1649473us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540009db54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:48.244674 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.244831 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034661248}
I20260709 13:05:48.236685 23715 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.254711 23757 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:48.224602 23681 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:48.270912 23556 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.003s
I20260709 13:05:48.233227 23600 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.249351 23740 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.259006 21830 raft_consensus.cc:606] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:48.283773 23609 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.285495 23498 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.287475 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:48.280146 23662 consensus_meta.cc:287] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.000s
I20260709 13:05:48.289649 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.300040 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.289806 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:48.290053 23737 consensus_meta.cc:287] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.003s
I20260709 13:05:48.290359 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.302685 23737 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.303396 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.292894 23774 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:48.304459 23786 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:48.304704 23737 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.304838 23774 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:48.305249 23774 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:48.305371 21833 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.290596 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.291992 23681 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.306874 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:48.307061 23703 consensus_meta.cc:287] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.005s
I20260709 13:05:48.307073 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.307505 23703 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.307900 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.308454 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.308888 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.309020 21831 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:48.309432 23703 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.309780 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.313527 23688 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.297713 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.298110 21900 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:48.288403 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.328773 21826 raft_consensus.cc:2410] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:48.281527 23696 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.336480 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.337169 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.248862 23579 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.302259 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.310678 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1317) took 4067 ms. Trace:
I20260709 13:05:48.310675 23681 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:05:48.314715 23330 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:48.318276 23779 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:48.310990 23679 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.002s
I20260709 13:05:48.319674 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.266613 23760 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.351713 21830 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:48.353166 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:48.317159 23780 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:05:48.319892 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:48.313020 23653 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.002s
I20260709 13:05:48.317291 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.327077 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:48.335732 23493 consensus_meta.cc:287] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 13:05:48.335804 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:48.343806 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.339402 21974 rpcz_store.cc:276] 0709 13:05:44.243028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.243166 (+   138us) service_pool.cc:224] Handling call
0709 13:05:44.259557 (+ 16391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:46.549856 (+2290299us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:46.999375 (+449519us) log.cc:844] Serialized 14 byte log entry
0709 13:05:47.331828 (+332453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:47.331874 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:47.331911 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.310472 (+978561us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54002d4954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:48.310525 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.310628 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3568,"prepare.queue_time_us":413089,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":78,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":5824,"spinlock_wait_cycles":901051264,"thread_start_us":773558,"threads_started":2,"wal-append.queue_time_us":391349}
I20260709 13:05:48.272614 23585 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:48.346396 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44261.9us
I20260709 13:05:48.342473 23600 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.353322 23740 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.364331 21827 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.364687 23690 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.345067 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.301628 23662 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.355944 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:48.357070 21901 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:48.367218 23593 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.296667 23556 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.350456 23786 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:48.309531 21833 raft_consensus.cc:2393] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.361426 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.371567 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.372341 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.372769 21826 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.369021 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.374073 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.374830 21974 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:48.375149 23498 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.375504 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:48.375560 23556 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:48.376780 23600 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:48.377888 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 303) took 1625 ms. Trace:
I20260709 13:05:48.383615 22552 rpcz_store.cc:276] 0709 13:05:46.752696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.989918 (+237222us) service_pool.cc:224] Handling call
0709 13:05:47.335707 (+345789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.335868 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.335903 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:47.335942 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:47.335971 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.336022 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.377736 (+1041714us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54000a9950. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:48.377837 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794696960}
I20260709 13:05:48.361054 23653 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.386785 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.387351 21978 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:48.387395 21826 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.388342 21976 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:48.369532 23712 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:48.388885 23712 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.388993 23688 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.389276 23712 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.390573 23484 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:48.391252 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.391978 21833 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.392283 23639 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.345676 23526 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.392850 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.393389 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.394739 23526 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.396876 21904 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.397730 23402 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:48.398658 23402 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:48.398881 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.398993 23402 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:48.399879 23402 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.401525 21831 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.399945 23291 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.403030 23402 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.403260 23579 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.403990 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.405009 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.405604 21983 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:48.405414 23579 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.387403 23662 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:48.406961 23662 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.408818 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:48.409435 21983 raft_consensus.cc:2368] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
W20260709 13:05:48.403128 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.393888 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:48.411055 21979 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.378944 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:48.411772 21901 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
W20260709 13:05:48.356252 23685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.374s	user 0.002s	sys 0.027s
I20260709 13:05:48.306020 23774 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.408042 23662 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.426321 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.357800 23679 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.427587 21901 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.417367 21826 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:48.428967 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.429490 21826 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:48.429301 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.423048 21974 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.424479 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:48.430486 21983 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.430660 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.367859 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.424878 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:48.424911 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44746.7us
I20260709 13:05:48.433141 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.433712 21900 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.433537 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.415256 21904 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:48.430857 21798 leader_election.cc:400] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:48.362572 23493 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.431226 21907 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.394155 23639 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.434963 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:48.421932 23685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.443s	user 0.003s	sys 0.027s
I20260709 13:05:48.442292 21981 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.441756 21979 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:48.435837 21830 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.424777 23675 raft_consensus.cc:476] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:05:48.434839 21798 leader_election.cc:403] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:05:48.474758 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 44012.9us
I20260709 13:05:48.476675 23639 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.477293 23679 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:48.447279 23732 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:48.478291 23732 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:48.479154 23732 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.479460 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:48.480273 21977 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.422627 23757 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.441175 21901 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:48.386816 23653 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.447134 21825 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.439013 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:48.445855 21983 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:48.427167 23600 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.448837 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:48.450021 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:48.451289 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:48.451547 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:48.452307 21974 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:48.462461 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1389) took 2164 ms. Trace:
I20260709 13:05:48.462919 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.467319 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.468524 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.471446 23686 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:48.473685 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1359) took 1024 ms. Trace:
W20260709 13:05:48.502256 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.518359 21834 rpcz_store.cc:276] 0709 13:05:47.448806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.449040 (+   234us) service_pool.cc:224] Handling call
0709 13:05:47.449271 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.887148 (+437877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.473389 (+586241us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54000e97d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:48.473614 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875031296}
I20260709 13:05:48.519444 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.519675 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1392) took 2167 ms. Trace:
I20260709 13:05:48.485101 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.519946 21834 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.519938 21902 rpcz_store.cc:276] 0709 13:05:46.351835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.351797 (+999962us) service_pool.cc:224] Handling call
0709 13:05:47.352460 (+   663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.440116 (+ 87656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.519521 (+1079405us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54000fbc54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:48.519635 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130043776}
I20260709 13:05:48.521827 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.522046 21907 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:48.486991 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:48.517457 23737 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:48.467825 23773 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.490720 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.433158 23787 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.494594 21830 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:48.496052 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.496121 21900 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:48.496259 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:48.529526 21983 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:48.530365 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:48.530786 21834 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:48.498553 21874 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:48.532078 21834 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:48.532107 21830 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:05:48.498529 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 59588.7us
I20260709 13:05:48.486997 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.523250 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.534567 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.535125 21983 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:48.517095 21908 rpcz_store.cc:276] 0709 13:05:46.298416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.596949 (+298533us) service_pool.cc:224] Handling call
0709 13:05:46.597185 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:46.617307 (+ 20122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.617337 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:46.617378 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:46.617406 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.462215 (+1844809us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5400078854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:48.462255 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.462394 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45902592}
I20260709 13:05:48.524645 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.525019 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.536281 21829 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.532065 21977 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 2.
I20260709 13:05:48.536856 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:48.537155 21831 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:48.537320 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:48.537849 21977 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.537978 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:48.538386 22521 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.517482 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:48.515391 23699 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.497702 23600 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:48.541577 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:48.539160 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:48.518198 23686 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:48.548570 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 909637us
I20260709 13:05:48.552793 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:48.531766 23374 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.547098 23330 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.561681 23330 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:48.552640 23556 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.562345 21828 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:48.562496 23556 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:48.562682 23330 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.563524 23556 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.564087 23686 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.565096 23686 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.535629 23696 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:48.551990 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1361) took 1102 ms. Trace:
I20260709 13:05:48.533282 23737 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:48.580034 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:48.580729 22551 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:48.581012 23737 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.585350 23437 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:48.560473 23695 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:48.568595 23786 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:48.587328 23786 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:48.587843 23786 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.554236 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.495066 23784 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:05:48.556082 21906 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.551853 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1309) took 2118 ms. Trace:
I20260709 13:05:48.498139 23757 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.569080 21908 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:48.572090 21832 rpcz_store.cc:276] 0709 13:05:47.449327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.449748 (+   421us) service_pool.cc:224] Handling call
0709 13:05:47.471387 (+ 21639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.854659 (+383272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.551762 (+697103us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540011e254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:48.551930 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880307968}
I20260709 13:05:48.533383 23291 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:48.569844 21799 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:48.574134 23662 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:48.624811 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:48.577317 23791 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:05:48.579155 23585 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:48.543356 23740 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:48.568182 23484 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:48.551712 21977 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:48.596905 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.597795 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.600344 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:48.600287 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:48.601328 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.604617 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.636068 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.611372 21982 rpcz_store.cc:276] 0709 13:05:46.433081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.607977 (+174896us) service_pool.cc:224] Handling call
0709 13:05:46.608212 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.347114 (+738902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.551652 (+1204538us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54003a4dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:48.551801 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694473600}
W20260709 13:05:48.623541 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.637094 21901 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.623445 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.552861 23600 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.636174 21904 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:48.623109 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 53332.2us
I20260709 13:05:48.637579 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.640143 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:48.640555 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.641156 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.641652 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.641961 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.585960 23437 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:48.642706 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.644279 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.645222 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.645948 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.645802 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.646965 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.637682 21908 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:48.604008 23653 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:48.551584 23699 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:48.649148 21979 pending_rounds.cc:85] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 1
I20260709 13:05:48.649888 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.649044 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:48.649896 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:48.650756 21980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1323) took 1295 ms (client timeout 1578 ms). Trace:
W20260709 13:05:48.652112 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51900.7us
I20260709 13:05:48.649443 21901 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:48.647948 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.682300 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:48.649389 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:48.723726 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:48.627480 23711 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:48.741345 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 92039.6us
I20260709 13:05:48.745326 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.727151 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.729805 21979 pending_rounds.cc:107] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:05:48.748059 21979 raft_consensus.cc:2889] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:48.733366 21905 raft_consensus.cc:2410] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:05:48.730664 21980 rpcz_store.cc:269] 0709 13:05:47.355096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.355319 (+   223us) service_pool.cc:224] Handling call
0709 13:05:48.650554 (+1295235us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003a57d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:48.650691 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506577152}
I20260709 13:05:48.751099 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.639149 23291 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:48.752621 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.639036 23662 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:48.733395 22553 raft_consensus.cc:2410] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:48.733624 21904 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:48.755195 21904 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
W20260709 13:05:48.735348 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 86377.4us
I20260709 13:05:48.757819 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.749716 23520 raft_consensus.cc:2764] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:48.736678 21908 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.648641 23777 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:48.732513 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:48.734128 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.647821 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:48.648206 23684 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:48.650622 23685 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:48.642381 23484 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.725265 23585 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:48.733394 23330 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:48.723099 23688 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:48.750494 23689 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:48.762249 23779 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:48.888460 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.776014 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.905778 21980 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:48.775698 21904 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:48.785421 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.836485 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.777550 21901 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.908571 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.798359 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:48.771451 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.792426 21900 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.910681 21908 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:48.909077 21902 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:48.912062 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 126789us
I20260709 13:05:48.916327 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:48.767684 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:48.918583 23689 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:48.919893 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 152892us
I20260709 13:05:48.921198 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:48.738082 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:48.925395 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.925154 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:48.768505 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:48.935388 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:48.980789 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 55639.3us
I20260709 13:05:48.983245 22553 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:48.986538 21908 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.987025 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:48.959482 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:48.793735 23520 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.799150 23593 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.192s
I20260709 13:05:48.988533 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.794863 23498 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.194s
I20260709 13:05:48.802065 23692 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.191s
I20260709 13:05:48.783150 23503 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:48.990258 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:49.002504 21829 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:48.796738 23585 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:48.993192 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:05:48.995141 23796 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.448s	user 0.001s	sys 0.000s
I20260709 13:05:48.952906 23690 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:48.794512 23484 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:48.990653 23800 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:05:49.011987 23570 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:05:48.999444 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:49.024251 23570 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:49.024757 23570 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:49.001418 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:49.017536 23712 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.627s	user 0.003s	sys 0.006s
I20260709 13:05:48.769400 23662 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:48.981266 21980 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:49.036976 21908 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:49.005745 23688 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:49.004236 23503 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:49.003640 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:48.924484 23689 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:49.013933 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:48.991564 23737 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:48.795019 23654 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.206s
I20260709 13:05:48.794745 23493 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:49.027937 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.057245 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.061136 21982 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:48.919525 23684 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:49.062892 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:48.995537 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:48.998466 23773 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:49.036448 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 240978us
I20260709 13:05:49.025578 23570 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.013739 23593 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:49.016618 23585 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.803416 23330 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.051812 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:48.798468 23437 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.049813 23503 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:49.070767 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 153146us
I20260709 13:05:49.046869 23757 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:48.960335 23291 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.050094 23690 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:49.076328 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.051251 23688 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:49.036270 23712 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.059964 23737 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:49.086830 21903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1401) took 1505 ms (client timeout 1937 ms). Trace:
I20260709 13:05:49.085444 21902 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:49.088234 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1331) took 1303 ms. Trace:
I20260709 13:05:49.081131 23498 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.091423 21903 rpcz_store.cc:269] 0709 13:05:47.581276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.582987 (+  1711us) service_pool.cc:224] Handling call
0709 13:05:49.086663 (+1503676us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400077954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:49.086783 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251936640}
I20260709 13:05:49.076900 23593 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:49.091997 21974 rpcz_store.cc:276] 0709 13:05:47.784810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.539380 (+754570us) service_pool.cc:224] Handling call
0709 13:05:48.555217 (+ 15837us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:48.568546 (+ 13329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.568585 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:48.568967 (+   382us) log.cc:844] Serialized 26 byte log entry
0709 13:05:48.624904 (+ 55937us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:49.087658 (+462754us) log.cc:844] Serialized 14 byte log entry
0709 13:05:49.087900 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.087985 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.088032 (+    47us) raft_consensus.cc:1685] finished
0709 13:05:49.088048 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.088175 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94032,"raft.queue_time_us":13051,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2925,"thread_start_us":379567,"threads_started":2,"wal-append.queue_time_us":82714}
I20260709 13:05:49.113842 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:49.116706 23662 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:49.118556 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:49.119416 21980 raft_consensus.cc:2368] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:05:49.120301 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:49.120910 21980 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.125174 23737 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.136422 23712 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:49.128513 23805 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:49.130612 23690 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.133890 23689 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.134881 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:49.147123 23688 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.151974 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.160496 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:49.165493 21909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.016s	sys 0.020s
W20260709 13:05:49.166797 21909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.016s	sys 0.020s
I20260709 13:05:49.161839 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.174149 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.174723 21974 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:49.175482 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.178048 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.181095 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.182320 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.183019 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:49.183193 21974 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:49.184698 21975 raft_consensus.cc:2368] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5.
I20260709 13:05:49.184088 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.187252 21974 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:49.187685 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:49.188804 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:49.189301 21825 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:49.190044 23787 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.000s
I20260709 13:05:49.189954 23593 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.190624 23787 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:49.191028 23593 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:49.183306 23800 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:05:49.194916 23799 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 13:05:49.196401 23330 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:49.196810 21976 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1325) took 1413 ms (client timeout 1828 ms). Trace:
W20260709 13:05:49.197180 21976 rpcz_store.cc:269] 0709 13:05:47.783258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.319607 (+536349us) service_pool.cc:224] Handling call
0709 13:05:49.196647 (+877040us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b54002d4954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:49.196763 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75664128}
I20260709 13:05:49.197570 21833 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:49.198462 21976 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:49.199039 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 171) took 1363 ms. Trace:
I20260709 13:05:49.199318 21976 rpcz_store.cc:276] 0709 13:05:47.835443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.198003 (+1362560us) service_pool.cc:224] Handling call
0709 13:05:49.198296 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.198814 (+   518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.198990 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:49.200731 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1340) took 1101 ms. Trace:
I20260709 13:05:49.201354 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1333) took 1416 ms. Trace:
W20260709 13:05:49.203369 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.204345 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.204845 23711 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:49.205415 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.201704 21979 rpcz_store.cc:276] 0709 13:05:47.785303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.557067 (+771764us) service_pool.cc:224] Handling call
0709 13:05:48.557289 (+   222us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:48.778592 (+221303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.778636 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:48.779328 (+   692us) log.cc:844] Serialized 52 byte log entry
0709 13:05:48.967199 (+187871us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:48.967255 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.200996 (+233741us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b54003a48d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:49.201036 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.201078 (+    42us) raft_consensus.cc:1685] finished
0709 13:05:49.201092 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.201304 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14427,"raft.queue_time_us":31022,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":8703,"spinlock_wait_cycles":210745088,"thread_start_us":187501,"threads_started":1,"wal-append.queue_time_us":279756}
I20260709 13:05:49.206575 23703 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:49.097122 23498 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.207119 23703 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:49.207983 23703 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.208580 23498 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:49.209033 21979 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:49.211171 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:49.211796 22549 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:49.212968 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.214668 21798 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.217224 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1341) took 1114 ms. Trace:
I20260709 13:05:49.217718 21979 rpcz_store.cc:276] 0709 13:05:48.102969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.207034 (+1104065us) service_pool.cc:224] Handling call
0709 13:05:49.208577 (+  1543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.209372 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.217166 (+  7794us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:49.201040 21976 rpcz_store.cc:276] 0709 13:05:48.099818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.200024 (+1100206us) service_pool.cc:224] Handling call
0709 13:05:49.200270 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.200418 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.200442 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:49.200481 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:49.200508 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.200555 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.200685 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:49.220824 21976 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:05:49.221501 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1343) took 1117 ms. Trace:
I20260709 13:05:49.221865 21976 rpcz_store.cc:276] 0709 13:05:48.103681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.220189 (+1116508us) service_pool.cc:224] Handling call
0709 13:05:49.220524 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:49.221235 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.221445 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:49.227594 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.228991 21976 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:49.229311 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.230837 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.232892 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:49.233780 21976 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:49.235136 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 172) took 1117 ms. Trace:
I20260709 13:05:49.235414 21976 rpcz_store.cc:276] 0709 13:05:48.117813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.233416 (+1115603us) service_pool.cc:224] Handling call
0709 13:05:49.233641 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.234945 (+  1304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.235092 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:49.235896 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:49.236361 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.236948 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1329) took 1452 ms. Trace:
W20260709 13:05:49.206588 23639 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.000s
I20260709 13:05:49.240536 21825 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:49.247215 21980 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:49.211341 23520 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:49.205428 23711 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:49.237510 21983 rpcz_store.cc:276] 0709 13:05:47.784310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.537734 (+753424us) service_pool.cc:224] Handling call
0709 13:05:48.537979 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:48.546313 (+  8334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.546358 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:48.569573 (+ 23215us) log.cc:844] Serialized 26 byte log entry
0709 13:05:49.075369 (+505796us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:49.233139 (+157770us) log.cc:844] Serialized 14 byte log entry
0709 13:05:49.234252 (+  1113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.234448 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.234502 (+    54us) raft_consensus.cc:1685] finished
0709 13:05:49.234520 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.236883 (+  2363us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":109224,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":98,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10932,"thread_start_us":538635,"threads_started":2,"wal-append.queue_time_us":568424}
I20260709 13:05:49.267300 21983 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:49.234112 23788 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.256253 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1347) took 1050 ms. Trace:
I20260709 13:05:49.228180 23579 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:49.270043 23779 raft_consensus.cc:993] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:05:49.240399 23816 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:05:49.270562 23779 raft_consensus.cc:1081] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:05:49.255107 23777 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:05:49.271699 21827 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:49.272708 23706 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.273013 21827 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:05:49.264732 23679 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:49.273516 23786 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.685s	user 0.011s	sys 0.000s
I20260709 13:05:49.240185 23681 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:49.265810 23330 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:05:49.265175 23639 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4.
I20260709 13:05:49.277374 23816 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:49.277544 21830 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:49.277801 23816 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:49.278740 23816 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.279520 21830 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:49.279920 21909 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:49.280135 23816 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.264417 23810 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.282048 23810 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.282699 23330 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:49.282763 21827 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:49.283207 23330 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:49.284050 23810 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:49.284325 23819 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:49.270110 23503 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.286458 23191 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:49.286821 23191 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:49.287256 23503 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.288038 23191 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.289063 23191 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:49.289347 23802 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:05:49.290786 21830 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:05:49.292878 23795 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.659s	user 0.002s	sys 0.000s
I20260709 13:05:49.293432 23585 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:49.295686 23686 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.002s
I20260709 13:05:49.296437 21834 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:49.284931 21827 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.284073 23330 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.298287 21979 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:49.300931 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:49.232452 23787 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:49.299188 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:49.239281 23570 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:49.268399 21976 rpcz_store.cc:276] 0709 13:05:48.205811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.255271 (+1049460us) service_pool.cc:224] Handling call
0709 13:05:49.255626 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.255832 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.255869 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:49.255934 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:49.255985 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.256063 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.256188 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:49.306136 21908 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:49.270066 23600 consensus_meta.cc:287] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:05:49.273881 23786 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.309070 21983 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:49.309401 21830 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:49.306073 23810 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:49.335022 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 166) took 1650 ms. Trace:
I20260709 13:05:49.335547 21981 rpcz_store.cc:276] 0709 13:05:47.684549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.684947 (+   398us) service_pool.cc:224] Handling call
0709 13:05:47.685254 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.442651 (+757397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.334746 (+892095us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b5400225bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:49.334952 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731266304}
I20260709 13:05:49.337337 21981 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:49.341225 21981 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:49.344907 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:49.312059 23330 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:49.352669 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.349140 21976 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:49.350704 21981 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:49.334544 22548 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:49.347787 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.355361 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.350963 23520 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.311177 23600 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.361043 23786 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.362779 23585 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.313089 23804 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:05:49.364137 23816 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:05:49.366200 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.366549 21874 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:49.369987 22553 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.369000 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:49.367761 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:49.369109 23816 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:49.394933 23816 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.395565 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1344) took 1289 ms. Trace:
I20260709 13:05:49.395931 23816 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.395988 21975 rpcz_store.cc:276] 0709 13:05:48.106159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.468229 (+362070us) service_pool.cc:224] Handling call
0709 13:05:49.391369 (+923140us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54003f9b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:49.395508 (+  4139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447872256}
I20260709 13:05:49.382344 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1337) took 1583 ms. Trace:
I20260709 13:05:49.381250 23774 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.397845 21974 rpcz_store.cc:276] 0709 13:05:47.798699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.187914 (+1389215us) service_pool.cc:224] Handling call
0709 13:05:49.188197 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:49.188537 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.188574 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:49.189019 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:05:49.323896 (+134877us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:49.323941 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.324026 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.382134 (+ 58108us) raft_consensus.cc:1685] finished
0709 13:05:49.382156 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.382290 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":357,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":134465,"threads_started":1,"wal-append.queue_time_us":170056}
I20260709 13:05:49.377703 22553 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:49.359004 23582 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.357131 23291 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:05:49.364380 23484 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:49.403055 23803 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.352s	user 0.001s	sys 0.001s
I20260709 13:05:49.404225 23484 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:49.404786 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1335) took 1606 ms. Trace:
I20260709 13:05:49.401942 23600 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.405157 21978 rpcz_store.cc:276] 0709 13:05:47.798124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.561979 (+763855us) service_pool.cc:224] Handling call
0709 13:05:48.562278 (+   299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:48.567943 (+  5665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.567985 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:48.590200 (+ 22215us) log.cc:844] Serialized 52 byte log entry
0709 13:05:48.796817 (+206617us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:48.796858 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.796922 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.402513 (+605591us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:05:49.404463 (+  1950us) raft_consensus.cc:1685] finished
0709 13:05:49.404488 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.404722 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5304,"raft.queue_time_us":5959,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":8342,"spinlock_wait_cycles":9040640,"thread_start_us":143835,"threads_started":1,"wal-append.queue_time_us":367376}
I20260709 13:05:49.402103 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:49.407945 21974 raft_consensus.cc:2368] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3.
I20260709 13:05:49.408990 22519 leader_election.cc:400] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3.
I20260709 13:05:49.399292 23679 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:49.409276 22519 leader_election.cc:403] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:05:49.402253 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.411149 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:49.412242 22554 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:49.412706 23463 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3.
I20260709 13:05:49.412899 21983 raft_consensus.cc:2368] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 3. Current term is 4.
I20260709 13:05:49.416921 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:49.417160 23582 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:49.425364 23732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.002s	sys 0.004s
W20260709 13:05:49.425798 23732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.002s	sys 0.004s
I20260709 13:05:49.370018 23775 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:05:49.426617 23775 consensus_queue.cc:1243] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:49.427004 23695 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.427356 23695 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:49.428381 23534 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:49.428131 23695 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.429349 23695 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.433228 23701 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.457934 23654 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.458599 23654 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:49.500298 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 244431us
I20260709 13:05:49.512796 21831 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:49.522576 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:49.529736 21798 leader_election.cc:400] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5.
W20260709 13:05:49.534643 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 186711us
W20260709 13:05:49.539948 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.558542 21798 leader_election.cc:403] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:49.631546 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 93878.8us
I20260709 13:05:49.636099 23692 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:49.637291 23692 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.637827 23692 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:49.636924 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:49.641307 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.645516 23681 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.643116 23696 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:05:49.650233 23696 consensus_queue.cc:1243] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:49.649542 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.650887 23696 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:49.651235 23484 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:49.651402 23696 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:49.652336 23484 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:49.652765 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.653107 23696 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.654546 23760 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:49.657330 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.657398 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:49.672101 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.673883 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.658766 23681 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.674630 23816 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.676077 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.677117 23816 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.678241 23562 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:49.677500 23534 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:05:49.678965 23562 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:49.680871 23562 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.682057 23816 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.699213 23562 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.708021 23374 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5.
I20260709 13:05:49.709673 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:49.710902 21827 raft_consensus.cc:2376] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4. Re-sending same reply.
W20260709 13:05:49.712074 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.705083 23732 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.715520 23732 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.718391 23732 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.715448 23498 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.712393 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:49.706696 23724 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:49.722756 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 193450us
I20260709 13:05:49.722973 23696 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.731299 21829 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:49.722796 23498 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.739423 21982 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:49.739893 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 82706.8us
I20260709 13:05:49.740840 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:05:49.741312 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.745168 23498 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.746810 21982 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:49.749630 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.750458 21974 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:49.752703 23463 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:49.755141 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:49.755968 21974 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:49.757650 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:49.758548 21982 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:49.758908 23724 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:49.759415 23724 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:49.759799 23724 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.762312 23498 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.763058 23498 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.763396 22519 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:49.764330 23463 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:49.764717 23463 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.765069 23463 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.765311 23498 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.758996 23681 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:49.767122 23600 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:49.767725 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:49.767833 23600 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.769801 23681 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:49.770213 23681 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.770587 23681 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.771004 23600 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:49.778143 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:49.779772 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:49.786594 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.788225 21829 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
W20260709 13:05:49.791538 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.787907 23681 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.795888 23760 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:49.778635 23692 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.797446 23463 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.809216 23681 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:49.815507 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:49.826802 23692 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:49.828477 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:05:49.832175 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.848114 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 61754.6us
I20260709 13:05:49.859227 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:49.861454 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:49.863631 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:49.867115 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1397) took 1577 ms. Trace:
I20260709 13:05:49.868129 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1348) took 1609 ms. Trace:
W20260709 13:05:49.882296 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.890954 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1411) took 1289 ms. Trace:
I20260709 13:05:49.891358 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:49.893062 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1416) took 1496 ms. Trace:
I20260709 13:05:49.893610 21828 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:05:49.905869 22554 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:49.909670 21981 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.907361 21905 rpcz_store.cc:276] 0709 13:05:48.601603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.751772 (+150169us) service_pool.cc:224] Handling call
0709 13:05:49.086797 (+335025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.086958 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.086982 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:49.087018 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:49.087045 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.087101 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.890541 (+803440us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400077950. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:49.890761 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769734400}
I20260709 13:05:49.906900 21980 rpcz_store.cc:276] 0709 13:05:48.258857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.265327 (+1006470us) service_pool.cc:224] Handling call
0709 13:05:49.426989 (+161662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.427163 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.427189 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:49.427228 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:49.427257 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.427309 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.867767 (+440458us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540005a5d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:49.867961 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371020032}
I20260709 13:05:49.913513 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:49.909606 23760 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:49.909530 21975 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:49.906591 21834 rpcz_store.cc:276] 0709 13:05:48.289387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.533090 (+243703us) service_pool.cc:224] Handling call
0709 13:05:48.533485 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.296747 (+763262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.866555 (+569808us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54001d7ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:49.866890 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753901312}
I20260709 13:05:49.907889 21833 rpcz_store.cc:276] 0709 13:05:48.396148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.462657 (+ 66509us) service_pool.cc:224] Handling call
0709 13:05:49.892722 (+1430065us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540008a554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:49.892873 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551282944}
I20260709 13:05:49.902741 23463 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.928854 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.929968 23760 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:49.939580 23699 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:49.939765 23760 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:49.940328 21974 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.940668 23760 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:49.940833 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1404) took 1567 ms. Trace:
I20260709 13:05:49.941129 23760 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:49.941306 21828 rpcz_store.cc:276] 0709 13:05:48.373574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.563051 (+189477us) service_pool.cc:224] Handling call
0709 13:05:49.893026 (+1329975us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:49.909004 (+ 15978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.940640 (+ 31636us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540008a550. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:49.940785 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3057790208}
I20260709 13:05:49.914485 23653 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:49.942899 23760 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.944764 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1410) took 1608 ms. Trace:
I20260709 13:05:49.945127 21831 rpcz_store.cc:276] 0709 13:05:48.336443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.539914 (+203471us) service_pool.cc:224] Handling call
0709 13:05:49.275386 (+735472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.513695 (+238309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.943990 (+430295us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b540017e3d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:49.944592 (+   602us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b540017e3d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:49.944704 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235415168}
I20260709 13:05:49.945726 23653 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:49.947113 23484 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:49.947656 23484 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:49.949064 23484 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.952193 23484 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.953635 23654 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:49.954883 22554 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:05:49.956236 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 121) took 1472 ms. Trace:
I20260709 13:05:49.956579 21906 rpcz_store.cc:276] 0709 13:05:48.483998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.486459 (+  2461us) service_pool.cc:224] Handling call
0709 13:05:48.555917 (+ 69458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.623746 (+ 67829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.955855 (+1332109us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b54000fa850. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:49.956076 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159179520}
I20260709 13:05:49.959178 23788 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.960114 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 159) took 1582 ms. Trace:
I20260709 13:05:49.959882 23788 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.960477 21832 rpcz_store.cc:276] 0709 13:05:48.377713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.627749 (+250036us) service_pool.cc:224] Handling call
0709 13:05:48.725823 (+ 98074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.794581 (+ 68758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.794611 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:48.794655 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:48.794685 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.959603 (+1164918us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b540011dd54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:49.959667 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.959891 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157676416}
I20260709 13:05:49.962826 23788 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:49.963589 23681 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:49.964182 23437 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.965713 23681 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:49.967458 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:49.973683 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 60262.8us
I20260709 13:05:49.976594 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:49.971290 23654 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:49.983611 21981 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:49.987565 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:49.995615 21981 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:49.979496 23724 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:49.989068 23654 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:49.991739 23760 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:50.010869 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:50.011626 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 60256us
I20260709 13:05:50.019079 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:50.019264 23654 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:49.986856 21982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff74442193fb468c966c8842f014e361"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:05:50.023571 21982 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.023939 21982 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:50.026728 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1423) took 1327 ms. Trace:
I20260709 13:05:50.027096 21901 rpcz_store.cc:276] 0709 13:05:48.698862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.908367 (+209505us) service_pool.cc:224] Handling call
0709 13:05:48.908607 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.908788 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:48.932626 (+ 23838us) log.cc:844] Serialized 14 byte log entry
0709 13:05:49.885907 (+953281us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b1800149bc0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:05:50.004876 (+118969us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.012423 (+  7547us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:50.026350 (+ 13927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.026447 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.026584 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23611,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":14813,"raft.queue_time_us":1928,"spinlock_wait_cycles":61826048,"thread_start_us":104795,"threads_started":1}
I20260709 13:05:50.028997 23593 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:50.029384 23724 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:50.041543 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 46567.6us
I20260709 13:05:50.042537 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:50.043422 23788 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:50.043916 23685 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.026065 22550 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:50.056849 22555 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:50.039366 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:50.063601 21980 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:50.063934 21980 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:05:50.064301 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.064601 23838 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:50.064826 21980 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.065861 21980 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:50.095037 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.099602 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58888.6us
I20260709 13:05:50.108028 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:50.110106 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.108880 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:50.111388 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:50.112249 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54647.8us
I20260709 13:05:50.098758 23724 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:50.114956 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:50.117637 21828 raft_consensus.cc:2410] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:50.118347 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:50.120941 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:50.125274 23562 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:50.126545 23847 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.126814 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:50.127327 23847 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:50.127838 23847 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:50.128868 23788 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.131781 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.132212 23696 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:50.132829 23696 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.134349 23498 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:50.134480 23703 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:05:50.136238 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.138447 23701 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.139146 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:50.139387 21832 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:50.139292 23437 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:50.140473 22554 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.143940 21983 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:50.145179 23700 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:50.145946 23700 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.146394 21906 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:05:50.148304 23700 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:50.138501 23844 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:50.150346 23844 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:05:50.150978 22550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 415) took 1501 ms (client timeout 1713 ms). Trace:
I20260709 13:05:50.151412 23844 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.152575 23844 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:50.153389 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.153287 23593 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:50.154053 23593 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:50.155678 23732 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:50.156056 23732 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:50.156452 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:50.156911 23732 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:50.157524 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 48079.2us
I20260709 13:05:50.158280 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:50.159461 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:50.160851 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1342) took 2057 ms. Trace:
I20260709 13:05:50.160920 23703 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.161396 23703 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:50.161306 21979 rpcz_store.cc:276] 0709 13:05:48.103365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.218920 (+1115555us) service_pool.cc:224] Handling call
0709 13:05:49.219186 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.301380 (+ 82194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.160412 (+859032us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b54003f9154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:50.160694 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181268352}
I20260709 13:05:50.162595 23703 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.163857 23703 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.164692 21833 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:50.167543 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:50.168108 21834 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
W20260709 13:05:50.170598 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.170372 23593 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.173030 23841 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:50.173813 23841 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:50.125818 23562 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.175995 23562 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:50.151428 22550 rpcz_store.cc:269] 0709 13:05:48.649598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.651861 (+  2263us) service_pool.cc:224] Handling call
0709 13:05:49.416803 (+764942us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9eee 0000000000375939 00007fb763f2d1e0 00007fb763ff60c4 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:50.150722 (+733919us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400680e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:50.150883 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141326336}
W20260709 13:05:50.178673 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.179224 23593 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:50.179704 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.183900 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 46125.3us
I20260709 13:05:50.184705 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.128731 23847 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.189888 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:50.190014 21982 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.190815 21901 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:50.192771 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:50.192106 21905 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:50.193434 21906 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:50.192063 21982 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:50.195057 21978 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:50.158118 23732 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:50.197086 23562 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:50.210541 23562 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.213493 23562 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:50.214570 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:50.215410 23484 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:50.215932 23484 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:50.216807 23484 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.219033 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:50.220036 23843 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:50.220604 23843 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:50.223033 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:50.201781 23593 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.202932 21980 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:50.203397 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 81251.3us
I20260709 13:05:50.205957 21979 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:50.221627 23843 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.234442 21908 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:50.278775 21908 pending_rounds.cc:85] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 1
I20260709 13:05:50.237596 21978 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:50.279053 21908 pending_rounds.cc:107] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:50.279340 21908 raft_consensus.cc:2889] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:50.279788 23681 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.281167 23681 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.282212 23841 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.282570 23841 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:50.283491 23841 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.284991 23841 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:50.286296 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.199306 23696 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:50.189899 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:50.244724 21983 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:05:50.288264 21983 pending_rounds.cc:85] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 2
I20260709 13:05:50.288546 21983 pending_rounds.cc:107] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:05:50.288826 21983 raft_consensus.cc:2889] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:50.246861 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:50.247789 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:50.249526 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:50.186034 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.258386 23788 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.258663 23699 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:50.259001 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57867.5us
I20260709 13:05:50.259855 21833 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
W20260709 13:05:50.263689 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.277046 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:50.299738 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 109876us
W20260709 13:05:50.300786 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.301173 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 78252.6us
I20260709 13:05:50.303046 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.302892 23699 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.303578 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:50.304647 23653 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:50.305130 23653 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:50.305413 23699 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:50.305647 23724 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:50.306546 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 120654us
I20260709 13:05:50.306430 23653 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.307408 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.307588 23701 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:50.308332 23701 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:50.308812 23700 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:50.309062 23701 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:50.309420 23700 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:50.310369 23700 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:50.308920 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.303678 23696 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:50.340466 23696 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:50.341014 23696 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:50.341405 21730 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.342717 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:50.343163 21730 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 3, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:50.344913 21730 catalog_manager.cc:5697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 2, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.337540 23724 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:50.339824 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:50.308931 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:50.341189 21729 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33508 (request call id 199) took 9757 ms. Trace:
I20260709 13:05:50.354331 21729 rpcz_store.cc:276] 0709 13:05:40.583459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.583709 (+   250us) service_pool.cc:224] Handling call
0709 13:05:40.815330 (+231621us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540037bed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef48090 00007fb75efe6f3a 00007fb764d9d1cc 00007fb764e9b37e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc 00007fb76335b392 00007fb75d31948c 00007fb75d3188c6
0709 13:05:50.340940 (+9525610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:46.966062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:46.966628 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:46.966660 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:05:46.966677 (+    17us) tablet.cc:662] Decoding operations
0709 13:05:46.967646 (+   969us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:46.967714 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:46.967746 (+    32us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:05:46.968576 (+   830us) tablet.cc:701] Row locks acquired
0709 13:05:46.968596 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:05:46.971454 (+  2858us) write_op.cc:270] Start()
0709 13:05:46.981229 (+  9775us) write_op.cc:276] Timestamp: P: 1783602346968692 usec, L: 0
0709 13:05:46.981246 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:05:47.190534 (+209288us) log.cc:844] Serialized 3626 byte log entry
0709 13:05:47.856876 (+666342us) op_driver.cc:464] REPLICATION: finished
0709 13:05:48.155245 (+298369us) write_op.cc:301] APPLY: starting
0709 13:05:48.155353 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:48.155617 (+   264us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:48.155745 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:48.203799 (+ 48054us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:48.203998 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:05:48.204503 (+   505us) write_op.cc:312] APPLY: finished
0709 13:05:48.206728 (+  2225us) log.cc:844] Serialized 71 byte log entry
0709 13:05:48.206897 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:48.207024 (+   127us) write_op.cc:454] Released schema lock
0709 13:05:48.207071 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:48.207385 (+   314us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:48.207412 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66320,"reported_tablets":32,"spinlock_wait_cycles":368720256,"child_traces":[["op",{"apply.queue_time_us":293541,"apply.run_cpu_time_us":3551,"apply.run_wall_time_us":52135,"num_ops":9,"prepare.queue_time_us":137495,"prepare.run_cpu_time_us":84636,"prepare.run_wall_time_us":513447,"raft.queue_time_us":217882,"raft.run_cpu_time_us":35520,"raft.run_wall_time_us":235837,"replication_time_us":859673,"thread_start_us":508447,"threads_started":4,"wal-append.queue_time_us":363478,"wal-append.run_cpu_time_us":12233,"wal-append.run_wall_time_us":1649231}]]}
I20260709 13:05:50.365031 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:50.370501 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61722.3us
I20260709 13:05:50.362802 23701 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:50.377007 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 68240.7us
I20260709 13:05:50.360913 23788 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:05:50.372463 23810 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.380708 21908 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:50.373795 23654 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:50.375730 21730 catalog_manager.cc:5697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 5, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 5 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.369763 23732 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:05:50.391444 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:50.379928 23681 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:50.389240 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:50.377020 23701 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:50.369621 23685 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:05:50.397714 22519 leader_election.cc:400] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 3. Current term is 4.
I20260709 13:05:50.398120 22519 leader_election.cc:403] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:05:50.395568 21873 leader_election.cc:336] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.584s (SENT)
I20260709 13:05:50.395171 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:50.408722 21978 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:50.411126 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.415144 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:50.417186 23690 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:05:50.419034 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:50.419674 21834 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:50.419953 21834 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:50.420758 21834 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.421609 21834 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:50.422509 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1336) took 2578 ms. Trace:
I20260709 13:05:50.422719 21730 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.422909 21977 rpcz_store.cc:276] 0709 13:05:47.798433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.648047 (+849614us) service_pool.cc:224] Handling call
0709 13:05:48.648349 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:48.648685 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:49.874733 (+1226048us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b1800252940. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf 00007fb75eff8038
0709 13:05:49.981087 (+106354us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.355699 (+374612us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:50.356321 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:05:50.356484 (+   163us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:50.356719 (+   235us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.361951 (+  5232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.364054 (+  2103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:50.372883 (+  8829us) raft_consensus.cc:1685] finished
0709 13:05:50.372916 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.377121 (+  4205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50511,"prepare.queue_time_us":535600,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":74,"raft.queue_time_us":67577,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":11100,"spinlock_wait_cycles":11177344,"thread_start_us":434470,"threads_started":3,"wal-append.queue_time_us":50940}
I20260709 13:05:50.424237 21730 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.397142 23701 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:50.395114 23654 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:50.429828 21983 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:50.430639 21980 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
W20260709 13:05:50.434903 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55168.2us
I20260709 13:05:50.390318 23593 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:05:50.417661 23700 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.446110 21730 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 3 to 4, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.395619 23703 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:05:50.404891 23692 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:05:50.450120 23437 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:50.464452 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:05:50.483672 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 91401.8us
I20260709 13:05:50.455929 23582 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.492533 21980 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:50.465835 21730 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 4, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 4 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:05:50.502821 21730 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 4, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:50.505911 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.469817 21974 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:05:50.510838 21873 leader_election.cc:336] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.686s (SENT)
I20260709 13:05:50.445525 23724 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.456274 23463 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:05:50.513445 23760 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.465740 23696 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.510640 23681 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:05:50.549306 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.543256 23330 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:50.554793 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.560281 23700 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:50.571784 21905 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.572527 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:50.579600 21908 raft_consensus.cc:2410] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:50.575943 22554 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:50.581259 23681 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.582713 23498 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.583909 23498 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:50.584534 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.546936 23695 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:50.561959 23696 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:50.593062 21828 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:50.601187 21978 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:50.587792 21834 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:50.541436 23582 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.603523 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:50.605327 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 140937us
I20260709 13:05:50.610925 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:50.613771 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:50.614511 21829 raft_consensus.cc:2368] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 3. Current term is 4.
I20260709 13:05:50.576982 23330 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:50.613309 21827 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:50.616582 23846 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.616685 23843 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:50.625809 23843 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:50.626679 23843 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.627978 22554 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.541579 23654 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.587939 23498 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:50.636819 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:50.620852 22519 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:05:50.629951 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:50.641371 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.643144 23437 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 3. Current term is 4.
I20260709 13:05:50.618809 23330 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:50.603032 23593 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:05:50.646799 23695 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:50.651264 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:50.653505 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:50.667582 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 126446us
I20260709 13:05:50.671017 22555 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:50.653630 23653 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:50.648187 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:50.650486 23437 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:50.691082 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 47094.9us
I20260709 13:05:50.649184 23593 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:05:50.650374 23701 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.649814 23700 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:05:50.649766 23692 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:05:50.698110 23699 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:50.693017 21827 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:50.711130 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:50.711910 23679 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:05:50.712230 23863 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:50.715658 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.737972 23856 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:05:50.727694 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.726341 23653 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.647359 23498 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.730423 23700 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:50.732517 23701 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:50.732862 23692 consensus_queue.cc:1243] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:05:50.691908 23810 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.733551 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.734735 21827 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:50.739430 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:50.719340 23699 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:50.706418 23437 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:50.768592 23700 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:05:50.794319 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 55014.1us
I20260709 13:05:50.794937 21873 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.795841 23679 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:50.796247 23695 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:50.681314 23690 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:50.796988 23681 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:50.797214 23690 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:50.797698 23681 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:50.798215 23690 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.799378 23690 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:50.798844 23681 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.794442 23437 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.792171 23877 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.796248 23679 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:50.802109 23699 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.802817 23679 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:50.802506 23877 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.803174 23699 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:50.805302 23877 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:50.796298 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.806437 23866 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.806965 23866 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.808053 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.808759 23692 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:50.809166 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.810065 23695 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:50.809101 23866 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:50.810792 23866 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.811462 23866 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.810719 23695 raft_consensus.cc:2764] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:50.812274 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:50.754338 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 62576.2us
I20260709 13:05:50.744314 23857 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:50.823478 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.827942 23653 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:50.832885 23703 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:50.809114 23692 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.839769 23877 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:50.840106 23692 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:50.840240 23877 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:50.840670 23877 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:50.839797 21828 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:50.841744 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:50.851816 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:50.852857 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:50.855342 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 58790.3us
I20260709 13:05:50.851438 23701 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:50.859614 23701 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.859954 23701 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:50.861502 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 128050us
I20260709 13:05:50.829756 23679 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.869139 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.870862 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:50.873965 21833 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:50.879266 23895 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:50.885831 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.897085 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:50.821501 23863 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.848758 23695 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:05:50.896135 21827 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:50.931571 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:50.894625 23582 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:50.932583 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 85587.3us
I20260709 13:05:50.934783 21906 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:50.924578 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 80196.8us
I20260709 13:05:50.868813 23654 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 13:05:50.924942 23887 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:05:50.896217 23593 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:05:50.955518 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 75976.3us
I20260709 13:05:50.961761 21901 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:50.984413 23858 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:50.985049 23850 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.530s	user 0.000s	sys 0.003s
I20260709 13:05:50.987792 23902 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.988415 23902 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:50.991418 23700 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:50.992590 23700 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:50.995322 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 126279us
I20260709 13:05:50.996081 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:50.997655 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:50.997828 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:50.998229 21982 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
W20260709 13:05:50.999823 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 89420.4us
I20260709 13:05:51.002368 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:50.964423 23654 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:51.016131 23654 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:51.016801 23881 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.017035 23654 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.017325 23881 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.018525 23330 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.019476 23498 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:51.021736 22554 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:51.005642 23863 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:51.006608 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.006784 23849 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:50.997455 23484 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:51.007092 23463 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.008417 23760 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.009117 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.009047 23681 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.010529 23894 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.011138 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.014827 21980 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:50.985090 23858 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.027061 21979 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:51.029228 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:51.117007 21983 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:51.039690 21982 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:05:51.026937 23330 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.043550 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:51.044595 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:51.020623 23857 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:51.038232 23703 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:51.080488 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.084985 23897 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:51.085511 23701 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.090824 21902 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:51.092017 23888 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:51.070921 23484 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:51.069772 23849 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:51.170866 23849 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:51.095775 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.174237 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:51.096679 21901 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:51.175606 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.176635 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.177146 21901 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:51.177821 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:51.077906 21906 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:51.178908 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.179803 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.180734 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.181656 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:51.063490 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 202317us
I20260709 13:05:51.113596 21798 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:51.119591 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.119966 22548 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:51.121658 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.122714 21907 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:51.123059 21900 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:05:51.123674 23870 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:05:51.134557 23894 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.083663 23866 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.134018 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.135576 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:51.071262 23463 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:51.136541 23871 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:05:51.136627 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:51.137501 22550 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:51.138041 23685 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:51.137956 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 94500.1us
I20260709 13:05:51.136668 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.182022 23692 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.141381 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.160137 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:51.161150 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.141911 23330 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.136754 23896 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:51.166110 21903 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:51.166210 23897 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.168545 23788 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.210779 23330 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.223223 23788 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.224679 23897 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:51.225200 23788 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.183197 23881 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:51.185711 21976 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:51.225505 23905 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:05:51.211804 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.193939 23894 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.183125 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:51.227564 21980 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:51.185963 23701 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:51.228298 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45273.1us
I20260709 13:05:51.201567 23858 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:51.183476 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 69962.9us
I20260709 13:05:51.226550 23593 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:51.229838 23593 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:51.214522 21903 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.230723 23593 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.231927 23593 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:51.232467 21903 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:51.233444 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.233738 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.225247 23330 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.213716 23732 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:51.186671 21900 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:51.235100 23732 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:51.215050 23696 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:51.235841 23696 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:51.236228 23732 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.236708 23696 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.186736 23582 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:51.216013 23463 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.191154 21902 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:05:51.217207 23891 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:51.192076 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:51.218312 23562 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:51.195082 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.195921 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:51.202553 23685 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:51.203608 23890 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:05:51.204229 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:51.260917 21982 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:51.204830 23534 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:05:51.206808 23679 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.207515 23844 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:51.209786 21983 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:51.210210 21979 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:51.185717 21907 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:51.195981 23902 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:51.235188 21900 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:51.187376 23484 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.213974 23877 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:51.246874 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.182130 21906 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:51.211962 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:51.210469 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.229375 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:51.222721 22550 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:51.211279 23692 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.259619 21977 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:51.163576 23703 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.262341 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:51.253068 21902 pending_rounds.cc:85] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 1
I20260709 13:05:51.258893 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:51.262670 21829 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:05:51.263159 21904 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:51.238059 23696 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:51.228381 23701 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:51.238011 23732 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:51.281579 21903 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:51.211048 23695 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.283300 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 109159us
I20260709 13:05:51.284459 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.284654 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:51.284812 21900 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.285295 23724 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:51.264415 23844 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:51.260754 23685 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:51.323108 21832 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:51.282157 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.293787 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.326308 23866 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:51.326761 23866 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.327080 23866 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:51.326298 21834 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:51.328554 21904 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:51.329854 21904 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:51.294369 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.330514 21982 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:51.295153 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.331563 21978 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:51.254194 23582 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.332199 23582 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:51.332670 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.297534 23841 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.305382 23703 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:51.335916 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.337226 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.337739 21904 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:51.339143 23885 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.338842 23844 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.339602 23885 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.340041 23844 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:51.341791 23885 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.318322 23699 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:51.333599 23841 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.344250 23841 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:51.344516 23877 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.302719 21902 pending_rounds.cc:107] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:05:51.307683 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 78398.2us
I20260709 13:05:51.309526 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.345288 21908 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:51.345425 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:51.345494 21980 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
W20260709 13:05:51.318755 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 59939.6us
I20260709 13:05:51.280910 23905 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.346963 23877 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:51.346633 23905 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.249915 23857 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.349205 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.351655 21902 raft_consensus.cc:2889] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:51.351984 21902 pending_rounds.cc:107] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:51.352205 21902 raft_consensus.cc:2889] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:51.353292 21833 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:05:51.319499 23724 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:51.353982 23724 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.354944 21834 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.358399 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:51.358744 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.359074 21905 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:51.280434 23858 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:51.360864 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 45913.1us
I20260709 13:05:51.361249 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:51.346931 21908 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:51.362334 22520 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:51.338521 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.302064 22519 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:51.299752 23654 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.363754 21904 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:51.399480 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:51.367172 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65948.1us
I20260709 13:05:51.402997 21834 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:51.403525 21900 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:51.353430 23690 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.000s
I20260709 13:05:51.408979 21980 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:51.409489 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:51.379967 21977 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
W20260709 13:05:51.411370 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.359104 23890 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.365911 23330 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:51.399080 23885 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:51.427968 21834 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:51.422250 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.405203 23437 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:51.408310 23849 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.436792 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:51.437479 21829 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:05:51.438330 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:51.412616 23863 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:05:51.418613 23681 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:05:51.414774 23858 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.445771 23852 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:51.446606 23846 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:51.447057 23861 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:51.447986 23863 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:51.448377 23863 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:51.449366 23863 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.451037 23863 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:51.454589 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.455788 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:51.458390 23849 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.498750 23890 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.406376 23654 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.521879 23857 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:51.522992 23685 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.524021 23902 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.524689 23906 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.402544 23841 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:05:51.432948 23843 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:51.364661 23695 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.436230 21826 pending_rounds.cc:85] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 1
I20260709 13:05:51.767525 21826 pending_rounds.cc:107] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:05:51.767824 21826 raft_consensus.cc:2889] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:51.547570 23498 consensus_meta.cc:287] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260709 13:05:51.548070 23582 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:51.741849 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:51.742118 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:51.784842 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:51.785175 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:51.785985 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.742995 21831 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:51.743773 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:51.745209 21901 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:51.523798 23810 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:05:51.746498 21900 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:51.792299 21900 pending_rounds.cc:85] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 2
W20260709 13:05:51.791950 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 390768us
I20260709 13:05:51.752379 21829 raft_consensus.cc:2368] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 3. Current term is 4.
W20260709 13:05:51.741636 21873 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.795s (SENT) [suppressed 26 similar messages]
I20260709 13:05:51.769270 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.780514 23889 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:05:51.735479 23703 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.792565 21900 pending_rounds.cc:107] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:51.801234 21900 raft_consensus.cc:2889] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:51.782260 21909 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:51.793713 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:05:51.797478 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.797981 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.804692 21829 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:51.805341 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.766744 23681 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.812475 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.739533 23760 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:05:51.747457 23690 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 13:05:51.816193 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 79320.9us
I20260709 13:05:51.831043 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:51.816629 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:51.791754 23905 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:51.756713 23857 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 13:05:51.821959 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 81122.7us
I20260709 13:05:51.794754 23858 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:51.742472 23852 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:05:51.759864 23724 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.760735 23902 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:51.839157 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:51.818451 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.838641 21833 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:05:51.843930 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.817193 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:51.845003 21831 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:51.837761 21902 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:51.769572 23866 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.851431 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:51.886667 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:51.888226 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:51.889660 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.890933 21982 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:51.817306 23463 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:05:51.892307 21978 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:51.842115 21827 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:51.838572 23696 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:51.882246 23844 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:51.838045 23681 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:51.923214 21983 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:51.907605 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:51.882607 23861 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:51.922744 21834 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:51.895881 23877 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:51.935250 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:51.895520 23905 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:51.921638 23484 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.945358 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:51.951747 21825 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:51.952788 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 144052us
I20260709 13:05:51.940496 23685 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:51.953811 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:51.963678 21834 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:51.929013 23330 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:51.802670 23906 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:51.928365 23849 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:51.932204 23844 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:51.978076 21982 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:51.938629 23843 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:51.952582 23498 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:51.982812 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 241186us
W20260709 13:05:51.969136 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 138172us
I20260709 13:05:51.968542 23330 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.979378 23844 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.009393 22555 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:51.978016 23699 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:51.937222 23696 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:05:51.998811 23732 consensus_meta.cc:287] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.010s
I20260709 13:05:51.975533 23654 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.010797 23330 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:51.976142 23484 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.015206 23890 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:52.037456 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 192375us
I20260709 13:05:52.038280 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:52.010605 23852 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:05:51.998498 23843 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.022771 23699 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:52.011690 23861 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:05:52.013984 23463 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:05:52.026525 23582 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.028029 23703 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:52.047871 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 75999.1us
I20260709 13:05:52.053004 22555 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:52.065223 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:52.066020 21907 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:52.068007 23902 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:52.095583 23919 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:05:52.096716 23923 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.096071 23920 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:05:52.057960 23685 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.063369 23866 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:52.119876 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 594601us
I20260709 13:05:52.123435 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:52.125984 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:52.103891 23918 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 13:05:52.128126 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 164109us
W20260709 13:05:52.132205 23913 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 13:05:52.134774 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:52.142078 23696 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.142637 23582 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.075184 23905 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:05:52.143046 23582 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:52.143472 23582 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.115727 23923 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.103541 23931 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:52.152159 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47739us
I20260709 13:05:52.145972 23923 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.127585 23902 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.172155 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:52.178949 21873 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:52.182580 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:52.189956 21826 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:52.180172 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:52.190716 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 64834.2us
I20260709 13:05:52.193295 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:52.205550 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.155505 23931 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:52.220993 21826 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 2: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:52.178682 23463 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.173840 23902 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:52.234719 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:52.236934 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.169956 23703 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:05:52.190007 23920 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:52.149554 23685 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:52.253671 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.254935 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76055.2us
I20260709 13:05:52.255971 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:52.242710 21980 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:52.198212 23861 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.206768 23905 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:52.247382 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 48736.4us
I20260709 13:05:52.261755 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:52.205623 23866 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.251361 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:52.258301 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:52.264012 21974 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:52.263535 21977 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:52.265864 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.265828 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.259850 23696 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:52.266776 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.267504 23685 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.268101 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.268723 23944 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:52.269338 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:52.269876 21907 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.204169 23699 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.272408 23866 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.273775 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:52.275031 23866 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.275688 23866 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:52.267869 23788 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:52.217109 23931 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:52.274389 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.280836 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:52.247119 23902 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.240231 23927 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:52.288084 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.291915 21830 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:52.267367 23696 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:52.276088 23866 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.298784 22555 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:52.305902 21907 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:52.308354 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:52.311476 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.311872 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:52.314116 21905 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.016s	sys 0.053s
W20260709 13:05:52.320611 21905 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.017s	sys 0.053s
W20260709 13:05:52.320832 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.284340 23890 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.245960 23463 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.314105 23866 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:52.344836 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.337656 23890 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:52.262552 23920 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.342854 23843 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:52.343508 23891 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:52.350987 23484 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.294327 23861 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:52.386435 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 130569us
I20260709 13:05:52.371147 23890 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:52.376662 23941 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:05:52.367470 23905 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:52.369239 23944 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:52.396380 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.368003 22550 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:52.370702 22548 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:52.374709 23703 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:52.313656 23927 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:52.404482 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.401618 21831 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:52.392180 23891 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:52.415548 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:52.398747 23699 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:52.419922 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:52.422341 22554 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:52.429078 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.432003 21831 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:52.434093 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.434875 22553 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:52.444180 21834 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:52.446641 21834 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:52.407146 23944 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.463099 21831 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:52.465633 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:52.399942 23939 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.467756 21834 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:52.420046 23703 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.479738 23944 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.482525 23964 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.430469 23699 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.484539 21977 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:52.442901 23685 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:52.423065 23962 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:52.483660 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:52.462024 23923 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:52.507630 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1469) took 1192 ms. Trace:
I20260709 13:05:52.385073 23936 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.285s
I20260709 13:05:52.487727 23939 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:52.515378 23463 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.515807 23703 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.498716 23944 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:52.516199 23945 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:05:52.516408 23944 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:52.516822 23944 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:52.506963 23692 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:52.518500 23692 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:52.519426 23947 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:05:52.519366 23958 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:05:52.520642 23940 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.521194 23940 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:52.522271 23932 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:05:52.523804 23957 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:52.461061 23905 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.526365 23939 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.526911 23582 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:52.528193 23956 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:52.528419 23927 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:52.529016 23582 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.529767 23861 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:52.531195 23959 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:05:52.532598 23844 consensus_meta.cc:287] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.506s	user 0.004s	sys 0.004s
I20260709 13:05:52.532967 23844 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.533981 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:52.534789 23920 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.535189 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:52.535981 21904 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:52.498906 23964 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.536736 23940 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.538282 23964 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.538935 21834 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:52.539850 23915 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.702s	user 0.000s	sys 0.003s
I20260709 13:05:52.534416 23330 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.507392 23891 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.542549 23330 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.542747 23906 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.543316 22555 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:52.544162 23679 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:52.544576 23679 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:52.545284 23969 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.545380 23679 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.545884 23969 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.553861 21974 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:52.554139 23681 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.509760 21905 rpcz_store.cc:276] 0709 13:05:51.315433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.359736 (+ 44303us) service_pool.cc:224] Handling call
0709 13:05:51.404293 (+ 44557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.411376 (+  7083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.411412 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.433353 (+ 21941us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.759422 (+326069us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:52.321848 (+562426us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.499178 (+177330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.499249 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.507394 (+  8145us) raft_consensus.cc:1685] finished
0709 13:05:52.507415 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.507567 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":612053,"prepare.run_wall_time_us":37,"raft.queue_time_us":74347,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7978,"spinlock_wait_cycles":7410432,"thread_start_us":1017679,"threads_started":3,"wal-append.queue_time_us":465710}
I20260709 13:05:52.555060 23844 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:52.557534 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1424) took 1156 ms. Trace:
I20260709 13:05:52.512892 23923 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:52.558559 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 75001.7us
I20260709 13:05:52.591632 21799 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:52.562911 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:52.595024 21974 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:05:52.601941 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:52.603659 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.582736 21832 rpcz_store.cc:276] 0709 13:05:51.400833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.400960 (+   127us) service_pool.cc:224] Handling call
0709 13:05:51.412424 (+ 11464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:51.438731 (+ 26307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.438757 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:51.470714 (+ 31957us) log.cc:844] Serialized 52 byte log entry
0709 13:05:52.218104 (+747390us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:52.244060 (+ 25956us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.493866 (+249806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.493975 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.557353 (+ 63378us) raft_consensus.cc:1685] finished
0709 13:05:52.557371 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.557492 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28170,"prepare.queue_time_us":30536,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":31858,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"thread_start_us":681107,"threads_started":2,"wal-append.queue_time_us":803407}
I20260709 13:05:52.586512 23685 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.595834 23962 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:52.562386 23902 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.586241 23944 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.610764 23685 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.594280 23955 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:05:52.618727 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.628363 23685 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.640408 23961 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:05:52.622792 23962 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:52.650496 23934 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.429s	user 0.000s	sys 0.002s
I20260709 13:05:52.650975 23699 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.658800 23696 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.661978 23944 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.660602 23890 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.661360 22550 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:52.662111 23696 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.668159 23696 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.666958 23890 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.661429 23685 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.671512 23923 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.632115 23788 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.679447 23902 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.680397 23696 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:52.674515 23931 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.653712 23866 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.633275 23937 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 13:05:52.699532 23931 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.700779 23969 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.702997 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:52.703735 21974 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.683549 23788 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.687202 23696 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:52.718866 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:52.719696 21980 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:52.720854 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:52.721704 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:52.722967 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:52.723762 21976 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:52.723523 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:52.724458 23681 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.724704 21975 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:52.724985 23681 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.727205 23681 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.710462 23788 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.709781 23866 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.733492 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1449) took 1284 ms. Trace:
I20260709 13:05:52.734683 21828 rpcz_store.cc:276] 0709 13:05:51.448629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.851390 (+402761us) service_pool.cc:224] Handling call
0709 13:05:51.852074 (+   684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.861385 (+  9311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.861429 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.919096 (+ 57667us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.034624 (+115528us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:52.034679 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.034768 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.644669 (+609901us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:05:52.731566 (+ 86897us) raft_consensus.cc:1685] finished
0709 13:05:52.731595 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.733429 (+  1834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5005,"raft.queue_time_us":17553,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8689,"spinlock_wait_cycles":43011328,"thread_start_us":99965,"threads_started":1,"wal-append.queue_time_us":248852}
I20260709 13:05:52.751641 21974 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:52.757015 23962 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.752868 23696 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.758659 23696 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.754361 23685 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.787369 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 140) took 1594 ms. Trace:
I20260709 13:05:52.787801 21901 rpcz_store.cc:276] 0709 13:05:51.193060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.211736 (+ 18676us) service_pool.cc:224] Handling call
0709 13:05:52.787193 (+1575457us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540034a654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:52.787291 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516872960}
I20260709 13:05:52.754122 23939 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.808549 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1447) took 1456 ms. Trace:
I20260709 13:05:52.808960 21833 rpcz_store.cc:276] 0709 13:05:51.358057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.358511 (+   454us) service_pool.cc:224] Handling call
0709 13:05:52.808363 (+1449852us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54000e92d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:52.808489 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098174720}
I20260709 13:05:52.809346 23788 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.811888 23724 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:52.815110 21909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1454) took 1694 ms (client timeout 2149 ms). Trace:
W20260709 13:05:52.815526 21909 rpcz_store.cc:269] 0709 13:05:51.120655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.121278 (+   623us) service_pool.cc:224] Handling call
0709 13:05:52.814896 (+1693618us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54002f58d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:52.815045 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374611840}
I20260709 13:05:52.816664 21903 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:52.818063 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1460) took 1609 ms. Trace:
I20260709 13:05:52.823273 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.823938 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.824357 21828 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:52.822494 21903 rpcz_store.cc:276] 0709 13:05:51.208346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.365490 (+157144us) service_pool.cc:224] Handling call
0709 13:05:52.816333 (+1450843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.817032 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.817878 (+   846us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54002f58d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:52.817998 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3232825088}
I20260709 13:05:52.826611 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.826637 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:52.828337 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:52.828754 21826 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.827298 21832 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:52.826293 22521 leader_election.cc:400] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 3 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 3. Current term is 4.
I20260709 13:05:52.829978 21834 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:52.831358 21831 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:52.825470 23857 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.833344 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.834712 21832 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:52.834827 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:52.837343 23866 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:52.838871 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:52.839553 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:52.837769 23866 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.840435 23866 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:52.840289 23931 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:05:52.835508 23857 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.843004 23885 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.843391 23885 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.843641 23857 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.843729 23885 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.844648 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:52.845661 23931 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.847352 21826 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:52.848412 23695 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.851727 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:52.852202 23695 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:52.854275 23962 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:52.854511 23920 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.854389 23695 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.854809 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:52.854970 23920 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:52.855480 23920 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.855983 23463 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:52.856468 23463 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:52.857353 23463 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.858506 23877 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:52.854857 23962 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.863402 23897 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:52.864355 23962 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.865633 23939 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.856432 23695 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.862640 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:52.863648 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1418) took 1606 ms. Trace:
W20260709 13:05:52.867708 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.869853 21826 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:52.868582 21827 rpcz_store.cc:276] 0709 13:05:51.257314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.258368 (+  1054us) service_pool.cc:224] Handling call
0709 13:05:51.305112 (+ 46744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.919268 (+614156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.863394 (+944126us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400288cd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:52.863587 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156293376}
I20260709 13:05:52.861984 23692 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.879998 23889 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:52.852859 23891 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:05:52.881055 23891 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:52.880024 23967 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:52.881619 23891 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:52.881846 23967 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.882565 23891 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.883694 23891 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.884169 23967 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.888492 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:52.887318 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:52.862063 23877 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.889891 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:52.891489 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:52.891970 21901 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:52.892238 21906 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 1.
I20260709 13:05:52.890470 21902 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:52.890055 23724 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.894424 23724 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.895131 21903 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:52.896476 23724 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:52.875211 23939 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.897454 21830 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:52.897738 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:52.899511 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:52.899968 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:52.900238 21900 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:52.898504 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.898901 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:52.903487 21904 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:52.893097 23889 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:05:52.903501 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1444) took 1608 ms. Trace:
I20260709 13:05:52.906536 21825 rpcz_store.cc:276] 0709 13:05:51.294662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.295642 (+   980us) service_pool.cc:224] Handling call
0709 13:05:51.564483 (+268841us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5800010598. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:05:51.749882 (+185399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.969656 (+219774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.903293 (+933637us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b540011ec54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:52.903446 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48949760}
I20260709 13:05:52.907554 23877 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.893200 23923 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:05:52.909512 23927 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:52.909840 23927 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:52.910676 23927 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.911362 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:52.911710 23921 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.836s	user 0.000s	sys 0.004s
I20260709 13:05:52.913424 23846 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:52.913605 23724 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:52.914000 23846 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.913470 23681 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.915741 23681 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.916011 23846 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.916703 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:52.918255 21908 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:05:52.918530 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.919359 21834 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:52.921041 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:52.921821 21826 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:52.924628 23681 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:52.891968 23885 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.926735 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.951659 22554 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:52.951818 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:52.927557 23861 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.952638 23861 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.953627 23861 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.940063 23877 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:52.925209 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.954530 23877 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.956745 23877 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.957558 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:52.879074 23962 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.945612 23866 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.958231 22554 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:52.958289 23962 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.959762 23866 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.933550 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:52.960486 23962 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.934046 21902 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:52.938675 21908 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:52.937930 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:52.875692 23695 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:52.897476 23939 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.962482 23695 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:52.943888 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:52.964069 23939 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.964495 23695 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.946462 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:05:52.965167 23954 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.553s	user 0.001s	sys 0.001s
I20260709 13:05:52.965725 23846 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.966137 23846 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.966475 23846 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.954046 23885 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.935271 23679 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.950989 23788 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:52.942024 23654 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.960348 23866 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.961024 21827 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:52.961871 23897 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.964619 22550 raft_consensus.cc:2368] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6.
I20260709 13:05:52.940868 23857 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:52.991756 23897 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.992296 23857 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:52.960446 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1429) took 1200 ms. Trace:
W20260709 13:05:52.969377 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45411.9us
I20260709 13:05:52.993448 21830 rpcz_store.cc:276] 0709 13:05:51.760444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.319037 (+558593us) service_pool.cc:224] Handling call
0709 13:05:52.319343 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.897312 (+577969us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54000cb0a0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef55dc0 00007fb75efe01c0 00007fb75efe1231 00007fb75efddd8f 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c
0709 13:05:52.897867 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.960183 (+ 62316us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b54000cb0a0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef55dc0 00007fb75efe1a02 00007fb75efdddd6 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:05:52.960390 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441746432}
I20260709 13:05:52.994244 23897 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:52.891637 23967 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 13:05:52.972857 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.999104 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:53.000434 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:52.938004 21904 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:52.961817 23931 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:53.004199 21799 leader_election.cc:400] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6.
I20260709 13:05:53.004863 21799 leader_election.cc:403] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:53.001752 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:53.011101 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:53.012209 22554 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.025271 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:52.966866 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:53.030711 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:53.037532 22554 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:53.038611 21799 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:53.008976 23732 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:53.041936 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:53.009204 23858 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.009717 23897 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:53.002372 23724 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:05:53.002595 23681 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:05:53.000042 23654 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.029000 23963 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:53.003341 23866 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:53.053906 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:53.058279 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 62584.8us
I20260709 13:05:53.003969 23374 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:05:53.041774 23788 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:53.044306 23732 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.070971 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:53.047045 23897 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:53.078714 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:53.079479 21902 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:53.061247 23963 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:53.074607 23732 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:53.095253 23963 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.096453 23963 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:53.103482 23866 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:53.105983 22550 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:53.111599 23681 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:53.112257 23681 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.075251 23374 consensus_queue.cc:1243] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:53.077634 23788 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:53.115583 23999 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.077744 23897 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.116109 23999 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.117036 23920 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:53.115231 23788 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:53.122443 23861 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.123018 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1448) took 1674 ms. Trace:
I20260709 13:05:53.124560 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:53.131474 21873 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.731s (SENT)
I20260709 13:05:53.128466 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.097579 23846 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:53.145069 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:53.148800 21904 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:53.155314 21901 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:53.159147 22548 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:53.150674 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:53.165023 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:53.151328 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:53.152684 21900 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:53.152805 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:53.146337 21829 rpcz_store.cc:276] 0709 13:05:51.448346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.805341 (+356995us) service_pool.cc:224] Handling call
0709 13:05:51.805619 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.818525 (+ 12906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.818568 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.866570 (+1048002us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b2c000014c8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:05:52.866916 (+   346us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.969158 (+102242us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:52.969198 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.969265 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.122739 (+153474us) raft_consensus.cc:1685] finished
0709 13:05:53.122758 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.122961 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2227,"raft.queue_time_us":18326,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":6666,"spinlock_wait_cycles":4424576,"thread_start_us":95686,"threads_started":1,"wal-append.queue_time_us":147838}
I20260709 13:05:53.153384 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.167783 22552 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:53.169054 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:53.168293 21977 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:53.129070 23906 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.177572 21900 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:53.171973 21798 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:53.179128 21798 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:53.180568 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49134.5us
I20260709 13:05:53.153765 23999 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:53.171054 23924 raft_consensus.cc:2764] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:53.191908 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:53.197620 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 164202us
I20260709 13:05:53.198484 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.198683 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.202054 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.203605 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.206251 21983 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:53.208681 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:53.182603 23889 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:53.209635 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.210011 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:53.216216 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:53.217146 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.217618 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.169929 23895 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:05:53.214085 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.217862 21974 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:53.218508 21983 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:53.217657 21981 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:05:53.218472 21979 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:05:53.223744 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.207942 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:53.193599 23890 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:53.224395 21983 raft_consensus.cc:2376] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5. Re-sending same reply.
I20260709 13:05:53.227480 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.229030 21907 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:53.230602 21983 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:53.229074 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:53.232643 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:53.235839 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.236192 21982 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:53.206079 23999 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:53.242266 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:53.242261 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.238696 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.180094 23906 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.244244 21907 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:05:53.241288 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.242020 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.244125 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:53.240780 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.245394 21976 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:53.245675 21982 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.222265 23942 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:53.286958 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 72096.8us
I20260709 13:05:53.231014 23955 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:53.230854 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.238974 23846 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:53.322499 21907 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:53.218689 24002 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
W20260709 13:05:53.631764 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 308304us
I20260709 13:05:53.632493 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:53.378883 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 157188us
I20260709 13:05:53.450980 21982 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:05:53.652506 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:53.646234 21873 leader_election.cc:336] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 2.074s (SENT)
I20260709 13:05:53.653935 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:53.655701 21979 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:53.286614 23942 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.686470 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.247877 24003 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:53.317377 23955 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:53.331143 24001 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:05:53.466959 23992 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:05:53.695032 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:53.412863 23788 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:53.316207 23890 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:53.329074 23685 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:53.248034 23999 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:53.533983 23654 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:53.649827 23920 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:53.706974 23955 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:53.659142 23858 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.003s
I20260709 13:05:53.333388 24000 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:53.758313 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 63357.7us
I20260709 13:05:53.658922 23846 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:53.689837 23892 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:53.690637 23942 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:53.779644 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.696967 24003 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.708878 23724 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.754706 23889 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:53.799530 23724 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.799934 23889 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.801575 23724 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:53.801796 24007 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:05:53.756582 23861 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:53.790156 21905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.018s	sys 0.046s
I20260709 13:05:53.803514 23534 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:53.804001 23534 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:53.804219 24003 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:53.804935 23534 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:53.811018 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.811633 21974 raft_consensus.cc:2376] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6. Re-sending same reply.
I20260709 13:05:53.813045 21981 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:53.813472 21981 pending_rounds.cc:85] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 2
I20260709 13:05:53.813759 21981 pending_rounds.cc:107] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:53.814159 23534 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.814235 21981 raft_consensus.cc:2889] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:53.791638 23846 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:53.816936 23861 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:53.817425 23861 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:53.803560 21905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.018s	sys 0.046s
I20260709 13:05:53.819407 23861 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:53.824980 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.778049 23679 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:53.783219 24000 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.791965 23858 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6.
I20260709 13:05:53.842319 21730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 123) took 3758 ms. Trace:
I20260709 13:05:53.776940 23654 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.769112 23685 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.843009 21979 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:53.822420 23967 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.821491 23906 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:53.772418 23788 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.837288 23679 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.816265 23846 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.871922 23846 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:53.876825 24009 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:53.877442 24008 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:53.878399 24009 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:53.879225 24008 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:53.880693 21827 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:53.866055 23654 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:53.848136 24000 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:53.882740 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:53.883474 23654 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:53.883702 22552 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:53.884030 23654 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:53.885457 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.887320 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:53.847103 21730 rpcz_store.cc:276] 0709 13:05:50.062386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.066363 (+  3977us) service_pool.cc:224] Handling call
0709 13:05:50.170301 (+103938us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b54001e0690. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beba0b2 00007fb764e33a89 00007fb764dcbda6 00007fb764d9d088 00007fb764e9b37e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc
0709 13:05:53.821011 (+3650710us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:51.138603 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:51.139259 (+   656us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:51.139312 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:05:51.139329 (+    17us) tablet.cc:662] Decoding operations
0709 13:05:51.205451 (+ 66122us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:51.205542 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:51.205576 (+    34us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:05:51.206385 (+   809us) tablet.cc:701] Row locks acquired
0709 13:05:51.206431 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:05:51.206604 (+   173us) write_op.cc:270] Start()
0709 13:05:51.206762 (+   158us) write_op.cc:276] Timestamp: P: 1783602351206529 usec, L: 0
0709 13:05:51.206796 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:05:51.207522 (+   726us) log.cc:844] Serialized 3601 byte log entry
0709 13:05:52.346455 (+1138933us) op_driver.cc:464] REPLICATION: finished
0709 13:05:52.651135 (+304680us) write_op.cc:301] APPLY: starting
0709 13:05:52.651265 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:52.651501 (+   236us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:52.651638 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:52.659218 (+  7580us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:52.659647 (+   429us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:05:52.659711 (+    64us) write_op.cc:312] APPLY: finished
0709 13:05:52.660080 (+   369us) log.cc:844] Serialized 71 byte log entry
0709 13:05:52.694209 (+ 34129us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:52.701768 (+  7559us) write_op.cc:454] Released schema lock
0709 13:05:52.708799 (+  7031us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:52.718482 (+  9683us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:52.718521 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9,"reported_tablets":17,"spinlock_wait_cycles":2751744,"child_traces":[["op",{"apply.queue_time_us":278086,"apply.run_cpu_time_us":4113,"apply.run_wall_time_us":82882,"num_ops":9,"prepare.queue_time_us":531326,"prepare.run_cpu_time_us":137222,"prepare.run_wall_time_us":282622,"raft.queue_time_us":134489,"raft.run_cpu_time_us":10993,"raft.run_wall_time_us":277119,"replication_time_us":1106735,"thread_start_us":735778,"threads_started":4,"wal-append.queue_time_us":687869,"wal-append.run_cpu_time_us":36272,"wal-append.run_wall_time_us":1782465}]]}
I20260709 13:05:53.888082 22552 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:53.890033 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.894222 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:53.896821 21908 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:53.892510 23788 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:53.897399 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:53.906847 21901 raft_consensus.cc:2376] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5. Re-sending same reply.
I20260709 13:05:53.907132 21981 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:53.898396 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:53.899288 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:53.900461 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.908315 22552 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:53.901427 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:53.896917 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:53.909502 22555 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:53.917008 22551 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:53.918781 23892 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:53.919946 23732 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.802s	user 0.006s	sys 0.004s
I20260709 13:05:53.920367 23732 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:53.921435 21830 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:53.922197 23969 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:53.922746 23969 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:53.922837 24010 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:05:53.922868 23906 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:53.924247 23906 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:53.923745 23969 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:53.924594 23906 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:53.925396 23906 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:53.919864 23892 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:53.939121 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.937649 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.963932 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:05:53.958081 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 66734.9us
I20260709 13:05:53.966979 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:53.968596 23923 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:53.969116 23923 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:53.973574 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:53.908375 21976 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:05:53.900990 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:53.907799 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.009385 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.975566 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.009743 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:54.010061 21983 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:53.902267 23679 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.925304 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:53.976523 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:05:53.964911 23895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.035s	sys 0.044s
I20260709 13:05:54.006335 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.042989 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.007371 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:54.043767 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 77868.8us
I20260709 13:05:54.044072 21982 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.012797 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:54.044754 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:53.936683 23999 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:54.022607 21908 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:53.938687 24012 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.964201 23498 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:54.056260 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.056555 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.053206 21982 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:54.016258 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:54.055549 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.058911 21826 raft_consensus.cc:2410] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:54.059141 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.059794 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.060770 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.974861 23732 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:53.986277 23886 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:54.062628 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:53.987885 23857 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:53.974917 23841 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:54.065719 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 419504us
W20260709 13:05:54.088531 21873 leader_election.cc:336] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 2.128s (SENT)
I20260709 13:05:54.043370 23463 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:53.901619 23890 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.066346 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.056303 23906 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:54.064227 23498 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.069800 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.070557 23927 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.969985 23923 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:54.048367 23895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.035s	sys 0.044s
I20260709 13:05:54.074236 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:54.062618 24012 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.078488 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.109308 21900 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 1.
I20260709 13:05:54.078585 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.078743 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.079147 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.110790 21903 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:54.079811 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:54.112664 21982 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:54.060091 23844 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:05:54.081156 23732 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:54.082011 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 192) took 1054 ms. Trace:
I20260709 13:05:54.127252 21827 rpcz_store.cc:276] 0709 13:05:53.027783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.027946 (+   163us) service_pool.cc:224] Handling call
0709 13:05:54.081869 (+1053923us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b540011dd54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:54.081960 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910743296}
I20260709 13:05:54.128593 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.123637 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:54.082811 23681 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:54.131157 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.085294 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 308) took 1187 ms. Trace:
I20260709 13:05:54.086927 23942 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.056497 24002 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:54.094125 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.150610 21974 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
W20260709 13:05:54.096709 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.153429 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.059324 23943 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:54.057420 23998 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.057902 24009 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:54.068347 23690 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:54.094741 23841 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.126127 23861 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:54.095045 23857 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:54.102375 22547 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:54.115641 21908 raft_consensus.cc:2393] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:54.116093 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.080664 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.120694 21902 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:54.122893 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.064033 23999 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:05:54.130061 21831 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:05:54.108949 23897 consensus_meta.cc:287] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.993s	user 0.007s	sys 0.003s
I20260709 13:05:54.195950 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.128865 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.198897 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.147401 21982 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:54.155879 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.196722 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.112310 23685 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:54.114389 23463 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:54.105953 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.195801 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.115478 24003 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.202222 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.156888 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.197221 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.194506 21900 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:54.199316 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:54.199371 23963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.004s	sys 0.031s
W20260709 13:05:54.234979 23963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.004s	sys 0.031s
I20260709 13:05:54.210505 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.236155 21832 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:54.235980 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.237201 23654 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.210034 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.204531 23681 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:54.238268 21902 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:54.238416 23681 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:54.238550 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:54.239467 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:54.239640 23681 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.240486 23654 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:54.240796 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.241657 21908 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:54.237226 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.242260 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.242774 21900 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:54.242969 23654 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:54.243024 23463 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.243992 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.244238 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.245426 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.236042 23963 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:54.237468 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.212476 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.197533 23897 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.252306 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.210602 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.198032 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.184715 23690 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:54.248540 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 272099us
I20260709 13:05:54.253548 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.253710 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:54.253764 21827 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:54.184525 24009 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:54.140954 23732 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.164583 23895 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:54.193888 23857 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.268198 21983 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:54.211258 23905 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:54.192567 23943 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:54.190613 23998 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.267958 24016 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:54.282740 24016 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.283059 24000 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.283993 21833 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:54.284654 21981 raft_consensus.cc:2368] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:54.273532 21829 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:54.257674 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:54.275454 24017 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:05:54.275875 23955 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.277292 23897 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:54.259894 23690 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.261210 24009 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:54.272343 23857 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.201058 23861 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.139146 22548 rpcz_store.cc:276] 0709 13:05:52.897611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.897741 (+   130us) service_pool.cc:224] Handling call
0709 13:05:52.898048 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:53.159566 (+261518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.085052 (+925486us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540053a7d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:54.085215 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569462528}
I20260709 13:05:54.267992 24020 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:54.303686 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46092.6us
I20260709 13:05:54.268025 24019 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.269183 23886 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:54.314852 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 194) took 1188 ms. Trace:
I20260709 13:05:54.357280 21830 rpcz_store.cc:276] 0709 13:05:53.126472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.126579 (+   107us) service_pool.cc:224] Handling call
0709 13:05:54.314673 (+1188094us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b540011f154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:54.314802 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732820224}
I20260709 13:05:54.323482 23374 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:54.363752 23374 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:54.330403 21873 leader_election.cc:336] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.781s (SENT)
I20260709 13:05:54.364429 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:54.330832 24012 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:54.338567 21904 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:54.344889 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1408) took 1098 ms. Trace:
I20260709 13:05:54.338327 23955 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:54.285485 24021 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:54.325196 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.362509 23886 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:54.363811 24005 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.033s	user 0.006s	sys 0.000s
I20260709 13:05:54.271919 23696 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.269620 23895 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.312014 23858 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.385270 21831 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:54.369848 21977 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:05:54.375188 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.334141 23902 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:54.378969 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 326362us
I20260709 13:05:54.296507 23498 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:54.367246 21975 rpcz_store.cc:276] 0709 13:05:53.246261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.897060 (+650799us) service_pool.cc:224] Handling call
0709 13:05:53.897335 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:53.897721 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.897748 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:53.901880 (+  4132us) log.cc:844] Serialized 26 byte log entry
0709 13:05:54.152434 (+250554us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:54.152477 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.152551 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:54.344640 (+192089us) raft_consensus.cc:1685] finished
0709 13:05:54.344665 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.344821 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":670,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":233926,"threads_started":1,"wal-append.queue_time_us":393855}
I20260709 13:05:54.382515 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 196) took 1138 ms. Trace:
I20260709 13:05:54.391186 21829 rpcz_store.cc:276] 0709 13:05:53.243763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.243893 (+   130us) service_pool.cc:224] Handling call
0709 13:05:54.382252 (+1138359us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002887d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:54.382439 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2352547584}
I20260709 13:05:54.391976 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.368893 23654 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.366083 23998 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:54.393615 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:54.394627 21977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1403) took 1167 ms (client timeout 1524 ms). Trace:
W20260709 13:05:54.387965 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 175569us
I20260709 13:05:54.372116 24019 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.372733 24021 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:54.400916 21977 rpcz_store.cc:269] 0709 13:05:53.219560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.220640 (+  1080us) service_pool.cc:224] Handling call
0709 13:05:54.325061 (+1104421us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:54.386707 (+ 61646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3938176}
I20260709 13:05:54.380739 24016 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:54.401895 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:54.406689 24021 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:54.414855 23998 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:54.415388 23998 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.415827 23998 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.420174 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.423029 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.396268 24002 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.398873 23969 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:54.401837 23902 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:54.393462 23858 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.408046 24000 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:54.422129 23892 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:54.452312 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 77246us
I20260709 13:05:54.452713 22554 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:54.453092 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.431474 23963 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:54.428457 23955 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:54.403148 23374 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.401782 23943 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.437988 24019 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:54.431751 23498 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:54.442664 23841 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:54.453337 24003 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:54.523425 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 100469us
I20260709 13:05:54.445564 23844 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:54.413435 24009 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:54.522378 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 65002.7us
I20260709 13:05:54.464753 24016 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.442714 23969 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.531466 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:54.464775 23846 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.000s
I20260709 13:05:54.450614 24036 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:54.459849 23895 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:54.534976 23963 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:54.537449 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.464192 23858 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:54.460680 23732 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:54.545162 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.563331 21982 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:54.563997 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.545841 22553 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
W20260709 13:05:54.531512 24030 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:05:54.460871 24038 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:54.550702 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.569660 21977 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:54.556386 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 207) took 1339 ms. Trace:
I20260709 13:05:54.570744 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:54.570319 21980 rpcz_store.cc:276] 0709 13:05:53.217227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.227137 (+  9910us) service_pool.cc:224] Handling call
0709 13:05:53.244542 (+ 17405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:53.790728 (+546186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.790770 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.790822 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:53.790881 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.556170 (+765289us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54002d4454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:54.556216 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.556333 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255637888}
W20260709 13:05:54.533407 23534 consensus_queue.cc:1175] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:05:54.557344 23969 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:54.558609 24036 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:54.461794 23690 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.558192 24046 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:54.550392 23374 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.572556 24046 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.572939 24046 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:54.570960 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:54.469624 23857 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:54.527334 23955 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.580040 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.580262 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.581001 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.581938 21902 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:54.581856 21903 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:54.582608 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.583289 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.603554 22548 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:54.603744 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.604238 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:54.604396 21983 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:54.605240 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.605327 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.605713 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.549654 23902 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.573714 23969 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:54.615093 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.615815 21982 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:05:54.616067 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.616555 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.613857 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.607226 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.606060 21905 raft_consensus.cc:2410] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:54.610109 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.615221 21833 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:05:54.621001 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.615027 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.572876 24036 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.572968 24009 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:54.623148 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:54.626430 21828 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:54.623267 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:54.623605 21826 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:54.627264 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:54.628818 21830 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:54.630120 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.630822 21983 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:54.631592 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.632943 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.633577 21982 raft_consensus.cc:2376] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6. Re-sending same reply.
I20260709 13:05:54.635167 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.635823 21827 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:54.637029 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:54.639539 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:54.532049 24019 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.647743 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:54.643321 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.644889 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.646377 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.649263 21981 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:54.648639 21906 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:54.653765 21982 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:54.622327 23969 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.665468 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:54.628538 23841 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:54.670969 24008 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:54.671201 21981 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:54.671355 24008 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:54.660257 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.661603 21982 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:54.578336 24016 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:05:54.634891 23890 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.634711 23923 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:54.640347 23891 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.681607 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:54.683771 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:54.684384 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.657477 23963 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:54.674077 23969 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:54.576227 24038 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.636588 24000 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:05:54.671912 24008 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.803586 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.804373 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:54.804795 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 165328us
I20260709 13:05:54.679776 23534 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:54.680286 23923 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:54.812278 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:54.659924 24002 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:05:54.752012 23562 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:54.761705 21906 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
W20260709 13:05:54.815001 23679 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.003s
I20260709 13:05:54.837847 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.751133 24020 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:54.752436 23866 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.866923 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.814332 23923 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:54.870240 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.871099 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.871728 21829 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:54.875263 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:54.867398 23562 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:54.755553 23963 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:54.819283 23895 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:54.871551 23857 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:54.909073 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:54.938552 21826 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:54.939777 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:54.940493 21829 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:05:54.940812 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:54.943814 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:54.870289 23679 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.945509 21827 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:54.930490 23690 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:54.944748 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:54.873173 24020 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:54.935535 23943 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.959563 21826 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
W20260709 13:05:54.984990 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 172796us
I20260709 13:05:54.944190 23955 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:54.943897 23886 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:54.995926 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:54.991051 21832 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:54.967878 24044 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
W20260709 13:05:55.000500 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.001561 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:55.003062 21829 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:55.010962 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:54.999434 24021 consensus_meta.cc:287] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 13:05:55.022075 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:55.030660 24052 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:05:55.031141 24038 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:55.030709 21827 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:05:55.032706 21827 pending_rounds.cc:85] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 6
I20260709 13:05:55.032914 21827 pending_rounds.cc:107] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:55.033126 21827 raft_consensus.cc:2889] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:55.037135 24054 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:55.046545 24019 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:55.048575 24020 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:55.050806 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:55.051565 21901 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:55.052390 24006 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.421s	user 0.009s	sys 0.000s
I20260709 13:05:55.012121 23562 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:55.054718 24051 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:05:55.055279 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1480) took 2168 ms. Trace:
I20260709 13:05:55.055691 21909 rpcz_store.cc:276] 0709 13:05:52.886458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.886608 (+   150us) service_pool.cc:224] Handling call
0709 13:05:52.898579 (+ 11971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.967861 (+ 69282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.967892 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.968368 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:05:53.214081 (+245713us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:53.214138 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.936819 (+722681us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b5400307354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:53.936887 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:55.051798 (+1114911us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:05:55.055065 (+  3267us) raft_consensus.cc:1685] finished
0709 13:05:55.055085 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:55.055203 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10360,"raft.queue_time_us":6579,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7192,"spinlock_wait_cycles":183468160,"thread_start_us":245362,"threads_started":1,"wal-append.queue_time_us":499973}
I20260709 13:05:55.054596 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 314) took 1011 ms. Trace:
I20260709 13:05:55.076375 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:55.057855 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:55.080323 22555 rpcz_store.cc:276] 0709 13:05:54.043034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.073991 (+ 30957us) service_pool.cc:224] Handling call
0709 13:05:55.054423 (+980432us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54006801d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:55.054543 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221377792}
I20260709 13:05:55.106401 21901 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:55.108222 21901 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:54.984251 23943 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:55.019963 24048 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
I20260709 13:05:55.002622 23886 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:55.147825 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:55.150631 21905 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:55.154919 24061 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:05:55.155669 21907 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:55.116494 24020 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:55.165482 23998 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.000s
I20260709 13:05:55.167007 23463 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:55.175577 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:05:55.171025 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 175152us
I20260709 13:05:55.082561 23330 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:55.140825 24056 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:55.144769 24068 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:55.168207 23679 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:55.027086 24021 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:55.188807 21834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.008s	sys 0.004s
I20260709 13:05:55.167984 23969 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:55.214383 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 179015us
W20260709 13:05:55.208262 21978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.014s
W20260709 13:05:55.229017 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 144177us
W20260709 13:05:55.240319 21834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.009s	sys 0.004s
I20260709 13:05:55.296280 21905 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:05:55.347596 21978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.000s	sys 0.021s
W20260709 13:05:55.330693 21949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.011s	sys 0.006s
I20260709 13:05:55.311761 21901 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:05:55.330844 21828 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.001s	sys 0.017s
I20260709 13:05:55.274832 21831 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:05:55.350769 21828 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.001s	sys 0.017s
W20260709 13:05:55.349951 21949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.012s	sys 0.006s
W20260709 13:05:55.352314 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 716149us
I20260709 13:05:55.353488 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:55.354751 22552 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:55.207463 23963 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:55.278259 22546 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:05:55.356575 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.192566 23998 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:55.285357 24061 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:55.362005 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:55.275696 23844 consensus_meta.cc:287] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.001s
I20260709 13:05:55.355612 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:55.205922 24020 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:55.239934 23330 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:55.221813 24068 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:55.239854 24069 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:55.355505 24046 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.000s
I20260709 13:05:55.364450 21949 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:55.397753 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:55.303452 23846 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:55.370748 23841 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.000s
I20260709 13:05:55.401844 23841 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:55.402711 23841 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:55.356822 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:55.367275 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:55.349131 24078 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.359797 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:05:55.476614 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 116867us
I20260709 13:05:55.370095 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:55.478755 21983 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:05:55.376775 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.381120 21980 raft_consensus.cc:2368] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 2. Current term is 3.
I20260709 13:05:55.355667 23969 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:55.404175 23846 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:55.410818 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:55.412298 23943 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:55.276813 23374 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.003s
I20260709 13:05:55.482261 24068 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:55.490213 24068 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:55.482865 24078 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:55.418816 24067 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.419792 24084 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:55.496285 24078 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:55.422326 24021 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:55.496778 24078 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:55.424057 24040 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:55.488205 23330 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:55.426241 23998 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:55.497812 24078 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:55.499058 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:55.499773 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:55.501892 23374 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.504086 23969 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:55.505467 24078 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:55.506790 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:55.508054 24055 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.573s	user 0.000s	sys 0.001s
I20260709 13:05:55.511198 23732 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:55.511719 23732 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:55.485652 24045 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:05:55.514113 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:55.514663 21975 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:55.514707 21974 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
W20260709 13:05:55.486864 21908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1476) took 1403 ms (client timeout 1870 ms). Trace:
I20260709 13:05:55.515832 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:55.439016 23930 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:55.366770 24074 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:05:55.519079 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:55.515655 21908 rpcz_store.cc:269] 0709 13:05:54.083735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.198150 (+114415us) service_pool.cc:224] Handling call
0709 13:05:55.486630 (+1288480us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b54003c9454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:55.486792 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9165568}
W20260709 13:05:55.455710 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 97970.5us
I20260709 13:05:55.520090 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:55.428634 24069 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:55.364601 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:55.521832 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:55.474268 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:55.372593 23844 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:55.443653 24000 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.427343 24046 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:55.479029 23841 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:55.488911 23846 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:55.495123 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.519593 21900 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.523142 21908 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:55.455340 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1456) took 1285 ms. Trace:
I20260709 13:05:55.525127 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:55.517907 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:55.522401 21975 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
I20260709 13:05:55.529618 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:55.534600 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 179047us
W20260709 13:05:55.533878 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 109802us
I20260709 13:05:55.520972 21834 raft_consensus.cc:606] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:55.541880 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:55.513469 24021 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:05:55.684203 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:55.540625 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:55.546824 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:55.577914 21909 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:55.691247 21905 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:55.481285 23685 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:55.693070 21909 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:55.693403 21909 pending_rounds.cc:85] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 2
I20260709 13:05:55.693784 21909 pending_rounds.cc:107] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:55.694336 21909 raft_consensus.cc:2889] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:55.694119 21832 rpcz_store.cc:276] 0709 13:05:54.170109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.247345 (+ 77236us) service_pool.cc:224] Handling call
0709 13:05:54.247613 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.001839 (+754226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.455017 (+453178us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54002896d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:55.455268 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702166400}
W20260709 13:05:55.634970 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 237257us
I20260709 13:05:55.701066 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:55.702207 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:55.702919 21983 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.711802 21900 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:55.518930 23930 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:55.727764 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:55.528966 24019 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.728677 21975 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.714668 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1471) took 1094 ms. Trace:
I20260709 13:05:55.539523 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:55.532143 24068 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:55.732617 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 212320us
I20260709 13:05:55.529228 23955 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.736770 21833 rpcz_store.cc:276] 0709 13:05:54.620205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.627994 (+  7789us) service_pool.cc:224] Handling call
0709 13:05:54.628936 (+   942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.629124 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:55.416939 (+787815us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b1800397f00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf
0709 13:05:55.417113 (+   174us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.712719 (+295606us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.713608 (+   889us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:55.713806 (+   198us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:55.714221 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.714465 (+   244us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:55.714605 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52132,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":48388,"raft.queue_time_us":331,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8773,"spinlock_wait_cycles":88064768,"thread_start_us":422974,"threads_started":2}
W20260709 13:05:55.714985 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 174543us
I20260709 13:05:55.741997 21977 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:55.743278 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:55.538918 24038 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:55.731187 24015 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:55.587850 24067 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:55.765377 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:55.795784 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:55.797372 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:55.729038 23930 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.579061 22547 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:55.779070 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:55.780889 24068 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:55.809887 21905 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:55.803635 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:55.863974 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 317055us
W20260709 13:05:55.866420 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 49660.2us
I20260709 13:05:55.868451 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:55.872696 22555 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:55.876983 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:55.879073 21975 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:55.889140 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:55.782181 24015 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:55.745155 24019 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:55.889972 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 194347us
I20260709 13:05:55.893291 21975 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:55.832655 24020 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:55.902963 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1442) took 2076 ms. Trace:
I20260709 13:05:55.877869 21981 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:05:55.901948 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 202487us
I20260709 13:05:55.882221 24074 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.880295 23685 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.903638 21976 rpcz_store.cc:276] 0709 13:05:53.826216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.126059 (+299843us) service_pool.cc:224] Handling call
0709 13:05:54.131061 (+  5002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.364501 (+233440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:54.364546 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:54.364602 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:54.364652 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.902689 (+1538037us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54003a43d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:55.902753 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:55.902898 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536288128}
I20260709 13:05:55.833117 23963 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:05:55.824932 23562 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:05:55.906133 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:55.756259 23955 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:55.817257 24038 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:55.794770 24067 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:55.749609 24069 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:55.895287 24015 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.825543 24036 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:05:55.823340 24049 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.140s
W20260709 13:05:55.912371 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 211394us
I20260709 13:05:55.898227 21975 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:55.825158 24084 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:05:55.923414 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:55.922849 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1461) took 2027 ms. Trace:
I20260709 13:05:55.929108 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:55.918613 21983 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:55.929750 21976 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:55.908677 24020 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:55.966037 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:55.968124 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44785.1us
W20260709 13:05:55.934056 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.969648 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:55.971302 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:55.970548 21904 rpcz_store.cc:276] 0709 13:05:53.899035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.899282 (+   247us) service_pool.cc:224] Handling call
0709 13:05:53.899600 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:54.366967 (+467367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.922544 (+1555577us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b540034a154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:55.922771 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008963840}
I20260709 13:05:55.922284 23681 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:55.907967 23998 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:55.912411 24074 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:55.968098 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 220803us
I20260709 13:05:55.925194 23841 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:55.925144 23846 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.922834 24038 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.920034 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:55.975770 21976 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:05:56.011071 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 124496us
I20260709 13:05:55.978003 23861 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:55.909422 24068 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:55.999364 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:55.930675 24019 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:55.969045 24036 consensus_queue.cc:1243] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:56.004848 24046 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:56.004678 24101 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:05:55.997764 23998 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.013011 23841 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.162614 23955 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.025524 24106 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:56.003698 24067 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.170073 24067 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:55.983645 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54778.8us
I20260709 13:05:56.171535 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:55.977069 23943 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:56.129465 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 117202us
W20260709 13:05:56.172863 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 173572us
I20260709 13:05:56.173696 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.178143 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:56.179687 22555 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 1 LEARNER]: Advancing to term 3
W20260709 13:05:56.148872 24097 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.152s	user 0.000s	sys 0.005s
I20260709 13:05:56.038304 24092 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.033977 24093 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 13:05:56.025691 24020 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:56.130420 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 279533us
I20260709 13:05:56.157078 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:56.158443 24019 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:56.159108 24108 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:56.159809 24101 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:56.160166 23998 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:56.165705 24106 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:56.182677 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 211463us
I20260709 13:05:56.163589 24036 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:56.171713 24099 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.192s	user 0.000s	sys 0.005s
I20260709 13:05:56.192651 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:56.185017 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 316350us
W20260709 13:05:56.227185 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53570.1us
I20260709 13:05:56.192209 24056 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:56.180711 24046 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:56.269439 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76861.1us
I20260709 13:05:56.270084 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:56.265352 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:56.267117 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 95690.2us
I20260709 13:05:56.271433 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.272050 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.268682 22555 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 3 LEARNER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:56.263474 24106 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.194410 23963 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.274623 23963 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.275910 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 443) took 1696 ms. Trace:
I20260709 13:05:56.276641 23963 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:56.276283 22547 rpcz_store.cc:276] 0709 13:05:54.579656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.606925 (+ 27269us) service_pool.cc:224] Handling call
0709 13:05:54.660125 (+ 53200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:55.878353 (+1218228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.275652 (+397299us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400680e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:56.275843 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953588096}
I20260709 13:05:56.277498 24112 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:56.278726 22552 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:56.278074 24112 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.281490 24112 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.287163 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:56.288233 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:56.289047 23998 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:56.289677 23998 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:56.290971 23998 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:56.266897 24097 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:56.294121 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:56.293104 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:56.303018 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:56.266944 23654 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.265992 23955 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:56.324597 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 439) took 2295 ms. Trace:
I20260709 13:05:56.297711 24036 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:56.298482 24119 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.231503 23861 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:56.231760 24108 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:56.300707 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:56.330578 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.330648 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:56.189342 23943 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.194197 23841 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:05:56.295210 24016 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.302953 24049 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.306959 23897 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.307265 23930 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.230320 24019 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.309733 24107 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:56.312204 23886 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:56.297279 22548 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:56.314875 21825 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:56.278077 23963 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:56.315235 23732 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:56.319176 24008 consensus_meta.cc:287] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.500s	user 0.006s	sys 0.009s
I20260709 13:05:56.398466 24008 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.272394 24100 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.193380 24092 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.320119 24096 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.320981 23923 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.421s	user 0.014s	sys 0.001s
I20260709 13:05:56.304711 24020 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:05:56.296329 23942 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.304643 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:56.324672 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 52694.6us
I20260709 13:05:56.402884 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:05:56.298065 24090 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.614s	user 0.000s	sys 0.001s
I20260709 13:05:56.325147 22554 rpcz_store.cc:276] 0709 13:05:54.010531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.010641 (+   110us) service_pool.cc:224] Handling call
0709 13:05:54.010942 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:54.453070 (+442128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.305864 (+1852794us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400545954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:56.306102 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015366528}
I20260709 13:05:56.328891 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:56.404841 21902 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:56.368732 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:56.379319 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:56.369021 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:56.367889 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 79730.7us
I20260709 13:05:56.405922 21906 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:56.365325 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:56.383153 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53572.1us
I20260709 13:05:56.267357 24101 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.380234 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:56.384713 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.430619 23732 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.404754 23923 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.430999 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:56.431617 21907 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:56.431888 21908 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:05:56.429718 21977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1426) took 1847 ms (client timeout 1954 ms). Trace:
I20260709 13:05:56.432560 23923 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.327636 24036 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:56.432624 21977 rpcz_store.cc:269] 0709 13:05:54.582298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.582410 (+   112us) service_pool.cc:224] Handling call
0709 13:05:56.429544 (+1847134us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54002d5354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:56.429665 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2293622144}
I20260709 13:05:56.292074 24046 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.433344 22555 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:56.333314 24108 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.435039 24046 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:56.393635 24120 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.435726 24120 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.437798 24120 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:56.326296 24015 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.437923 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:56.422801 24096 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.439663 24015 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.440011 24019 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.419313 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:56.440441 22546 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:05:56.408614 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.442767 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:56.385196 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:56.419973 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 115400us
I20260709 13:05:56.443761 21901 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:56.429849 21978 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:56.383112 21905 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:56.433264 24036 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.329668 23955 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.440161 21979 raft_consensus.cc:2410] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:56.292384 24056 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:56.450461 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.444754 22555 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:56.447635 22554 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:56.451176 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.394613 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 346) took 1201 ms. Trace:
I20260709 13:05:56.444149 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:56.456925 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:56.457034 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:56.458973 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:56.426604 24114 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.194s	user 0.000s	sys 0.003s
I20260709 13:05:56.463191 23930 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.464761 24045 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:56.466471 24124 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:56.418789 23942 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:05:56.467007 24124 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.469009 24124 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:56.470232 24106 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.472291 24106 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:56.472896 23969 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:56.473412 23969 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:56.473837 23969 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:56.474124 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.474428 21900 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 2.
I20260709 13:05:56.475452 23955 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.441154 24015 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:56.490259 21828 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:56.490437 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.479809 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.481945 21829 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:05:56.422305 24092 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.420724 24122 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.420513 23897 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:56.495942 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 93132.1us
I20260709 13:05:56.555306 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.556651 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.491446 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.391861 24107 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:56.558893 24107 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.560225 24107 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:56.489027 21901 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
W20260709 13:05:56.499006 24002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.620s	user 0.018s	sys 0.047s
I20260709 13:05:56.499966 21975 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:05:56.562004 24002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.685s	user 0.018s	sys 0.047s
I20260709 13:05:56.562835 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:56.563747 21975 raft_consensus.cc:2368] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:05:56.564620 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:56.501793 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:56.565886 21982 raft_consensus.cc:2410] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:56.454507 23562 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.534281 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 103360us
I20260709 13:05:56.532407 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:56.507153 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 53894.7us
I20260709 13:05:56.569648 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:56.532764 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.570621 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:56.538722 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.451599 23923 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:56.517798 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.389930 23861 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.458815 24012 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:56.510409 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.548707 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:56.551494 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:56.489867 24016 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:56.581013 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:56.571274 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:56.583418 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:56.584190 21902 raft_consensus.cc:2368] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:05:56.584219 21900 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:56.533525 24120 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:56.539676 24046 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.539574 23890 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:56.539709 24026 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:56.547839 24101 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.566767 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:56.575785 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:56.644171 21905 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:56.441231 24108 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.577437 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:56.584965 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:56.585753 22519 leader_election.cc:400] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:05:56.648815 22519 leader_election.cc:403] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:05:56.587368 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:56.588831 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:56.577775 23696 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:56.456202 22548 rpcz_store.cc:276] 0709 13:05:55.193008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.205813 (+ 12805us) service_pool.cc:224] Handling call
0709 13:05:56.156914 (+951101us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9eee 0000000000375939 00007fb763f2d1e0 00007fb763ff60c4 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:05:56.394555 (+237641us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14279936}
I20260709 13:05:56.574805 21873 leader_election.cc:400] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:05:56.650509 21873 leader_election.cc:403] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:05:56.544524 23955 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:05:56.654011 21982 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:56.647120 21907 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:56.654759 21975 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:56.651269 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65697us
I20260709 13:05:56.679159 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.656255 22520 leader_election.cc:400] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:05:56.568356 24015 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:56.656622 21900 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:56.569083 23943 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:56.752086 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:56.586730 24038 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.003s
I20260709 13:05:56.554950 24125 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:56.588127 24003 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:56.640528 24132 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:56.824975 24132 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:56.825459 24008 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:56.825819 24132 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.656083 23696 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.762513 23330 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:05:56.588311 23890 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:56.834422 23890 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.590250 23999 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.230s
W20260709 13:05:56.835788 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 248049us
I20260709 13:05:56.836453 23999 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:56.836874 23999 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:56.837615 23696 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:56.575913 23654 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.238s
I20260709 13:05:56.820473 24101 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
W20260709 13:05:56.656361 24127 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:05:56.545387 24122 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.642921 24092 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.238s
I20260709 13:05:56.587841 24120 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:56.575625 24123 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:56.575392 23963 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:56.816845 24067 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:56.782903 24049 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.641183 24046 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.656625 24026 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.842145 21832 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:05:56.842589 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 385738us
I20260709 13:05:56.642729 24117 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:56.849086 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.882972 24026 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.826368 21906 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:56.589620 24002 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.251s
I20260709 13:05:56.885174 24002 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:56.885604 24002 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:56.886409 24002 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.887844 24002 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:56.813910 24125 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.889407 24125 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:56.890888 24126 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:05:56.894604 21827 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:56.895099 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.895434 24015 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:05:56.898599 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.900717 24012 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.901356 24012 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:56.906956 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 320658us
I20260709 13:05:56.906850 24125 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:56.855540 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 317736us
I20260709 13:05:56.589466 24016 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.579614 23562 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.908910 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.909229 24021 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:56.910079 22547 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:56.910934 23562 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:56.821113 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:56.822527 24124 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.842492 24020 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:05:56.918912 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.863890 24067 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:56.837852 23999 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.856168 24120 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.872210 24049 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:56.814299 24038 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.880791 24046 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:56.853089 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 174002us
I20260709 13:05:56.857712 21975 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:05:56.912284 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:05:56.915236 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.903877 24012 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.919718 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:56.862217 24084 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:56.925971 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:56.940445 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 365754us
I20260709 13:05:56.943076 21831 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:56.943252 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:56.944382 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:56.918540 23923 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:56.918846 24020 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:56.925551 24067 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.921576 24045 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.950518 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.955767 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:56.953400 21903 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:56.956549 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.956670 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:56.957886 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:56.940702 23930 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:05:56.963249 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 375902us
I20260709 13:05:56.938782 24016 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:56.969172 24094 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:56.969573 24094 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:56.969923 24094 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.971125 24128 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:56.959196 24123 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:56.954674 23897 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:05:56.989792 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 70169.4us
I20260709 13:05:56.971900 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:05:56.973814 21873 connection.cc:256] RPC call timeout handler was delayed by -1.2804398450000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 13:05:56.959656 23942 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:05:56.927259 23562 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:05:56.950834 24019 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:56.949565 23923 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.952243 23999 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.925688 24124 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:56.984745 24095 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.952569 23963 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.959733 23330 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.004208 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:57.014091 21831 raft_consensus.cc:606] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:56.991981 22551 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:57.009862 24133 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:05:57.034557 24108 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:56.967444 23930 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.010493 24118 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:57.010586 23696 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.037052 23930 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.037317 23696 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.011523 24146 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:05:57.038642 24119 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.001s
I20260709 13:05:57.038792 21908 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:57.039047 24119 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:57.013072 24122 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:05:57.040174 24036 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.004s
I20260709 13:05:57.011786 24125 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:57.007193 23732 consensus_meta.cc:287] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.006s
I20260709 13:05:57.014464 21831 raft_consensus.cc:614] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:57.040623 24036 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.042327 21982 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:57.041922 21831 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:57.045472 21983 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:57.047400 24136 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:57.047533 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.047912 24136 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.048529 21983 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:57.050443 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.051218 21983 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
W20260709 13:05:57.009117 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 43799.5us
I20260709 13:05:57.014856 24117 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:57.054531 24117 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:57.055042 24117 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.017632 24124 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:56.961375 24129 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:05:57.002452 24128 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:57.019567 24038 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.005815 23923 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.007241 24116 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:05:57.061429 24116 consensus_queue.cc:1243] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:56.959125 24045 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.062392 24036 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:57.062698 24128 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.063308 24045 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.022949 24095 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.024340 23897 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.024996 23562 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:57.025305 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:57.069358 21976 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.025534 23330 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.025835 24049 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.026932 24107 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:57.029724 24112 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.748s	user 0.005s	sys 0.004s
I20260709 13:05:57.062079 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:57.073951 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:57.038991 24096 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.066192 24095 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:57.079133 24146 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:57.086680 24146 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:05:57.087493 23955 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:57.087942 23955 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:57.087598 24146 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.015703 23861 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.085947 21827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:57.077589 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:57.049988 24136 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.080572 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:57.080691 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:57.079101 23969 consensus_meta.cc:287] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.009s
I20260709 13:05:57.089982 21827 raft_consensus.cc:606] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:57.093927 23330 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:56.440562 23857 consensus_queue.cc:1175] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:57.079627 24118 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:57.096144 24118 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.088730 23955 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.119151 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:57.119187 21873 leader_election.cc:336] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.524s (SENT)
I20260709 13:05:57.104460 21908 raft_consensus.cc:2410] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:05:57.089664 23846 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:57.138285 23846 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:57.138525 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.139279 23846 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.140422 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:57.141254 22550 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:57.119156 23969 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.142671 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:57.143321 21906 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:57.144140 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:57.144421 23969 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.144507 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:57.145200 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:57.124917 24084 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:57.118153 24094 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.145962 21906 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:05:57.146248 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.146010 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.150022 24094 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:57.150542 23955 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.151048 21906 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:57.091185 21831 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:05:57.129630 21976 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:57.130481 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.089991 24112 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.157511 24056 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:57.158746 24112 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.159404 24129 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:57.131753 23890 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.160346 22551 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:57.161542 23890 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.078944 24038 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:57.162309 21833 raft_consensus.cc:2368] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
I20260709 13:05:57.089953 24107 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.164518 24107 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.164886 21832 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:57.132959 21902 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:57.166198 24038 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.133467 24120 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.134836 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:57.173234 21900 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.154671 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.179054 21976 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:05:57.179941 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.181999 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.182049 21900 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:05:57.182684 21976 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:57.182512 24118 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:05:57.180684 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.183434 24118 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.183950 23890 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.184514 23890 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.184762 21948 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.186061 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.186399 24003 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:57.187134 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.187917 21827 raft_consensus.cc:2410] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:57.183775 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.188632 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.189827 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:57.192849 24038 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.195652 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.196376 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.196789 21832 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:05:57.197598 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:57.197661 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:57.199240 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.201052 24120 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.126348 24067 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.203308 24067 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:57.203640 24128 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:57.204598 24128 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:57.203856 24091 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.226s	user 0.000s	sys 0.022s
I20260709 13:05:57.201750 21901 raft_consensus.cc:2393] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:57.206131 21982 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.213945 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.214696 24103 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:57.215091 24103 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:57.214569 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:57.216924 21900 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:57.214224 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.220085 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:57.220638 21900 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.220535 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:57.221783 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:57.215950 24128 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.224237 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.186393 23890 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.225247 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.225268 21873 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:57.227011 21976 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:57.227912 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.228459 21900 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:57.228552 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.228399 24038 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:57.229431 24038 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:57.229799 24038 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:57.215879 24103 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.230158 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.230736 21827 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:57.230831 24103 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.231751 21827 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:57.232251 21976 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:05:57.211609 23897 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:57.233951 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:57.233757 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.234622 21832 raft_consensus.cc:606] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:57.234902 21976 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:05:57.232785 23690 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:57.235879 23690 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:57.236599 23690 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.237682 23690 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:57.238739 22551 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:57.240233 24129 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:57.240742 24129 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.233554 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:57.235059 21832 raft_consensus.cc:614] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:57.244632 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.243799 23897 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.246469 24067 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:57.243768 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:57.225510 24120 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:57.247920 21828 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.248672 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:57.249114 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:57.249238 21827 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.249291 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.228773 24128 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:57.205315 24117 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.258759 21981 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:57.259114 21981 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:57.255481 21982 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:05:57.231581 24107 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:57.263713 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:57.225744 24069 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:05:57.267182 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.260013 21981 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.268530 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.268631 21981 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.245999 24129 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.269734 21976 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:57.271029 21982 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:57.270726 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:57.279022 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:57.262576 24009 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:57.280043 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.258703 24067 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:57.282860 24110 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.976s	user 0.002s	sys 0.000s
I20260709 13:05:57.287410 21981 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:05:57.287875 21981 pending_rounds.cc:85] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 6
I20260709 13:05:57.288631 21981 pending_rounds.cc:107] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:57.289461 21981 raft_consensus.cc:2889] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:57.290795 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1474) took 1620 ms. Trace:
I20260709 13:05:57.290957 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:05:57.293293 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.263141 24107 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:57.256080 24120 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.297503 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:05:57.298779 24105 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:05:57.281502 23724 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:57.296207 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:57.300035 21832 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:57.302659 21873 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.299113 24063 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:05:57.295811 24069 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:57.303938 21827 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:05:57.304433 24069 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:57.305004 21827 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:57.286315 24067 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.306073 21900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39266
I20260709 13:05:57.310890 21900 raft_consensus.cc:606] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:57.295706 24118 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.305399 24069 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.311841 21827 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:05:57.305742 23724 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:57.313311 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.313704 23724 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.314468 21900 raft_consensus.cc:614] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:57.295317 21981 rpcz_store.cc:276] 0709 13:05:55.670311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.930861 (+260550us) service_pool.cc:224] Handling call
0709 13:05:55.931118 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.258662 (+1327544us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400104620. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef55dc0 00007fb75efe01c0 00007fb75efe1231 00007fb75efddd8f 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c
0709 13:05:57.290570 (+ 31908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.290748 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502393728}
I20260709 13:05:57.298353 24107 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:57.297272 23897 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.298985 23923 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.319625 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.300269 24128 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:57.321237 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:57.318225 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:57.322366 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.317134 24067 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.301378 24129 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:57.330313 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.339406 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:57.346235 23844 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.346463 23696 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:57.368871 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 204) took 1847 ms. Trace:
I20260709 13:05:57.369303 21830 rpcz_store.cc:276] 0709 13:05:55.521431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.522276 (+   845us) service_pool.cc:224] Handling call
0709 13:05:55.585394 (+ 63118us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:55.592765 (+  7371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.592809 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:55.682236 (+ 89427us) log.cc:844] Serialized 26 byte log entry
0709 13:05:55.985639 (+303403us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:55.985704 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.985842 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.246708 (+1260866us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:05:57.364982 (+118274us) raft_consensus.cc:1685] finished
0709 13:05:57.365006 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.368811 (+  3805us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20004,"raft.queue_time_us":10262,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":47737088,"thread_start_us":254430,"threads_started":1,"wal-append.queue_time_us":496610}
I20260709 13:05:57.318183 24119 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:57.354288 24064 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:57.377231 24064 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:57.377810 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 349) took 2018 ms. Trace:
I20260709 13:05:57.328362 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.356655 24120 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.318645 24117 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:57.361792 21828 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:57.314256 24122 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:57.383775 24122 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.384158 24122 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.363652 23923 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:57.388654 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff74442193fb468c966c8842f014e361"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:05:57.389282 21831 raft_consensus.cc:606] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:57.390463 21831 raft_consensus.cc:614] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:57.343863 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:57.366950 21908 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.367441 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.368316 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:57.368270 23844 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.317744 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:57.393953 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76247.9us
I20260709 13:05:57.394848 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.396239 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:57.397197 24119 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:57.397650 24119 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:57.378055 24064 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.398928 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:57.372752 21900 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:57.366498 24129 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.373699 24057 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:57.411392 24057 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:57.411581 23886 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:57.411468 24143 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:05:57.376348 22521 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.854s (SENT) [suppressed 26 similar messages]
W20260709 13:05:57.377226 22553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 335) took 4436 ms (client timeout 2218 ms). Trace:
I20260709 13:05:57.378334 22552 rpcz_store.cc:276] 0709 13:05:55.359743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.503898 (+144155us) service_pool.cc:224] Handling call
0709 13:05:56.278423 (+774525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.279063 (+   640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.377585 (+1098522us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400680e50. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:57.377744 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778552704}
W20260709 13:05:57.382900 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 54637.3us
I20260709 13:05:57.401561 23844 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:57.391743 23724 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.402472 23963 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:57.402951 24120 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:57.403374 24108 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:57.407390 23955 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:57.409134 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:57.421048 21981 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.423964 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:05:57.409453 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.410758 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 66990.6us
I20260709 13:05:57.428098 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:57.368955 24038 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.417152 24019 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:57.416234 21908 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:05:57.419245 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:57.419634 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.418035 22553 rpcz_store.cc:269] 0709 13:05:52.940774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.940888 (+   114us) service_pool.cc:224] Handling call
0709 13:05:57.376967 (+4436079us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54004c4354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:57.377099 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3416706304}
I20260709 13:05:57.423233 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:57.434605 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:57.434917 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.412565 24129 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.439648 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:57.442633 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:57.446367 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:57.438454 23858 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:57.448305 23858 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:57.448712 23858 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:57.438728 23696 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:57.433072 24019 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:57.454357 24119 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.460544 24038 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:57.453634 24108 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:05:57.447376 23955 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:57.446586 23897 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:57.461807 23955 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.462091 23897 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:57.445277 24063 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.453732 24118 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:57.462240 23955 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.462831 24063 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.453006 24122 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.457728 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:57.438863 23844 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:05:57.417248 24057 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:57.462960 23897 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:57.676003 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.519374 21977 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:05:57.779397 21977 pending_rounds.cc:85] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 4
I20260709 13:05:57.676780 21981 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:05:57.780128 21977 pending_rounds.cc:107] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:05:57.780532 21977 raft_consensus.cc:2889] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:57.780822 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.764444 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1496) took 1432 ms. Trace:
W20260709 13:05:57.661697 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.443277 24105 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:57.591308 21979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 214) took 2955 ms (client timeout 1554 ms). Trace:
I20260709 13:05:57.610675 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1503) took 1040 ms. Trace:
I20260709 13:05:57.794821 21903 rpcz_store.cc:276] 0709 13:05:56.570603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.570712 (+   109us) service_pool.cc:224] Handling call
0709 13:05:56.570954 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.967024 (+396070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.610393 (+643369us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54002382d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:57.610609 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879015296}
I20260709 13:05:57.796378 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:57.797773 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:57.513875 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.033s	sys 0.075s
W20260709 13:05:57.799113 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.038s	sys 0.096s
W20260709 13:05:57.799472 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 808355us
I20260709 13:05:57.695673 24103 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.784770 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:05:57.588831 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 142550us
I20260709 13:05:57.462991 24118 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.806116 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:57.608942 23858 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.791397 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:57.671249 23890 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.619349 24143 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:57.681376 24128 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:57.608700 23969 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:57.608989 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:05:57.793459 21979 rpcz_store.cc:269] 0709 13:05:54.563634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.563766 (+   132us) service_pool.cc:224] Handling call
0709 13:05:57.518592 (+2954826us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540005afd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:57.518780 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4312573312}
I20260709 13:05:57.800895 21906 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:05:57.685001 24123 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.782330 21909 rpcz_store.cc:276] 0709 13:05:56.332065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.332187 (+   122us) service_pool.cc:224] Handling call
0709 13:05:56.383209 (+ 51022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.408279 (+ 25070us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:56.580890 (+172611us) log.cc:844] Serialized 14 byte log entry
0709 13:05:56.912174 (+331284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:56.912218 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:56.912259 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.764170 (+851911us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b54002f4ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:57.764250 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.764387 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46942,"prepare.queue_time_us":58631,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":31,"raft.queue_time_us":102,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6627,"spinlock_wait_cycles":57097600,"thread_start_us":451744,"threads_started":2,"wal-append.queue_time_us":441086}
I20260709 13:05:57.803804 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:57.804122 21903 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 3: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:57.804037 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:57.896238 22552 raft_consensus.cc:2376] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3. Re-sending same reply.
I20260709 13:05:57.687258 24108 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.465670 23846 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:57.695753 24038 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.465704 23963 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:57.777133 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.587693 23724 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:57.816172 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.806648 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:57.835196 21981 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:57.837607 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:57.899082 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:57.841720 24143 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:57.533950 24067 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.464835 24107 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:57.847340 21976 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.022s	sys 0.024s
I20260709 13:05:57.853540 21904 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
W20260709 13:05:57.916249 21976 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.022s	sys 0.024s
I20260709 13:05:57.890965 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:05:57.840961 24015 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.007s	sys 0.026s
I20260709 13:05:57.831925 23844 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:57.887104 21980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1433) took 3278 ms (client timeout 1524 ms). Trace:
I20260709 13:05:57.821617 24118 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:57.899691 21981 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.834259 24103 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.837803 22555 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:57.919521 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:57.943878 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:57.944386 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:57.897594 24141 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:57.944593 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.944505 21903 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:57.945334 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:57.946602 21904 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.954818 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:57.955375 21903 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:05:57.902649 23963 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:05:57.918989 24015 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.010s	sys 0.026s
I20260709 13:05:57.843114 23890 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:57.949781 21902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.012s	sys 0.030s
I20260709 13:05:57.953946 21981 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:57.800196 24105 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.886910 23969 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:57.942520 21980 rpcz_store.cc:269] 0709 13:05:54.608657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.614910 (+  6253us) service_pool.cc:224] Handling call
0709 13:05:57.855141 (+3240231us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54001f45d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:57.887007 (+ 31866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759768960}
I20260709 13:05:57.911378 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:57.897292 24150 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:05:57.912664 23846 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.898979 24123 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.900403 24108 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.914846 24038 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:57.910876 23861 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:57.962422 21902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.013s	sys 0.030s
I20260709 13:05:57.962546 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:05:58.485365 21982 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.203s	user 0.049s	sys 0.093s
W20260709 13:05:58.774151 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.021s	sys 0.052s
I20260709 13:05:58.017127 21904 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
W20260709 13:05:58.844414 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.023s	sys 0.054s
W20260709 13:05:58.844853 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.844734 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 328) took 1001 ms. Trace:
W20260709 13:05:58.843935 21982 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.561s	user 0.050s	sys 0.120s
W20260709 13:05:58.845050 21947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.012s	sys 0.034s
W20260709 13:05:58.850827 21873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.005s	sys 0.003s
W20260709 13:05:58.860453 21873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.006s	sys 0.004s
W20260709 13:05:58.861191 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 1.05458e+06us
W20260709 13:05:58.851249 21976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.002s	sys 0.007s
W20260709 13:05:58.862421 21976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.002s	sys 0.007s
W20260709 13:05:58.862627 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:58.860271 21947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.012s	sys 0.040s
W20260709 13:05:58.185057 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.919971 22547 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:58.867558 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:05:58.845219 21946 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.003s	sys 0.005s
W20260709 13:05:58.612630 21874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.007s	sys 0.042s
W20260709 13:05:57.997238 24064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.002s	sys 0.027s
I20260709 13:05:58.018297 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1459) took 2502 ms. Trace:
I20260709 13:05:58.859380 22553 rpcz_store.cc:276] 0709 13:05:57.843782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.962258 (+118476us) service_pool.cc:224] Handling call
0709 13:05:58.844686 (+882428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.860518 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1498) took 1246 ms. Trace:
W20260709 13:05:58.252779 21983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.116s	user 0.012s	sys 0.051s
W20260709 13:05:58.236848 22521 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.015s	sys 0.029s
W20260709 13:05:58.273524 21900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.005s	sys 0.041s
I20260709 13:05:57.944831 23724 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.925s
I20260709 13:05:58.867784 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:57.993260 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:57.957415 23844 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:05:58.900483 23923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.003s	sys 0.007s
W20260709 13:05:58.890578 21797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.007s	sys 0.002s
W20260709 13:05:58.934067 21797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.266s	user 0.007s	sys 0.002s
I20260709 13:05:57.993649 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:58.898597 21980 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:58.898730 21946 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.005s	sys 0.007s
I20260709 13:05:58.488170 24103 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:58.243685 23858 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:58.529963 24107 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:58.588344 24027 raft_consensus.cc:993] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
W20260709 13:05:58.887871 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.018000 24128 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:58.084892 24063 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:58.900821 21981 rpcz_store.cc:276] 0709 13:05:57.613998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.898854 (+284856us) service_pool.cc:224] Handling call
0709 13:05:58.860453 (+961599us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:58.847025 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.003s	sys 0.006s
I20260709 13:05:58.579190 23890 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:58.900158 21974 rpcz_store.cc:276] 0709 13:05:55.516183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.523659 (+  7476us) service_pool.cc:224] Handling call
0709 13:05:55.523928 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.669728 (+145800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.669771 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:55.669824 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:55.669867 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.018017 (+2348150us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002274d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:58.018061 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.018209 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334727040}
W20260709 13:05:58.901582 21983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.765s	user 0.030s	sys 0.072s
I20260709 13:05:58.907825 21909 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:58.927119 22521 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.510s	user 0.016s	sys 0.074s
W20260709 13:05:58.926671 21900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.485s	user 0.005s	sys 0.084s
I20260709 13:05:57.962148 23963 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:58.930464 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1552) took 1465 ms. Trace:
I20260709 13:05:58.966328 21903 rpcz_store.cc:276] 0709 13:05:57.464571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.992982 (+528411us) service_pool.cc:224] Handling call
0709 13:05:58.930419 (+937437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.967432 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:58.968179 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1557) took 1461 ms. Trace:
I20260709 13:05:58.968497 21903 rpcz_store.cc:276] 0709 13:05:57.507062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.967195 (+1460133us) service_pool.cc:224] Handling call
0709 13:05:58.968128 (+   933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.972472 23969 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:58.930306 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1562) took 1268 ms. Trace:
W20260709 13:05:58.487385 24069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.037s	sys 0.060s
I20260709 13:05:58.931560 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:58.851090 24067 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:58.983637 24069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.618s	user 0.051s	sys 0.098s
I20260709 13:05:58.017499 24003 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:58.046721 24122 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:58.232400 24073 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 2.564s	user 0.004s	sys 0.009s
W20260709 13:05:58.935665 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.002s	sys 0.018s
W20260709 13:05:58.991891 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.002s	sys 0.018s
W20260709 13:05:58.992416 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 1.18633e+06us
W20260709 13:05:58.898350 21874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.016s	sys 0.052s
I20260709 13:05:58.940698 24176 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:05:58.409039 24159 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.513s	user 0.001s	sys 0.001s
W20260709 13:05:58.935050 23923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.004s	sys 0.007s
I20260709 13:05:58.890898 23861 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:58.932757 23955 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.470s	user 0.004s	sys 0.007s
W20260709 13:05:58.925366 24152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.007s	sys 0.007s
W20260709 13:05:58.917725 24064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.464s	user 0.019s	sys 0.070s
I20260709 13:05:58.950081 21980 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:05:58.952013 24103 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.004536 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1462) took 1542 ms. Trace:
I20260709 13:05:57.997680 24143 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.005477 24108 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:58.934669 24038 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:58.942418 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 355) took 1105 ms. Trace:
I20260709 13:05:58.938107 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 354) took 1100 ms. Trace:
I20260709 13:05:58.942824 23858 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:58.958005 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1451) took 1795 ms. Trace:
I20260709 13:05:58.994999 24003 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:59.002154 24152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.007s	sys 0.008s
I20260709 13:05:58.979039 21904 rpcz_store.cc:276] 0709 13:05:57.662430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.867481 (+1205051us) service_pool.cc:224] Handling call
0709 13:05:58.930250 (+ 62769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.978808 21903 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:58.979444 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:58.964841 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 1.58842e+06us
I20260709 13:05:59.028321 21981 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:05:59.028388 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.028834 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1501) took 1282 ms. Trace:
I20260709 13:05:58.980796 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1539) took 1558 ms. Trace:
I20260709 13:05:59.029142 21981 rpcz_store.cc:276] 0709 13:05:57.746092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.979221 (+1233129us) service_pool.cc:224] Handling call
0709 13:05:59.028784 (+ 49563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.264289 24074 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:58.984045 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 359) took 1143 ms. Trace:
I20260709 13:05:59.026050 21982 rpcz_store.cc:276] 0709 13:05:57.162996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.272742 (+109746us) service_pool.cc:224] Handling call
0709 13:05:57.272965 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.273137 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:58.859847 (+1586710us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.957663 (+ 97816us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.957717 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:58.957763 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.957837 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.957953 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":808680,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":7797,"raft.queue_time_us":28163,"raft.run_wall_time_us":6060,"spinlock_wait_cycles":6210816,"thread_start_us":1674559,"threads_started":2,"wal-append.queue_time_us":131655}
I20260709 13:05:59.038885 22553 rpcz_store.cc:276] 0709 13:05:57.840549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.931085 (+1090536us) service_pool.cc:224] Handling call
0709 13:05:58.983990 (+ 52905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.952244 24068 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:58.955297 24171 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.964130 24129 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.516s	user 0.010s	sys 0.003s
W20260709 13:05:58.978763 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.008s	sys 0.009s
I20260709 13:05:59.031364 23858 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.042218 24141 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:59.042265 24129 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.042712 24068 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.043219 24141 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.044013 23858 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.044346 24129 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.044523 23858 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.982585 24063 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.045331 24063 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.045403 24171 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.046823 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:59.000325 24128 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:59.031792 24122 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.048169 22553 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:05:59.048581 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 358) took 1210 ms. Trace:
I20260709 13:05:59.048943 22553 rpcz_store.cc:276] 0709 13:05:57.838419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.046508 (+1208089us) service_pool.cc:224] Handling call
0709 13:05:59.048530 (+  2022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.049935 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:59.050572 22553 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:05:59.051003 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 327) took 1207 ms. Trace:
I20260709 13:05:59.051297 22553 rpcz_store.cc:276] 0709 13:05:57.843500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.049739 (+1206239us) service_pool.cc:224] Handling call
0709 13:05:59.050957 (+  1218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.052420 22553 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:58.994417 24173 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.052906 24173 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.010403 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:59.029345 21900 rpcz_store.cc:276] 0709 13:05:57.422666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.424013 (+  1347us) service_pool.cc:224] Handling call
0709 13:05:57.424327 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.424560 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:57.441865 (+ 17305us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.980056 (+1538191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.980105 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:58.980148 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.980206 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.980745 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14879,"prepare.queue_time_us":17489,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":44789,"spinlock_wait_cycles":38110592,"thread_start_us":1522975,"threads_started":1,"wal-append.queue_time_us":1565902}
I20260709 13:05:59.026676 24108 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.009454 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 440) took 4969 ms. Trace:
I20260709 13:05:59.005959 24143 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.030107 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:59.061487 21904 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:59.062106 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1542) took 1626 ms. Trace:
I20260709 13:05:59.062480 21904 rpcz_store.cc:276] 0709 13:05:57.435339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.048109 (+1612770us) service_pool.cc:224] Handling call
0709 13:05:59.061333 (+ 13224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.061887 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.062048 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.062196 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 457) took 1213 ms. Trace:
I20260709 13:05:59.044706 24068 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:05:58.845002 22519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.000s	sys 0.008s
W20260709 13:05:59.068495 22519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.001s	sys 0.009s
I20260709 13:05:59.007462 22548 rpcz_store.cc:276] 0709 13:05:57.836583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.839034 (+  2451us) service_pool.cc:224] Handling call
0709 13:05:58.938519 (+1099485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.004891 21980 rpcz_store.cc:276] 0709 13:05:57.461699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.867213 (+1405514us) service_pool.cc:224] Handling call
0709 13:05:59.004481 (+137268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.962276 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 329) took 1118 ms. Trace:
I20260709 13:05:59.031260 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1541) took 1599 ms. Trace:
I20260709 13:05:59.010771 23685 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:05:59.054045 24118 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.109s	user 0.002s	sys 0.004s
I20260709 13:05:59.072157 21903 rpcz_store.cc:276] 0709 13:05:57.431630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.969072 (+1537442us) service_pool.cc:224] Handling call
0709 13:05:58.978631 (+  9559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.030965 (+ 52334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.031195 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.073495 21903 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:59.074160 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1546) took 1620 ms. Trace:
I20260709 13:05:59.076205 21903 rpcz_store.cc:276] 0709 13:05:57.454051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.073083 (+1619032us) service_pool.cc:224] Handling call
0709 13:05:59.073348 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.073875 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.074095 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.964810 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:59.003727 23955 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.030382 24123 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.040304 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:58.999241 23844 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.029403 24120 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:05:59.066597 21981 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:59.108466 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1497) took 1494 ms. Trace:
I20260709 13:05:59.108906 21981 rpcz_store.cc:276] 0709 13:05:57.613696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.029876 (+1416180us) service_pool.cc:224] Handling call
0709 13:05:59.108396 (+ 78520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.111354 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1502) took 1353 ms. Trace:
I20260709 13:05:59.111842 21982 rpcz_store.cc:276] 0709 13:05:57.758460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.040045 (+1281585us) service_pool.cc:224] Handling call
0709 13:05:59.111283 (+ 71238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.007782 24103 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.067492 24128 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:58.989686 23890 raft_consensus.cc:1081] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:05:59.054840 24122 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.066401 22553 rpcz_store.cc:276] 0709 13:05:57.848710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.051886 (+1203176us) service_pool.cc:224] Handling call
0709 13:05:59.052133 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.061873 (+  9740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.062111 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.079793 21974 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.108034 23685 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.080500 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:59.059145 24108 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:59.127254 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 129839us
I20260709 13:05:59.127792 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1494) took 1811 ms. Trace:
I20260709 13:05:59.059481 23846 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:59.026383 22547 rpcz_store.cc:276] 0709 13:05:57.836240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.838986 (+  2746us) service_pool.cc:224] Handling call
0709 13:05:57.897472 (+ 58486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.899782 (+1002310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.936682 (+ 36900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.114452 24120 consensus_queue.cc:1243] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:59.070159 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 446) took 2891 ms. Trace:
W20260709 13:05:59.129127 24182 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 13:05:59.068652 24105 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:59.117959 21981 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:05:59.092468 24118 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.150024 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1455) took 1986 ms. Trace:
I20260709 13:05:59.150573 21981 rpcz_store.cc:276] 0709 13:05:57.163958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.117331 (+1953373us) service_pool.cc:224] Handling call
0709 13:05:59.117677 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.149668 (+ 31991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.149959 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.152115 21981 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:59.152820 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1490) took 1837 ms. Trace:
I20260709 13:05:59.153192 21981 rpcz_store.cc:276] 0709 13:05:57.315213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.151516 (+1836303us) service_pool.cc:224] Handling call
0709 13:05:59.151889 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.152556 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.152759 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.055145 23858 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.128185 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:59.128225 21980 rpcz_store.cc:276] 0709 13:05:57.316379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.080172 (+1763793us) service_pool.cc:224] Handling call
0709 13:05:59.127729 (+ 47557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.116736 24152 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.116390 24100 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:59.138705 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:59.143503 24066 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:59.141970 21974 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:05:59.142421 23943 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.142899 23895 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:59.143504 24020 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.144522 24003 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.072072 22550 rpcz_store.cc:276] 0709 13:05:57.851278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.943751 (+ 92473us) service_pool.cc:224] Handling call
0709 13:05:58.958678 (+1014927us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:59.116092 24167 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:59.160425 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:59.135190 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1452) took 1972 ms. Trace:
I20260709 13:05:59.170820 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1499) took 1556 ms. Trace:
I20260709 13:05:59.173179 24185 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:59.173512 24120 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:59.175712 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:59.180783 21909 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:05:59.145227 23963 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:59.429030 21975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 238) took 2925 ms (client timeout 2216 ms). Trace:
I20260709 13:05:59.057816 22549 rpcz_store.cc:276] 0709 13:05:54.040283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.068686 (+ 28403us) service_pool.cc:224] Handling call
0709 13:05:54.069072 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:54.098257 (+ 29185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:54.101711 (+  3454us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:54.875904 (+774193us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b2c000474b8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:05:54.930894 (+ 54990us) log.cc:844] Serialized 26 byte log entry
0709 13:05:55.229531 (+298637us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:55.229591 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.229694 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.231705 (+3002011us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:05:59.006081 (+774376us) raft_consensus.cc:1685] finished
0709 13:05:59.007580 (+  1499us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.009268 (+  1688us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28890,"raft.queue_time_us":25477,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":18006784,"thread_start_us":211622,"threads_started":1,"wal-append.queue_time_us":527652}
I20260709 13:05:59.169634 23846 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.380842 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1547) took 1917 ms. Trace:
I20260709 13:05:59.449994 21974 rpcz_store.cc:276] 0709 13:05:57.622026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.964574 (+1342548us) service_pool.cc:224] Handling call
0709 13:05:59.170768 (+206194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:59.440953 21975 rpcz_store.cc:269] 0709 13:05:56.503997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.564358 (+ 60361us) service_pool.cc:224] Handling call
0709 13:05:59.428789 (+2864431us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x7b54000b7a54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:59.428939 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205840768}
W20260709 13:05:59.453418 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:59.455330 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 279671us
I20260709 13:05:59.457033 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:59.458230 21974 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.458181 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:59.462114 21828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1475) took 2250 ms (client timeout 2049 ms). Trace:
W20260709 13:05:59.462536 21828 rpcz_store.cc:269] 0709 13:05:57.212131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.220263 (+  8132us) service_pool.cc:224] Handling call
0709 13:05:59.461928 (+2241665us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b54000e8dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:59.462029 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60782336}
I20260709 13:05:59.463660 24185 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.421576 23955 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.410252 23724 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:59.431975 24173 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.421185 24103 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:59.423272 24108 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.422397 24118 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.465238 23724 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.467888 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:05:59.468772 23724 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.459959 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:59.471387 21975 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:59.440681 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1454) took 3927 ms. Trace:
I20260709 13:05:59.472398 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:05:59.472995 21975 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.472014 21978 rpcz_store.cc:276] 0709 13:05:55.513289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.529156 (+ 15867us) service_pool.cc:224] Handling call
0709 13:05:56.429666 (+900510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.444565 (+ 14899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.440474 (+2995909us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54002d5350. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:59.440627 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956843776}
I20260709 13:05:59.474529 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:59.475567 24122 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.476387 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:05:59.309319 24186 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:05:59.476500 24181 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:59.470394 24185 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.478401 24181 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:59.480602 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1540) took 2057 ms. Trace:
I20260709 13:05:59.167047 24100 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:05:59.495013 24185 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:59.483554 21974 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:59.486178 21975 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:05:59.404340 23844 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.171882 23890 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:59.439698 21976 rpcz_store.cc:276] 0709 13:05:57.163214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.273604 (+110390us) service_pool.cc:224] Handling call
0709 13:05:57.273819 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.273989 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:57.916677 (+642688us) log.cc:844] Serialized 14 byte log entry
0709 13:05:59.134858 (+1218181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.134914 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:59.134962 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.135030 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.135136 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8803,"prepare.queue_time_us":966321,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":77884,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7781,"thread_start_us":1851391,"threads_started":3,"wal-append.queue_time_us":1080348}
I20260709 13:05:59.454994 21903 rpcz_store.cc:276] 0709 13:05:57.463331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.077061 (+1613730us) service_pool.cc:224] Handling call
0709 13:05:59.380170 (+303109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.380406 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.380444 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.380496 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:59.380538 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.380628 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.380768 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.480978 21906 rpcz_store.cc:276] 0709 13:05:57.422964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.424020 (+  1056us) service_pool.cc:224] Handling call
0709 13:05:57.443453 (+ 19433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.854002 (+410549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.480361 (+1626359us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54000fbc54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:05:59.480526 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819297536}
W20260709 13:05:59.511795 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.179452 24195 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:59.172298 24119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.584s	user 0.008s	sys 0.007s
I20260709 13:05:59.500363 21978 raft_consensus.cc:2410] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:59.269913 24190 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:59.395757 24171 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.510696 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1496) took 2190 ms. Trace:
I20260709 13:05:59.510932 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1495) took 2194 ms. Trace:
I20260709 13:05:59.518914 21976 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:59.519819 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1461) took 2078 ms. Trace:
I20260709 13:05:59.520411 21976 rpcz_store.cc:276] 0709 13:05:57.441340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.518399 (+2077059us) service_pool.cc:224] Handling call
0709 13:05:59.518690 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.519555 (+   865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.519772 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.518299 21975 rpcz_store.cc:276] 0709 13:05:57.320367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.509640 (+2189273us) service_pool.cc:224] Handling call
0709 13:05:59.510028 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.510286 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.510323 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.510391 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:59.510441 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.510509 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.510630 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.522837 21975 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:59.486968 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 326594us
W20260709 13:05:59.499369 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.523581 21978 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:59.524130 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1503) took 1748 ms. Trace:
I20260709 13:05:59.524334 21978 rpcz_store.cc:276] 0709 13:05:57.776142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.523164 (+1747022us) service_pool.cc:224] Handling call
0709 13:05:59.523403 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.523961 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.524090 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:59.314071 24163 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:05:59.525580 21903 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:59.526198 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1550) took 2062 ms. Trace:
I20260709 13:05:59.526485 21903 rpcz_store.cc:276] 0709 13:05:57.464114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.518221 (+2054107us) service_pool.cc:224] Handling call
0709 13:05:59.525431 (+  7210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.525953 (+   522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.526114 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.526880 21978 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:05:59.528189 21978 pending_rounds.cc:85] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 2
I20260709 13:05:59.528606 21978 pending_rounds.cc:107] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:05:59.514544 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1543) took 2072 ms. Trace:
I20260709 13:05:59.519043 21974 rpcz_store.cc:276] 0709 13:05:57.316592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.510253 (+2193661us) service_pool.cc:224] Handling call
0709 13:05:59.510511 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.510664 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.510687 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.510724 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:59.510752 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.510801 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.510886 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.271756 24146 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.242558 24063 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:59.300209 24141 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:05:59.216588 23685 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.523573 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1500) took 1828 ms. Trace:
W20260709 13:05:59.518180 24119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.930s	user 0.010s	sys 0.008s
I20260709 13:05:59.181824 24123 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:59.318892 24196 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.210s
I20260709 13:05:59.531461 21974 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:59.404228 22551 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:05:59.532549 21903 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:59.559031 21974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:05:59.562268 21974 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.562677 21974 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.529409 21900 rpcz_store.cc:276] 0709 13:05:57.442373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.054618 (+1612245us) service_pool.cc:224] Handling call
0709 13:05:59.054897 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.056670 (+  1773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.056700 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.057121 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.508203 (+451082us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:59.508239 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.508326 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.514325 (+  5999us) raft_consensus.cc:1685] finished
0709 13:05:59.514342 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.514470 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1426,"raft.queue_time_us":2285,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":11571,"thread_start_us":450779,"threads_started":1,"wal-append.queue_time_us":455803}
W20260709 13:05:59.495543 23897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.025s	sys 0.057s
I20260709 13:05:59.549738 21978 raft_consensus.cc:2917] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:05:59.456750 24120 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.565665 21978 raft_consensus.cc:2889] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:59.549497 21975 rpcz_store.cc:276] 0709 13:05:57.695258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.521991 (+1826733us) service_pool.cc:224] Handling call
0709 13:05:59.522669 (+   678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.523300 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.523511 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.567603 24120 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.182606 24066 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.147739 22546 rpcz_store.cc:276] 0709 13:05:56.176937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.181720 (+  4783us) service_pool.cc:224] Handling call
0709 13:05:56.396541 (+214821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.441986 (+ 45445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.057087 (+2615101us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400463f50. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:59.068498 (+ 11411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285097216}
I20260709 13:05:59.574525 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1489) took 2259 ms. Trace:
I20260709 13:05:59.570827 23858 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.586619 21982 rpcz_store.cc:276] 0709 13:05:57.314874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.112585 (+1797711us) service_pool.cc:224] Handling call
0709 13:05:59.112962 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.113380 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.113418 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.113886 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.378815 (+264929us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:59.378861 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.378925 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.574347 (+195422us) raft_consensus.cc:1685] finished
0709 13:05:59.574369 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.574474 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":230246,"threads_started":1,"wal-append.queue_time_us":282572}
I20260709 13:05:59.169636 24152 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.182474 23943 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.569828 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:59.552006 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1549) took 2088 ms. Trace:
I20260709 13:05:59.592406 21906 rpcz_store.cc:276] 0709 13:05:57.463876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.517709 (+2053833us) service_pool.cc:224] Handling call
0709 13:05:59.551556 (+ 33847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.551718 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.551742 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.551780 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:59.551813 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.551862 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.551957 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.593672 21900 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:59.594319 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1555) took 2129 ms. Trace:
I20260709 13:05:59.594661 21900 rpcz_store.cc:276] 0709 13:05:57.465279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.592130 (+2126851us) service_pool.cc:224] Handling call
0709 13:05:59.593507 (+  1377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.594073 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.594269 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.595016 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:59.595633 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:59.590032 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 352) took 1783 ms. Trace:
I20260709 13:05:59.518281 23844 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.598158 21974 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.270078 24020 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.315634 24019 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:59.570247 23897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.025s	sys 0.058s
I20260709 13:05:59.494853 23846 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:59.609788 24201 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:05:59.610219 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1487) took 2660 ms. Trace:
I20260709 13:05:59.606452 23858 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:59.611461 23858 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:59.610576 21983 rpcz_store.cc:276] 0709 13:05:56.949293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.101456 (+152163us) service_pool.cc:224] Handling call
0709 13:05:57.125449 (+ 23993us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:57.135916 (+ 10467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.135961 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:57.136613 (+   652us) log.cc:844] Serialized 52 byte log entry
0709 13:05:58.964119 (+1827506us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:58.964155 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.964216 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.609988 (+645772us) raft_consensus.cc:1685] finished
0709 13:05:59.610006 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.610143 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9791,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":120,"thread_start_us":1827116,"threads_started":1,"wal-append.queue_time_us":1911245}
I20260709 13:05:59.612118 21976 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:59.565689 24100 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.555932 24195 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:59.586771 24185 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:05:59.613572 24195 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.554402 24176 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:05:59.614220 21901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1502) took 3044 ms (client timeout 2088 ms). Trace:
I20260709 13:05:59.614041 24185 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.614624 24176 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.608300 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:59.615733 21906 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:05:59.614156 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1548) took 2150 ms. Trace:
I20260709 13:05:59.599099 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:59.620080 21900 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:05:59.614643 21901 rpcz_store.cc:269] 0709 13:05:56.570285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.570413 (+   128us) service_pool.cc:224] Handling call
0709 13:05:59.614000 (+3043587us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54002e68d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:59.614125 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449859328}
I20260709 13:05:59.616641 21908 rpcz_store.cc:276] 0709 13:05:57.463625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.168940 (+1705315us) service_pool.cc:224] Handling call
0709 13:05:59.169233 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.174302 (+  5069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.174350 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.174704 (+   354us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.378815 (+204111us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:59.378856 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.378926 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.613957 (+235031us) raft_consensus.cc:1685] finished
0709 13:05:59.613977 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.614096 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4680,"raft.queue_time_us":14192,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":57654,"thread_start_us":203582,"threads_started":1,"wal-append.queue_time_us":259221}
I20260709 13:05:59.597645 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:59.511538 23890 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.601608 21975 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:59.554211 24141 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.654413 23906 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:59.655566 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:05:59.527920 24190 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.655963 23906 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.596412 22551 rpcz_store.cc:276] 0709 13:05:57.806221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.807446 (+  1225us) service_pool.cc:224] Handling call
0709 13:05:59.274276 (+1466830us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:05:59.330002 (+ 55726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.571293 (+241291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.589964 (+ 18671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19287424}
I20260709 13:05:59.527683 24181 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.657624 23963 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.658453 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1493) took 2342 ms. Trace:
I20260709 13:05:59.654413 24120 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.658792 21980 rpcz_store.cc:276] 0709 13:05:57.316121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.158790 (+1842669us) service_pool.cc:224] Handling call
0709 13:05:59.159140 (+   350us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:59.173860 (+ 14720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.173893 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:59.174584 (+   691us) log.cc:844] Serialized 78 byte log entry
0709 13:05:59.532380 (+357796us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:59.532432 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.532514 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.658241 (+125727us) raft_consensus.cc:1685] finished
0709 13:05:59.658260 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.658403 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11569,"raft.queue_time_us":14481,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":357359,"threads_started":1,"wal-append.queue_time_us":424927}
I20260709 13:05:59.660049 24120 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.607837 21974 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:59.612304 23858 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.599692 23889 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:59.608167 24192 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:05:59.664759 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:59.666234 23892 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:59.666669 23892 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:05:59.667026 23892 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.669881 23890 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.671428 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:59.673741 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:05:59.674392 21908 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:59.631371 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:05:59.675169 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 43895.9us
I20260709 13:05:59.570508 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1551) took 2106 ms. Trace:
I20260709 13:05:59.569296 24123 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.677268 21903 rpcz_store.cc:276] 0709 13:05:57.464336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.527479 (+2063143us) service_pool.cc:224] Handling call
0709 13:05:59.532394 (+  4915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.561832 (+ 29438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.570457 (+  8625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.680147 23897 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.680193 23889 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:59.680855 23897 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.681419 23889 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.682488 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1545) took 2235 ms. Trace:
I20260709 13:05:59.682849 21904 rpcz_store.cc:276] 0709 13:05:57.446956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.063169 (+1616213us) service_pool.cc:224] Handling call
0709 13:05:59.073400 (+ 10231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.079120 (+  5720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.079163 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.110221 (+ 31058us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.553159 (+442938us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:59.553197 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.553256 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.682276 (+129020us) raft_consensus.cc:1685] finished
0709 13:05:59.682297 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.682437 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5352,"raft.queue_time_us":5511,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":13978,"spinlock_wait_cycles":1326080,"thread_start_us":430697,"threads_started":1,"wal-append.queue_time_us":564504}
I20260709 13:05:59.694232 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1559) took 2087 ms. Trace:
I20260709 13:05:59.694887 21903 rpcz_store.cc:276] 0709 13:05:57.607250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.678379 (+2071129us) service_pool.cc:224] Handling call
0709 13:05:59.693699 (+ 15320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.693883 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.693910 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.693953 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:59.693987 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.694042 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.694146 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.696070 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:59.728803 24192 consensus_queue.cc:1243] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:05:59.676785 24151 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:59.729620 24151 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:59.730587 24151 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.731492 24188 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:59.732139 24188 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:59.733161 24188 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:59.733844 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:59.734756 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 58905.5us
W20260709 13:05:59.735824 24165 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.679s	user 0.003s	sys 0.000s
I20260709 13:05:59.737085 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1518) took 2408 ms. Trace:
I20260709 13:05:59.742889 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1560) took 2110 ms. Trace:
I20260709 13:05:59.737555 21902 rpcz_store.cc:276] 0709 13:05:57.328490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.328655 (+   165us) service_pool.cc:224] Handling call
0709 13:05:57.329002 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.329377 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.329415 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.366676 (+ 37261us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.843359 (+1476683us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:58.843405 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.843479 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.735275 (+891796us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:05:59.736716 (+  1441us) raft_consensus.cc:1685] finished
0709 13:05:59.736742 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.736994 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29623,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"spinlock_wait_cycles":9110912,"thread_start_us":1453285,"threads_started":1,"wal-append.queue_time_us":1651408}
I20260709 13:05:59.744818 21904 rpcz_store.cc:276] 0709 13:05:57.632755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.684812 (+2052057us) service_pool.cc:224] Handling call
0709 13:05:59.742299 (+ 57487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.742519 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.742554 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.742607 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:59.742649 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.742715 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.742831 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.746533 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1565) took 2007 ms. Trace:
I20260709 13:05:59.746954 21902 rpcz_store.cc:276] 0709 13:05:57.739457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.745287 (+2005830us) service_pool.cc:224] Handling call
0709 13:05:59.745682 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.746037 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.746076 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.746129 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:59.746273 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.746346 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.746471 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.677161 24132 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.750219 23963 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.743973 24192 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:59.763830 23963 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.764324 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1566) took 2021 ms. Trace:
I20260709 13:05:59.764612 24192 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:59.765166 24192 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:59.764694 21904 rpcz_store.cc:276] 0709 13:05:57.742968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.745928 (+2002960us) service_pool.cc:224] Handling call
0709 13:05:59.763875 (+ 17947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.764040 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.764065 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.764100 (+    35us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:59.764136 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.764183 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.764274 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.766319 24100 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.766773 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1524) took 1850 ms. Trace:
I20260709 13:05:59.766185 24192 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.767107 21904 rpcz_store.cc:276] 0709 13:05:57.916746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.766057 (+1849311us) service_pool.cc:224] Handling call
0709 13:05:59.766329 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.766494 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.766518 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:59.766555 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:59.766593 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.766641 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.766727 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:59.767719 24192 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.768111 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 227) took 3272 ms. Trace:
I20260709 13:05:59.768448 21977 rpcz_store.cc:276] 0709 13:05:56.495662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.498923 (+  3261us) service_pool.cc:224] Handling call
0709 13:05:57.518962 (+1020039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.781108 (+262146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.767936 (+1986828us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540005afd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:59.768063 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345197824}
W20260709 13:05:59.772792 21909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1558) took 2175 ms (client timeout 1991 ms). Trace:
W20260709 13:05:59.773298 21909 rpcz_store.cc:269] 0709 13:05:57.597139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.890681 (+293542us) service_pool.cc:224] Handling call
0709 13:05:59.772592 (+1881911us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54003c9454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:05:59.772711 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2278709504}
W20260709 13:05:59.790230 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 114539us
I20260709 13:05:59.792160 21904 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:59.791450 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:05:59.794582 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:59.804147 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:59.805540 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:59.806586 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:59.813591 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.815572 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:59.816238 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:59.816797 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:59.854106 21830 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:05:59.752697 24132 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.831282 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:05:59.832062 21832 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:59.818037 23906 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.848754 21826 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:59.814711 23895 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.822458 23844 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.815205 24118 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:05:59.818222 23374 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:59.815007 23685 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:05:59.819413 24016 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:05:59.865972 21949 connection.cc:256] RPC call timeout handler was delayed by -1.9057943610000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:05:59.822739 24174 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:05:59.847715 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:05:59.866643 21949 connection.cc:256] RPC call timeout handler was delayed by -1.6942943610000611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:05:59.859827 22521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.007s	sys 0.028s
I20260709 13:05:59.867941 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:05:59.852430 21828 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:59.868757 21828 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:59.851501 24185 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:05:59.868227 22521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.007s	sys 0.029s
I20260709 13:05:59.796561 24171 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:59.867383 21949 connection.cc:256] RPC call timeout handler was delayed by -1.3280174270000771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 13:05:59.861999 24150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.011s	sys 0.027s
I20260709 13:05:59.880281 24132 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.878957 23844 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:05:59.887830 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 745647us
I20260709 13:05:59.864140 24112 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:59.860275 23895 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.892378 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:59.919464 21977 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:59.920562 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:59.894069 21975 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:05:59.879400 24066 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.862573 23897 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.832240 24175 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:05:59.896109 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:59.898979 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:05:59.938786 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:59.939901 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:05:59.940815 24174 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:59.941180 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:05:59.941270 24175 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:59.897573 24150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.012s	sys 0.027s
I20260709 13:05:59.942001 24174 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:59.942418 24174 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.942770 24174 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.902457 21983 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:59.902467 23963 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.903064 23892 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.945114 23892 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.903698 23906 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:59.945617 23906 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:59.946393 23906 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.946910 24057 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.947542 23906 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.863654 23374 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:05:59.949717 24174 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:05:59.950354 23374 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.950774 23732 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:59.951236 23732 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:05:59.951735 24174 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:59.952265 23732 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.953809 23732 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:59.905821 24168 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.013s	user 0.000s	sys 0.002s
I20260709 13:05:59.898056 23685 consensus_queue.cc:1243] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:59.864504 23846 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:05:59.906328 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:59.907704 24180 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:59.907434 23844 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:05:59.908334 24152 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.898491 24195 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.914083 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:59.883513 24190 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.882965 24176 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.882761 23943 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.891180 24123 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.910498 23861 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:05:59.879603 24120 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.987680 24019 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.987251 24180 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:05:59.959163 23374 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:05:59.964967 24199 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.657s	user 0.002s	sys 0.000s
I20260709 13:05:59.882757 24141 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:05:59.925719 23895 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.988629 22552 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:05:59.897235 24171 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.019894 23844 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:00.019788 23969 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.020057 24171 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:00.023680 24180 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.027407 24180 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:00.036468 24179 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.037286 24179 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:05:59.894371 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 86684.3us
W20260709 13:06:00.071264 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 254909us
I20260709 13:06:00.073231 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:00.074043 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.074713 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.896263 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.079155 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.080542 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.081005 21831 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:00.081789 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:00.082950 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.084293 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:00.084555 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:00.087224 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.077339 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:00.091059 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1523) took 2177 ms. Trace:
I20260709 13:05:59.886452 21828 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.091593 21902 rpcz_store.cc:276] 0709 13:05:57.913676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.747996 (+1834320us) service_pool.cc:224] Handling call
0709 13:05:59.771122 (+ 23126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.771775 (+   653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.771814 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.772313 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.893515 (+121202us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:59.893576 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.893667 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.035790 (+142123us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:00.090399 (+ 54609us) raft_consensus.cc:1685] finished
0709 13:06:00.090443 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.090830 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":10644736,"thread_start_us":120746,"threads_started":1,"wal-append.queue_time_us":210124}
I20260709 13:06:00.093386 21828 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:00.095396 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.097843 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.901093 21976 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:00.098518 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.098585 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:05:59.985540 21982 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:05:59.981678 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:05:59.982089 21949 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:00.102402 21983 raft_consensus.cc:2410] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:59.930987 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:00.104288 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 122167us
I20260709 13:06:00.116129 23685 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:00.117326 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.116137 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.120160 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.122355 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.122766 23685 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.124020 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:05:59.960520 22521 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:00.132344 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.140337 22555 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
W20260709 13:06:00.141101 21825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1481) took 3664 ms (client timeout 1885 ms). Trace:
I20260709 13:06:00.141278 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:00.146425 23886 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.148322 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.148947 24179 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:06:00.148880 23906 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:00.022393 23969 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:00.142299 23861 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.101928 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:00.104295 21977 raft_consensus.cc:2376] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7. Re-sending same reply.
I20260709 13:06:00.149524 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.154244 24027 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:00.155019 24015 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:00.156528 24015 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.146476 23892 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:00.158748 23892 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:00.159034 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:00.160068 21832 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:00.160408 21832 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:00.161052 24026 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:00.161561 24026 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:00.164296 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.165486 23923 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:00.147517 21825 rpcz_store.cc:269] 0709 13:05:56.476072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.477817 (+  1745us) service_pool.cc:224] Handling call
0709 13:06:00.140569 (+3662752us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001d6ad4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:00.140828 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3251068672}
I20260709 13:06:00.153687 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.168238 21827 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:00.162003 21832 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.170397 21832 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.170303 24067 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.171408 24072 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:00.174273 24016 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:00.174753 24016 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:00.176321 24016 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.182305 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:00.160341 23892 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:00.183931 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 77857.9us
W20260709 13:06:00.174875 21874 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.017s	sys 0.022s
W20260709 13:06:00.203676 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.204996 21832 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
W20260709 13:06:00.206975 21874 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.018s	sys 0.023s
I20260709 13:06:00.166013 23923 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:00.218433 23844 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:00.219131 23844 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:00.219908 22555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 360) took 2376 ms (client timeout 1748 ms). Trace:
W20260709 13:06:00.220376 22555 rpcz_store.cc:269] 0709 13:05:57.843174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.943601 (+100427us) service_pool.cc:224] Handling call
0709 13:06:00.219655 (+2276054us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b540043cbd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:00.219805 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5043018496}
I20260709 13:06:00.221720 23844 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:00.222374 24226 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 13:06:00.222625 21826 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:00.223829 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.225114 23846 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.207417 24072 raft_consensus.cc:2764] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:00.225744 23846 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.228274 23846 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:00.228878 23897 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:06:00.234776 21834 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:00.235253 21949 leader_election.cc:400] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
I20260709 13:06:00.235625 21949 leader_election.cc:403] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:06:00.237409 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 92772.8us
W20260709 13:06:00.238636 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 137032us
I20260709 13:06:00.242126 21830 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:06:00.243196 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45241.3us
W20260709 13:06:00.247200 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 881174us
W20260709 13:06:00.251955 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.252827 24171 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.210325 24016 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:00.261731 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.263687 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.269398 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:00.270750 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.270526 24026 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.271687 21974 raft_consensus.cc:2410] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:00.272215 24026 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.273630 23374 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:00.276598 21974 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:00.277930 24067 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:00.284338 21976 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:00.291870 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:00.284945 23732 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.293092 23732 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.286419 21981 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:06:00.294093 21981 pending_rounds.cc:85] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 5
I20260709 13:06:00.294422 21981 pending_rounds.cc:107] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:06:00.294737 21981 raft_consensus.cc:2889] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.295228 23732 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:00.278235 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.290750 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.296967 21982 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:00.298092 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.299150 21902 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:00.300990 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.302271 21900 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:00.191459 23685 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:06:00.274803 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:00.315639 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 77642.7us
I20260709 13:06:00.319386 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.320008 21834 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:00.321768 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 107054us
W20260709 13:06:00.321900 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 361328us
W20260709 13:06:00.325708 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.327315 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.328040 24146 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:00.329056 24196 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:00.329500 24190 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4.
I20260709 13:06:00.264714 23861 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.270777 24171 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.331674 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.332600 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.334019 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:00.334609 23923 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.335579 24067 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:00.337908 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:00.338384 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 79044.9us
I20260709 13:06:00.313385 24063 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.278116 23690 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.339219 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.339442 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.340173 21908 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:06:00.339061 24100 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.009s
I20260709 13:06:00.365746 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.356884 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:00.356055 21828 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:00.366549 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.358230 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:00.358731 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:00.359088 21832 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:00.360455 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.355427 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.365542 21902 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:00.355026 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:00.358824 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:00.368598 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.359637 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.362509 21975 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:00.354108 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.444599 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:00.362282 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.368363 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1491) took 3052 ms. Trace:
I20260709 13:06:00.366071 23923 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:00.454885 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 104829us
I20260709 13:06:00.448973 21981 rpcz_store.cc:276] 0709 13:05:57.315512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.154045 (+1838533us) service_pool.cc:224] Handling call
0709 13:05:59.157683 (+  3638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.295399 (+1137716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.367985 (+ 72586us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400225bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:00.368258 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2593948928}
I20260709 13:06:00.467931 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.357156 24112 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 13:06:00.482295 21901 raft_consensus.cc:2410] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:06:00.482555 21976 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:00.482699 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.483409 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.367022 24067 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:00.454747 24020 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.718s	user 0.007s	sys 0.020s
W20260709 13:06:00.471522 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 114871us
I20260709 13:06:00.471429 24174 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:00.364378 24171 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:00.474493 21982 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
W20260709 13:06:00.456210 23858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.008s	sys 0.016s
I20260709 13:06:00.365885 23969 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.486053 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.486866 23969 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.487321 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.488183 21982 raft_consensus.cc:2410] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:00.488652 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.488966 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:00.476873 21903 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:00.489979 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.491127 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1564) took 2756 ms. Trace:
I20260709 13:06:00.491362 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.491493 21903 rpcz_store.cc:276] 0709 13:05:57.735324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.716759 (+1981435us) service_pool.cc:224] Handling call
0709 13:05:59.790215 (+ 73456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.490158 (+699943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.490855 (+   697us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54002e68d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:00.491074 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578295552}
I20260709 13:06:00.492746 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.477268 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:00.495287 21980 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:00.495812 21908 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.496654 21980 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:00.498021 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:00.358613 24085 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:06:00.470923 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:00.498368 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.499500 21983 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:00.500008 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.459275 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.500895 22555 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:00.455060 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 97313.5us
I20260709 13:06:00.449872 24063 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.454113 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:00.489672 21982 raft_consensus.cc:2376] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5. Re-sending same reply.
I20260709 13:06:00.473102 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.470620 21904 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:06:00.485165 21907 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:00.478389 23690 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:00.445679 21948 connection.cc:256] RPC call timeout handler was delayed by -1.3044111440000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 13:06:00.360014 24196 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.482129 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.362066 23861 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:00.483527 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.464797 21829 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:00.494026 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:00.359695 24146 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:00.477696 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.474599 21827 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:00.482295 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.474880 21979 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:00.490018 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.476959 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.489686 21909 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:00.475831 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.501281 22555 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:00.454699 21978 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:00.512042 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.512938 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.510789 21977 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
W20260709 13:06:00.456081 23890 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.786s	user 0.009s	sys 0.014s
W20260709 13:06:00.512233 21907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1507) took 3393 ms (client timeout 2187 ms). Trace:
I20260709 13:06:00.501044 22551 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:00.525060 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.511242 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.477726 24179 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.521613 21900 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.641338 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.659678 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:00.659967 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.579448 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.655401 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:00.551723 21907 rpcz_store.cc:269] 0709 13:05:57.118709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.118914 (+   205us) service_pool.cc:224] Handling call
0709 13:06:00.511985 (+3393071us) spinlock_profiling.cc:243] Waited 3.35 s on lock 0x7b540020bcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:00.512134 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7714679168}
W20260709 13:06:00.633347 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 70178.7us
I20260709 13:06:00.582369 21977 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:00.662866 21834 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:00.590600 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.588476 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.552974 22554 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 3.
I20260709 13:06:00.469326 24170 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.588248 21906 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:00.662467 21831 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:00.588778 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.483733 21729 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.609174 21902 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:00.619756 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.576346 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:00.624433 21828 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
W20260709 13:06:00.685982 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.582736 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.676254 21908 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
W20260709 13:06:00.699049 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.609536 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 54823.8us
I20260709 13:06:00.590178 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:00.699820 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.699937 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.575743 21974 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:00.620062 21976 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:00.698321 22553 raft_consensus.cc:2410] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:00.697969 21825 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:00.703393 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.520162 24196 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.726310 24179 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.726858 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:00.727569 21908 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:00.728928 24179 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:00.484846 23895 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.729559 21909 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:00.618875 24020 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:00.704994 24100 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.730334 21832 raft_consensus.cc:2376] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3. Re-sending same reply.
I20260709 13:06:00.730552 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.590576 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:00.731280 21909 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:00.589892 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.733668 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:00.732851 21832 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:00.732249 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.701287 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:00.708323 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.590411 21905 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:00.705659 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.734372 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:00.752530 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.732599 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.763090 21908 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:00.765033 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:00.733924 21829 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:06:00.627460 22555 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.768009 21830 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:06:00.767251 21901 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:00.771173 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:00.732739 24234 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:00.551429 23690 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:00.784003 21825 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:00.784309 21906 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.551518 24146 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:06:00.787739 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 128780us
I20260709 13:06:00.787613 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:00.778076 21826 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
W20260709 13:06:00.794907 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 273989us
I20260709 13:06:00.571756 23890 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.805524 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.806098 21900 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:00.730587 24020 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.813576 21908 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.812398 21902 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:00.814616 21902 pending_rounds.cc:85] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 3
I20260709 13:06:00.814814 21902 pending_rounds.cc:107] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:06:00.815044 21902 raft_consensus.cc:2889] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.816146 21729 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:00.817512 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 163561us
I20260709 13:06:00.816008 21834 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:00.820148 21834 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:00.812278 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:00.779250 24170 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.823516 21904 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:00.823524 21907 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:00.823640 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:00.826414 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:00.803306 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:00.833256 21900 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:06:00.824999 21834 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.834645 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:00.838411 24128 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:00.838972 24128 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.841125 24128 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:00.843634 21833 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 4: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:00.844313 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.844410 24240 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:00.844897 24240 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.845307 24240 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:00.834888 21900 pending_rounds.cc:85] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 2
I20260709 13:06:00.848325 21900 pending_rounds.cc:107] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:06:00.848759 21900 raft_consensus.cc:2889] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.854763 24016 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:00.854928 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:00.856904 24066 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:00.849332 24146 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.858372 24066 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:00.858760 24146 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:00.859311 24066 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:00.859789 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:00.863075 24237 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:00.864534 21976 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:00.866860 21975 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:00.860437 24123 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:00.857393 21729 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:00.863788 24238 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:00.851317 23895 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:00.898681 21834 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.870055 21729 catalog_manager.cc:5697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 5, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 5 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:06:00.900990 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 66433.3us
I20260709 13:06:00.866727 23890 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:00.873157 24066 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.909719 24020 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:00.912737 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1499) took 1111 ms. Trace:
I20260709 13:06:00.913125 21833 rpcz_store.cc:276] 0709 13:05:59.801531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.805125 (+  3594us) service_pool.cc:224] Handling call
0709 13:06:00.912479 (+1107354us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54002733d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:00.912663 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2023628544}
I20260709 13:06:00.868031 24128 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:00.907512 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:00.922554 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 111757us
I20260709 13:06:00.923979 21729 catalog_manager.cc:5697] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 4, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 4 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.930886 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:00.927225 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:00.938690 23844 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:00.965459 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 165192us
I20260709 13:06:00.965468 24082 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:06:00.929665 24170 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:00.966979 21729 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.920363 24196 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:00.966567 24020 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.974714 21729 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 6, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 6 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.973809 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:00.983578 24249 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:00.967156 23844 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.995152 21906 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:00.943306 24128 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:01.003921 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:00.975112 23969 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:01.009022 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 75559.2us
I20260709 13:06:00.995931 24170 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:01.027361 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.027474 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:01.008607 23861 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:01.028291 21827 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
W20260709 13:06:01.028869 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 54854.4us
W20260709 13:06:01.031476 24239 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:00.986122 24020 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:01.033382 24248 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:01.034772 24020 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:01.038618 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:01.039882 24174 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:01.040405 24174 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.040951 24174 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:01.043938 24196 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:01.043987 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:01.002580 23844 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:01.025444 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:02.414935 21829 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
W20260709 13:06:02.415433 21829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 224) took 1390 ms (client timeout 1750 ms). Trace:
W20260709 13:06:02.415755 21829 rpcz_store.cc:269] 0709 13:06:01.025084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.025203 (+   119us) service_pool.cc:224] Handling call
0709 13:06:02.415383 (+1390180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:01.022264 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:02.417788 21825 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:01.017962 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:01.021493 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:01.024215 21830 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:02.684404 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 223) took 1667 ms. Trace:
I20260709 13:06:01.022324 22547 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:06:02.688529 22547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 334) took 2191 ms (client timeout 1688 ms). Trace:
W20260709 13:06:02.688951 22547 rpcz_store.cc:269] 0709 13:06:00.497351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.497595 (+   244us) service_pool.cc:224] Handling call
0709 13:06:02.688293 (+2190698us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54004c4354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:02.688443 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162577664}
I20260709 13:06:01.013782 23890 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:01.043772 24240 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:01.051903 24243 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:06:02.697899 24240 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:01.045621 24146 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:02.269942 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.270368 22519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.306s	user 0.042s	sys 0.017s
I20260709 13:06:02.700390 23890 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.700549 22519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.737s	user 0.042s	sys 0.017s
I20260709 13:06:02.700953 23890 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:02.701653 22519 connection.cc:256] RPC call timeout handler was delayed by -1.4871252770000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 13:06:02.702095 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.702514 22519 connection.cc:256] RPC call timeout handler was delayed by -1.3509615970000368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 13:06:02.702805 22519 connection.cc:256] RPC call timeout handler was delayed by -1.2859456499999169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 13:06:02.322638 21799 connection.cc:256] RPC call timeout handler was delayed by -1.1716429580000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
I20260709 13:06:02.703054 23890 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:02.703325 21799 connection.cc:256] RPC call timeout handler was delayed by -1.1671429579999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 13:06:02.704375 23890 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:02.323285 21949 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:02.336817 23844 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.704857 23890 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.705802 23895 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.351058 24066 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.442s	user 0.010s	sys 0.010s
I20260709 13:06:02.357487 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1511) took 1719 ms. Trace:
I20260709 13:06:02.708231 23895 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.708483 21834 rpcz_store.cc:276] 0709 13:06:00.637890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.736161 (+ 98271us) service_pool.cc:224] Handling call
0709 13:06:00.790775 (+ 54614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.357039 (+1566264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.357068 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.357125 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:02.357177 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.357250 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.357401 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40046,"raft.queue_time_us":1354967,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83}
I20260709 13:06:02.364651 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 225) took 1338 ms. Trace:
W20260709 13:06:02.369062 24174 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.328s	user 0.009s	sys 0.010s
I20260709 13:06:02.377921 24020 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:02.710269 24174 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:02.710847 22521 leader_election.cc:336] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.854s (SENT)
I20260709 13:06:02.711107 24020 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.710084 21832 rpcz_store.cc:276] 0709 13:06:01.026153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.026317 (+   164us) service_pool.cc:224] Handling call
0709 13:06:01.026615 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.307304 (+1280689us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:02.308290 (+   986us) log.cc:844] Serialized 14 byte log entry
0709 13:06:02.361249 (+ 52959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.361299 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:02.361344 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.364417 (+  3073us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b54000ea1d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:02.364460 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.364596 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50782,"prepare.queue_time_us":977,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":50869,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":42684672,"thread_start_us":1246,"threads_started":2,"wal-append.queue_time_us":894}
I20260709 13:06:02.712528 24174 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.713054 24020 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.383622 24063 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:02.713419 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 371) took 2225 ms. Trace:
I20260709 13:06:02.390511 24171 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:02.713799 24063 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:02.714200 24171 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.713824 22550 rpcz_store.cc:276] 0709 13:06:00.487946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.492687 (+  4741us) service_pool.cc:224] Handling call
0709 13:06:00.493104 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.493509 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.493557 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:00.494160 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:06:00.803018 (+308858us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:00.804881 (+  1863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.815635 (+ 10754us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:02.713188 (+1897553us) raft_consensus.cc:1685] finished
0709 13:06:02.713206 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.713344 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569024,"thread_start_us":155623,"threads_started":1,"wal-append.queue_time_us":357025}
I20260709 13:06:02.715662 24016 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.716276 24171 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:02.395628 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:02.716132 24016 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.717203 24063 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:02.717370 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 321794us
I20260709 13:06:02.717638 24063 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.718058 24063 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:02.409226 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.720000 24016 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.424132 21825 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:02.720731 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 222) took 1703 ms. Trace:
I20260709 13:06:02.721088 21825 rpcz_store.cc:276] 0709 13:06:01.017154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.021998 (+  4844us) service_pool.cc:224] Handling call
0709 13:06:02.720669 (+1698671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.426445 24255 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:02.429090 21873 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.989s (SENT) [suppressed 18 similar messages]
I20260709 13:06:02.434059 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 333) took 1937 ms. Trace:
I20260709 13:06:02.445695 24123 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.721921 24255 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.725821 24123 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.727873 24123 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:02.458895 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:02.461054 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:02.728109 24255 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:02.466292 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:02.728752 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 299695us
I20260709 13:06:02.728767 21907 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:02.730202 21903 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:06:02.730473 21873 connection.cc:256] RPC call timeout handler was delayed by -1.5171872350000513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 13:06:02.479017 24256 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.731045 21873 connection.cc:256] RPC call timeout handler was delayed by -1.5099872350000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 13:06:02.731374 21873 connection.cc:256] RPC call timeout handler was delayed by -1.4991872350000222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:06:02.484570 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:02.487433 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:02.731927 21873 connection.cc:256] RPC call timeout handler was delayed by -1.4792757570000958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 13:06:02.496513 21729 catalog_manager.cc:5697] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 5, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 5 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:02.498721 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.566s	user 0.029s	sys 0.022s
W20260709 13:06:02.508056 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1544) took 5063 ms (client timeout 1874 ms). Trace:
I20260709 13:06:02.732836 21902 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:02.508308 21906 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:02.508749 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.733978 21909 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:02.522778 23923 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:02.731338 24256 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.736135 23923 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.738296 23923 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.738327 24256 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.728832 22549 rpcz_store.cc:276] 0709 13:06:00.496289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.496458 (+   169us) service_pool.cc:224] Handling call
0709 13:06:00.496824 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.794772 (+297948us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:00.798748 (+  3976us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.802507 (+  3759us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:00.803987 (+  1480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.432481 (+1628494us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b18003d7a40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419
0709 13:06:02.433757 (+  1276us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54006801d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:02.433813 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.433972 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13518,"raft.queue_time_us":16041,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":17990,"spinlock_wait_cycles":555552384}
I20260709 13:06:02.523790 23943 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.740288 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.807s	user 0.030s	sys 0.023s
I20260709 13:06:02.740195 23943 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:02.740924 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 1.83335e+06us
I20260709 13:06:02.742295 23943 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:02.525290 24128 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.528466 24244 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:02.743914 24244 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.530997 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:02.733109 21905 rpcz_store.cc:269] 0709 13:05:57.444876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.457460 (+ 12584us) service_pool.cc:224] Handling call
0709 13:06:02.507792 (+5050332us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b54002e81d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:02.507966 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6178469248}
I20260709 13:06:02.532727 24179 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:02.596555 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.622980 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:02.623131 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 1.7153e+06us
I20260709 13:06:02.635097 24170 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:02.647574 21904 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:02.648418 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 1.67778e+06us
W20260709 13:06:02.653689 21763 debug-util.cc:398] Leaking SignalData structure 0x7b080008bfa0 after lost signal to thread 20697
I20260709 13:06:02.654007 24259 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:02.757201 21904 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:02.760021 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:02.663616 24261 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:02.763209 21832 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:02.663714 21874 leader_election.cc:336] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Timed out: RequestConsensusVote RPC to 127.20.53.132:38783 timed out after 1.605s (SENT)
I20260709 13:06:02.764305 21874 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:06:02.765303 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 101630us
I20260709 13:06:02.766312 24259 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:02.664390 24246 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.793s	user 0.012s	sys 0.011s
I20260709 13:06:02.666352 24257 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.769079 24257 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.769487 21825 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:02.769848 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 372) took 2281 ms. Trace:
I20260709 13:06:02.771085 24257 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.771589 24257 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:02.678992 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 221) took 1662 ms. Trace:
W20260709 13:06:02.670773 24247 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.702s	user 0.008s	sys 0.010s
I20260709 13:06:02.763221 24261 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.682003 21833 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
W20260709 13:06:02.773140 21833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 219) took 1757 ms (client timeout 1854 ms). Trace:
W20260709 13:06:02.773476 21833 rpcz_store.cc:269] 0709 13:06:01.016028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.021188 (+  5160us) service_pool.cc:224] Handling call
0709 13:06:02.773088 (+1751900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.684661 21830 rpcz_store.cc:276] 0709 13:06:01.017499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.023374 (+  5875us) service_pool.cc:224] Handling call
0709 13:06:01.023837 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:02.684122 (+1660285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.684348 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.706300 24026 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:02.771972 21826 rpcz_store.cc:276] 0709 13:06:01.016791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.017689 (+   898us) service_pool.cc:224] Handling call
0709 13:06:02.678895 (+1661206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.706719 23890 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.730226 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1578) took 1902 ms. Trace:
I20260709 13:06:02.778860 21907 rpcz_store.cc:276] 0709 13:06:00.828798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.458599 (+1629801us) service_pool.cc:224] Handling call
0709 13:06:02.730144 (+271545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:02.477358 22555 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.728653 21900 raft_consensus.cc:2376] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4. Re-sending same reply.
W20260709 13:06:02.734031 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.520027 24082 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:02.722275 23895 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.735077 21729 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:02.523643 21831 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.506s	user 0.006s	sys 0.014s
W20260709 13:06:02.788244 21831 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.771s	user 0.007s	sys 0.015s
I20260709 13:06:02.788597 21729 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 4, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 4 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:06:02.747219 21873 connection.cc:256] RPC call timeout handler was delayed by -1.4217872350000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:06:02.790315 21873 connection.cc:256] RPC call timeout handler was delayed by -1.404687234999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:06:02.790813 21873 connection.cc:256] RPC call timeout handler was delayed by -1.3451757569999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 13:06:02.758405 21763 debug-util.cc:398] Leaking SignalData structure 0x7b0800092000 after lost signal to thread 21766
I20260709 13:06:02.762521 21909 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:02.768474 24259 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.770228 22546 rpcz_store.cc:276] 0709 13:06:00.488278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.494330 (+  6052us) service_pool.cc:224] Handling call
0709 13:06:00.494776 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.630477 (+135701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.630829 (+   352us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:00.650943 (+ 20114us) log.cc:844] Serialized 26 byte log entry
0709 13:06:00.800920 (+149977us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:00.800984 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.806632 (+  5648us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:02.663007 (+1856375us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:02.769573 (+106566us) raft_consensus.cc:1685] finished
0709 13:06:02.769591 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.769796 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2728,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"spinlock_wait_cycles":8679808,"thread_start_us":279674,"threads_started":2,"wal-append.queue_time_us":190717}
I20260709 13:06:02.339442 23861 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:02.795095 24244 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:02.796283 22520 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:02.706727 23844 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:02.797825 24244 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:02.797930 23844 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.798352 24244 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.775681 21904 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.798676 23844 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.799417 21904 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:02.801338 23844 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:02.789121 23890 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:02.729416 24063 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.786304 21908 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:02.791101 21873 connection.cc:256] RPC call timeout handler was delayed by -1.3074872350000533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 13:06:02.780092 24261 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.797243 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:02.798296 24082 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:02.793262 21763 debug-util.cc:398] Leaking SignalData structure 0x7b08001cfc60 after lost signal to thread 21858
I20260709 13:06:02.761402 24263 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.806991 21873 connection.cc:256] RPC call timeout handler was delayed by -1.2749757569999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
I20260709 13:06:02.787622 24016 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:02.791797 24066 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.811602 21873 connection.cc:256] RPC call timeout handler was delayed by -1.1534757570000238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 13:06:02.759044 24179 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:02.811875 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 92336.4us
W20260709 13:06:02.812538 21763 debug-util.cc:398] Leaking SignalData structure 0x7b08003838e0 after lost signal to thread 21933
I20260709 13:06:02.812839 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:02.813373 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:02.814263 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:02.825325 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 502172us
I20260709 13:06:02.825767 21826 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:06:02.826596 21833 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:02.826555 21729 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 5, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 5 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:02.827664 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.807045 24244 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:02.816861 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:02.759670 24170 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:02.825264 21763 debug-util.cc:398] Leaking SignalData structure 0x7b0800321440 after lost signal to thread 21934
I20260709 13:06:02.791636 24026 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:02.832089 21763 debug-util.cc:398] Leaking SignalData structure 0x7b080023ee40 after lost signal to thread 22007
W20260709 13:06:02.832398 21763 debug-util.cc:398] Leaking SignalData structure 0x7b080039ea80 after lost signal to thread 22008
W20260709 13:06:02.833477 21763 debug-util.cc:398] Leaking SignalData structure 0x7b080024b400 after lost signal to thread 22579
W20260709 13:06:02.833745 21763 debug-util.cc:398] Leaking SignalData structure 0x7b0800359260 after lost signal to thread 22580
W20260709 13:06:02.834039 21763 debug-util.cc:398] Leaking SignalData structure 0x7b08002d55e0 after lost signal to thread 23846
W20260709 13:06:02.835168 21763 debug-util.cc:398] Leaking SignalData structure 0x7b080039a080 after lost signal to thread 24019
W20260709 13:06:02.835592 21763 debug-util.cc:398] Leaking SignalData structure 0x7b0800379060 after lost signal to thread 24122
W20260709 13:06:02.836035 21763 debug-util.cc:398] Leaking SignalData structure 0x7b080039c320 after lost signal to thread 24181
W20260709 13:06:02.836299 21763 debug-util.cc:398] Leaking SignalData structure 0x7b080039c460 after lost signal to thread 24192
W20260709 13:06:02.836585 21763 debug-util.cc:398] Leaking SignalData structure 0x7b0800356920 after lost signal to thread 24215
W20260709 13:06:02.836881 21763 debug-util.cc:398] Leaking SignalData structure 0x7b0800057da0 after lost signal to thread 24230
I20260709 13:06:02.832114 21729 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:02.829906 23923 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:02.843024 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:02.843668 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:02.840060 23895 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:02.844671 23895 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.845023 23895 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:02.845237 24179 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.846439 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.832281 24259 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:02.825057 24016 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.828732 24066 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.850405 22551 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:02.860702 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:02.861600 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.862807 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.866237 24271 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:06:02.867161 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:02.867367 24026 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.867893 24264 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:02.868122 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:02.868574 24264 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:02.838681 24256 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:02.871299 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:02.873039 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 220) took 1856 ms. Trace:
I20260709 13:06:02.874145 23969 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:02.874684 23969 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.859001 23923 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:02.878898 21904 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:02.879346 24016 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.879033 23923 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.877980 21833 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:02.885093 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:02.887223 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 367) took 2400 ms. Trace:
I20260709 13:06:02.888762 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:02.889920 22547 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:02.870059 23861 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:02.890887 23861 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.892591 24082 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:02.894032 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:02.828277 21830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
W20260709 13:06:02.894282 24085 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:06:02.819295 24263 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.895386 24258 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:02.896032 24258 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.896752 24263 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.897985 24063 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:02.894790 21830 raft_consensus.cc:606] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:02.902346 21830 raft_consensus.cc:614] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:02.891273 23861 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:02.903100 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.903870 22553 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:02.904664 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.906399 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:02.907016 21830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:02.907644 21830 raft_consensus.cc:606] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:02.907050 21826 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:06:02.910279 24256 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:06:02.871018 21729 catalog_manager.cc:5697] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:02.911787 21729 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:02.913056 24256 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.912943 21729 catalog_manager.cc:5697] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:06:02.904592 22519 leader_election.cc:336] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.993s (SENT)
W20260709 13:06:02.914716 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45742.7us
I20260709 13:06:02.906421 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:02.914147 21729 catalog_manager.cc:5697] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:02.933346 22552 raft_consensus.cc:2410] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:06:02.919173 21873 leader_election.cc:336] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.614s (SENT)
I20260709 13:06:02.921458 21830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:02.936350 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:02.934253 21873 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:02.929313 22519 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:02.939301 22519 leader_election.cc:336] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 2.216s (SENT)
I20260709 13:06:02.919396 24257 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:02.939911 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:02.940027 23969 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:02.917968 24174 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:02.940646 23895 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.923431 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.942106 24240 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:02.910221 24066 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.917341 23943 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:06:02.925511 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:02.942896 24259 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:02.943418 23943 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:02.924907 24170 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:02.935155 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:02.943936 23943 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:02.941612 24174 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:02.944324 21902 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:06:02.922921 22549 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:02.945153 24258 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:02.939250 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:02.945904 21900 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:02.936563 21830 raft_consensus.cc:606] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:02.887667 22555 rpcz_store.cc:276] 0709 13:06:00.486604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.488407 (+  1803us) service_pool.cc:224] Handling call
0709 13:06:00.488799 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.500795 (+ 11996us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54005a12a0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef55dc0 00007fb75efe01c0 00007fb75efe1231 00007fb75efddd8f 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c
0709 13:06:02.477159 (+1976364us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b58005e1fd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef3a0aa 00007fb75efbc447 00007fb75efd4fe7 00007fb75efd67de 00007fb75efe0b49 00007fb75efe1416 00007fb75efddd8f 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4
0709 13:06:02.872687 (+395528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.872723 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.886951 (+ 14228us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:02.887009 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.887084 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.887177 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11823,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":19315,"spinlock_wait_cycles":3900120832}
I20260709 13:06:02.946746 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.935195 24082 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.947434 22552 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:02.947477 24082 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.931567 21901 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:02.917842 24264 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:02.942656 24085 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:02.948805 24085 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:02.949568 24082 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:02.931640 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:02.950771 21904 raft_consensus.cc:2410] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:06:02.951368 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66367.2us
I20260709 13:06:02.951884 24266 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:02.952284 24264 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:02.952421 24269 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:02.946743 21830 raft_consensus.cc:614] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:02.921334 21875 connection.cc:256] RPC call timeout handler was delayed by -1.869861396000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 13:06:02.961212 21875 connection.cc:256] RPC call timeout handler was delayed by -1.7941664460000766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:06:02.962023 21875 connection.cc:256] RPC call timeout handler was delayed by -1.7438613959999429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260709 13:06:02.954299 24257 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:02.949680 24085 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:02.963660 24085 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:02.964490 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 122219us
I20260709 13:06:02.944852 23943 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:02.953809 21873 leader_election.cc:336] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 2.164s (SENT)
W20260709 13:06:02.966820 21875 connection.cc:256] RPC call timeout handler was delayed by -1.4482434290000583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 13:06:02.960093 21729 catalog_manager.cc:5697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:02.969349 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:02.978873 22555 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:02.969660 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.969499 24264 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:02.984375 23943 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:02.970490 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:02.986759 21904 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:02.970713 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.970916 24063 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:02.971457 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:02.971717 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.973003 22547 pending_rounds.cc:85] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 6
I20260709 13:06:02.998286 22547 pending_rounds.cc:107] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:02.998618 22547 raft_consensus.cc:2889] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:02.975430 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:02.976236 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:02.988463 21729 catalog_manager.cc:5697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 4, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 4 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:06:02.967546 21875 connection.cc:256] RPC call timeout handler was delayed by -1.4459613960000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
I20260709 13:06:02.983886 21830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:02.984287 22549 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:06:03.001827 21875 connection.cc:256] RPC call timeout handler was delayed by -1.4077434289999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 13:06:02.999894 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:03.002013 21830 raft_consensus.cc:606] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:03.002226 21875 connection.cc:256] RPC call timeout handler was delayed by -1.3429434290000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 13:06:03.002456 21830 raft_consensus.cc:614] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:03.002547 21875 connection.cc:256] RPC call timeout handler was delayed by -1.2544828019999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 13:06:03.002875 21875 connection.cc:256] RPC call timeout handler was delayed by -1.245743429000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 13:06:03.005277 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:03.005874 21976 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.010331 24257 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:03.010504 22519 leader_election.cc:336] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 2.864s (SENT)
I20260709 13:06:03.010790 24257 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.011196 24257 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.014647 21979 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:03.015100 24174 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:03.015367 21906 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:03.015740 24277 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:03.016846 21874 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:03.011055 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:03.006074 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:03.021741 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:03.022454 21906 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 4: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:03.022953 24256 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:03.024032 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:03.024765 21979 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:03.027196 21976 raft_consensus.cc:2410] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:03.026863 21729 catalog_manager.cc:5697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 5, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 5 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:03.033324 21906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39266
I20260709 13:06:03.017000 23890 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:03.033974 21906 raft_consensus.cc:606] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:03.041199 21906 raft_consensus.cc:614] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:03.044534 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:03.045339 21900 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:03.047132 21979 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:03.020762 24174 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:03.044760 21982 pending_rounds.cc:85] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 2
I20260709 13:06:03.054368 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.057601 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.054674 21982 pending_rounds.cc:107] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:03.058634 21982 raft_consensus.cc:2889] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:03.072723 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 116393us
I20260709 13:06:03.075052 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.075848 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.075935 21829 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:03.074083 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.067397 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.073017 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.072710 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.079659 21832 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:03.080799 21900 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:03.077417 21826 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:03.045050 23890 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.060241 22546 raft_consensus.cc:2410] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:03.084345 21976 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:03.052913 24066 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:03.086803 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 151338us
I20260709 13:06:03.083418 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.084690 21979 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:03.087673 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:03.087958 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.090389 21827 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:03.090770 21830 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:03.091601 21900 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:06:03.093210 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:03.094230 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.095495 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:03.096267 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.096933 21900 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:06:03.097205 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.055680 24285 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:03.098449 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.099640 21834 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:03.052991 24278 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.088485 23890 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:03.101441 21799 leader_election.cc:336] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Timed out: RequestConsensusVote RPC to 127.20.53.132:38783 timed out after 1.748s (SENT)
W20260709 13:06:03.103688 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.110430 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.110719 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:03.115521 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.121995 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:03.066478 24274 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:06:03.122946 24174 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:03.126619 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:03.127588 24174 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:03.128036 24174 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:03.128908 24257 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.128844 24174 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.109575 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:03.099051 24277 raft_consensus.cc:2764] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:03.133118 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:03.125679 23861 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.137377 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.140830 22520 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:03.140865 21974 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
W20260709 13:06:03.141597 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 73425.3us
W20260709 13:06:03.142660 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.144709 24179 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:03.145174 24179 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.146692 24179 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.147840 24240 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:03.148277 24240 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:03.148638 24240 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.110019 24278 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.153223 21833 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:03.094650 24066 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.153919 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:03.155452 21834 raft_consensus.cc:606] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:03.155674 21834 raft_consensus.cc:614] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:03.154297 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:02.873445 21831 rpcz_store.cc:276] 0709 13:06:01.016445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.016562 (+   117us) service_pool.cc:224] Handling call
0709 13:06:01.016922 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.017155 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:02.788613 (+1771458us) log.cc:844] Serialized 14 byte log entry
0709 13:06:02.860448 (+ 71835us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.860500 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:02.872818 (+ 12318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.872885 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.872988 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7182,"prepare.queue_time_us":115833,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":29207,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":1835308,"threads_started":3,"wal-append.queue_time_us":96142}
W20260709 13:06:03.164462 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.165225 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 67154.6us
I20260709 13:06:03.140465 24026 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.169275 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:03.171844 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 70452.1us
I20260709 13:06:03.170130 21982 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
W20260709 13:06:03.175323 21799 leader_election.cc:336] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.874s (SENT)
I20260709 13:06:03.177706 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.178301 21974 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:03.166447 24285 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:03.183172 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:03.185325 21799 leader_election.cc:336] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.991s (SENT)
I20260709 13:06:03.192736 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:03.166333 24278 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:03.198212 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.198486 23861 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:03.170955 24244 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.199584 22548 raft_consensus.cc:2368] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:06:03.200486 24244 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:06:03.202379 24277 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:03.202970 24277 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:03.203068 24259 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.203609 24259 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.212127 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.203915 24277 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.216976 24179 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.219436 23895 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:03.219195 24179 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:03.222301 24257 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:03.223205 24066 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:03.224627 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:03.226332 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:03.228044 21874 leader_election.cc:400] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:06:03.228128 24259 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:03.228434 21874 leader_election.cc:403] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:03.191999 24285 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:03.229282 24285 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.228446 23890 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.234110 23890 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:03.238062 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.242281 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.240857 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:03.259588 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66970.3us
I20260709 13:06:03.260936 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:03.262853 24259 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:03.264953 24259 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:03.267791 24277 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:03.268307 24277 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:03.268672 24277 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.275111 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:03.276613 23844 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:03.276975 23844 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:03.277328 23844 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.280731 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:03.284626 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 43877.1us
I20260709 13:06:03.285920 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.222321 24063 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:03.258103 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:03.267669 23890 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:03.258241 24257 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:03.349275 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.342885 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:03.353880 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61591.1us
I20260709 13:06:03.282205 23861 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:03.344005 22547 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.381059 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:03.384356 21983 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:03.382258 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:03.364991 23861 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.417966 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.365942 24274 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:06:03.405009 24256 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.405687 23861 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:03.356446 24271 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:06:03.476404 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 187428us
I20260709 13:06:03.411693 24261 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:03.554278 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 138733us
I20260709 13:06:03.559273 23890 raft_consensus.cc:1064] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:06:03.563656 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:03.566800 24289 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:06:03.568622 24293 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
W20260709 13:06:03.601621 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 313307us
I20260709 13:06:03.398195 24259 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.555166 24261 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.522639 24170 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.143s
W20260709 13:06:03.609936 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46344.3us
I20260709 13:06:03.561887 23890 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:03.643697 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 87350us
W20260709 13:06:03.626075 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.627784 24294 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:03.608639 24063 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:03.632529 24285 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:03.638813 24299 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:03.639250 22547 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:03.639912 24263 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:03.640407 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.611559 24261 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.645568 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:03.662004 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:03.699522 21825 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:03.663849 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.664414 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.665290 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.617492 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:03.666181 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:03.667438 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.701038 21975 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.671465 21828 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:03.680788 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.683261 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.573635 24256 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.683821 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.606864 24240 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.640515 23969 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:03.652221 24307 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:03.690796 24274 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:03.694753 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.702067 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:03.706331 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 60838.8us
I20260709 13:06:03.691097 24263 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:03.707026 21829 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:03.702867 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:03.710647 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50447.8us
I20260709 13:06:03.711947 21834 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:03.713136 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:03.721848 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 105332us
I20260709 13:06:03.703328 24066 raft_consensus.cc:993] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:03.734965 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:03.735558 21975 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:03.719131 24170 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:03.727149 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 154387us
I20260709 13:06:03.695557 21979 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:03.730568 21831 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:03.703802 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.730623 21875 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:03.662814 24016 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:06:03.740269 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:03.741237 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:03.727903 24264 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:03.742197 21832 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:03.740073 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.734530 24280 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.772598 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:03.776682 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:03.734326 24063 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:03.788616 21829 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:03.736896 24308 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:03.742456 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.731710 23969 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:03.781611 23844 consensus_meta.cc:287] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.005s
I20260709 13:06:03.741812 24291 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:03.803274 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.771155 24306 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:03.799140 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 68470.9us
I20260709 13:06:03.738617 24170 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:03.787742 24063 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.813225 24290 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:03.813369 24264 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:03.814715 24063 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:03.815164 24313 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:03.815682 24285 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:03.816953 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.817734 21982 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:03.813136 24170 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.808611 24305 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:03.819937 24305 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:03.820340 24305 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.820770 24305 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:03.822948 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:03.808727 23844 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.733208 24277 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.827581 21979 raft_consensus.cc:2410] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:03.828524 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:03.830428 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:03.831916 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:03.836922 21906 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:03.775633 24304 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 13:06:03.844882 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 103655us
I20260709 13:06:03.846720 21906 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:03.843202 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.772076 24026 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:06:03.738420 24274 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:03.847776 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:03.851059 21981 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:03.848896 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:03.851953 21907 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:03.828384 24066 raft_consensus.cc:1081] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
W20260709 13:06:03.841166 24296 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:06:03.857848 24315 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:03.858440 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.858693 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:03.851706 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:03.860463 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:03.879935 21977 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:03.790313 24280 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.835958 23844 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:03.865679 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:03.836278 24285 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:03.838410 24063 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:03.882397 21909 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:03.896953 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.899940 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.880267 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:03.887580 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 150327us
I20260709 13:06:03.891571 21974 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:03.915221 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.804046 24263 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.917168 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:03.920346 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.883365 24315 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.887856 24291 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:03.934543 24291 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.934952 24291 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.937717 24066 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:03.938133 24066 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:03.938524 24066 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:03.924450 24063 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.945212 24244 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.945794 24063 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:03.926607 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:03.961324 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 146076us
I20260709 13:06:03.934012 24280 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:03.945923 24244 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:03.946732 24302 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:06:03.953845 24277 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:03.959381 24274 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:03.883868 24256 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:03.964515 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.971932 21982 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:03.847155 24170 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.966355 24240 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:03.922811 23844 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.862557 23969 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:03.978659 21909 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:03.928858 24315 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.923583 24285 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.006590 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.015836 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.014770 23969 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.017968 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.018699 21974 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:04.020970 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:03.963521 24085 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:06:04.022115 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:04.022634 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.036751 21983 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.037114 21979 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:04.022228 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:04.004895 24257 consensus_meta.cc:287] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.000s
I20260709 13:06:04.022506 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.040972 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:04.041299 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 212850us
I20260709 13:06:04.036089 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:04.045563 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.046041 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.046741 21979 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:04.045440 21974 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:04.049491 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:04.049796 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.046594 21977 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:04.050019 21981 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.050988 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.053623 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:04.054210 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 145748us
I20260709 13:06:04.030637 24240 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.051087 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:04.060480 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:04.060551 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.006947 24256 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:06:04.081393 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.081624 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.045101 24257 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 3. Current term is 4.
I20260709 13:06:04.006479 23844 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.082650 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.087998 21977 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:04.064711 24308 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:04.087582 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:04.094352 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:04.094285 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:04.096601 22552 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.099669 21825 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:04.106065 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45652.2us
I20260709 13:06:04.098241 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.108261 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:04.111634 21828 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:04.112645 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:04.113684 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:04.115656 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:04.115768 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 144662us
I20260709 13:06:04.113842 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.117447 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.117524 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.116677 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.117787 21827 pending_rounds.cc:85] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 3
I20260709 13:06:04.104527 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:04.151008 21974 raft_consensus.cc:2410] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:04.097810 24257 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:04.115099 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:04.108891 24305 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.107301 24304 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:04.103097 24264 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:04.154325 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.153360 21827 pending_rounds.cc:107] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 13:06:04.158689 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.234674 21827 raft_consensus.cc:2889] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:04.236311 21981 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:04.094265 24259 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:06:04.116319 22547 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:04.170619 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:04.238258 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 203489us
I20260709 13:06:04.238765 22550 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:04.146593 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:04.187351 24244 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.188930 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.239506 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:04.165997 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.191859 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:04.157138 24316 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:04.146646 24265 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.148214 24320 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:04.171425 23895 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:04.145340 24330 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:04.165952 22546 raft_consensus.cc:2410] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:04.220968 21983 raft_consensus.cc:2410] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:06:04.144265 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 236989us
I20260709 13:06:04.189846 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.117298 24327 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:04.239527 24321 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:04.240798 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.109284 24308 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:04.232704 24323 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:06:04.243919 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.245666 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:04.245679 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 101507us
I20260709 13:06:04.247480 24331 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:04.231705 23861 consensus_meta.cc:287] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.669s	user 0.006s	sys 0.006s
W20260709 13:06:04.234004 24318 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.127s	user 0.000s	sys 0.003s
I20260709 13:06:04.250927 24285 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:04.248696 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 204962us
I20260709 13:06:04.235801 24264 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.229027 24179 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:04.244230 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:04.240116 24319 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.155s	user 0.000s	sys 0.003s
I20260709 13:06:04.253203 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.158092 21979 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:04.225803 24257 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.260977 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:04.277948 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.254830 22548 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:04.287307 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.307406 24179 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:04.312315 24334 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:04.312759 24334 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:04.313161 24334 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:04.315275 24340 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 13:06:04.315603 24257 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:04.300396 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.247618 22549 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:04.256558 24170 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:04.258512 24330 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.230756 24256 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:04.238216 24304 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.305779 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:04.308758 21979 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:04.362234 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.362990 21909 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:04.307730 24335 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:06:04.317065 24301 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:04.359025 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 114861us
I20260709 13:06:04.358968 21976 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:04.308223 24264 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.305275 21982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:06:04.369824 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.370334 21982 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.370477 21908 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.370805 21982 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.371393 24337 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 13:06:04.371798 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66085.7us
I20260709 13:06:04.304020 23861 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.325004 23844 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:04.321322 24285 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:04.360291 24261 consensus_meta.cc:287] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.000s
I20260709 13:06:04.361096 24330 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:04.389698 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:04.361848 24256 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:06:04.363744 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 102862us
I20260709 13:06:04.384433 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.366460 24317 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:04.389392 21949 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:04.368923 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.402061 21902 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.369109 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.363500 24259 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.393654 21909 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:04.373384 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 257826us
I20260709 13:06:04.407568 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:04.399056 21908 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:04.401666 21978 raft_consensus.cc:2368] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6.
I20260709 13:06:04.384429 24265 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.405367 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:04.374097 24329 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:06:04.412994 24244 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.413518 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:04.414283 24305 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.393870 24320 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:06:04.438995 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.312335 24179 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.418871 22552 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:04.415920 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:04.397719 24256 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.440171 21905 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:04.416545 24331 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:04.439846 24327 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:04.447930 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.390358 24261 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.450332 24244 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:06:04.454979 24304 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.455348 24244 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:04.455711 24244 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:04.456684 24244 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.458346 24338 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.462442 21905 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:04.460253 24316 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:04.450567 24305 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.466064 24244 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:04.470633 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:04.460325 24274 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:06:04.458272 24332 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:04.473577 24332 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:04.474097 24332 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.475617 21982 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.477312 21982 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:04.480374 21907 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
W20260709 13:06:04.456701 24333 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:04.482769 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.459018 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.460033 21903 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:04.483503 21907 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:04.483554 21906 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:04.484174 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.461046 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.485574 21904 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.485647 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:04.487730 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:04.489194 24343 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:04.489595 24343 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:04.489950 24343 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.490231 24345 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:06:04.492810 21904 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:06:04.496389 22520 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:04.497044 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.498057 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:04.497781 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:04.499002 22552 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:04.417768 24066 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.500907 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:04.427278 24285 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:06:04.501749 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.502555 21901 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:04.373600 24301 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.505292 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.506310 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.508227 21909 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:04.510527 24351 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.510694 24170 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.511535 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.512408 24170 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.513736 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:04.514618 24170 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:04.514750 23861 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:04.515122 24170 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:04.515587 24170 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.515774 24330 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.516526 24066 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.436595 24291 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.517952 21906 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:04.519313 24291 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.520511 24261 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.519309 24330 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.521366 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.493438 24331 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:04.524082 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:04.525825 21902 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:04.503741 24085 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:04.508559 24179 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.545781 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.451277 24265 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:06:04.583051 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.504097 24174 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:04.504917 24244 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:04.610103 24315 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.565s	user 0.006s	sys 0.005s
W20260709 13:06:04.612509 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 88517.4us
I20260709 13:06:04.611924 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.614405 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.617139 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.616731 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:04.617280 21983 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:04.616699 21979 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
W20260709 13:06:04.620793 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.621600 24336 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:06:04.621405 24315 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.623421 21902 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:04.581555 24330 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.626708 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.628669 21903 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:04.638447 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.610961 24244 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.642570 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.615671 24261 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.646306 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:04.650817 21826 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.651070 21976 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:04.646615 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:04.651504 21976 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:04.651836 21828 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.652705 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.653406 21904 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:04.625627 24174 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:04.647882 21825 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:06:04.648681 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 147855us
I20260709 13:06:04.648761 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:04.622473 24341 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.659847 24341 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.655484 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:04.660567 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 161711us
I20260709 13:06:04.661156 21982 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:04.661231 22520 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:04.640609 23861 raft_consensus.cc:2764] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:04.656786 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.658666 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.666723 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:04.667165 21902 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:04.667290 22551 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:04.667443 22552 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:04.662998 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.668576 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.668910 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.668577 22552 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:04.669730 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.671192 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.650660 24244 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:04.625519 24240 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:06:04.671415 21909 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:06:04.672242 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.679459 21902 raft_consensus.cc:2376] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5. Re-sending same reply.
I20260709 13:06:04.680603 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.664824 21982 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:04.678928 24350 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:04.682372 24350 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.682745 24350 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:04.679157 24343 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.647058 24357 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:04.675298 21976 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.692312 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.674402 24322 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.693169 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:04.693843 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.696748 21976 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.699033 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.700788 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.702265 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.706110 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:04.682746 24348 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:04.680135 24337 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:04.709293 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.726037 21828 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:04.703655 24291 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:04.742424 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.708575 24308 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.743124 21829 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:04.738184 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.709102 24257 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.746054 24264 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.752257 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.713865 24346 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:04.755939 24341 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.703745 24066 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:06:04.756690 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.786515 21829 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:04.759287 24170 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:04.778571 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 107123us
I20260709 13:06:04.779165 21903 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:04.791692 21976 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:04.792076 21976 pending_rounds.cc:85] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 6
I20260709 13:06:04.792332 21976 pending_rounds.cc:107] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:04.682770 24344 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.247s
I20260709 13:06:04.667340 24174 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.778863 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:04.644788 24327 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.792627 21976 raft_consensus.cc:2889] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:04.792541 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:04.797542 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.802493 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.742447 24322 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.803058 21903 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.803543 24369 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.804030 24369 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.793167 24357 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:04.806185 24369 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.806943 24357 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.747030 24265 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.747210 24343 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.817091 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.745724 24291 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:04.818300 24291 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:04.810891 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.818557 24342 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.818728 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.819128 24342 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.819633 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:04.819813 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.820192 21827 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.751875 23969 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.814836 21903 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:04.816642 21977 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:04.721582 24351 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:06:04.785816 24337 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:04.823863 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:04.825366 21903 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.826052 24322 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.826290 24362 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.826972 24370 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.827991 24360 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:04.828229 24263 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.828536 24360 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:04.829414 24360 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.830150 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.831025 21825 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:04.827591 24370 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.826785 24362 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.831827 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.840692 21825 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:04.696064 24331 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.821295 24315 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.845645 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.817914 24349 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
W20260709 13:06:04.846099 24334 consensus_meta.cc:287] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.001s
I20260709 13:06:04.852917 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.853765 23861 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:04.855499 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.855443 23861 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:06:04.856732 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.857748 23861 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:04.858037 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:04.866734 24342 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:04.823663 24256 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.870338 24301 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:04.870563 24374 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.879024 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:04.882812 24261 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.850054 24170 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:04.792176 24346 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.881549 24244 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.846518 24308 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.889470 21827 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:04.913059 21900 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.913497 21903 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:04.835304 23969 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.890925 21826 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:06:04.897187 24341 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.899691 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:04.901003 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:04.890300 24315 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.851557 24364 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:04.902930 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:04.903424 24352 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:06:04.907038 24345 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:04.821164 24265 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.908089 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1538) took 1242 ms. Trace:
I20260709 13:06:04.913990 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.907809 24370 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:04.923194 22554 raft_consensus.cc:2368] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7.
I20260709 13:06:04.915436 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:04.926263 21826 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.923952 21831 rpcz_store.cc:276] 0709 13:06:03.665216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.743909 (+ 78693us) service_pool.cc:224] Handling call
0709 13:06:03.781581 (+ 37672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:03.781833 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.781861 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:03.795512 (+ 13651us) log.cc:844] Serialized 26 byte log entry
0709 13:06:04.008862 (+213350us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:04.008913 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.009001 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:04.907147 (+898146us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b2400120c68. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf2ffb0 00007fb75eba6488 00007fb75eba6be8 00007fb75eb7e398 00007fb75eb7976a 00007fb75eb78bb6
0709 13:06:04.907822 (+   675us) raft_consensus.cc:1685] finished
0709 13:06:04.907845 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.908025 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2857856,"thread_start_us":167730,"threads_started":1,"wal-append.queue_time_us":273547}
I20260709 13:06:04.917253 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:04.901873 24342 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:04.914511 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.884616 24334 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.924672 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.930219 21976 raft_consensus.cc:2410] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:04.924222 21825 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:04.922478 21900 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:04.928331 21903 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:06:04.928678 21827 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:04.925267 24345 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.951223 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:04.959501 24256 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:04.960029 21905 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:04.960537 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:04.960839 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:04.969741 21831 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:04.970449 24308 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.971030 24308 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.973789 24308 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.963315 24338 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:04.999078 24338 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.963864 24285 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:04.964212 24315 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:05.002516 24315 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:05.002521 24285 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.003558 24315 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.004956 24315 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:04.964248 24350 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:04.923200 24373 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.006836 21909 raft_consensus.cc:2368] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7.
I20260709 13:06:04.974416 23969 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:05.008040 24350 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:05.008278 24271 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:04.976488 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:05.001971 24338 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:05.008740 24271 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:05.005788 24285 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:05.009244 21903 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:05.010342 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:05.010897 21903 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.009776 24271 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.011286 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:05.011956 21982 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:05.015563 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:04.977078 24332 consensus_meta.cc:287] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.001s
I20260709 13:06:05.016438 24332 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.017164 24377 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:05.017771 24377 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:05.018203 24377 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.978045 24264 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:05.020982 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1488) took 1177 ms. Trace:
I20260709 13:06:05.021435 21978 rpcz_store.cc:276] 0709 13:06:03.843140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.843264 (+   124us) service_pool.cc:224] Handling call
0709 13:06:05.020752 (+1177488us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54002c7754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:05.020908 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220144384}
W20260709 13:06:05.022912 23844 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:06:05.023586 24332 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:04.978907 24244 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:05.025786 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:05.025942 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:04.979455 24334 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:04.980610 24361 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:04.981614 24346 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:04.981781 21976 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:05.064374 21903 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:05.065594 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:04.986872 21830 raft_consensus.cc:2410] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:06:04.987246 24376 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:04.987390 24291 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:04.988726 21826 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:05.079139 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:04.989408 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.080859 21827 raft_consensus.cc:2410] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:06:04.990926 21831 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:04.978904 24362 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:04.996691 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:04.961263 24345 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:05.026415 21978 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.026415 21906 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:04.983209 24265 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:05.081826 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:05.105389 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:05.114674 21834 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:05.114764 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:05.084568 24361 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.115178 24345 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.166469 24290 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:05.167631 21826 raft_consensus.cc:2368] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:06:05.168870 21978 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:05.115336 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:05.175781 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:05.063407 24332 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:05.178690 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:05.186242 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:05.187142 21827 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.122430 22552 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 3 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:05.190469 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:05.191236 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:05.191191 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 195566us
I20260709 13:06:05.191919 21903 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.195317 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.196080 21826 raft_consensus.cc:2410] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:05.167284 24278 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:05.199793 21831 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:05.203043 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:05.204771 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:05.158212 24264 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:05.173049 24290 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:05.180505 24346 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:05.220286 22521 leader_election.cc:336] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 2.304s (SENT)
I20260709 13:06:05.223245 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.221760 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 470) took 1111 ms. Trace:
I20260709 13:06:05.223922 22554 rpcz_store.cc:276] 0709 13:06:04.098937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.102007 (+  3070us) service_pool.cc:224] Handling call
0709 13:06:04.902787 (+800780us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:06:05.205821 (+303034us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b54002508d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:05.210656 (+  4835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20169216}
I20260709 13:06:05.115374 24334 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:06:05.192588 24331 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:05.178705 24345 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.189658 24332 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.236624 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:05.225214 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.253494 21983 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:05.235598 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1576) took 1083 ms. Trace:
I20260709 13:06:05.259533 21977 rpcz_store.cc:276] 0709 13:06:04.152324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.301476 (+149152us) service_pool.cc:224] Handling call
0709 13:06:04.301833 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:04.823358 (+521525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.235312 (+411954us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400226fd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:05.235522 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173902080}
I20260709 13:06:05.202663 24278 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:05.222793 24325 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.007s	sys 0.013s
I20260709 13:06:05.262080 21903 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
W20260709 13:06:05.252547 24359 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.613s	user 0.002s	sys 0.000s
W20260709 13:06:05.229889 24356 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.590s	user 0.003s	sys 0.000s
I20260709 13:06:05.264178 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.287056 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.285851 21827 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:05.287705 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:05.288024 21826 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:05.288259 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:05.281344 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.275372 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:05.281935 24327 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.289390 21903 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.251067 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:05.289494 24327 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.290297 22549 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:05.258214 24313 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:05.250420 24290 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.284089 24344 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:05.291706 24344 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:05.291669 24313 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.292189 24327 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:05.282368 24330 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:05.292896 24330 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.292714 24344 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.246842 24264 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.294101 21826 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:05.294400 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.294824 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:05.287107 24256 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.295805 24306 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:05.296197 24306 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.296353 21983 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 6. Ops: []
I20260709 13:06:05.296604 24306 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:05.288364 21907 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:06:05.297935 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:05.299275 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:05.299865 21980 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.264144 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.298796 21907 raft_consensus.cc:2410] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:06:05.302595 21831 raft_consensus.cc:2410] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:05.273556 24346 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:05.264461 24277 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:05.293403 24330 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.303640 21907 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:05.249584 24362 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.261211 24331 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.315894 21829 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:05.313741 21903 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:05.314954 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:05.316979 21983 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:05.247797 24361 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:05.314561 24350 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:05.319605 24350 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:05.320014 24350 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.320329 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:05.321979 24306 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.322626 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.323859 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.324690 24259 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:05.325008 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.322368 24321 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:05.340230 21907 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:06:05.311982 24325 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.009s	sys 0.018s
I20260709 13:06:05.338584 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:05.339229 24373 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.341041 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:05.324227 24306 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:05.342710 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:05.294047 24313 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:05.346609 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.337033 21983 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:05.257862 24377 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.332619 24374 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.375113 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:05.381044 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:05.382722 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:05.379565 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:05.385898 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:05.386699 21976 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:05.343477 24321 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.326876 24327 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:06:05.351876 24344 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.402873 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:05.389707 21905 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:05.389891 21974 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:05.343693 24290 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.388404 21875 leader_election.cc:400] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:06:05.404464 21875 leader_election.cc:403] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:05.395773 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:05.405714 24063 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.327189 24277 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.406157 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.416241 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.410199 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:05.419600 21875 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.384178 24264 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:05.420078 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:05.420827 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.420995 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.389281 24256 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:05.390154 24334 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:05.425951 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.426389 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.427278 21980 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:05.422590 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:05.428045 21983 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:05.399106 24342 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:05.398818 24373 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:05.393976 24291 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:05.402997 24331 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:05.432096 24280 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:05.446666 24280 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:05.447685 24280 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.450449 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:05.451252 21974 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:05.452346 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:05.453022 21974 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.417814 24341 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:06:05.424492 24361 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.430536 24334 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.424676 24338 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:05.369125 24278 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.429509 24261 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:05.424906 24259 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.463768 24331 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:05.435086 24313 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:05.432678 24265 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:05.505440 21974 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
W20260709 13:06:05.494189 24395 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:06:05.441707 24339 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:06:05.546793 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:05.578109 21826 raft_consensus.cc:2376] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4. Re-sending same reply.
I20260709 13:06:05.550422 24261 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:05.497709 24334 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.527503 24315 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.425276 24346 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.558632 24265 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:05.590842 24265 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.594378 24263 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.595002 24263 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.609539 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:05.537020 24331 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.611830 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:05.616151 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:05.617865 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:05.626523 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 203988us
I20260709 13:06:05.537828 24313 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:05.618647 22550 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:05.632470 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:05.579577 24345 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:05.533397 24341 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:06:05.627413 21948 leader_election.cc:400] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7.
I20260709 13:06:05.638808 21948 leader_election.cc:403] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:05.639599 22550 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:05.589816 24350 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.641409 24327 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.641691 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:05.641331 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:05.643039 22555 raft_consensus.cc:2368] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:06:05.585081 24332 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:05.647146 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:05.650408 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:05.669070 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:05.627014 24339 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:05.627522 24331 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.673076 22519 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:05.672989 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:05.674346 24332 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.678784 24332 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.681870 24332 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:05.674695 21874 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:05.675326 22549 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:05.640830 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.698513 24332 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:05.699538 24332 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:05.700848 24332 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:05.711359 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 70648.2us
I20260709 13:06:05.713120 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:05.677326 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:05.642491 24264 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7.
I20260709 13:06:05.716346 24362 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:05.723958 24362 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.723438 24313 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.724373 24362 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.724946 24313 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.719064 24377 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:05.731467 24026 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:05.733019 24263 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:05.732906 24362 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.671505 24327 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.736188 24362 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:05.736413 24271 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:05.738415 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.742283 24377 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.743113 24377 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:05.743537 24377 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.743968 24377 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.749545 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:05.751510 24339 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.752136 24339 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.752648 24261 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.754859 21833 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:05.756807 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:05.757305 21828 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:05.757553 21828 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:05.758252 21828 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.759199 21828 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.762645 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1539) took 1042 ms. Trace:
I20260709 13:06:05.763224 21834 rpcz_store.cc:276] 0709 13:06:04.720502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.911978 (+191476us) service_pool.cc:224] Handling call
0709 13:06:05.762389 (+850411us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002729d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:05.762563 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411945856}
I20260709 13:06:05.766774 24265 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.776204 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:05.776227 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.780239 21828 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:05.675868 24304 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:05.793112 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:05.795277 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 364325us
I20260709 13:06:05.803162 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:05.803208 21831 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:05.803800 21834 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:05.806977 21827 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:05.811458 21833 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:06:05.813422 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 100399us
I20260709 13:06:05.818537 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:05.721925 24085 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:05.754076 24339 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:05.784817 24311 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.840049 24374 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.847116 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:05.850553 21979 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:05.850646 23861 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:05.851257 23861 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.853224 23861 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:05.855973 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 385) took 1180 ms. Trace:
I20260709 13:06:05.856335 22552 rpcz_store.cc:276] 0709 13:06:04.692712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.692849 (+   137us) service_pool.cc:224] Handling call
0709 13:06:05.122077 (+429228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.189420 (+ 67343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.855789 (+666369us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400638150. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:05.855919 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949396352}
I20260709 13:06:05.857775 21979 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:05.858954 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:05.859819 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.832286 24345 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.866564 21834 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:05.846331 24085 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:05.891549 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.891647 24085 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:05.892787 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:05.893571 21834 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:05.871037 24330 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 13:06:05.894353 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.894659 24330 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:05.895634 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.896317 21834 raft_consensus.cc:2368] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:05.897128 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.897656 21834 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:05.902812 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.868041 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.878892 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:05.923547 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:05.884225 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 428038us
I20260709 13:06:05.926723 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:05.889853 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1618) took 1219 ms. Trace:
I20260709 13:06:05.927395 21902 rpcz_store.cc:276] 0709 13:06:04.670014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.695157 (+ 25143us) service_pool.cc:224] Handling call
0709 13:06:04.695500 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.231130 (+535630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.231163 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:05.231205 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:05.231236 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.889531 (+658295us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54002378d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:05.889599 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.889777 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231388416}
I20260709 13:06:05.935776 21833 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:05.936827 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:05.936702 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 69623.9us
I20260709 13:06:05.874675 24353 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:05.923002 24395 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:06:05.977285 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 118406us
I20260709 13:06:05.980690 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:05.982733 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45979.7us
I20260709 13:06:05.983616 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:05.987968 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.005872 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 67787.4us
I20260709 13:06:06.041725 21830 raft_consensus.cc:2410] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:06.010320 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:05.940615 24339 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:06.023437 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 350503us
I20260709 13:06:06.043447 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:05.936378 24256 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:05.976635 24350 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:06.007900 24345 raft_consensus.cc:2764] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:06:06.007258 24325 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:06.007474 23969 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:06.041652 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:06.030263 24401 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.054203 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:06.054819 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:06.062019 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:06.065653 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:06.030522 24346 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:06:06.050329 24325 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.055193 23861 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:06.050191 24339 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:06.061968 24360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.005s	sys 0.014s
I20260709 13:06:06.076129 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:06.055550 23969 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:06.068943 24311 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:06.067842 24330 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:06.074973 24325 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.064519 24320 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:06:06.074158 24306 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.078410 24263 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:06.064208 24401 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:06.082104 24344 consensus_meta.cc:287] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.000s
I20260709 13:06:06.075668 24405 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:06:06.164631 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 88571.7us
W20260709 13:06:06.168877 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 183962us
I20260709 13:06:06.151422 24327 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:06.085469 24373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.038s
I20260709 13:06:06.082993 23969 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.088809 23861 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:06.072314 24331 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:06.088294 24360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.005s	sys 0.015s
I20260709 13:06:06.170306 24332 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:06.208266 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:06.189872 24353 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:06.222661 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 242054us
I20260709 13:06:06.236635 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:06.241349 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:06.242564 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:06.189375 24263 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:06.244859 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49926.6us
I20260709 13:06:06.247558 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:06.160266 24256 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:06.198905 24373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.015s	sys 0.049s
W20260709 13:06:06.252919 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44758.7us
I20260709 13:06:06.254025 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:06.222765 24408 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:06:06.218792 24313 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:06.267863 23890 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:06:06.270334 24410 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 13:06:06.272055 21934 heartbeater.cc:646] Failed to heartbeat to 127.20.53.190:38207 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.53.190:38207 timed out after 15.000s (SENT)
W20260709 13:06:06.277010 24403 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:06:06.266254 24353 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:06.318703 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.356063 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 113555us
I20260709 13:06:06.251111 24320 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:06:06.368405 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 114432us
I20260709 13:06:06.192329 24339 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.400269 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:06.272609 24327 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:06.369776 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 122309us
I20260709 13:06:06.197892 24280 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:06:06.162057 24311 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.223984 24332 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:06.378602 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 326765us
I20260709 13:06:06.411947 21949 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:06.250150 24373 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:06.397038 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 243495us
W20260709 13:06:06.379310 24271 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.010s
I20260709 13:06:06.374488 24026 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.382547 24085 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.368629 24350 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:06.437489 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1628) took 1680 ms. Trace:
I20260709 13:06:06.426982 21799 leader_election.cc:400] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7.
I20260709 13:06:06.438068 21799 leader_election.cc:403] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:06.437911 21903 rpcz_store.cc:276] 0709 13:06:04.756618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.326647 (+570029us) service_pool.cc:224] Handling call
0709 13:06:05.326946 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.342066 (+ 15120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.342097 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.350268 (+  8171us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.839866 (+489598us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:05.839900 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.839976 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.437260 (+597284us) raft_consensus.cc:1685] finished
0709 13:06:06.437280 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.437422 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14751,"raft.queue_time_us":14850,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2707,"thread_start_us":431286,"threads_started":1,"wal-append.queue_time_us":854576}
I20260709 13:06:06.439759 24441 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:06.440184 21903 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:06.440212 24441 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:06.440897 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 217) took 1178 ms. Trace:
I20260709 13:06:06.441161 24441 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:06.441296 21903 rpcz_store.cc:276] 0709 13:06:05.262610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.439695 (+1177085us) service_pool.cc:224] Handling call
0709 13:06:06.440021 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.440659 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.440845 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:06.449395 24377 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.705s	user 0.005s	sys 0.003s
I20260709 13:06:06.449908 24441 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:06.450822 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1622) took 1711 ms. Trace:
I20260709 13:06:06.451498 21904 rpcz_store.cc:276] 0709 13:06:04.739177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.302968 (+563791us) service_pool.cc:224] Handling call
0709 13:06:05.303383 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.303769 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.303812 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.304330 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.619689 (+315359us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:05.619750 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.619857 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.450604 (+830747us) raft_consensus.cc:1685] finished
0709 13:06:06.450625 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.450767 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":805,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":12515,"thread_start_us":250798,"threads_started":1,"wal-append.queue_time_us":515061}
I20260709 13:06:06.453876 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 218) took 1191 ms. Trace:
W20260709 13:06:06.459677 24290 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.044s	user 0.011s	sys 0.000s
I20260709 13:06:06.460670 24373 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.461679 24265 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:06.461807 24085 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:06.463762 24344 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:06.463661 24327 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:06.464634 24263 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.422859 24422 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.470322 21904 rpcz_store.cc:276] 0709 13:06:05.262945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.453119 (+1190174us) service_pool.cc:224] Handling call
0709 13:06:06.453407 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.453580 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.453607 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.453647 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:06.453679 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.453732 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.453826 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:06.484351 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57474us
I20260709 13:06:06.485369 24026 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7.
I20260709 13:06:06.449889 24377 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:06.492825 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:06.450762 24401 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:06.509685 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.548790 21832 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:06.512377 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 222) took 1248 ms. Trace:
I20260709 13:06:06.520915 21825 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:06.548418 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:06.549726 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 152965us
I20260709 13:06:06.550213 21903 rpcz_store.cc:276] 0709 13:06:05.263898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.473166 (+1209268us) service_pool.cc:224] Handling call
0709 13:06:06.511359 (+ 38193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.511597 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.511637 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.511695 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:06.511743 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.511816 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.512176 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:06.554363 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:06.514905 24374 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:06.500237 24435 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:06.518766 24290 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:06.576939 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 108906us
W20260709 13:06:06.527318 24321 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.136s	user 0.013s	sys 0.000s
I20260709 13:06:06.571280 21904 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:06.572007 24338 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:06:06.539554 24434 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.576021 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:06.575251 21981 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:06.575186 24404 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:06.541008 24416 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:06.588101 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 176229us
I20260709 13:06:06.591439 21949 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:06.594759 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:06.594830 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:06.596379 21829 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:06.596657 21981 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:06.479267 23861 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.599726 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:06.599947 21949 leader_election.cc:400] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:06.600342 21949 leader_election.cc:403] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:06.600312 22550 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.601231 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:06.585542 24418 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:06:06.603886 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:06.527758 24357 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:06.577252 24290 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:06.632256 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:06.632419 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 52566.2us
I20260709 13:06:06.642185 22552 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:06.614356 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:06.679787 21904 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:06.786597 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:06.787158 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:06.787371 22555 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:06.787926 22554 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.609483 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:06.796408 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 187160us
W20260709 13:06:06.811663 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 207847us
W20260709 13:06:06.819476 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.823665 24415 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.824534 24415 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:06.826388 24443 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.827123 24443 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:06.827841 24443 raft_consensus.cc:2764] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:06.608930 24405 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.220s
I20260709 13:06:06.828933 24443 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:06.829545 24404 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.830118 24404 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.832185 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 269) took 1430 ms. Trace:
I20260709 13:06:06.832427 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:06.833297 22549 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:06.832568 21978 rpcz_store.cc:276] 0709 13:06:05.401412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.578793 (+177381us) service_pool.cc:224] Handling call
0709 13:06:05.579080 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.579360 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.579383 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.582359 (+  2976us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.851888 (+269529us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b480021c258. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:06:05.979148 (+127260us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:05.979196 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.979271 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.831834 (+852563us) raft_consensus.cc:1685] finished
0709 13:06:06.831860 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.832124 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2281,"raft.run_cpu_time_us":2316,"raft.run_wall_time_us":266466,"spinlock_wait_cycles":18147584,"thread_start_us":349253,"threads_started":1,"wal-append.queue_time_us":1243354}
I20260709 13:06:06.835664 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 216) took 2059 ms. Trace:
I20260709 13:06:06.836189 21908 rpcz_store.cc:276] 0709 13:06:04.776281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.599371 (+823090us) service_pool.cc:224] Handling call
0709 13:06:05.599769 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.600171 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.600210 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.600738 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.979510 (+378772us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:05.979560 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.979634 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.835428 (+855794us) raft_consensus.cc:1685] finished
0709 13:06:06.835452 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.835602 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6207,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":378393,"threads_started":1,"wal-append.queue_time_us":653590}
W20260709 13:06:06.838615 24433 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 13:06:06.839124 24440 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:06.839658 24440 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.842399 24280 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.824540 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:06.843667 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:06.585666 24321 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.579440 24374 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.842296 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:06.790961 24290 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.596619 24331 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:06.588886 24434 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:06.821069 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:06.597515 24435 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:06.841894 24440 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:06.579397 24332 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.633458 24350 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.216s
I20260709 13:06:06.857167 22550 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:06.807034 24424 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.609302 24401 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.240s
I20260709 13:06:06.883215 21902 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:06.891458 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:06.856071 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 60038.6us
I20260709 13:06:06.900628 22554 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:06.927069 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:06.930742 21982 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:06.797879 24357 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:06.934598 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:06.832612 24404 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:06.944764 24429 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.947013 24444 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.947657 24444 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.943648 24413 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:06:06.944181 24435 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.609710 24432 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.260s
W20260709 13:06:06.932958 23969 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.720s	user 0.008s	sys 0.004s
I20260709 13:06:06.842952 24280 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:06.959141 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:06.959965 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:06.857784 22546 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:06:06.606972 24416 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:06.974803 24434 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:06.977712 24426 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.389s	user 0.000s	sys 0.000s
I20260709 13:06:06.978039 24449 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:06:06.978587 24438 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.979146 24442 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:06.988610 21908 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 6. Ops: []
I20260709 13:06:06.939232 24405 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:06.993207 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.002912 21904 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:06.993537 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:07.004283 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:07.008628 21908 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:07.000819 24413 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:07.009075 21904 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:06.966667 24430 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.012415 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.961709 24085 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:06.973744 23969 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.015568 24413 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:06:07.013073 24438 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.023402 24357 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.023654 24374 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.024475 24438 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:07.004256 24442 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:06.937650 24424 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.026149 24442 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.026834 21908 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:06:07.025312 24321 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.027232 21908 pending_rounds.cc:85] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 3
I20260709 13:06:07.027546 21908 pending_rounds.cc:107] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:07.027777 21908 raft_consensus.cc:2889] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:07.028250 24424 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:07.029490 24413 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.029712 24280 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:06.999933 24450 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.034464 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:06.994393 24416 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:06.990239 24377 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:07.062047 22520 connection.cc:256] RPC call timeout handler was delayed by -1.1025238440000749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30350000000000005s for a response
I20260709 13:06:07.038908 21904 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:07.034222 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 99718.2us
I20260709 13:06:07.033624 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:06.991251 24444 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:07.071615 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:07.072364 22550 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:07.075723 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:07.076792 22550 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:06:07.083164 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:07.073431 24434 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:06:07.012087 24405 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.089040 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:07.089896 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:07.091037 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:07.093060 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:07.068194 24357 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.094086 21983 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:07.097396 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:07.097666 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:07.099747 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1553) took 1324 ms. Trace:
I20260709 13:06:07.015707 24430 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.074502 24453 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:07.100124 21826 rpcz_store.cc:276] 0709 13:06:05.775008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.775138 (+   130us) service_pool.cc:224] Handling call
0709 13:06:05.805600 (+ 30462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.805980 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.806018 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.837238 (+ 31220us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.211786 (+374548us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:06.211839 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.211940 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.977090 (+765150us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:07.092027 (+114937us) raft_consensus.cc:1685] finished
0709 13:06:07.092056 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.099691 (+  7635us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380,"raft.queue_time_us":216,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13939,"spinlock_wait_cycles":17936128,"thread_start_us":340094,"threads_started":1,"wal-append.queue_time_us":675260}
I20260709 13:06:07.113274 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:07.067198 24438 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:06:07.094058 24405 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.117306 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:07.117887 22552 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:07.118049 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:07.093789 22549 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:07.115029 21829 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:07.110473 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:07.124877 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:07.108806 24334 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.493s	user 0.013s	sys 0.000s
I20260709 13:06:07.100172 24435 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:07.128059 22553 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:07.128019 21983 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:07.106623 24377 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:07.105978 22550 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:07.119045 24450 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:07.132540 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:07.132135 24450 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.141189 24450 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:07.099376 24357 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.116608 24453 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.129060 24377 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.142673 24405 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.145627 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:07.161202 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 90223.7us
I20260709 13:06:07.129998 24334 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.150838 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:07.152511 24443 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:07.153612 24377 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:07.131323 24435 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.187464 21909 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:07.170621 22549 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:07.161041 24405 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.179306 22548 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:07.213654 24085 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:07.221055 23969 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:07.225713 24325 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.059s	user 0.011s	sys 0.001s
I20260709 13:06:07.236886 22550 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:07.239204 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:07.251384 21905 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:07.253536 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:07.250702 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 104034us
I20260709 13:06:07.239837 24405 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:07.249378 24285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.013s	sys 0.024s
I20260709 13:06:07.269307 21828 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:07.257428 24430 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.273206 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:07.257702 24357 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:07.263538 24285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.013s	sys 0.024s
I20260709 13:06:07.260346 24373 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.283703 24455 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:06:07.261440 24462 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:07.239773 24325 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.304986 24435 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:07.306423 24334 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.290503 21826 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:07.309839 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:07.332505 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1580) took 2037 ms. Trace:
W20260709 13:06:07.338917 21830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1556) took 1562 ms (client timeout 1680 ms). Trace:
W20260709 13:06:07.339428 21830 rpcz_store.cc:269] 0709 13:06:05.776125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.792831 (+ 16706us) service_pool.cc:224] Handling call
0709 13:06:07.338698 (+1545867us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540008af54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:07.338852 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569365248}
I20260709 13:06:07.340785 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:07.343904 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:07.332973 21977 rpcz_store.cc:276] 0709 13:06:05.295402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.318303 (+ 22901us) service_pool.cc:224] Handling call
0709 13:06:05.318638 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.444399 (+125761us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:05.492821 (+ 48422us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.833747 (+340926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:05.833815 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:05.833873 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.332230 (+1498357us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54002d4e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:07.332292 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.332431 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77766,"prepare.queue_time_us":40116,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":24572,"raft.queue_time_us":32945,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5724,"spinlock_wait_cycles":288564480,"thread_start_us":311258,"threads_started":1,"wal-append.queue_time_us":503088}
I20260709 13:06:07.346308 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:07.347540 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:06:07.308140 24342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.791s	user 0.004s	sys 0.006s
I20260709 13:06:07.349716 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:07.351899 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:07.352236 21827 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:07.354065 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:07.353255 21826 raft_consensus.cc:2376] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5. Re-sending same reply.
I20260709 13:06:07.356410 21826 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:07.295408 24357 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:06:07.352542 24342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.859s	user 0.004s	sys 0.006s
I20260709 13:06:07.350983 24445 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:07.328275 24373 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:07.404569 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 50565.2us
I20260709 13:06:07.352766 24063 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:07.295565 24290 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.351127 24285 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:07.357015 23861 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:07.357743 24443 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:07.287582 24450 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:07.413903 24472 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:06:07.407625 24459 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:06:07.414678 24373 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.405288 24342 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:07.406462 24445 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:07.461692 21975 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:07.463454 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:07.406368 24462 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:07.408604 24285 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.411438 23861 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:07.405499 24453 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.411921 24063 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:07.461292 24443 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:07.527588 24445 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:07.535426 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 277197us
W20260709 13:06:07.539961 24469 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:06:07.531303 23861 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.530020 24285 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:07.548153 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 192601us
I20260709 13:06:07.553563 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:07.556547 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:07.572872 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1627) took 2816 ms. Trace:
I20260709 13:06:07.573277 21900 rpcz_store.cc:276] 0709 13:06:04.756379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.323420 (+567041us) service_pool.cc:224] Handling call
0709 13:06:05.323736 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:05.324135 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.324165 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:05.324702 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 13:06:05.797604 (+472902us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:06.085653 (+288049us) log.cc:844] Serialized 14 byte log entry
0709 13:06:06.085873 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.085962 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.570329 (+1484367us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b1800363d00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:07.572581 (+  2252us) raft_consensus.cc:1685] finished
0709 13:06:07.572686 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.572816 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52754,"prepare.queue_time_us":52849,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":86424,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":28246,"spinlock_wait_cycles":7198464,"thread_start_us":711345,"threads_started":2,"wal-append.queue_time_us":858765}
W20260709 13:06:07.576768 24392 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 2.034s	user 0.014s	sys 0.011s
W20260709 13:06:07.577786 24399 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.639s	user 0.002s	sys 0.006s
I20260709 13:06:07.578397 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1619) took 2908 ms. Trace:
I20260709 13:06:07.578789 21906 rpcz_store.cc:276] 0709 13:06:04.673833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.191318 (+517485us) service_pool.cc:224] Handling call
0709 13:06:05.204546 (+ 13228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.230817 (+ 26271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.230861 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.247161 (+ 16300us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.351544 (+104383us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:05.389274 (+ 37730us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.394454 (+  5180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.394537 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.576262 (+2181725us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:07.578088 (+  1826us) raft_consensus.cc:1685] finished
0709 13:06:07.578195 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.578325 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30760,"prepare.queue_time_us":38320,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":31046,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":10649,"spinlock_wait_cycles":18570496,"thread_start_us":103590,"threads_started":1,"wal-append.queue_time_us":209872}
I20260709 13:06:07.580946 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 215) took 2886 ms. Trace:
I20260709 13:06:07.581318 21901 rpcz_store.cc:276] 0709 13:06:04.694803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.256905 (+562102us) service_pool.cc:224] Handling call
0709 13:06:05.257305 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.261690 (+  4385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.261740 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.270796 (+  9056us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.506044 (+235248us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:05.506095 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.506216 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.577309 (+2071093us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:07.580678 (+  3369us) raft_consensus.cc:1685] finished
0709 13:06:07.580700 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.580892 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16405,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":84,"spinlock_wait_cycles":68805504,"thread_start_us":156328,"threads_started":1,"wal-append.queue_time_us":516139}
W20260709 13:06:07.583683 24412 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.437s	user 0.007s	sys 0.015s
I20260709 13:06:07.589329 24063 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.543138 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:07.597584 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 54528.7us
I20260709 13:06:07.598304 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:07.598394 22521 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.513s (SENT) [suppressed 45 similar messages]
I20260709 13:06:07.600430 24351 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:07.600956 24325 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:07.606752 24478 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:07.609637 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:07.621551 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:07.596717 24468 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:07.637137 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:07.611400 23969 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:07.611486 24351 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.556650 24462 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.654883 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:07.655856 22550 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:07.642199 24438 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:07.599628 24342 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.640877 24325 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:07.642457 24263 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:06:07.609997 24443 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.645058 23969 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.644490 24290 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:07.651715 24351 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:07.616974 24377 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.677951 22550 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:07.665568 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:07.662035 24450 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:07.662506 24339 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:07.665548 24438 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:07.687337 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:07.687979 22550 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:07.679566 23969 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:07.694212 22519 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:07.695174 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:07.699312 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:07.703068 21874 leader_election.cc:400] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5.
I20260709 13:06:07.685673 24339 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.685374 24337 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:07.686566 24476 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.685249 22548 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
W20260709 13:06:07.713949 24394 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 2.175s	user 0.011s	sys 0.000s
W20260709 13:06:07.706187 24345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.455s	user 0.000s	sys 0.024s
I20260709 13:06:07.691005 24334 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:07.693116 24430 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:07.697223 24405 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.687332 24423 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:07.741360 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 142984us
I20260709 13:06:07.734630 24063 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:07.707170 24468 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:07.717527 24339 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:07.743156 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 106111us
W20260709 13:06:07.740012 24345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.517s	user 0.001s	sys 0.024s
I20260709 13:06:07.708261 24290 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:06:07.742025 24325 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:07.716781 24315 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:06:07.750607 24423 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.735531 24337 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.757398 24063 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.739228 24476 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.746836 24334 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.753743 24405 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.751802 24430 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.780241 24423 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:07.775700 24468 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:07.787030 24063 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:07.809538 24311 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.815423 24373 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:07.816079 24373 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.821132 24488 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.821794 24488 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:07.813828 21825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1546) took 2065 ms (client timeout 2196 ms). Trace:
W20260709 13:06:07.832700 21825 rpcz_store.cc:269] 0709 13:06:05.748793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.749253 (+   460us) service_pool.cc:224] Handling call
0709 13:06:07.813636 (+2064383us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b540017e3d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:07.813762 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735654784}
I20260709 13:06:07.835307 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:07.835985 21980 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:07.841511 21977 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:07.842115 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:07.757866 24438 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.856729 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:07.880498 21983 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:07.823297 24402 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:07.858278 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 153631us
I20260709 13:06:07.884809 21982 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:07.886615 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.887353 21900 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:07.897046 21900 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:07.898077 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:07.898599 21900 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:07.899500 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.899698 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:07.860203 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1575) took 2933 ms. Trace:
I20260709 13:06:07.900840 21902 rpcz_store.cc:276] 0709 13:06:04.926800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.929010 (+1002210us) service_pool.cc:224] Handling call
0709 13:06:05.929369 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.932293 (+1002924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.859912 (+927619us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b5400077954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:07.860127 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193148288}
I20260709 13:06:07.901916 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.878356 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:07.900442 21825 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:07.906672 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.907714 21902 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:07.908507 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.909368 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.878118 24259 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:07.910180 24259 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:07.910609 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.911947 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.912848 21903 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:07.913666 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.894869 24373 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.861637 24377 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:07.924419 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46152.1us
I20260709 13:06:07.925855 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:07.927351 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:07.917579 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:07.918213 21902 raft_consensus.cc:2368] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:07.911091 24259 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.918865 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:07.916460 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.921470 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:07.944468 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:07.946484 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.813159 24063 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:07.950875 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.942878 21900 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
W20260709 13:06:07.952767 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50746.9us
I20260709 13:06:07.953042 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.951447 24259 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:07.954325 24485 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:06:07.954455 24353 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:07.954931 24488 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.898355 24402 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:07.957206 24486 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:06:07.957345 24442 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.958424 21978 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:07.960949 24494 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.961668 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 272) took 2547 ms. Trace:
I20260709 13:06:07.962056 21974 rpcz_store.cc:276] 0709 13:06:05.414550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.591429 (+176879us) service_pool.cc:224] Handling call
0709 13:06:05.591777 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.348282 (+1756505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.348315 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:07.348354 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:07.348385 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.961435 (+613050us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540005afd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:07.961474 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.961594 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4039160192}
I20260709 13:06:07.965142 21978 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:07.966416 24490 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.966925 24490 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.968954 24490 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.969153 21900 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:07.970014 24405 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:07.961406 24494 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.969960 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:07.940295 24437 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:07.938287 24304 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:07.856323 24325 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:07.999778 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.942402 24377 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:07.923736 24290 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:06:08.012645 21980 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:08.007110 21904 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:08.007929 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:08.013695 21900 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:07.938989 23844 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:06:08.010936 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:08.016357 21977 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:08.020360 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:07.997766 24443 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:07.970687 24476 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:08.000694 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:08.032521 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:08.032680 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:08.033520 21900 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:08.002736 24405 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:08.031225 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.008559 24353 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.044185 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:08.044768 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1558) took 1551 ms. Trace:
I20260709 13:06:08.001204 24291 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:06:08.045296 21828 rpcz_store.cc:276] 0709 13:06:06.493270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.494269 (+   999us) service_pool.cc:224] Handling call
0709 13:06:06.494568 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.269829 (+775261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.044463 (+774634us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540011e754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:08.044698 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781005056}
I20260709 13:06:08.052008 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:08.038870 24484 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:06:08.028241 24431 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:08.061427 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.063097 24402 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.017472 24377 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:08.065687 21903 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:08.037454 22546 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:08.055115 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:08.006629 24488 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:06:08.032683 24338 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.065986 24490 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:08.027942 24491 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:08.055567 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 99784.4us
I20260709 13:06:08.032477 24446 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:08.062037 21826 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:08.070410 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.089948 21828 raft_consensus.cc:2410] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:08.090266 21948 leader_election.cc:400] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:08.047672 24476 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.059628 24431 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:07.939383 24468 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.085501 21900 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:08.088814 24490 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:08.067891 24499 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.042038 24405 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.053403 24353 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.397471 21903 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:06:08.326156 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 163611us
I20260709 13:06:08.400290 24499 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:08.397778 24494 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:08.103597 24338 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.403318 24342 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.403854 24342 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:08.273480 24411 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 2.080s	user 0.010s	sys 0.011s
I20260709 13:06:08.405288 24405 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.137334 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1631) took 3380 ms. Trace:
I20260709 13:06:08.409044 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:08.403318 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.156288 24414 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.905s	user 0.000s	sys 0.003s
I20260709 13:06:08.410737 21826 raft_consensus.cc:2410] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:08.158419 24339 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.412662 22555 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [6.8-7.9]
W20260709 13:06:08.274382 24452 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.282s	user 0.000s	sys 0.003s
W20260709 13:06:08.412722 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.274959 24277 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:08.411628 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.408356 21907 rpcz_store.cc:276] 0709 13:06:04.757330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.341052 (+583722us) service_pool.cc:224] Handling call
0709 13:06:05.355339 (+ 14287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.382396 (+ 27057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.382442 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.390607 (+  8165us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.795006 (+404399us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:05.833123 (+ 38117us) log.cc:844] Serialized 14 byte log entry
0709 13:06:05.833369 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.136967 (+2303598us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b54002e81d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:08.137015 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.137058 (+    43us) raft_consensus.cc:1685] finished
0709 13:06:08.137144 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.137262 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29291,"prepare.queue_time_us":51557,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":259271,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":56857,"spinlock_wait_cycles":43060992,"thread_start_us":354749,"threads_started":1,"wal-append.queue_time_us":552773,"wal-append.run_cpu_time_us":3317,"wal-append.run_wall_time_us":1489497}
W20260709 13:06:08.421146 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.422113 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:08.429489 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.430362 21826 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:08.431586 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.433423 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:08.434652 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 404649us
I20260709 13:06:08.434952 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:08.253778 24265 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:08.442224 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:08.417632 24334 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:08.433156 24285 consensus_meta.cc:287] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.837s	user 0.008s	sys 0.019s
I20260709 13:06:08.439453 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.437264 24291 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:08.447109 23861 consensus_meta.cc:287] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.001s
I20260709 13:06:08.489022 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:08.448002 24445 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.890s	user 0.009s	sys 0.003s
I20260709 13:06:08.449770 24353 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.508764 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.441807 24265 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:08.140439 24423 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:08.453246 23969 consensus_meta.cc:287] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.000s
I20260709 13:06:08.440871 24508 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:08.421736 22546 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
W20260709 13:06:08.480556 24351 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.795s	user 0.000s	sys 0.009s
I20260709 13:06:08.108688 24446 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:08.426730 24437 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:06:08.444767 24373 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:08.108435 24476 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:08.509651 21826 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:08.445400 24342 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:08.515770 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 73750.6us
I20260709 13:06:08.510568 24445 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.138361 24490 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:08.108044 24491 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:08.775600 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.602782 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 157070us
W20260709 13:06:08.542043 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 102704us
I20260709 13:06:08.789278 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:08.791620 24519 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:08.793699 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.000s	sys 0.011s
W20260709 13:06:08.794065 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.000s	sys 0.011s
I20260709 13:06:08.794646 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:08.711985 24291 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:08.508083 23861 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.593856 24265 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:08.797010 24265 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:08.797530 24291 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:08.798370 23861 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.798946 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.538915 23969 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.799638 21826 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:08.800611 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:08.514003 24442 consensus_meta.cc:287] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.006s
I20260709 13:06:08.628640 24481 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:08.891554 23861 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:08.811117 24373 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.597914 24334 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:08.489404 24285 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.824414 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:08.900689 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:08.912987 21981 raft_consensus.cc:2410] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:08.855769 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.804765 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:08.801627 21825 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:08.801947 24291 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:08.911789 23861 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.918422 24291 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:08.918651 23861 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.906921 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1556) took 2406 ms. Trace:
I20260709 13:06:08.602878 24494 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.892652 21907 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:08.521425 24339 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.821520 24491 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:08.706905 24500 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.922569 21832 rpcz_store.cc:276] 0709 13:06:06.492692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.494809 (+  2117us) service_pool.cc:224] Handling call
0709 13:06:06.495074 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.570934 (+ 75860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.899221 (+2328287us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b54000311d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:08.899406 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106518912}
I20260709 13:06:08.893522 24476 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:08.520521 24423 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:08.624763 24514 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.932902 21974 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:08.822748 24521 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:06:08.892138 24445 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.892729 24446 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:08.895133 24430 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:08.904874 23969 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:08.907527 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 112979us
I20260709 13:06:08.652294 24350 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.260s
I20260709 13:06:08.932461 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:08.923830 24334 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:08.801493 24351 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.802040 24508 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.941139 21832 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:08.934962 24476 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:08.936602 24342 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:08.909020 24481 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.952700 24481 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:08.953287 24342 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:08.954226 24342 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.952898 21832 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:08.955683 24313 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:08.956243 24313 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:08.936266 24514 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.958352 24430 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:08.959029 24430 consensus_queue.cc:1243] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:08.959873 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:08.933161 24494 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.960487 24489 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:08.960983 24489 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:08.937063 24500 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:08.962059 24494 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.961822 24489 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.962770 24430 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:08.938984 24346 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:08.963485 24500 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:08.964268 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:08.963528 24346 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.965332 21875 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:08.965996 24430 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:08.959896 24514 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.966583 24430 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.969066 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1614) took 1134 ms. Trace:
I20260709 13:06:08.969666 24377 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:08.970731 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:08.972391 24346 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.977150 24430 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:08.978257 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:08.979580 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:08.980914 24483 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.981518 24483 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:08.983804 24261 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:08.984292 24261 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:08.984323 24430 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:08.984922 24430 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.985342 24430 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:08.988235 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:08.988495 24346 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:08.988890 24346 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:08.989277 24346 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:08.989326 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:08.992921 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:08.993655 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1570) took 4189 ms. Trace:
I20260709 13:06:08.994073 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.994910 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1563) took 1045 ms. Trace:
I20260709 13:06:08.995234 21831 rpcz_store.cc:276] 0709 13:06:07.949263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.993817 (+1044554us) service_pool.cc:224] Handling call
0709 13:06:08.994851 (+  1034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.996299 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.996994 21831 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:08.997494 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1562) took 1048 ms. Trace:
I20260709 13:06:08.999639 24373 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:08.999894 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1582) took 1098 ms. Trace:
I20260709 13:06:09.000226 24373 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.000272 21825 rpcz_store.cc:276] 0709 13:06:07.901284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.910239 (+  8955us) service_pool.cc:224] Handling call
0709 13:06:07.910468 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.914565 (+1004097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.999664 (+ 85099us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b540017e8d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:08.999837 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048984960}
W20260709 13:06:08.947285 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.005024 21901 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:09.006138 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.006721 21901 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:09.007629 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:08.996340 24431 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:08.979686 24438 raft_consensus.cc:2955] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:09.051210 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:08.969486 21978 rpcz_store.cc:276] 0709 13:06:07.834869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.835006 (+   137us) service_pool.cc:224] Handling call
0709 13:06:08.968890 (+1133884us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540001efd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:08.969004 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281288576}
I20260709 13:06:08.983805 24483 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.003233 21825 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:09.088136 21906 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:09.088721 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1585) took 1169 ms. Trace:
I20260709 13:06:09.089078 21825 rpcz_store.cc:276] 0709 13:06:07.919797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.002613 (+1082816us) service_pool.cc:224] Handling call
0709 13:06:09.002975 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.088474 (+ 85499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.088674 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.090312 21825 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:09.090865 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1560) took 1142 ms. Trace:
I20260709 13:06:09.091189 21825 rpcz_store.cc:276] 0709 13:06:07.948463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.089852 (+1141389us) service_pool.cc:224] Handling call
0709 13:06:09.090125 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.090638 (+   513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.090807 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.092414 21825 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:09.092890 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1571) took 1120 ms. Trace:
I20260709 13:06:09.093183 21825 rpcz_store.cc:276] 0709 13:06:07.972802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.091878 (+1119076us) service_pool.cc:224] Handling call
0709 13:06:09.092141 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.092699 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.092844 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.008157 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:08.997761 21830 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:09.095791 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1584) took 1184 ms. Trace:
I20260709 13:06:09.096098 21830 rpcz_store.cc:276] 0709 13:06:07.911781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.997244 (+1085463us) service_pool.cc:224] Handling call
0709 13:06:08.997492 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.095578 (+ 98086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.095746 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.956244 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:08.985275 24261 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:09.105508 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.993991 21909 rpcz_store.cc:276] 0709 13:06:04.804691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.607215 (+802524us) service_pool.cc:224] Handling call
0709 13:06:05.607563 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.187961 (+1580398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.993454 (+1805493us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000fb254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:08.993602 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3633072000}
I20260709 13:06:09.051083 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.106295 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:09.106645 21908 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:09.107112 24304 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:09.065029 21826 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:09.064787 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.057564 21902 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:09.061909 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 72676.1us
I20260709 13:06:09.066725 21900 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:09.067302 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:09.108498 21904 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:08.997633 24346 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.059636 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:09.084584 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1571) took 2268 ms. Trace:
I20260709 13:06:09.085064 24311 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:09.064800 24468 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.997830 21831 rpcz_store.cc:276] 0709 13:06:07.949003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.996080 (+1047077us) service_pool.cc:224] Handling call
0709 13:06:08.997442 (+  1362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.057690 21901 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:09.107620 24304 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.110661 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1572) took 1112 ms. Trace:
I20260709 13:06:09.121203 21825 rpcz_store.cc:276] 0709 13:06:07.998621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.093799 (+1095178us) service_pool.cc:224] Handling call
0709 13:06:09.110196 (+ 16397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.110361 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.110384 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.110423 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:09.110458 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.110507 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.110591 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.051810 24449 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:06:09.138374 24468 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.115989 24483 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:09.140560 24468 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.142961 24499 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.144133 24508 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.086295 21833 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:09.116261 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:09.145711 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1564) took 1195 ms. Trace:
I20260709 13:06:09.146040 21833 rpcz_store.cc:276] 0709 13:06:07.949808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.987927 (+1038119us) service_pool.cc:224] Handling call
0709 13:06:09.145657 (+157730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.146893 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.146940 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.147862 21978 raft_consensus.cc:2410] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:09.148562 21980 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:09.119726 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 261) took 1093 ms. Trace:
I20260709 13:06:09.071907 24431 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:09.112599 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53080.9us
I20260709 13:06:09.144196 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1608) took 2561 ms. Trace:
I20260709 13:06:09.150959 21977 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:09.123961 24518 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:06:09.122650 24304 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.081687 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.125340 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.126920 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:09.127027 24334 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.128618 24346 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.177433 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.130265 24063 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.131714 24443 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:09.133512 24479 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:09.125749 24261 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:09.134944 24285 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.135713 24441 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:09.137002 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.177963 24514 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:09.149137 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:09.149271 21832 rpcz_store.cc:276] 0709 13:06:08.026436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.097586 (+1071150us) service_pool.cc:224] Handling call
0709 13:06:09.119136 (+ 21550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.119343 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.119379 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.119434 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:09.119478 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.119548 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.119662 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.150612 21975 rpcz_store.cc:276] 0709 13:06:06.582812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.586058 (+  3246us) service_pool.cc:224] Handling call
0709 13:06:06.586363 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.520879 (+934516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.143997 (+1623118us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54003fa554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:09.144144 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012542720}
I20260709 13:06:09.173058 21833 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:09.190714 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.178370 21906 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:09.178610 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 262) took 1151 ms. Trace:
I20260709 13:06:09.191504 21828 rpcz_store.cc:276] 0709 13:06:08.026835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.126700 (+1099865us) service_pool.cc:224] Handling call
0709 13:06:09.178549 (+ 51849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.192312 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.193416 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.153134 24446 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:08.823072 24488 consensus_queue.cc:1175] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d76b2c4699e43fba10eeb81a91e4913" responder_term: 6 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:09.181591 24479 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.179095 24445 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:09.190591 24491 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:09.179566 24443 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:09.193931 21828 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:09.205410 24342 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.205739 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.205860 24342 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.187260 24401 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:09.207396 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.196913 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:09.154667 24431 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.208081 24342 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.208971 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.209738 24431 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:09.187685 24063 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:06:09.210372 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.211746 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.217511 24016 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:09.218557 24339 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:09.218958 24339 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:09.219722 24496 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.264s	user 0.003s	sys 0.000s
I20260709 13:06:09.219789 24339 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.221073 24339 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.221532 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.222091 21903 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:09.222898 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.223424 21903 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:09.217286 24304 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.224136 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.225142 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.227684 21975 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:09.228478 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.212343 21906 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:09.231194 21903 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.183609 24442 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:06:09.196143 24526 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.200623 24479 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.191015 23861 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:06:09.241786 24519 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.243985 24524 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:09.244606 24308 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:09.112922 21834 rpcz_store.cc:276] 0709 13:06:06.815893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.108614 (+292721us) service_pool.cc:224] Handling call
0709 13:06:07.108887 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.109062 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:07.126755 (+ 17693us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.938727 (+1811972us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b18000187c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:06:09.084127 (+145400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.084186 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:09.084242 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.084334 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.084489 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17404,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":2970,"raft.queue_time_us":109,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":25567,"spinlock_wait_cycles":4363520,"thread_start_us":145157,"threads_started":1}
W20260709 13:06:09.245828 24532 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:09.246114 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1561) took 1297 ms. Trace:
I20260709 13:06:09.247524 24304 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.248061 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 387) took 2180 ms. Trace:
I20260709 13:06:09.263994 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 364) took 2151 ms. Trace:
I20260709 13:06:09.263105 22554 rpcz_store.cc:276] 0709 13:06:07.067894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.068005 (+   111us) service_pool.cc:224] Handling call
0709 13:06:07.068260 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.094569 (+ 26309us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:07.152040 (+ 57471us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.536688 (+1384648us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b18001271e0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a
0709 13:06:08.536939 (+   251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.537011 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:08.537083 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.247809 (+710726us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b54004f79d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:09.247852 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.247998 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130313,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":21071,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":30787,"spinlock_wait_cycles":70313472,"thread_start_us":127239,"threads_started":2,"wal-append.queue_time_us":109686,"wal-append.run_cpu_time_us":1097,"wal-append.run_wall_time_us":1046301}
I20260709 13:06:09.252770 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.246132 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.267198 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.267431 24489 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.253454 24308 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:09.233481 24491 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:09.269556 24308 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.270663 24308 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.270910 24491 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.256543 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.276260 21908 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:09.277187 21908 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:09.257947 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.278427 21902 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:09.258317 24519 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:09.258844 21827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 250) took 2705 ms (client timeout 1513 ms). Trace:
W20260709 13:06:09.280088 21827 rpcz_store.cc:269] 0709 13:06:06.553898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.554027 (+   129us) service_pool.cc:224] Handling call
0709 13:06:09.258605 (+2704578us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540008a054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:09.258766 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832958336}
I20260709 13:06:09.280859 24519 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.281172 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:09.281708 21827 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.259689 21833 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:06:09.283306 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.285996 24313 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.287285 21832 raft_consensus.cc:606] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:09.287696 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.288295 22555 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 3.
I20260709 13:06:09.240442 24264 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:09.262140 21826 rpcz_store.cc:276] 0709 13:06:07.948742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.800335 (+851593us) service_pool.cc:224] Handling call
0709 13:06:09.245949 (+445614us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540011d854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:09.246060 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598511360}
I20260709 13:06:09.289119 24264 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:09.289834 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.290053 24264 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.290941 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.291294 24264 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.287727 21832 raft_consensus.cc:614] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:09.294018 24345 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:09.294433 24345 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:09.294574 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1574) took 4377 ms. Trace:
I20260709 13:06:09.295209 24345 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.295001 21905 rpcz_store.cc:276] 0709 13:06:04.917216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.783587 (+866371us) service_pool.cc:224] Handling call
0709 13:06:05.805851 (+ 22264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.257320 (+1451469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.294377 (+2037057us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002e77d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:09.294521 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3323970304}
I20260709 13:06:09.297014 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.297660 21905 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:09.298450 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.299069 21905 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.301165 24338 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.237387 24016 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:06:09.302528 21908 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:09.291683 21826 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:09.306340 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.307303 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.308188 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.269588 24430 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.266042 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.314863 24337 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.315001 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.251049 24526 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.264364 22551 rpcz_store.cc:276] 0709 13:06:07.112524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.116005 (+  3481us) service_pool.cc:224] Handling call
0709 13:06:09.263309 (+2147304us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:06:09.263498 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.263672 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.263700 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.263746 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:09.263779 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.263835 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.263943 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3305344}
I20260709 13:06:09.316917 24526 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.294705 24443 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.317809 24443 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:09.318498 24446 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.319597 24453 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:09.320518 24453 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:09.320880 24453 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:09.326720 21908 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:09.327898 24369 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:09.328297 24369 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:09.321761 24453 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.309091 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.261297 21906 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
W20260709 13:06:09.333163 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.334146 21827 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:09.335229 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:09.261394 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 252560us
I20260709 13:06:09.333039 21905 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:09.338973 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:09.330706 21826 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
W20260709 13:06:09.343065 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 252670us
I20260709 13:06:09.344406 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:09.352144 21903 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:09.353106 21902 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:09.288932 24313 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:09.355850 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 172093us
I20260709 13:06:09.357153 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.373129 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.371914 22550 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:09.374200 21905 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:09.373721 21903 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:09.375582 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:09.376116 22550 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.377233 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.380357 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.381928 21903 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:09.384434 22554 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [6.8-7.9]
I20260709 13:06:09.386960 22555 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:09.388144 21903 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:09.388824 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.329059 24369 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.341887 24423 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:09.496996 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 263) took 1469 ms. Trace:
I20260709 13:06:09.521453 21831 rpcz_store.cc:276] 0709 13:06:08.027156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.117551 (+1090395us) service_pool.cc:224] Handling call
0709 13:06:09.117851 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:09.118159 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.118210 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:09.123159 (+  4949us) log.cc:844] Serialized 52 byte log entry
0709 13:06:09.337624 (+214465us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:09.337679 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.337764 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.496756 (+158992us) raft_consensus.cc:1685] finished
0709 13:06:09.496775 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.496926 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2902,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":20135,"thread_start_us":212105,"threads_started":1,"wal-append.queue_time_us":326930}
I20260709 13:06:09.523897 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.410620 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.526427 21905 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:09.411706 24445 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:09.411170 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:09.383590 24265 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
W20260709 13:06:09.527981 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.545763 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 111072us
W20260709 13:06:09.536103 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 295769us
I20260709 13:06:09.490769 24430 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.383833 24338 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 13:06:09.410499 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.516464 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 275) took 1507 ms. Trace:
I20260709 13:06:09.348037 24453 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:09.543057 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 198703us
I20260709 13:06:09.547221 22552 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 3.
I20260709 13:06:09.410249 24353 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.134s
I20260709 13:06:09.547194 21974 rpcz_store.cc:276] 0709 13:06:08.009468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.012010 (+  2542us) service_pool.cc:224] Handling call
0709 13:06:09.516231 (+1504221us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540005a0d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:09.516394 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068499840}
I20260709 13:06:09.543516 21875 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:09.549896 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:09.542181 22550 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:09.560250 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:09.561754 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.562548 21827 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:09.434520 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.566442 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:09.431674 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:09.572885 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:09.574483 21900 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:09.574416 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.576314 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1604) took 1157 ms. Trace:
I20260709 13:06:09.576678 21907 rpcz_store.cc:276] 0709 13:06:08.419337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.419785 (+   448us) service_pool.cc:224] Handling call
0709 13:06:08.433610 (+ 13825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.927197 (+493587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.576125 (+648928us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b540020b2d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:09.576267 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054879616}
I20260709 13:06:09.540066 24445 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:09.410677 24337 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:09.568320 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:09.581032 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:09.549199 24526 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:09.390370 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.582329 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.545383 24442 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:09.401042 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:09.545029 24313 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:09.435171 24479 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:09.603931 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.589244 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:09.580994 24259 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:09.586272 24445 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.586445 24430 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:09.616441 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:09.595386 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 205068us
I20260709 13:06:09.596977 24345 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.586138 24016 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:09.600345 21974 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:09.606112 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.594965 22553 raft_consensus.cc:2955] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:09.593279 24508 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:09.595225 24415 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:09.633463 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:09.665943 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:09.628381 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.634281 24350 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:09.634997 24508 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:09.635318 24415 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:09.636631 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.638088 24304 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.594313 24337 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.639194 24437 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:09.642856 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1618) took 1599 ms. Trace:
I20260709 13:06:09.677729 21981 rpcz_store.cc:276] 0709 13:06:08.043711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.043878 (+   167us) service_pool.cc:224] Handling call
0709 13:06:09.642698 (+1598820us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54003fa054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:09.642807 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995794816}
I20260709 13:06:09.678730 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.645175 24369 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.646981 24306 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:09.649672 24401 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:09.612999 24430 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:09.673874 24350 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.652143 24259 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.654791 24315 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.610977 24338 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:09.611357 24313 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.656895 24416 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:09.658389 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.659150 22551 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:09.581703 24308 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:06:09.602998 24442 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.706542 24508 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.707597 24416 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.708595 24442 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.607197 24492 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:09.709235 24492 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.662729 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 264) took 1635 ms. Trace:
I20260709 13:06:09.627864 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.710431 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 258) took 2533 ms. Trace:
W20260709 13:06:09.710778 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 83039.9us
I20260709 13:06:09.711166 23861 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.710261 21825 rpcz_store.cc:276] 0709 13:06:08.027439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.122120 (+1094681us) service_pool.cc:224] Handling call
0709 13:06:09.122424 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.122621 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.122647 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.123642 (+   995us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.343006 (+219364us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:09.343039 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.343103 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.662541 (+319438us) raft_consensus.cc:1685] finished
0709 13:06:09.662562 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.662679 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":218995,"threads_started":1,"wal-append.queue_time_us":450042}
I20260709 13:06:09.711784 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.712512 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:09.713016 21825 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:09.664268 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.714390 24540 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.714782 24540 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:09.715116 24540 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.716269 22554 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:09.716928 24445 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.711792 23861 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:09.717918 23861 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.718312 24489 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.693065 24259 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.687143 24306 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:09.638549 24317 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:09.674695 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.675953 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:09.681594 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48206.3us
I20260709 13:06:09.610584 24330 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.675844 24415 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:09.689816 21831 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:09.677053 24325 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:09.689005 24401 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.694950 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:09.736474 21978 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:09.694051 24338 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.689486 24430 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.697201 24315 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.709538 24416 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:09.672293 21949 connection.cc:256] RPC call timeout handler was delayed by -1.4271955890000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 13:06:09.719305 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.617892 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53289.5us
I20260709 13:06:09.742758 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.745149 21825 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:09.710803 21829 rpcz_store.cc:276] 0709 13:06:07.177076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.679281 (+502205us) service_pool.cc:224] Handling call
0709 13:06:07.686901 (+  7620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.538289 (+1851388us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b18003154c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb75efd6060 00007fb75efd6bfb 00007fb75efe164b
0709 13:06:09.538413 (+   124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.538440 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.538962 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.606784 (+ 67822us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:09.606816 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.606890 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.710128 (+103238us) raft_consensus.cc:1685] finished
0709 13:06:09.710149 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.710378 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104749,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4004,"spinlock_wait_cycles":8211328,"thread_start_us":173058,"threads_started":2,"wal-append.queue_time_us":154806}
I20260709 13:06:09.729460 21903 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:09.690435 24350 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:09.747629 21949 connection.cc:256] RPC call timeout handler was delayed by -1.1832955889999539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260709 13:06:09.730983 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:09.732764 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.733107 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:09.722023 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.734390 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.734676 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.733976 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.750312 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.750490 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.750687 24265 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:09.751055 21909 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:09.751312 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.751169 24265 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.751582 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.752605 21980 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:06:09.752911 21980 pending_rounds.cc:85] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 3
I20260709 13:06:09.753124 24278 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.746158 24325 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:09.759254 24445 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:09.760010 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:09.759909 24306 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:09.735386 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 60771.7us
I20260709 13:06:09.761202 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.761425 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.688581 24342 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.762252 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:09.762807 21833 raft_consensus.cc:2376] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5. Re-sending same reply.
I20260709 13:06:09.763590 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.763737 24315 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.763985 24311 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:09.704043 24313 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.737512 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.764436 24311 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.764849 24311 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.764219 21730 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.767062 22554 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:09.767138 24541 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:09.768087 24541 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:09.768428 24541 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:09.769158 24541 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.769558 23861 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.718349 24264 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:09.771541 23861 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:09.771587 24337 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.772642 24492 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.741806 24338 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.739589 24259 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.775229 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.776279 21981 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:09.733268 24446 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:09.777951 24446 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.778550 24285 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:09.778947 24285 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:09.779984 24446 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:09.740679 21979 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:09.779822 24285 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.780829 24285 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:09.780715 24401 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.763605 24490 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:09.741525 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.742043 21905 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:09.742981 21983 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:09.746158 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.784446 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:09.791244 21982 raft_consensus.cc:2410] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:09.791949 24360 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:09.692495 24304 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.791239 21831 raft_consensus.cc:606] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:09.793076 21831 raft_consensus.cc:614] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:09.792761 24304 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.793665 24360 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:09.794826 22555 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:09.736555 21907 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:09.792685 21827 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:09.786888 24351 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.794914 24304 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.753161 24265 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:09.743911 24437 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:09.844506 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.845734 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:09.788482 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.718928 24489 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:09.748332 21949 connection.cc:256] RPC call timeout handler was delayed by -1.1256955889999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:06:09.798290 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 60174.5us
I20260709 13:06:09.786571 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:09.794395 21831 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:09.909734 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:09.909834 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:09.910307 21831 raft_consensus.cc:606] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:09.910542 21833 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:09.910617 24540 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.911530 21831 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:09.753134 21980 pending_rounds.cc:107] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:09.912750 21980 raft_consensus.cc:2889] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:09.913091 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:09.913182 24540 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.913899 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.914191 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:09.914714 21949 connection.cc:256] RPC call timeout handler was delayed by -1.0059955890000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 13:06:09.914958 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.915552 21980 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:09.915591 24265 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.915788 24442 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.916157 24265 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.747674 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.916329 24442 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:09.808712 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.808266 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.840646 24342 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:09.810216 21904 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 4.
I20260709 13:06:09.918607 24342 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:09.812281 21909 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:06:09.919020 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.919751 21983 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:09.919448 24342 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.920305 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.920454 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.921048 24259 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.921504 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.811143 21902 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:06:09.922538 21902 pending_rounds.cc:85] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 8
I20260709 13:06:09.922823 21902 pending_rounds.cc:107] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:06:09.922617 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.923101 21902 raft_consensus.cc:2889] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:09.841375 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.924120 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:09.842386 24313 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:09.861873 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 71279.1us
I20260709 13:06:09.926045 24313 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.926818 24481 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:09.865717 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.867101 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:09.867604 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.854508 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.869693 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.928069 21907 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:09.871325 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:09.928433 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 61404.5us
I20260709 13:06:09.873298 21828 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:09.843817 24360 consensus_queue.cc:1243] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:09.874475 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:09.785943 24479 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.782718 24401 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:09.759920 24325 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.946942 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.882419 21834 raft_consensus.cc:2410] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:09.886312 21829 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:09.947482 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 73067.2us
I20260709 13:06:09.888669 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.889694 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:09.948136 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:09.898427 24443 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:09.954794 24442 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.954794 24443 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:09.956238 24443 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.957340 24443 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.899587 24350 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.959543 21900 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:09.960453 24438 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:09.960865 24438 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:09.961661 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.961622 24438 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.962409 24338 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:09.962836 24438 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.964895 24338 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:09.927567 24263 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.965761 24263 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.967286 24437 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:09.967662 24263 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:09.968154 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.968365 24437 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:09.929702 24537 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:09.969276 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:09.969595 24537 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.969964 24537 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.969841 24016 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:09.919216 21909 pending_rounds.cc:85] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 2
I20260709 13:06:09.971033 24265 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:09.971419 21909 pending_rounds.cc:107] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:06:09.960876 24350 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.926275 21798 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:09.863164 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.869022 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:09.928442 21974 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:09.973416 24016 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:09.842746 21830 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:09.937575 21908 raft_consensus.cc:2376] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7. Re-sending same reply.
I20260709 13:06:09.930413 21976 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 4: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:09.974678 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1587) took 1953 ms. Trace:
I20260709 13:06:09.928705 21977 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:09.946135 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.786425 24541 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.894548 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:09.947839 23969 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.951474 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:09.952041 23861 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:09.952577 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.916420 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:09.953126 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:09.962662 21975 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:09.901505 21730 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.971727 21909 raft_consensus.cc:2889] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:09.925410 24369 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:09.972822 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 46635.1us
I20260709 13:06:09.996423 21907 raft_consensus.cc:2376] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8. Re-sending same reply.
I20260709 13:06:09.952983 24313 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.975096 21983 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:09.975054 21830 rpcz_store.cc:276] 0709 13:06:08.021634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.096746 (+1075112us) service_pool.cc:224] Handling call
0709 13:06:09.841307 (+744561us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800010598. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:06:09.841556 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.974439 (+132883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.974625 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29806464}
W20260709 13:06:09.986896 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.969887 21829 raft_consensus.cc:606] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:09.997009 21904 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:09.969276 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:10.006783 21829 raft_consensus.cc:614] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:10.008555 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:09.924131 24489 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:09.975579 21976 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:09.999207 21982 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:10.004797 21798 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:10.018694 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:09.997896 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 46487.3us
I20260709 13:06:09.939441 24345 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.011176 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:10.011731 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.012279 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:10.025053 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.014460 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.945101 24405 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:10.043008 21980 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:10.024227 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:10.026235 22550 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:10.032457 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:10.045866 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:10.048178 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:10.049551 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:10.051116 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:10.026273 21909 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:09.975845 24514 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:10.024223 21902 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:06:10.052559 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:10.054621 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:09.953838 24311 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.055747 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:10.056056 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:10.057370 21902 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:10.059798 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:10.061805 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.062753 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:10.063678 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:10.064169 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:10.065330 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:10.067888 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:10.069169 21977 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:10.054348 24345 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.070214 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:10.071123 24345 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:10.071357 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:10.054553 24405 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.071986 24405 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:10.054914 24416 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:10.074353 24337 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:10.074548 24514 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.074721 21908 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:10.075124 24514 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.072000 21977 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:10.078775 21983 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:09.999679 24540 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:10.079591 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:10.002691 24265 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:10.087186 21980 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:06:10.008526 24304 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:10.077440 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:10.089319 21977 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:10.090983 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:10.015224 24479 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.087502 24308 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:10.096210 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:10.122238 21977 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:10.096354 21976 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:10.056234 24401 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:06:10.075713 24360 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:10.080616 24490 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:10.076897 24519 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:10.094609 24540 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.107968 24537 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:10.137272 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 209727us
I20260709 13:06:10.015884 24430 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.140460 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:10.015177 23861 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:10.044150 24016 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:10.118448 21825 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:10.123869 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:10.057492 24342 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:10.129094 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:10.130795 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:10.154462 21909 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:10.155385 21978 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:10.131846 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:10.133765 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.086916 24416 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:10.008592 23969 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.156597 21979 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:10.134935 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:10.087085 24330 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:10.161276 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff74442193fb468c966c8842f014e361"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
W20260709 13:06:10.136544 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52522.6us
I20260709 13:06:10.161900 21829 raft_consensus.cc:606] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:10.111507 24311 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.059386 24350 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:06:10.112761 21949 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:06:10.169780 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 57101.7us
I20260709 13:06:10.122033 24308 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.171262 24308 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.170930 23861 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:10.143555 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:10.140558 24306 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.170974 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:10.131444 24345 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:10.151263 21906 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:10.093111 24415 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.162387 21829 raft_consensus.cc:614] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:10.163758 21902 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:10.162272 24338 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.167253 24360 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:10.183081 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.131764 24278 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:06:10.129287 24479 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:10.189339 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:10.146802 24259 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:10.204814 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:10.205665 24481 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:10.150748 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:10.215966 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53628.7us
I20260709 13:06:10.218573 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:10.224619 21906 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:10.147367 24520 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:06:10.201211 24360 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:10.258368 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 107687us
I20260709 13:06:10.259269 24401 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:10.260129 24401 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:10.260870 24401 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:10.261164 24401 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:10.262439 24265 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:10.262928 24265 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:10.262439 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:10.263759 24265 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.265228 24265 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:10.234709 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:10.266844 24350 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:10.269176 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:10.270061 24350 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:10.270526 24350 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:10.261950 24401 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.270969 24350 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.271584 24401 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.202093 24342 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:10.209084 24526 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:10.211220 24353 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:10.209223 24285 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:10.231056 24313 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:10.253196 24369 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:06:10.370151 24537 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.227025 24345 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:10.359676 24513 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:10.253259 24519 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.372506 24557 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
W20260709 13:06:10.431777 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.208501 24338 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.279109 24445 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:10.359524 24526 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:10.437779 24353 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:06:10.281435 24416 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.156s
W20260709 13:06:10.436162 24538 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:06:10.459647 24285 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:10.450706 24513 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.492187 24362 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:10.502797 24443 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.001s
I20260709 13:06:10.497776 24513 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:10.458374 24519 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:10.562497 24558 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:06:10.470621 24481 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:10.566370 24556 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
W20260709 13:06:10.564358 24438 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
W20260709 13:06:10.574366 24560 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:06:10.575179 24562 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:06:10.540247 24526 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:10.576480 24561 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:10.557802 24430 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.597553 24479 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:10.603859 24541 consensus_meta.cc:287] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.002s
I20260709 13:06:10.607463 24519 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:10.612512 24514 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 13:06:10.615796 24514 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:10.617169 24446 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:10.624904 24514 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:10.232015 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.662320 21826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.008s
W20260709 13:06:10.662827 21826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.006s	sys 0.008s
I20260709 13:06:10.664320 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 272) took 1321 ms. Trace:
I20260709 13:06:10.251010 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:10.664840 21826 rpcz_store.cc:276] 0709 13:06:09.342529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.555221 (+212692us) service_pool.cc:224] Handling call
0709 13:06:09.555468 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.555631 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:09.675208 (+119577us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.663434 (+988226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.663561 (+   127us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:10.663707 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.663861 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.664181 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81220,"prepare.queue_time_us":395315,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":110681,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":4437,"thread_start_us":1001169,"threads_started":3,"wal-append.queue_time_us":456362}
I20260709 13:06:10.667168 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:10.669837 21827 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:10.670710 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1583) took 1476 ms. Trace:
I20260709 13:06:10.671399 21832 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:10.671203 21834 rpcz_store.cc:276] 0709 13:06:09.194370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.314779 (+120409us) service_pool.cc:224] Handling call
0709 13:06:10.670021 (+1355242us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54000e97d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:10.670392 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270139136}
I20260709 13:06:10.672344 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1595) took 1010 ms. Trace:
I20260709 13:06:10.672953 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1591) took 1012 ms. Trace:
W20260709 13:06:10.673913 21831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.006s	sys 0.037s
W20260709 13:06:10.674309 21831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.037s
W20260709 13:06:10.661368 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.003s	sys 0.009s
W20260709 13:06:10.678609 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.004s	sys 0.010s
W20260709 13:06:10.680121 21729 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 219) took 19750 ms (client timeout 15000 ms). Trace:
I20260709 13:06:10.681003 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1596) took 1018 ms. Trace:
I20260709 13:06:10.681440 21825 rpcz_store.cc:276] 0709 13:06:09.662189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.813408 (+151219us) service_pool.cc:224] Handling call
0709 13:06:09.813649 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.150704 (+337055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.680478 (+529774us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540040cc54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:10.680824 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700555520}
W20260709 13:06:10.684274 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 415019us
I20260709 13:06:10.686216 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:10.689465 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:10.690347 21827 rpcz_store.cc:276] 0709 13:06:09.661952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.803318 (+141366us) service_pool.cc:224] Handling call
0709 13:06:09.803641 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.670689 (+867048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.671997 (+  1308us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540008af54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:10.672258 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990566784}
W20260709 13:06:10.693902 21975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.017s
W20260709 13:06:10.696331 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.696460 21982 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 3. Current term is 5. Ops: []
W20260709 13:06:10.697719 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.699702 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 494882us
W20260709 13:06:10.680650 21729 rpcz_store.cc:269] 0709 13:05:50.929457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.930131 (+   674us) service_pool.cc:224] Handling call
0709 13:06:10.679794 (+19749663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:03.562335 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:03.565209 (+  2874us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:03.565271 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:06:03.565304 (+    33us) tablet.cc:662] Decoding operations
0709 13:06:03.859375 (+294071us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:03.883552 (+ 24177us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:03.895884 (+ 12332us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:06:03.930990 (+ 35106us) tablet.cc:701] Row locks acquired
0709 13:06:03.931046 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:06:03.931207 (+   161us) write_op.cc:270] Start()
0709 13:06:03.931353 (+   146us) write_op.cc:276] Timestamp: P: 1783602363931145 usec, L: 0
0709 13:06:03.931395 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:06:03.932059 (+   664us) log.cc:844] Serialized 7511 byte log entry
0709 13:06:04.839023 (+906964us) op_driver.cc:464] REPLICATION: finished
0709 13:06:05.282059 (+443036us) write_op.cc:301] APPLY: starting
0709 13:06:05.282197 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:05.282623 (+   426us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:05.282765 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:05.285071 (+  2306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:05.285502 (+   431us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:06:05.285551 (+    49us) write_op.cc:312] APPLY: finished
0709 13:06:05.286000 (+   449us) log.cc:844] Serialized 132 byte log entry
0709 13:06:05.340602 (+ 54602us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.368551 (+ 27949us) write_op.cc:454] Released schema lock
0709 13:06:05.388135 (+ 19584us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:05.457028 (+ 68893us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.460376 (+  3348us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17608,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":397090,"apply.run_cpu_time_us":5225,"apply.run_wall_time_us":151275,"num_ops":19,"prepare.queue_time_us":282886,"prepare.run_cpu_time_us":17453,"prepare.run_wall_time_us":551142,"raft.queue_time_us":284817,"raft.run_cpu_time_us":30799,"raft.run_wall_time_us":323063,"replication_time_us":861660,"thread_start_us":738044,"threads_started":4,"wal-append.queue_time_us":458326,"wal-append.run_cpu_time_us":51657,"wal-append.run_wall_time_us":1974845}]]}
I20260709 13:06:10.673385 21832 rpcz_store.cc:276] 0709 13:06:09.660959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.668805 (+  7846us) service_pool.cc:224] Handling call
0709 13:06:10.670415 (+1001610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.671996 (+  1581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.672724 (+   728us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54000e97d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:10.672894 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2281581312}
W20260709 13:06:10.722879 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 460364us
W20260709 13:06:10.730873 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.727561 21975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.010s	sys 0.018s
W20260709 13:06:10.733140 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.733850 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.724028 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:10.741426 24423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.010s	sys 0.010s
I20260709 13:06:10.741654 24437 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.742774 24437 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.743906 24525 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:10.744690 24525 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.745565 24291 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:10.745419 24525 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.495638 24285 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.745443 24337 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:10.766947 24338 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:10.767155 24337 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:10.767779 24337 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:10.770298 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.008s	sys 0.014s
W20260709 13:06:10.770763 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.008s	sys 0.015s
W20260709 13:06:10.772137 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 631700us
I20260709 13:06:10.748234 24525 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.778447 24416 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.779716 24570 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:10.779448 24416 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.780222 24570 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:10.780797 24570 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:10.783113 24265 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 13:06:10.786005 24441 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:10.786592 24441 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:10.787236 24586 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.788058 24586 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:10.788841 24438 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:10.789690 24438 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.792333 24438 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.798529 24337 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.800861 24337 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.801163 24415 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.802666 24586 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:10.692313 21730 catalog_manager.cc:5697] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 3, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:06:10.804594 21730 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.807029 21730 catalog_manager.cc:5697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 5, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 5 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.814244 24415 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:10.814908 24415 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.816628 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:10.817181 24415 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.817512 21903 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:10.818703 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 94907.8us
I20260709 13:06:10.822420 24353 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:10.823011 24353 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:10.823192 21901 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:06:10.824131 24353 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:10.824990 24350 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.005s
I20260709 13:06:10.825484 24350 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:10.785953 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:10.828197 21903 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:10.500320 24016 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:10.745944 24437 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.787786 24441 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.827854 24350 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:10.858443 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 169209us
I20260709 13:06:10.829285 24445 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:10.872525 21981 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:10.873811 21730 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 5, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 5 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.876042 24285 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.879829 21730 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 5, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 5 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.881896 21730 catalog_manager.cc:5697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 4, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:10.893633 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 123541us
I20260709 13:06:10.863705 24416 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.898197 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:10.826145 24443 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:06:10.905129 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:10.910636 21907 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.006s	sys 0.004s
W20260709 13:06:10.911078 21907 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.006s	sys 0.005s
I20260709 13:06:10.920241 24483 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:10.921188 24483 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:10.923452 24360 consensus_meta.cc:287] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.008s
I20260709 13:06:10.924131 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:10.924059 24360 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:10.925432 24483 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:10.895715 24570 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:10.926591 24446 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:10.927016 24446 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.927356 24446 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.927735 24570 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:10.931581 21903 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
W20260709 13:06:10.938738 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49841.4us
I20260709 13:06:10.898497 24016 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.940950 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:10.942035 22552 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:06:10.943747 24308 consensus_meta.cc:287] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.772s	user 0.005s	sys 0.009s
I20260709 13:06:10.944396 24308 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:10.950241 21901 raft_consensus.cc:2410] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:06:10.953488 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:10.954210 21900 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.953971 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:10.968502 24259 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:10.969116 24259 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.971740 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:10.972325 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:10.973088 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1585) took 1110 ms. Trace:
I20260709 13:06:10.973218 21906 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:10.963922 24441 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.972810 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:10.975310 22552 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:10.976464 24589 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:10.976836 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:10.977711 24589 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:10.973538 21978 rpcz_store.cc:276] 0709 13:06:09.862136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.862914 (+   778us) service_pool.cc:224] Handling call
0709 13:06:10.972738 (+1109824us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54002d3f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:10.972888 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420392704}
I20260709 13:06:10.978340 24483 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:10.978468 24589 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:10.978885 24483 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:10.979946 24589 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:10.980172 24483 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:10.981848 24483 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:10.977830 22551 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:10.936987 21730 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 5, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 5 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:06:11.018576 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.997578 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 640403us
I20260709 13:06:11.032538 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.033406 21827 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:11.034320 24315 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:11.034785 24315 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:11.035884 24315 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.037351 24315 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:11.038610 24415 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:11.039117 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:11.040057 24443 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:11.040601 24540 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:11.046764 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:11.047643 24586 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:11.048027 24586 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.048369 24586 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.049201 24513 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.053756 24595 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:11.059896 24308 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:11.061337 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:11.031308 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 79270.6us
I20260709 13:06:11.042456 24360 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:11.131042 21900 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
W20260709 13:06:11.143705 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.149641 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 110736us
I20260709 13:06:11.137177 21730 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 5, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 5 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:11.159704 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 205597us
I20260709 13:06:11.173081 21827 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:11.176223 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.177708 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:11.178577 21825 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:11.180212 24405 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.108s	user 0.015s	sys 0.000s
W20260709 13:06:11.180905 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.180655 24405 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:11.189283 24598 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:06:11.190471 24597 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:06:11.199308 21834 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:11.202183 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:11.202402 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.202661 24540 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:11.203446 24540 consensus_queue.cc:1243] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:11.204015 24540 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:11.204309 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.205315 24513 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:11.206192 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.207389 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:11.208597 24446 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.208940 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:11.211318 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1652) took 1129 ms. Trace:
I20260709 13:06:11.211704 21980 rpcz_store.cc:276] 0709 13:06:10.082191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.097529 (+ 15338us) service_pool.cc:224] Handling call
0709 13:06:10.097835 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.153866 (+ 56031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.153909 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.153968 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:10.154007 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.210864 (+1056857us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b5400059bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:11.210936 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.211141 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128322944}
I20260709 13:06:11.214854 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:11.215301 23969 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:11.226104 24489 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.226872 24489 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.230818 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:11.231746 21829 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:11.176303 24306 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.962s	user 0.012s	sys 0.004s
W20260709 13:06:11.240783 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.229869 24489 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:11.247720 21825 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:11.219722 21730 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.259809 21906 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:11.263190 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:11.266732 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 112931us
W20260709 13:06:11.273726 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.200035 24285 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:11.284495 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.285467 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:11.262961 24445 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:11.282303 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:11.290782 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:11.293287 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.268800 24353 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.301470 21827 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:11.301935 24353 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.304163 24353 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:11.305893 24304 raft_consensus.cc:993] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:11.306542 24483 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:11.306995 21909 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:11.307842 21834 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.307183 24479 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:11.307534 24285 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:11.307945 24345 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:11.308012 21903 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:11.289068 24446 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:11.311038 21906 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:11.302301 24369 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:11.310658 22551 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:11.321623 24483 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.322160 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:11.323840 24304 raft_consensus.cc:1081] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:11.323954 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:11.324425 24479 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.318302 24345 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:11.288807 24306 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:11.319078 24405 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:11.342064 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:11.335599 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 128315us
I20260709 13:06:11.332850 24285 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:11.344251 24593 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:11.350448 24265 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:11.350709 24585 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:11.350896 24265 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:11.351176 24585 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:11.351956 24265 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.352240 24585 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.353322 24585 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:11.350490 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:11.356771 24265 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.358557 24369 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.362731 22552 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.326370 22551 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:11.373544 21830 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:11.382669 24479 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:11.382728 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 123093us
I20260709 13:06:11.386714 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:11.387151 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:11.389227 24445 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:11.390090 24445 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:11.391095 24445 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:11.399183 24306 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.401247 24369 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:11.334457 24586 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.415784 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.419905 24524 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.420725 24524 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.422317 24489 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:11.422456 24264 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:11.422968 24317 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.423455 24264 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:11.423873 24264 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:11.423556 24317 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.424810 24264 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.427119 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:11.422986 24489 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.429297 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:11.430428 24259 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.432089 21901 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:11.432739 24259 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:11.374053 24345 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.433804 24345 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.435436 24524 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:11.414450 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:11.401955 24306 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:11.439667 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.444834 21827 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:11.448211 21829 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:11.430549 24489 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:11.466856 24442 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:11.467484 24405 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.468255 24405 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.469110 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:11.470212 24304 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:11.471055 24304 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.426160 24264 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:11.457435 22555 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:11.457717 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:11.457858 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:11.458338 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:11.434065 24317 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:11.485942 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:11.493916 21980 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:11.494004 22552 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:11.494331 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:11.491973 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 62816.3us
I20260709 13:06:11.449057 24285 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.451517 24443 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:11.500735 21834 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:11.495615 21902 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:11.506246 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.506718 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.467495 24442 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:11.517817 21902 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:11.518460 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.513628 21905 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:11.497536 24483 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:11.529558 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:11.530344 21827 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:11.525976 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:11.505507 24489 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:11.527016 24446 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:06:11.532441 24315 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:11.536917 24315 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.538484 24541 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.539415 24315 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:11.539136 24541 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.541056 24585 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:11.544988 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:11.541428 24541 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:11.551538 21902 raft_consensus.cc:2368] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:06:11.552482 21834 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:06:11.552876 21834 pending_rounds.cc:85] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 7
I20260709 13:06:11.542317 24585 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:06:11.554875 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.556176 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:11.546628 24443 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:11.557540 24443 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:11.558228 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1676) took 1548 ms. Trace:
I20260709 13:06:11.558543 24443 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.559929 24443 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.558641 21907 rpcz_store.cc:276] 0709 13:06:10.010121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.010274 (+   153us) service_pool.cc:224] Handling call
0709 13:06:10.072288 (+ 62014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.162016 (+ 89728us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:10.911478 (+749462us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.157014 (+245536us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.161547 (+  4533us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:11.174894 (+ 13347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.557911 (+383017us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x7b54002382d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:11.557971 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.558140 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":578413,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":98,"raft.queue_time_us":13326,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6968,"spinlock_wait_cycles":205855104,"thread_start_us":926931,"threads_started":2,"wal-append.queue_time_us":282982}
I20260709 13:06:11.563545 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:11.565025 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.567586 22551 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.568951 22551 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.569191 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:11.571059 24526 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.574692 21982 pending_rounds.cc:85] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 2
I20260709 13:06:11.561081 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:11.575526 21907 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:11.575605 24483 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.571134 24315 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:11.553128 21834 pending_rounds.cc:107] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:11.575042 21982 pending_rounds.cc:107] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:11.578135 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:11.582049 21834 raft_consensus.cc:2889] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:11.582132 21982 raft_consensus.cc:2889] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:11.584836 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.586292 21829 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:11.588230 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.588969 21832 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:11.589882 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:11.577446 24441 consensus_meta.cc:287] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.006s
I20260709 13:06:11.600405 21825 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.602911 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.581831 24315 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.607556 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.609669 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.576306 24483 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.610631 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:11.612949 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:11.581032 24285 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.620711 21832 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:06:11.611368 24315 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.634148 22554 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:11.632869 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:11.631315 21907 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:11.612497 24405 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:11.646925 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:11.653893 21975 raft_consensus.cc:2410] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:06:11.654343 21834 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:11.634027 24441 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.669230 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:11.671154 21904 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.681384 21903 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:11.685242 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.669289 24585 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:11.695787 24585 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.696609 21974 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:11.697618 24508 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:11.698244 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:11.701069 21906 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:11.702414 22520 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:11.703446 22520 leader_election.cc:400] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:06:11.703691 22520 leader_election.cc:403] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:11.706084 24479 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:11.696661 21983 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:06:11.710848 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.713127 21832 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:11.707389 24423 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:11.720510 24423 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:11.721016 24423 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:11.731812 24481 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:06:11.695816 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:11.738878 24508 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.739578 21979 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.740888 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:11.741744 21976 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:11.742501 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:11.743940 21976 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:11.745075 21976 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:11.746282 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:11.721210 24612 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:06:11.657840 24586 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:11.778659 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:11.778524 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:11.780448 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.802098 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 233005us
I20260709 13:06:11.809783 21977 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:11.811784 21981 raft_consensus.cc:2410] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:11.722832 24304 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:11.811105 24405 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:11.843181 24405 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.836833 24259 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.802553 24441 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.675267 24442 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:11.887202 21829 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:11.823043 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:11.953871 21976 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:11.963356 21827 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:11.965111 24445 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.969731 24445 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.970384 24353 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.970988 24353 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.964637 21825 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:11.972724 24446 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:11.973371 24446 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:11.974546 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:11.975106 21975 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:11.990389 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:11.991225 21977 raft_consensus.cc:2410] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:06:11.991714 24345 consensus_meta.cc:287] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.557s	user 0.013s	sys 0.010s
I20260709 13:06:11.992059 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:11.992690 24585 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:11.993163 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.000311 21979 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:12.005175 24445 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.006232 21904 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:12.001600 21830 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
W20260709 13:06:12.008616 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 376050us
I20260709 13:06:12.011361 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.012125 21979 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:12.006104 24585 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.888480 24259 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:12.016054 24585 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.025718 21976 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:12.018047 24353 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.023012 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.032172 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.032891 21979 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:12.039738 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:12.051324 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:12.028757 24483 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:12.054879 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.058090 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.032027 24304 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.059782 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:12.061928 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.064425 21908 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:12.065814 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.066979 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.068027 21976 raft_consensus.cc:2368] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:06:12.069077 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.068414 21975 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:12.069535 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.069747 21905 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:12.070147 21982 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:12.070312 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:12.071044 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:12.071636 21982 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.075549 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.076141 21901 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:12.046978 24526 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.049394 24285 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.084113 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.084793 21904 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.086438 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.082409 21982 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
W20260709 13:06:12.087317 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.090509 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.062626 24589 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:12.095716 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:12.109347 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 52734.1us
I20260709 13:06:12.103564 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:12.111392 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 73030.5us
I20260709 13:06:12.111897 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 409) took 1033 ms. Trace:
I20260709 13:06:12.087611 24304 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.123930 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:12.111182 24265 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.754s	user 0.015s	sys 0.001s
I20260709 13:06:12.151412 24304 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:12.094798 24526 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.103536 24489 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.117965 22550 rpcz_store.cc:276] 0709 13:06:10.969927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.998799 (+ 28872us) service_pool.cc:224] Handling call
0709 13:06:11.143378 (+144579us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:11.247232 (+103854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.247268 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:11.286551 (+ 39283us) log.cc:844] Serialized 52 byte log entry
0709 13:06:11.507366 (+220815us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:11.507403 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.507465 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.002740 (+495275us) raft_consensus.cc:1685] finished
0709 13:06:12.002758 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.002922 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45204,"raft.queue_time_us":56691,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":206039,"threads_started":1,"wal-append.queue_time_us":575612}
I20260709 13:06:12.149958 24585 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.159017 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:12.168149 21975 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:12.169719 21975 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:12.170500 24405 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:12.152483 24446 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.173060 24619 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:12.173504 24619 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:12.113106 24441 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.150301 24315 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.122714 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.110608 24589 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:12.105078 24317 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.176040 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:12.185416 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.185956 21976 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.150486 24479 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:12.177572 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:12.115152 24593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.052s	sys 0.110s
W20260709 13:06:12.180521 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 475808us
I20260709 13:06:12.152088 24304 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.123441 24285 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:06:12.176783 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.195438 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:12.188198 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 65603.8us
W20260709 13:06:12.190236 24593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.056s	sys 0.115s
I20260709 13:06:12.204532 21904 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:12.205359 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:12.205506 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:12.186373 24589 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.205243 24585 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.182925 24586 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:12.213078 22550 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:12.201457 24360 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:12.193668 24483 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:12.214433 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:12.221661 22554 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.006s
I20260709 13:06:12.221975 22554 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:12.222741 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:12.226469 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:12.194901 24317 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:12.230616 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:12.232698 22553 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:06:12.219928 24508 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:12.181866 21982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:06:12.207001 24304 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.247591 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.247984 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:12.249882 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.251008 21979 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:12.253556 21976 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:12.203069 24619 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:12.222784 24285 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.258507 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:12.252493 24423 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.005s
I20260709 13:06:12.266332 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:12.239159 24483 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:06:12.255752 24360 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:12.261548 24628 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:06:12.276829 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.280839 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:12.281713 24317 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:12.281783 21976 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:12.282529 24325 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:12.282922 24317 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:12.284430 21982 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:12.284582 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.284950 21982 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.284611 21979 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:12.265285 24441 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:12.279646 24619 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.296298 24481 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:12.305481 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:12.288909 24526 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:12.286801 24360 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:12.267894 24423 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:12.314796 21982 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:12.316749 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 365388us
W20260709 13:06:12.316861 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 163855us
I20260709 13:06:12.317636 24508 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:12.300511 24446 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:12.302008 24479 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:12.322667 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.307659 24315 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:12.324139 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 172751us
I20260709 13:06:12.324236 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:12.324883 21830 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:12.312330 24264 consensus_meta.cc:287] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.821s	user 0.016s	sys 0.000s
I20260709 13:06:12.321388 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.321559 21827 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:12.319270 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:12.325431 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.328163 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:12.328481 21831 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:12.332926 21977 raft_consensus.cc:2410] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:12.332942 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:12.333391 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.333881 21833 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.337391 21827 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:12.338423 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.339829 24259 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:12.339955 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.340526 21901 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:12.342444 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:12.352468 21982 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.354458 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.354938 21901 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:12.355207 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.355929 21904 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:12.356279 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.356829 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.356848 21901 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:12.359338 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:12.329236 24304 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:12.362620 24285 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.308614 24627 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:06:12.364153 24624 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:12.366732 21831 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:12.323185 24479 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:12.325727 24405 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:12.368427 21829 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:12.327595 24508 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:12.369967 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:12.373427 21909 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.370970 21828 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.372058 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:12.336374 22551 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.767s	user 0.014s	sys 0.005s
I20260709 13:06:12.375162 21825 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:06:12.374100 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 139245us
I20260709 13:06:12.376127 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.334061 24585 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.392005 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:12.376791 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:12.380358 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 119614us
W20260709 13:06:12.387617 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.394759 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:12.395627 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:12.390561 21826 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:12.397078 24446 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:12.397504 24446 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.397966 24446 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.402313 24353 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:12.402829 24353 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.403265 24353 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.404531 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.405673 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.329782 24265 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:06:12.406215 21825 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:12.326956 24628 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:06:12.406864 24445 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:12.407051 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.407351 24445 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:12.408375 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.408278 24445 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.409014 21831 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:12.409446 24445 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.377408 24405 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:12.409969 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.411222 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.411548 24405 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:12.407217 24626 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:06:12.368832 24526 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:06:12.413874 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:12.414496 21826 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
W20260709 13:06:12.409143 24443 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.849s	user 0.007s	sys 0.007s
I20260709 13:06:12.371846 24264 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:12.437270 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 63793.9us
I20260709 13:06:12.330205 24441 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:06:12.427263 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:12.434556 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 127417us
I20260709 13:06:12.441366 21833 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:12.443655 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.444813 21949 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.445465 24259 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:12.445582 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:12.447853 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:12.448110 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.449597 21978 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.450518 21983 raft_consensus.cc:2410] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:12.451238 21909 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:12.391788 24285 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:12.452287 24285 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.452415 24481 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.452754 24285 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.453016 24481 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:12.439049 24585 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:12.455008 24585 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.455435 24585 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:12.456058 24315 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:12.456102 24415 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:12.457602 24345 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:12.458434 24345 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:12.459632 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.463624 24446 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.464123 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.470031 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:12.471828 24317 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:12.465953 24632 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:12.479033 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:12.479593 21830 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
W20260709 13:06:12.535537 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.537133 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:12.540481 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:12.549072 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 85017.7us
I20260709 13:06:12.485004 22551 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:06:12.552279 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 73314.4us
I20260709 13:06:12.553396 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.377521 24623 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.168s
I20260709 13:06:12.504895 24264 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:12.583806 21798 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.582585 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:12.584951 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 135338us
I20260709 13:06:12.543004 24415 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:12.594354 21980 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
W20260709 13:06:12.598398 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 128440us
I20260709 13:06:12.554317 24345 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:12.600621 22519 leader_election.cc:400] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5.
I20260709 13:06:12.604928 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:12.581633 24481 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.546852 24593 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:06:12.558046 24441 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:12.450884 24508 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:12.586410 24265 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:12.619885 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 240942us
I20260709 13:06:12.543853 24585 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.543607 24637 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:06:12.624010 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:12.594777 24315 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:12.484810 24360 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:12.602846 24442 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:12.550515 24479 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:12.642076 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 189728us
W20260709 13:06:12.645629 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 61887.4us
I20260709 13:06:12.628590 24481 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:12.615638 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 411) took 1300 ms. Trace:
I20260709 13:06:12.654573 24634 raft_consensus.cc:2764] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:06:12.670795 24453 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:06:12.671023 24629 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:12.671586 24629 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:12.646919 24442 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:12.658368 24481 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:12.687907 24481 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.657716 24345 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:12.709336 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:12.648762 24265 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:06:12.730639 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 84820.5us
I20260709 13:06:12.731293 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.696350 24442 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:12.709515 24479 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.714823 24317 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.705705 24652 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:12.671052 24647 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 13:06:12.763062 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 105837us
W20260709 13:06:12.765385 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 91434.1us
I20260709 13:06:12.748322 24446 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.664414 22551 rpcz_store.cc:276] 0709 13:06:11.294548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.295989 (+  1441us) service_pool.cc:224] Handling call
0709 13:06:11.310473 (+ 14484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.567100 (+256627us) spinlock_profiling.cc:243] Waited 8.79 ms on lock 0x7b4c00247d80. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d2aaa20 00007fb75d2bba29 00007fb75d281644 00007fb75d2a8f2d 00007fb75d2a8b93 00007fb75efd918b 00007fb75efd9cb5 00007fb75efd4f30 00007fb75efd67de 00007fb75efe0b49 00007fb75efe1416
0709 13:06:12.557784 (+990684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.595136 (+ 37352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20206464}
I20260709 13:06:12.684883 24264 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.745330 24644 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:12.728960 24353 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.761808 24441 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:12.775359 24639 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:06:12.812740 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:12.814407 24649 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.727452 24415 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:12.826612 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.822322 24661 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:12.823123 24645 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:12.823624 24642 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:12.769685 24653 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.798192 24652 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:12.860150 21828 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
W20260709 13:06:12.868155 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 270340us
W20260709 13:06:12.824841 24654 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:12.871593 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:12.869065 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 264223us
I20260709 13:06:12.872762 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:12.873975 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:12.875389 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 66811.6us
I20260709 13:06:12.875298 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:12.867166 24635 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:06:12.807511 24259 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:06:12.818843 24325 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:06:12.866482 24619 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:06:12.802573 24441 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:12.969342 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 94103.8us
W20260709 13:06:12.944788 24625 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:12.945144 24646 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:12.945914 24651 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:12.953675 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:12.875921 24446 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:06:12.857067 24345 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:12.950677 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:12.870720 24304 raft_consensus.cc:2764] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:12.802891 24644 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:12.962560 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 149977us
I20260709 13:06:12.873883 24585 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:12.961694 21978 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
W20260709 13:06:13.053260 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 166714us
W20260709 13:06:12.992360 24641 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:06:13.019505 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 284304us
I20260709 13:06:13.054701 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:12.769892 24315 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:13.048081 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 174155us
I20260709 13:06:12.960853 24669 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:12.965608 24657 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.872448 24661 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.018813 24445 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:13.067353 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.050817 24353 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:13.079826 21949 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:13.084852 24658 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:13.086803 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.054922 24660 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:13.052047 24671 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.066704 24423 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.091331 21798 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.075326 24619 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.078997 24678 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:13.102344 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.054589 24481 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.088316 24664 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:13.104820 22550 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:13.085299 24658 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:13.109014 24672 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.050190 24651 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.048789 24646 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:13.121740 24489 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.963s	user 0.012s	sys 0.000s
I20260709 13:06:13.126950 24489 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.128268 24445 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:13.128767 24445 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.106694 24678 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.130793 24673 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:13.131186 24678 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.131341 24673 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:13.132091 24589 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.903s	user 0.008s	sys 0.001s
I20260709 13:06:13.104187 24636 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:13.102949 24353 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:13.101245 24659 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
W20260709 13:06:13.119252 24663 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:06:13.116910 24658 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.116534 24671 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.092017 24645 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:06:13.172885 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 97287.8us
I20260709 13:06:13.178229 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:13.181530 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 94784.6us
I20260709 13:06:13.104564 24619 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.152359 24636 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.215758 24636 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.218300 24623 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:13.218716 24665 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:06:13.218766 24623 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:13.220023 24623 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.221362 24623 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.224213 24636 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.230931 24673 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.232909 24636 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.123541 24661 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.107054 24660 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.090972 24652 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:13.212389 21873 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.548s (SENT) [suppressed 16 similar messages]
I20260709 13:06:13.153512 24589 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.214800 24682 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:13.213694 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:13.122381 24677 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:13.151377 24656 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:13.285355 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 183172us
I20260709 13:06:13.184686 24259 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:13.291059 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 106896us
W20260709 13:06:13.287452 24479 consensus_meta.cc:287] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.001s
W20260709 13:06:13.293818 24285 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.840s	user 0.006s	sys 0.010s
I20260709 13:06:13.295274 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.298573 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:13.299736 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:13.300560 21833 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:13.300683 22554 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:06:13.301179 22554 pending_rounds.cc:85] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 6
I20260709 13:06:13.301337 22554 pending_rounds.cc:107] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:06:13.301525 22554 raft_consensus.cc:2889] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:13.299111 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:13.302829 22555 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:13.282028 24353 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:13.306734 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:13.285856 24441 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:13.305154 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:13.277345 24661 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.202525 24671 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.314805 21830 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:13.317512 21830 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:13.301862 24405 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.321151 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.322760 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:13.176874 24672 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.323380 22553 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
W20260709 13:06:13.322019 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 230889us
I20260709 13:06:13.324295 21826 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:13.316699 24508 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:13.329206 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 116880us
I20260709 13:06:13.329489 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:13.299371 24285 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.333725 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:13.335317 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:13.322312 24446 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.320520 24353 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:13.341382 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:13.332383 24442 consensus_meta.cc:287] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 13:06:13.344071 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:13.338626 21830 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.343591 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.344937 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.345553 21833 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:13.345954 21827 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
W20260709 13:06:13.346408 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.323669 24685 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:13.347791 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:13.348402 21975 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:13.349910 21983 raft_consensus.cc:2410] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:06:13.350876 22551 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:06:13.351362 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:13.334877 24264 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:13.352231 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.352082 24264 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.341274 24259 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:13.354221 24264 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.354271 24259 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:13.354952 24259 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.355597 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.356274 21828 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:13.360047 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:13.360670 21833 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.359720 21830 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.358826 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:13.368052 21977 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:13.364095 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.371399 21826 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:13.366703 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:13.322708 24661 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.326530 24489 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:06:13.373860 24481 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:13.377642 24670 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:06:13.389078 24629 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.393471 24660 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.394387 24646 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.394536 21832 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.395236 21831 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:13.397293 24661 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.399507 24285 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:13.400866 24589 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.403244 21832 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:13.359671 24446 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.393252 24445 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.406106 24446 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.406491 24445 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:13.380524 21983 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:06:13.358646 24442 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.354640 24680 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.384222 24672 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:13.386775 24675 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:06:13.395334 24619 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.379118 24651 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:13.412906 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61648.5us
W20260709 13:06:13.416105 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 121572us
I20260709 13:06:13.429253 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:13.415707 21833 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:13.425172 21830 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:13.426302 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:13.363761 24508 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:13.431444 22550 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
W20260709 13:06:13.420054 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47641.3us
I20260709 13:06:13.433059 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:13.413753 24629 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.435290 21981 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:13.413594 24589 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.413698 24664 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:13.427085 24682 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:13.441102 24681 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:13.433104 24672 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:13.429001 24685 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.445726 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1624) took 1072 ms. Trace:
I20260709 13:06:13.451181 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:13.432128 24677 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:13.462232 24685 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.462603 24442 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:13.462653 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:13.463692 22550 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:13.464143 24585 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:13.464514 24585 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:13.464671 24694 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:13.453002 24672 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.465308 24585 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.465826 24672 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.465896 24694 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:13.466572 24694 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:13.470430 24315 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:13.472620 21980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1598) took 1979 ms (client timeout 1548 ms). Trace:
I20260709 13:06:13.472815 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:13.473011 21980 rpcz_store.cc:269] 0709 13:06:11.496190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.501604 (+  5414us) service_pool.cc:224] Handling call
0709 13:06:13.472476 (+1970872us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54001f6154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:13.472560 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422363392}
I20260709 13:06:13.471014 24315 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.454536 24661 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:13.474821 24682 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:13.475199 24678 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:13.475596 24678 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:13.475999 24678 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.475755 24682 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.474329 24652 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:13.476769 21982 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:13.455093 21829 rpcz_store.cc:276] 0709 13:06:12.373769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.373976 (+   207us) service_pool.cc:224] Handling call
0709 13:06:12.416897 (+ 42921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:12.665306 (+248409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.665369 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:12.687415 (+ 22046us) log.cc:844] Serialized 26 byte log entry
0709 13:06:13.011617 (+324202us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:13.247262 (+235645us) log.cc:844] Serialized 14 byte log entry
0709 13:06:13.277076 (+ 29814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.277162 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.445473 (+168311us) raft_consensus.cc:1685] finished
0709 13:06:13.445500 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.445663 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29529,"prepare.queue_time_us":97039,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":35,"raft.queue_time_us":88052,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":3107,"thread_start_us":633903,"threads_started":3,"wal-append.queue_time_us":410578}
I20260709 13:06:13.480748 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.437619 24669 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:13.473860 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:13.478808 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:13.446004 24526 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:13.444175 24683 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:13.482378 21799 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:13.488425 24304 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.486740 24681 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:13.489152 24585 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.456166 24689 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:06:13.489949 24677 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.491050 24664 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.491698 24685 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.507053 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:13.432144 24508 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.502323 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:13.446496 24589 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.545200 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:13.474856 24661 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.476011 24315 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.443416 24259 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:13.546862 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 48236.6us
I20260709 13:06:13.494431 24526 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.548030 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:13.549927 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 67673us
I20260709 13:06:13.550400 24699 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.550801 24689 consensus_queue.cc:1243] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:13.550805 24673 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:13.551329 24661 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.507041 24696 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:06:13.558668 24704 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:06:13.559888 24589 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.567212 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.445001 24353 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.501737 24405 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:13.571704 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:13.599946 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:13.545480 24285 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.600783 24441 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.500290 24646 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:06:13.570463 24446 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:13.563916 24442 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.566224 24445 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:13.568994 24637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.006s	sys 0.000s
I20260709 13:06:13.607853 21980 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:13.607168 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:13.564301 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40618
I20260709 13:06:13.567850 24526 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.604378 24652 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:13.618877 24700 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:06:13.622340 24696 consensus_queue.cc:1243] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:13.570710 24673 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:13.627110 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 59948.2us
I20260709 13:06:13.649688 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:13.508360 24658 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:13.641798 24637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.009s	sys 0.020s
W20260709 13:06:13.617357 24701 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:06:13.607959 24405 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:13.497102 24694 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.607825 24690 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.502440 24683 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.651196 21982 raft_consensus.cc:2410] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:13.651612 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:13.640483 21829 raft_consensus.cc:606] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:06:13.667510 21829 raft_consensus.cc:614] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:13.652592 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:13.671977 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61977.4us
I20260709 13:06:13.672880 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:13.673620 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:13.650421 24673 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.566118 24671 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:13.633216 24489 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.659034 24405 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.660148 24655 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.682708 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:13.683306 21903 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.683252 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:13.683979 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:13.679765 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:13.657344 24659 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:13.660110 21826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:13.686595 21826 raft_consensus.cc:606] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.680683 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:13.638360 24285 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.645210 24445 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.694315 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:13.688200 22552 raft_consensus.cc:2410] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:06:13.641146 24441 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.647328 24446 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.643543 24442 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.690642 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:13.684612 24304 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:13.665439 24623 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:06:13.700891 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.648586 24669 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.669134 24696 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:13.705494 21907 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:13.666638 24690 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.634666 24681 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.685740 24694 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.686313 24659 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.706571 21980 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:13.710002 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:13.711875 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:13.705819 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.712589 21979 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:13.687798 24707 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:06:13.725229 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:13.718145 21908 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:13.706519 24304 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.732515 21903 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:13.733536 21906 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:13.740105 21983 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:06:13.708153 24698 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.740638 21983 pending_rounds.cc:85] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 6
I20260709 13:06:13.746191 21983 pending_rounds.cc:107] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:06:13.746541 21983 raft_consensus.cc:2889] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:13.722029 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:13.724867 24659 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.727239 24259 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.760143 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:13.749704 22546 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:13.762351 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.765278 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:13.766027 24589 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.767166 24589 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:13.767506 24589 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.767815 24589 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.768640 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.769263 21826 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:13.769589 24446 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.770221 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.770644 21831 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:13.771091 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:13.771301 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.772225 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:13.772403 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.778012 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.778364 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:13.780177 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.777887 24658 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:13.774063 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.783357 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.794097 21908 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:13.798787 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.801726 24304 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.808355 24673 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.810263 22550 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:13.813274 24710 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:13.813843 24710 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:13.775616 24672 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.812927 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:13.818120 21874 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:13.821759 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.848675 21908 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:13.854199 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:13.858647 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:13.859364 21827 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:13.860895 22547 raft_consensus.cc:2410] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:13.861284 24690 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.862139 24683 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.814740 24710 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.862957 24442 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.848354 24508 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:13.864338 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.867043 21829 raft_consensus.cc:2410] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:13.819620 24661 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.852065 24628 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:13.839763 24678 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.872639 21905 raft_consensus.cc:2368] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10.
I20260709 13:06:13.856560 24445 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:13.877473 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:13.860199 24443 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:13.868907 24508 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:13.891544 24508 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.891381 24443 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.893447 24443 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:13.831657 24526 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.887008 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:13.887097 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:13.888010 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:13.894768 21829 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:13.903661 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:13.904842 24689 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:13.905429 24689 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.905965 24689 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.910737 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:13.911972 24685 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.912907 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:13.894483 24707 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:13.931108 21825 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:13.923812 24685 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.937444 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:13.932004 24727 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:06:13.928545 24682 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.928759 24489 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.888608 24628 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.933601 24725 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:13.922868 24405 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.948642 21830 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:13.953120 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:13.956471 21909 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:13.968465 24673 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.970263 24526 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.954667 24672 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.949994 24682 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.974742 24652 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.975108 24689 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.976022 24628 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:13.977550 24689 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:13.951244 24481 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.949404 24489 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:13.958056 24589 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:13.987749 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:06:13.988730 21780 auto_rebalancer.cc:893] Removing replace marker failed: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:13.999202 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:14.001375 21780 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:06:14.008387 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:13.950968 24725 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:14.004604 21780 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:06:14.017650 22550 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:14.036451 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.007131 24672 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:14.059994 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.060238 21907 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:14.050521 24353 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.061856 21902 raft_consensus.cc:2376] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7. Re-sending same reply.
W20260709 13:06:14.070785 24721 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:14.080240 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:14.083205 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.002180 24481 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.088980 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.089776 21902 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:14.092761 24729 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:06:14.092669 24508 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.093608 21901 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:14.094786 24508 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:14.095542 21901 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:14.095400 24589 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.101043 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:14.052606 24731 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:06:14.107842 21833 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:14.108217 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.058449 24672 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.111204 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.116406 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.117517 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.118502 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:14.106215 24483 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.119052 21977 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:14.119311 24483 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.121533 24483 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:06:14.122066 24678 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.129633 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.130286 21976 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:14.130400 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.132484 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.133507 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.134158 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.134517 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.102926 24629 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.135104 21977 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:14.135242 21901 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
W20260709 13:06:14.136307 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.147020 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:14.090973 24353 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.167481 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.150610 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:14.151690 24317 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:14.151822 22549 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:14.151873 24489 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.152381 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:14.176837 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:14.152652 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:14.152801 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:14.177955 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:14.153869 24659 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.155624 24672 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.156159 24481 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.184862 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.185755 21904 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:14.157344 24660 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:14.145975 24629 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.158134 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 503) took 1080 ms. Trace:
I20260709 13:06:14.158950 24725 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.162263 24636 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:14.164747 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:14.149976 24730 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:06:14.165946 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.168025 21827 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:14.153410 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:14.196667 22552 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:14.180797 21902 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:14.197137 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:14.180946 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:14.198822 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.184930 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.187008 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.202311 21903 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.108266 24733 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:06:14.174430 24317 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:14.196017 21833 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:14.188740 24483 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:14.188166 24660 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:14.207122 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.227509 22553 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:14.188622 24732 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.180058 24731 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.189731 22548 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:14.238487 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 502) took 1161 ms. Trace:
I20260709 13:06:14.199612 24489 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:14.239617 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.194216 24636 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:14.240312 21901 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:14.241252 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.239979 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.242887 24706 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:14.242983 24317 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.244230 24317 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.247014 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:14.248625 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:14.240490 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.204123 24481 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:14.250469 24481 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:14.251693 24481 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.191198 22551 rpcz_store.cc:276] 0709 13:06:13.077541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.079221 (+  1680us) service_pool.cc:224] Handling call
0709 13:06:13.104281 (+ 25060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.351345 (+247064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.157867 (+806522us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400680e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:14.158075 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543247104}
I20260709 13:06:14.254247 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.204909 24649 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.255137 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:14.255388 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:14.256511 24659 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:14.257536 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:14.257717 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.258445 21906 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:14.259203 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.260161 24629 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.256513 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.238971 22554 rpcz_store.cc:276] 0709 13:06:13.077184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.077342 (+   158us) service_pool.cc:224] Handling call
0709 13:06:13.077631 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.305873 (+228242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.238234 (+932361us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002508d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:14.238422 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480083840}
I20260709 13:06:14.265952 21903 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:14.266930 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.267102 21906 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:14.205215 24645 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:06:14.236567 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:14.233791 24483 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:14.274785 24483 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.291821 24264 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.292526 24656 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:14.293062 24656 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:14.293162 24660 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.293742 24682 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.294389 24660 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:14.292474 24703 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:14.295866 24703 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:14.268908 24698 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.516s	user 0.003s	sys 0.007s
I20260709 13:06:14.297935 24703 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.298312 22548 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
W20260709 13:06:14.299311 24737 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:06:14.307322 24285 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:14.308566 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 387) took 2051 ms. Trace:
I20260709 13:06:14.308946 22555 rpcz_store.cc:276] 0709 13:06:12.259775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.262458 (+  2683us) service_pool.cc:224] Handling call
0709 13:06:12.271370 (+  8912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.306635 (+1035265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.308370 (+1001735us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54006801d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:14.308514 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2371695360}
I20260709 13:06:14.291821 24644 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:14.274796 24585 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.315241 21976 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:06:14.315613 21976 pending_rounds.cc:85] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 7
I20260709 13:06:14.315861 21976 pending_rounds.cc:107] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:14.292408 24264 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.316079 21976 raft_consensus.cc:2889] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.317920 24264 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.314670 24585 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.298484 24698 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:14.320727 24739 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:06:14.320642 24585 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.314678 21874 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:14.322712 24699 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:14.323086 24699 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:14.323426 24593 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:14.324090 24593 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:14.323765 24699 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.325116 24699 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.325358 24593 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.331461 24585 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:14.331962 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:14.332244 24585 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:14.333483 24694 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.003s
I20260709 13:06:14.334200 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:14.334792 22555 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:14.334954 24585 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.241874 24672 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:06:14.335788 24644 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:14.337067 24661 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:14.337400 24646 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:14.337886 24646 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:14.338913 24646 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.343595 24636 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.345396 24636 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.346968 24441 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:14.351773 24441 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.352357 24441 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.355101 24441 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.356664 24712 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:14.358546 24353 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.371594 24405 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.374007 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:14.376122 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:14.380734 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:14.380749 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:14.381646 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 89983.1us
I20260709 13:06:14.404167 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.381644 21827 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:14.382150 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 145663us
I20260709 13:06:14.415875 21831 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:14.362154 24646 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:14.405017 21826 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:14.405062 21825 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:14.418247 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.422075 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:14.382606 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:14.384181 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.423538 21829 raft_consensus.cc:2410] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:06:14.407048 22520 leader_election.cc:400] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10.
I20260709 13:06:14.425109 22520 leader_election.cc:403] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.381209 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.359889 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:14.427068 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 67248.2us
I20260709 13:06:14.430583 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1675) took 1099 ms. Trace:
I20260709 13:06:14.430946 21981 rpcz_store.cc:276] 0709 13:06:13.331659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.332472 (+   813us) service_pool.cc:224] Handling call
0709 13:06:14.430428 (+1097956us) spinlock_profiling.cc:243] Waited 93.1 ms on lock 0x7b54002c7254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:14.430532 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214094592}
I20260709 13:06:14.380790 24586 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:14.379575 24489 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:14.424106 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:14.382073 24619 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:14.438719 22520 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:14.439851 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:14.451293 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:14.452023 21983 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:14.452837 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.455475 21980 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
W20260709 13:06:14.459059 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 278657us
I20260709 13:06:14.464677 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:14.465685 21832 raft_consensus.cc:2368] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:14.432322 24589 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.425611 24649 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.466939 24684 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:14.450380 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:14.470618 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:14.487543 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:14.504381 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:14.510385 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49972us
I20260709 13:06:14.508049 21982 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:14.509325 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.436525 24405 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:14.510345 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 60070.3us
I20260709 13:06:14.511562 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:14.447566 24345 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.506646 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.446516 24441 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:14.516916 21834 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:14.518801 21827 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:14.516911 21980 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:14.480265 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:14.520682 21832 raft_consensus.cc:606] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:14.519809 21829 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:14.518049 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.522989 21825 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:14.459075 24628 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:14.436483 24325 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:14.518738 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.537973 21827 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:14.447294 24453 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:14.525689 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:14.526464 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 88721.8us
I20260709 13:06:14.547046 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:14.527369 24483 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.531112 24264 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:14.502843 24703 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.534421 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:14.513263 24649 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.500862 24677 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.524401 24441 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.535416 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:14.470700 24672 consensus_queue.cc:1243] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:14.526481 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.569543 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:14.525453 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.459692 24585 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:14.544025 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.575918 21978 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:14.544775 21826 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:14.548094 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:14.525192 24689 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.577450 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.536739 24628 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.578110 24628 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.578533 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.579566 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.525514 24489 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:14.516045 24405 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:14.515856 24589 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.524607 24345 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.553815 24629 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:14.536607 24732 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:14.458750 24706 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:06:14.518745 24285 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:14.562346 21981 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.564929 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.582504 21832 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:14.543675 24325 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:14.519312 24684 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.617393 21834 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:14.618744 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.623056 24483 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.623780 24483 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:14.624279 24483 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:14.574074 24619 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:14.624805 24619 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.625188 24619 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.626411 24441 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.571785 24677 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.567582 24703 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.632357 21827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:14.648479 21827 raft_consensus.cc:606] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:14.648880 21827 raft_consensus.cc:614] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:14.644371 21979 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:14.647315 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.650990 21832 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:14.646762 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:14.652113 21977 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.584621 24585 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.584614 24696 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.660614 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.607111 22546 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:14.661571 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.661688 21831 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
W20260709 13:06:14.670033 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 226256us
I20260709 13:06:14.670387 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.671895 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.572814 24637 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:06:14.670769 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 246729us
I20260709 13:06:14.674795 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:14.676433 22550 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.674795 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:14.676894 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 206339us
I20260709 13:06:14.677335 21832 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:14.606419 24405 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:14.607221 24732 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.679023 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:14.627647 24738 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.395s	user 0.003s	sys 0.002s
I20260709 13:06:14.632355 24677 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.660295 24285 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:14.639726 24589 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.638468 24703 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.609401 24672 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:14.643412 24345 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.681977 21833 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:14.662717 24585 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.704746 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.706286 21977 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:14.691527 24732 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.676455 24586 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:14.705598 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.670965 24696 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.676229 24264 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:06:14.632978 24483 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.707908 24345 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:14.731663 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61220.5us
I20260709 13:06:14.698879 24441 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:06:14.711578 24672 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:14.736379 24684 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:14.717334 24489 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.706394 24649 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.716831 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:14.741832 21829 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:14.745159 22550 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:14.749560 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:14.708617 24589 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:06:14.701642 24325 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.761343 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:14.762892 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:14.761926 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 83195.4us
I20260709 13:06:14.763521 24315 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:14.766873 24315 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:14.766937 24589 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:14.767354 24315 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.767388 24589 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:06:14.769275 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.764681 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:14.776947 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:14.778311 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:14.778888 21909 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:14.787078 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:14.790895 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:06:14.791735 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.761279 24481 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:14.796130 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 284611us
I20260709 13:06:14.796886 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:14.798416 24508 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:14.799829 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:14.801473 21825 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:14.803857 21834 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:14.771929 24685 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:14.807422 24685 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:14.810616 24264 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:14.811033 24264 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:14.811158 24748 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:06:14.811419 24264 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.811863 24586 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.815840 21906 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:14.819540 21827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:14.820083 21827 raft_consensus.cc:606] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:14.820389 21827 raft_consensus.cc:614] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:14.780352 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:14.770285 24703 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:14.823721 24703 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:14.824819 24659 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:14.825249 24453 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10.
I20260709 13:06:14.825971 24664 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.827180 24628 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.808820 24685 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.825275 24659 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.829699 24628 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:14.774070 24589 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.787801 24698 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:14.830485 24751 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:14.833765 24659 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:14.849403 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 58568.2us
I20260709 13:06:14.851923 24733 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:14.788615 24752 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:14.828997 24703 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.852345 24441 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:14.771770 24684 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:14.818620 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:14.872278 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53834.9us
I20260709 13:06:14.878912 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:14.853482 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 83966.9us
I20260709 13:06:14.868000 24752 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.835059 24672 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.855556 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:14.857659 21981 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:14.801730 24619 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.774718 24285 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.859062 24265 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:14.913297 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 57862.4us
I20260709 13:06:14.892192 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:14.875298 24636 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.880847 24678 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:06:14.931556 24678 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:14.931962 24678 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:14.933100 24678 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.891228 24649 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:14.934944 24649 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:14.935536 24649 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.859943 24481 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.898916 22546 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:14.899367 24405 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.876322 24684 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.939633 24684 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:14.940652 24405 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:14.942507 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:14.942999 24681 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:14.875840 24733 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:14.945482 24733 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:14.914098 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:14.952670 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:14.927254 21825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:14.912513 24762 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:06:14.958369 21873 leader_election.cc:336] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.548s (SENT)
I20260709 13:06:14.960685 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:14.966786 22555 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:06:14.959576 24405 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.972935 24712 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.896510 24752 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.877172 24441 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:14.969715 24698 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:14.890652 24677 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:06:14.973277 24304 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:14.984776 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:14.993110 21983 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:14.956724 24660 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:14.957540 24593 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.978456 21875 leader_election.cc:400] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:15.000550 21875 leader_election.cc:403] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.967217 24761 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:14.999591 21906 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:15.006650 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:14.988421 24678 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.021164 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:15.025260 22546 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:15.025339 24593 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:15.020339 24761 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:15.029243 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.032022 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:14.996934 24660 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.008141 24526 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.018857 24405 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.008379 24304 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:15.072317 21830 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:15.067992 21983 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:15.039888 24681 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:06:15.043262 24593 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.956338 24265 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.033206 24661 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:15.078465 24304 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.007688 24732 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:15.088027 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 409064us
I20260709 13:06:15.080250 24762 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:15.044863 24660 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:15.090606 21831 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:15.046417 24712 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.021641 24644 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:06:15.094770 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:15.021436 24653 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:06:15.085552 24264 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.090133 24661 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.077026 24265 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:15.117641 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:15.123871 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:15.126134 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:15.074477 24526 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.099570 24712 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:06:15.134637 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 151085us
I20260709 13:06:15.140772 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:15.149586 21825 raft_consensus.cc:606] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:15.121599 24661 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:15.137874 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.096623 24645 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:06:15.154438 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 264695us
I20260709 13:06:15.093736 24593 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.098896 24762 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.147701 24712 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.146577 24706 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:15.163084 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 271601us
W20260709 13:06:15.165158 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.109056 24315 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.188380 24646 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:15.189146 24646 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.189620 24315 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:15.190924 24315 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.191468 24315 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.191982 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:15.193442 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:15.197877 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:15.211515 22553 raft_consensus.cc:2368] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6.
I20260709 13:06:15.212122 21900 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:15.198060 24646 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:15.212658 21874 leader_election.cc:400] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6.
I20260709 13:06:15.212970 21874 leader_election.cc:403] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:15.213809 24646 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.214393 24483 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:15.206027 21909 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:15.210681 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:15.205227 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:15.216017 24754 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:15.216542 21904 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.216524 24754 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:15.217562 24754 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.218699 24754 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.219012 24672 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.219496 24672 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.221560 24672 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.194129 24315 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.223089 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.223184 24315 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:15.223727 21977 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:15.224972 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:15.228138 24628 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:15.152408 24619 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.232512 21982 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:15.236634 21904 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:15.246804 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:15.247468 21980 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.229583 24677 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:15.257189 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 133420us
I20260709 13:06:15.235324 24672 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:15.264616 21980 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:15.264413 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:15.267901 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:15.268515 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:15.255827 24677 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:15.262315 24759 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:15.266314 24672 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:15.294795 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.258253 24619 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:06:15.280761 24677 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:15.283097 24751 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:15.302403 24585 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.006s
I20260709 13:06:15.300161 24672 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.300803 24759 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.299958 22551 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
W20260709 13:06:15.351641 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 84158.9us
I20260709 13:06:15.352288 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:15.341180 24765 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 13:06:15.361583 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.345683 24732 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:06:15.343091 24751 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:15.380517 24526 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.386109 22546 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
W20260709 13:06:15.387101 24782 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:15.388307 24593 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.388212 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:15.389397 24776 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:06:15.389468 21730 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 124) took 15270 ms (client timeout 15000 ms). Trace:
I20260709 13:06:15.398185 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:15.338210 24656 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.399341 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:15.399724 24656 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.399894 21833 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:15.400739 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:15.401212 21833 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.391266 24589 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:15.343578 24585 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.402705 24751 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.404387 24585 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:15.405485 24774 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:15.392874 24649 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.406523 24781 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.407073 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:15.407269 24698 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:15.407660 24698 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:15.407717 24649 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.389513 24593 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:15.408087 24775 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:06:15.363256 24784 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:15.410653 24784 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:15.411079 24645 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:15.411528 24784 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.411630 24645 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.413981 21828 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:15.350699 24759 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.416710 24752 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.421494 24684 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:15.423291 24773 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:06:15.424619 24677 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.407758 21826 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:15.396036 24762 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:15.408080 24778 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.430649 21906 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:15.444171 21833 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
W20260709 13:06:15.398326 21730 rpcz_store.cc:269] 0709 13:06:00.119016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.196300 (+ 77284us) service_pool.cc:224] Handling call
0709 13:06:15.389368 (+15193068us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:12.071902 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:12.072633 (+   731us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:12.072685 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:06:12.072706 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:12.073850 (+  1144us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:12.073955 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:12.073986 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:12.157040 (+ 83054us) tablet.cc:701] Row locks acquired
0709 13:06:12.157095 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:06:12.157299 (+   204us) write_op.cc:270] Start()
0709 13:06:12.157458 (+   159us) write_op.cc:276] Timestamp: P: 1783602372157234 usec, L: 0
0709 13:06:12.157486 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:06:12.158275 (+   789us) log.cc:844] Serialized 4430 byte log entry
0709 13:06:12.464589 (+306314us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:13.086010 (+621421us) op_driver.cc:464] REPLICATION: finished
0709 13:06:13.377932 (+291922us) write_op.cc:301] APPLY: starting
0709 13:06:13.378057 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:13.378347 (+   290us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:13.378396 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:13.379947 (+  1551us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:13.380319 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:06:13.380370 (+    51us) write_op.cc:312] APPLY: finished
0709 13:06:13.380765 (+   395us) log.cc:844] Serialized 83 byte log entry
0709 13:06:13.380983 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:13.381133 (+   150us) write_op.cc:454] Released schema lock
0709 13:06:13.381205 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:13.436395 (+ 55190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:13.438191 (+  1796us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":886412,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":243211,"apply.run_cpu_time_us":3784,"apply.run_wall_time_us":55967,"num_ops":11,"prepare.queue_time_us":627676,"prepare.run_cpu_time_us":40934,"prepare.run_wall_time_us":216149,"raft.queue_time_us":338997,"raft.run_cpu_time_us":9260,"raft.run_wall_time_us":307864,"replication_time_us":894770,"spinlock_wait_cycles":20817152,"thread_start_us":664038,"threads_started":4,"wal-append.queue_time_us":165381,"wal-append.run_cpu_time_us":33489,"wal-append.run_wall_time_us":2081398}]]}
I20260709 13:06:15.446123 24585 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.442864 24593 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:15.445046 24762 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:15.447921 24656 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:15.483157 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 130913us
I20260709 13:06:15.491657 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:15.478299 24646 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6.
I20260709 13:06:15.493584 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:15.408593 24698 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.478278 24585 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:15.500236 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 73568.6us
I20260709 13:06:15.522315 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.527410 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:15.528473 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:15.445387 24778 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:15.514793 24659 consensus_meta.cc:287] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 13:06:15.518065 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.529021 21979 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.516587 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:15.531694 21977 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:15.499491 24780 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:15.480417 24712 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.533365 21974 raft_consensus.cc:2368] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:15.517109 24681 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:15.481480 24656 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.547582 21904 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:15.548185 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.548827 21975 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:15.532418 24698 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:15.532795 24405 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:15.619622 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:15.618878 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.620474 21975 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:15.621066 21974 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:15.640215 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.641155 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:15.641414 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.641973 21974 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:15.545835 24681 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:15.644838 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.550606 24678 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:15.647871 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:15.649358 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.650758 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 93360.3us
I20260709 13:06:15.536283 24660 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.656767 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.662423 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.544492 24659 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.663455 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.640836 24677 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:15.664922 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.671288 21979 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:15.672938 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:15.548550 24593 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.676404 21974 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:15.752146 24759 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:15.751376 24645 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.752789 24752 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:15.768570 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:15.712224 21979 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:15.651873 24681 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.769399 21974 raft_consensus.cc:2368] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
W20260709 13:06:15.710384 24776 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:15.712018 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:15.823323 21977 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:15.823642 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:15.821966 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 149108us
W20260709 13:06:15.821414 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 178417us
I20260709 13:06:15.830806 24678 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:15.835599 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.661803 24793 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.719403 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.712338 24684 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:15.760078 24661 consensus_meta.cc:287] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
I20260709 13:06:15.835881 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:15.757673 24712 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.758431 24585 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:15.671878 24304 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:15.851505 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:15.840960 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.801502 24656 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:15.828846 24265 consensus_meta.cc:287] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.002s
I20260709 13:06:15.753088 24778 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:15.886090 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.855376 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.823942 24645 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:15.829041 24489 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:15.857766 24798 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:06:15.857955 24789 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
W20260709 13:06:15.858790 24799 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:06:15.861552 24694 raft_consensus.cc:993] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:15.862965 24659 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.864193 21830 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:15.866468 24752 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:15.867034 24689 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.869241 24803 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:15.663297 24666 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.190s
I20260709 13:06:15.874982 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:15.878449 21977 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:15.887065 21979 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:15.887814 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:15.889683 24791 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.340s	user 0.005s	sys 0.000s
I20260709 13:06:15.886335 24684 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:15.850052 24285 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:06:15.903172 21831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.001s	sys 0.017s
I20260709 13:06:15.905049 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.899966 24780 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:15.906365 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.872973 24661 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.914496 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:15.915263 21974 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:15.910794 21831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.001s	sys 0.017s
I20260709 13:06:15.905351 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:15.898983 24489 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:15.912499 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:15.918612 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:15.838039 24678 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.886104 24304 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.905664 24649 raft_consensus.cc:1081] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:15.892236 24265 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.846450 24793 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.926550 24732 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.898023 24645 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.928061 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:15.929039 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1662) took 1271 ms. Trace:
I20260709 13:06:15.938782 21977 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:15.939183 21829 rpcz_store.cc:276] 0709 13:06:14.657781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.693726 (+ 35945us) service_pool.cc:224] Handling call
0709 13:06:15.928816 (+1235090us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54000e92d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:15.928964 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67821440}
I20260709 13:06:15.931806 21980 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:15.907622 24778 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:15.908699 24804 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.933219 24672 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
I20260709 13:06:15.922350 24684 raft_consensus.cc:2764] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:15.942026 21980 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:15.930459 24752 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:15.919876 24806 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.926942 24489 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.905318 24689 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.937733 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:15.943089 21980 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:15.953860 21977 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:15.944561 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:15.905184 24803 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.946430 21979 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:15.947664 21974 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:15.911437 24759 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:15.921981 24781 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:06:15.959494 21901 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:15.960237 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:15.940032 24732 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.969159 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:15.936162 24585 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:06:15.967334 21979 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:15.968456 21974 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:15.966650 21909 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:15.955639 24806 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:15.983618 24353 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:15.984994 24661 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.985404 24265 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:15.985793 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:15.986948 24689 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.987287 24780 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.988628 24264 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:15.991274 24793 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.995330 24645 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:15.962566 24712 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:15.996084 24660 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:15.952718 24672 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.951915 24804 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:15.969516 24778 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:15.969676 24796 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:16.001930 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.042901 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.041205 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1701) took 1076 ms. Trace:
W20260709 13:06:16.012950 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.042825 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:15.972697 21977 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:16.006682 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.044049 21976 rpcz_store.cc:276] 0709 13:06:14.965088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.965945 (+   857us) service_pool.cc:224] Handling call
0709 13:06:14.984337 (+ 18392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.015905 (+ 31568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.015948 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.016011 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:15.016064 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.041001 (+1024937us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54002c8b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:16.041043 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.041155 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71993728}
I20260709 13:06:16.006551 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.044495 24353 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:16.049199 24696 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.049551 24804 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.050444 21833 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:16.050784 24688 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:16.051170 24688 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:16.051343 24672 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.058724 21974 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:06:16.006716 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.068217 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 404) took 1394 ms. Trace:
I20260709 13:06:16.068675 24732 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:16.068673 22551 rpcz_store.cc:276] 0709 13:06:14.673687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.676020 (+  2333us) service_pool.cc:224] Handling call
0709 13:06:16.068018 (+1391998us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b5400313dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:16.068136 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153781504}
I20260709 13:06:16.069940 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1738) took 1292 ms. Trace:
I20260709 13:06:16.070369 21903 rpcz_store.cc:276] 0709 13:06:14.777694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.777804 (+   110us) service_pool.cc:224] Handling call
0709 13:06:14.810449 (+ 32645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.854016 (+ 43567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.854059 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.854111 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:14.854183 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.069741 (+1215558us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54002387d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:16.069782 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.069891 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73001856}
I20260709 13:06:16.071132 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:16.071702 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.072041 24593 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:16.072785 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.010983 24781 consensus_queue.cc:1243] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:16.005869 24803 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.072727 24593 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:16.129108 24593 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.086479 24264 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:16.089035 21827 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:16.091637 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:16.044355 24778 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.098413 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.098589 24806 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:16.098726 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.098935 21980 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:16.099504 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.036754 24481 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.105345 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1700) took 1140 ms. Trace:
I20260709 13:06:16.109030 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:16.114667 24353 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.051853 24712 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.038668 24304 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:16.051940 24688 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:16.123368 24763 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.260s	user 0.003s	sys 0.000s
I20260709 13:06:16.124922 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.165760 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.127167 24681 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.133380 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:16.170188 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:06:16.143510 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51958.6us
I20260709 13:06:16.148046 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:16.148128 21829 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:16.104228 24325 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.161912 21974 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:16.161470 21981 rpcz_store.cc:276] 0709 13:06:14.964716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.974516 (+  9800us) service_pool.cc:224] Handling call
0709 13:06:14.997775 (+ 23259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.030344 (+ 32569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.030392 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.030464 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:15.030513 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.105072 (+1074559us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b5400165154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:16.105129 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.105275 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74276096}
I20260709 13:06:16.166527 21907 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.172441 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:16.174981 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.175925 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:16.176405 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.179205 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.179945 21982 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:16.152379 24315 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:16.185002 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:16.183388 21976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:06:16.184623 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.184875 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.186117 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.186247 21976 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:16.186698 21902 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:16.186811 21976 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.187130 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.187507 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.187711 21905 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:16.188457 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.189077 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:16.185237 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.158274 24778 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.186501 21977 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:16.190732 21903 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:16.191834 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:16.208868 21832 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:16.209688 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:16.211018 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:16.211246 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.212267 21832 raft_consensus.cc:2410] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:16.213073 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:16.213737 21832 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:16.203907 24759 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:16.175500 24706 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:16.215022 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.152875 24803 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:06:16.214483 21903 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:16.215502 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:16.214478 21905 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:16.158921 24264 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.216485 21902 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:16.190382 24688 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.220428 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:16.204198 24661 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:16.220664 21907 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:16.220948 21982 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.182512 24806 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:16.221746 21907 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:16.194453 24345 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:16.215159 24750 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:16.225764 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 317) took 1579 ms. Trace:
I20260709 13:06:16.226142 21978 rpcz_store.cc:276] 0709 13:06:14.646688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.646954 (+   266us) service_pool.cc:224] Handling call
0709 13:06:14.660606 (+ 13652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.663281 (+  2675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.663320 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.663834 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.749887 (+ 86053us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:14.749928 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.749988 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.122776 (+1372788us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:16.222612 (+ 99836us) raft_consensus.cc:1685] finished
0709 13:06:16.222632 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.225707 (+  3075us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2302,"raft.queue_time_us":8665,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":12597,"spinlock_wait_cycles":13262720,"thread_start_us":49825,"threads_started":1,"wal-append.queue_time_us":165111}
I20260709 13:06:16.216743 24405 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:16.181900 24796 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:06:16.227105 21976 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.239670 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 279) took 1050 ms. Trace:
I20260709 13:06:16.225580 24678 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:06:16.240096 21906 rpcz_store.cc:276] 0709 13:06:15.188859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.191654 (+  2795us) service_pool.cc:224] Handling call
0709 13:06:16.239504 (+1047850us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400307854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:16.239615 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463445376}
I20260709 13:06:16.240715 24678 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:16.241113 24678 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:16.241556 21901 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:16.242312 24481 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:16.242000 24678 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.242841 24481 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.244932 24761 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:16.245131 24481 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.245424 24796 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:16.245792 24796 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:16.226684 24750 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.246428 24750 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.249874 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.243206 24678 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.252200 21905 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:16.253820 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.254583 21901 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:16.256963 21901 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:16.259075 24712 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.259653 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:16.260778 24264 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:16.261299 22553 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:16.262678 22551 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:16.263854 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:16.222772 24345 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.270658 21982 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
W20260709 13:06:16.275537 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 52517.5us
I20260709 13:06:16.276237 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34370 (request call id 29) took 1370 ms. Trace:
I20260709 13:06:16.276631 21825 rpcz_store.cc:276] 0709 13:06:14.905579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.905942 (+   363us) service_pool.cc:224] Handling call
0709 13:06:16.276069 (+1370127us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002733d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd8853 00007fb763fa660a 00007fb75d52c7d4 00007fb75d52c762 00007fb75d52c691 00007fb75d52c60c 00007fb75d52b8c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:16.276155 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448517376}
I20260709 13:06:16.247751 24796 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.278434 24405 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:16.280149 24405 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:16.281086 24808 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:16.281160 24405 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:16.281641 24806 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:16.282265 24808 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:16.282356 24780 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:16.283093 24808 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:16.283263 24780 consensus_queue.cc:1243] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:16.283700 24709 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:16.284013 24780 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:16.284132 24709 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:16.284581 24780 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:16.285143 24709 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.286358 24806 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:16.286880 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.287134 24709 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.289593 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.283494 24441 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:16.286882 24806 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:16.291476 24806 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.292579 24806 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.286372 21978 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:16.295037 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.297640 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.300803 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:16.301448 22550 raft_consensus.cc:2368] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6.
I20260709 13:06:16.306905 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:16.310864 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:16.266989 24698 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:16.283478 24808 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:16.313799 21906 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:16.312000 24589 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:16.317058 21948 leader_election.cc:400] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6.
W20260709 13:06:16.315516 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.315431 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:16.296276 24345 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:16.328711 21978 raft_consensus.cc:2368] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:16.339406 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.345013 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.309163 24661 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:06:16.349255 21873 leader_election.cc:400] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:16.326516 24707 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.313328 24698 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:16.318081 22547 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:06:16.322877 24681 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:16.350922 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.317544 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:16.353274 24808 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.285624 24780 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.360468 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.391777 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.360795 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.392910 21905 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:16.362123 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.369445 24698 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.406056 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.407404 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:16.408576 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.365867 24707 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.372769 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.347159 24481 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.378074 24750 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.430384 21978 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:16.380697 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 405) took 1706 ms. Trace:
I20260709 13:06:16.318835 24589 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.449393 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.449822 24750 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:16.404052 21975 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:16.404490 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.431758 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 285) took 1140 ms. Trace:
I20260709 13:06:16.431329 22555 rpcz_store.cc:276] 0709 13:06:14.674058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.674157 (+    99us) service_pool.cc:224] Handling call
0709 13:06:14.696460 (+ 22303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.967370 (+270910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.380414 (+1413044us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54007044d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:16.380640 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620989696}
I20260709 13:06:16.449996 24589 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:16.375869 24405 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:16.427531 24441 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:06:16.461354 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.451521 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:16.499318 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.536365 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:16.538261 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.519448 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:16.539037 21983 raft_consensus.cc:2368] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
W20260709 13:06:16.520226 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.513065 21904 rpcz_store.cc:276] 0709 13:06:15.267525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.267666 (+   141us) service_pool.cc:224] Handling call
0709 13:06:16.407640 (+1139974us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54002e63d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:16.407729 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605230976}
I20260709 13:06:16.450101 21901 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:16.428650 24593 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:16.547459 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:16.549587 21983 raft_consensus.cc:2376] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10. Re-sending same reply.
I20260709 13:06:16.535799 24405 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.520433 24481 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.550635 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.559574 21901 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:16.607117 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.428453 24778 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.612076 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:16.612452 21873 leader_election.cc:400] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:16.627568 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:16.612659 21902 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:16.613246 21983 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:16.634503 21978 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:16.644024 24750 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.643954 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.644929 21906 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.648424 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:16.611510 24780 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.650481 21974 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:16.646045 24808 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.658537 21906 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:16.584286 24593 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.667299 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:16.667657 24778 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:16.668557 24694 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:16.711911 24694 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.672775 24660 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:16.712925 24660 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.713979 24694 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.646327 24750 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.669808 24345 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.714927 24660 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:16.684204 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.716946 21981 raft_consensus.cc:2368] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6.
I20260709 13:06:16.716933 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:16.672353 24793 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:16.665966 24481 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:16.671137 24659 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.671554 24645 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.671958 24689 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.664955 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1652) took 1451 ms. Trace:
I20260709 13:06:16.674428 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:16.673612 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:16.727411 21832 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.648815 24688 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:16.695166 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.696828 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:16.697633 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 537176us
I20260709 13:06:16.705634 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:16.710994 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1648) took 1668 ms. Trace:
I20260709 13:06:16.717703 21833 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:16.731791 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:16.732499 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:16.733692 21833 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:16.720882 24593 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.722200 24345 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:16.723234 24767 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.565s	user 0.010s	sys 0.012s
W20260709 13:06:16.662097 24826 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:16.730715 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:16.737818 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:16.727229 21826 rpcz_store.cc:276] 0709 13:06:15.213800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.767827 (+554027us) service_pool.cc:224] Handling call
0709 13:06:15.768119 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.768309 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:15.768611 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.906039 (+137428us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.650738 (+744699us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18001c8c40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:16.664465 (+ 13727us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18001c8c40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:06:16.664614 (+   149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:16.664663 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:16.664709 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.664780 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.664901 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":752793,"prepare.queue_time_us":32772,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"raft.queue_time_us":764960,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":4355,"spinlock_wait_cycles":7644800,"thread_start_us":132978,"threads_started":1,"wal-append.queue_time_us":237808}
I20260709 13:06:16.743173 21829 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:16.715936 24750 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:16.739158 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.742174 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:16.731276 21831 rpcz_store.cc:276] 0709 13:06:15.043016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.150158 (+107142us) service_pool.cc:224] Handling call
0709 13:06:15.156958 (+  6800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.157214 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:15.368508 (+211294us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.710565 (+1342057us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:16.710635 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:16.710696 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.710780 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.710927 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":750483,"prepare.queue_time_us":295484,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":7652,"raft.queue_time_us":753698,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":729374,"threads_started":3,"wal-append.queue_time_us":577241}
I20260709 13:06:16.745265 21825 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:16.743829 21832 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:16.747514 21832 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:06:16.747753 21832 pending_rounds.cc:85] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 4
I20260709 13:06:16.747952 21832 pending_rounds.cc:107] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:06:16.748154 21832 raft_consensus.cc:2889] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:16.733258 24808 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.745061 24325 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:16.749002 24660 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:16.734527 24645 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.735996 24659 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.735924 24689 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.717664 24793 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.758335 21979 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:16.763748 21825 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:16.768931 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:16.769187 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1658) took 1538 ms. Trace:
I20260709 13:06:16.777159 21831 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:16.776810 21830 rpcz_store.cc:276] 0709 13:06:15.230964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.924138 (+693174us) service_pool.cc:224] Handling call
0709 13:06:15.924466 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:16.669065 (+744599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.669092 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:16.669658 (+   566us) log.cc:844] Serialized 52 byte log entry
0709 13:06:16.706712 (+ 37054us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:16.707126 (+   414us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.768902 (+ 61776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.768980 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.769016 (+    36us) raft_consensus.cc:1685] finished
0709 13:06:16.769028 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.769141 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":805654,"prepare.queue_time_us":227,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":745708,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":36653,"threads_started":1,"wal-append.queue_time_us":36984}
I20260709 13:06:16.781761 24666 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.783337 24666 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.785521 24526 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:16.786280 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.786441 24666 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.786031 24526 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.787135 24660 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:16.788329 24526 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:16.788003 24660 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.789395 24645 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:16.794552 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51466.4us
I20260709 13:06:16.759519 24325 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.797698 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1659) took 1531 ms. Trace:
I20260709 13:06:16.798028 21827 rpcz_store.cc:276] 0709 13:06:15.266049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.940331 (+674282us) service_pool.cc:224] Handling call
0709 13:06:15.941581 (+  1250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.142898 (+201317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.797475 (+654577us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540009d154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:16.797644 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338542848}
I20260709 13:06:16.802416 24793 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:16.803936 24689 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.804066 24325 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:16.806412 24688 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.806905 24688 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.807626 24664 raft_consensus.cc:993] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:16.808070 24664 raft_consensus.cc:1081] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:16.808863 24688 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:16.810277 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.796224 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:16.760249 24808 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.815833 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:16.796944 24666 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.828595 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1643) took 2330 ms. Trace:
I20260709 13:06:16.829559 24659 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:16.816792 24634 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:16.829111 21828 rpcz_store.cc:276] 0709 13:06:14.498496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.499922 (+  1426us) service_pool.cc:224] Handling call
0709 13:06:14.517848 (+ 17926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.414330 (+896482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.828279 (+1413949us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540011d354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:16.828494 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060264192}
I20260709 13:06:16.818465 24325 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:16.845337 21829 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:16.842576 24634 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.848673 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:16.844269 24325 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.822211 24666 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.844066 24645 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:16.857868 24793 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:16.860683 24793 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.863299 24793 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:16.863785 21732 catalog_manager.cc:5697] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 4 to 5, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 5 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.867513 21732 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 4 to 5, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 5 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.851819 24634 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.870182 21732 catalog_manager.cc:5697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 3 to 6, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 6 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:16.872948 21732 catalog_manager.cc:5697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.874807 21732 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 4 to 5, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 5 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.877748 21732 catalog_manager.cc:5697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:06:16.878675 24833 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:06:16.888748 24781 raft_consensus.cc:476] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:16.852902 24325 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.888311 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:16.893676 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:16.896729 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:16.902603 21732 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 2 to 4, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 4 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.915398 21732 catalog_manager.cc:5697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 3 to 4, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 4 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.895687 24752 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:16.858482 24645 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.898856 24345 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:16.930245 24666 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:16.918501 24441 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:16.898202 24781 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:06:16.927186 24345 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.935161 24345 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.936188 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:16.939702 24684 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:16.930008 24808 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.919009 24778 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:06:16.946054 24645 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.937618 24441 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:16.947990 24441 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:16.955049 24645 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:16.955726 24645 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:16.955475 21732 catalog_manager.cc:5697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 3, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.959293 21732 catalog_manager.cc:5697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 4, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 4 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:16.962987 21732 catalog_manager.cc:5697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 1 to 2, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.964504 24353 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.961568 24645 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:16.961025 21976 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:16.979247 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:16.980140 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.980060 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:16.981492 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.981956 21909 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:16.982365 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.985838 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.986940 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:16.985589 24808 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:06:16.988533 24808 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:16.989015 24808 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:16.989359 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:16.986922 24783 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:16.989928 21900 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:16.990233 24783 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.990682 24783 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.990758 24784 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:16.993090 22548 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:06:16.994083 24834 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:06:16.994186 24629 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:16.995765 24405 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:16.996423 24703 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:16.996835 24703 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:16.989032 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:16.999238 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1647) took 1354 ms. Trace:
I20260709 13:06:16.999809 21980 rpcz_store.cc:276] 0709 13:06:15.644688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.954309 (+309621us) service_pool.cc:224] Handling call
0709 13:06:15.954581 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.158749 (+204168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.998949 (+840200us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54002c7c54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:16.999165 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331568512}
I20260709 13:06:17.001667 21980 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:17.002189 24634 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:17.003401 24835 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:06:17.007550 24808 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.007938 24345 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.009140 24808 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:17.003516 21828 raft_consensus.cc:2368] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9.
W20260709 13:06:16.993139 24836 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:06:17.012205 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.013438 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:17.014001 21825 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.014647 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:16.988590 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:17.015745 21829 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:17.016108 21829 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:17.017938 21832 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:17.018026 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:17.018896 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:17.024855 21909 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:17.019596 24841 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.030804 21900 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:17.016762 21829 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.033655 21829 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:17.034257 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:16.988664 22551 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:17.036775 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.032222 24634 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:17.035941 24784 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.020109 24778 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.047297 24707 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:17.051628 21831 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:17.052714 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:17.055301 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1654) took 1295 ms. Trace:
I20260709 13:06:17.055677 24781 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:17.056216 24781 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.056488 24778 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.034624 24481 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:17.058101 24781 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:17.058804 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:17.037508 24345 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:17.068058 21825 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
W20260709 13:06:17.068396 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.069797 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:17.055716 21979 rpcz_store.cc:276] 0709 13:06:15.760142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.988236 (+228094us) service_pool.cc:224] Handling call
0709 13:06:15.988531 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.775928 (+787397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.055068 (+279140us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540005afd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:17.055243 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764884736}
I20260709 13:06:17.073470 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:17.075685 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.053859 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.082643 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:17.037357 24842 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:06:16.997709 24703 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:17.084911 21978 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:17.083997 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:17.068205 24836 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:06:17.091777 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 55093us
I20260709 13:06:17.092823 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.094331 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.095958 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:17.097230 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:17.102454 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:17.104362 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.084501 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:17.084627 24634 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:17.114933 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.072256 24684 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:17.117396 21829 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:17.116281 24634 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:17.118113 21979 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 8. Ops: []
I20260709 13:06:17.120299 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.085515 24843 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.079317 24325 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.103250 24285 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:17.103514 24784 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:17.104013 24778 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.122149 24345 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.122902 24703 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:17.141317 21978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
W20260709 13:06:17.137241 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.139221 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.144563 21832 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:17.138616 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.148125 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:17.149166 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:17.150744 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:17.154610 22553 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:17.139001 24405 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.158838 24405 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.160705 24780 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.161224 24780 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:17.145313 24778 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:17.138909 24634 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.174727 22553 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:06:17.175745 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.177150 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.159188 24644 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:17.178252 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.179513 24780 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:17.181798 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:17.182343 21977 raft_consensus.cc:2410] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:17.183009 21983 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:17.183799 24325 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:17.184782 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:17.185509 21983 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:17.126679 24843 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:17.188369 24843 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:17.191120 21826 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:17.193648 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:17.194850 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.197618 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.197336 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:17.198997 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:17.200934 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:17.134470 24844 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:17.204766 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.205361 22553 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:17.209474 22520 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:17.211309 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.213135 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:17.164719 24661 raft_consensus.cc:2764] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:06:17.216980 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 96806.6us
I20260709 13:06:17.173081 24678 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.219972 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.228070 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.221143 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.226629 21901 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:06:17.229233 21901 pending_rounds.cc:85] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 7
I20260709 13:06:17.229537 21901 pending_rounds.cc:107] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:17.229825 21901 raft_consensus.cc:2889] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:17.229949 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.173038 24405 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:17.198244 24637 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.215170 24681 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:17.270335 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:17.220546 24629 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:17.212215 24808 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:17.270756 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49696.4us
I20260709 13:06:17.275517 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.370931 21909 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:17.371750 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:17.374959 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 145102us
I20260709 13:06:17.375524 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.376173 21831 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:17.376607 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:17.377024 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:17.377658 21831 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.208123 24593 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 13:06:17.270726 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.277433 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1635) took 1758 ms. Trace:
I20260709 13:06:17.367908 21983 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:17.365990 21982 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:17.388655 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:17.251132 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.227165 24586 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:17.164176 24684 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:17.235479 24830 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:17.392473 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.271710 24688 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.414861 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.390202 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:17.387991 21975 rpcz_store.cc:276] 0709 13:06:15.519034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.675695 (+156661us) service_pool.cc:224] Handling call
0709 13:06:15.675976 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.518929 (+842953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.277133 (+758204us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54002c7254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:17.277366 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673905536}
I20260709 13:06:17.270524 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.232640 24806 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:17.409950 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 185425us
W20260709 13:06:17.417754 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 184077us
I20260709 13:06:17.278110 24844 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:17.380204 24784 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:17.270212 24636 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 13:06:17.367962 24841 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:17.232010 24644 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.176s
I20260709 13:06:17.407963 24778 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:17.417862 24707 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.376789 24851 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.424299 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:17.268721 24664 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.181s
I20260709 13:06:17.388906 24843 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.381978 24660 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.379287 24681 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.278971 24589 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 13:06:17.233007 24846 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.194s
I20260709 13:06:17.431217 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.423889 21975 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:17.414047 24441 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.416292 24629 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:17.413952 24830 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:17.416965 24656 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:17.443181 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.266332 24637 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:17.408213 24345 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:06:17.416666 24285 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:06:17.459020 24784 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.459896 24852 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 13:06:17.461143 24845 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:17.463815 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:17.509929 21827 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.431172 24796 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.436501 24672 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:17.432847 24489 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:17.476634 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 52470.7us
I20260709 13:06:17.430100 22551 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
W20260709 13:06:17.479104 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47979.1us
I20260709 13:06:17.436902 24778 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:17.438338 24793 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:17.440851 24678 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.430243 24806 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:17.484284 24660 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:17.430853 24808 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:06:17.492293 24707 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:17.492390 24656 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.493968 24637 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:17.485786 24441 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.494117 21826 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:17.492188 21982 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:17.475466 24681 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.447116 24851 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:17.423019 24688 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:17.505632 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:17.510543 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 95961.6us
I20260709 13:06:17.485625 24593 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.489848 24830 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:17.517920 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.518762 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.519150 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.518491 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.521973 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.465721 24844 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:06:17.508275 24285 consensus_queue.cc:1243] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:17.527879 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.665130 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.659195 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.767189 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.632946 22521 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:17.815317 21829 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:17.816005 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 183152us
I20260709 13:06:17.675045 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:17.817270 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:17.665545 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.667114 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.660497 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.665843 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.528594 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.820672 21901 raft_consensus.cc:2410] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:06:17.756961 21977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 330) took 1471 ms (client timeout 1732 ms). Trace:
I20260709 13:06:17.512143 24852 consensus_queue.cc:1243] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:17.827106 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.820811 21907 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:17.665446 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:17.755038 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1649) took 2711 ms. Trace:
I20260709 13:06:17.667515 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1680) took 1324 ms. Trace:
I20260709 13:06:17.832877 21976 rpcz_store.cc:276] 0709 13:06:16.343337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.968844 (+625507us) service_pool.cc:224] Handling call
0709 13:06:16.969398 (+   554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.970717 (+  1319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.970764 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.971621 (+   857us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.117041 (+145420us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:17.312884 (+195843us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.313259 (+   375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.313378 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.667279 (+353901us) raft_consensus.cc:1685] finished
0709 13:06:17.667302 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.667454 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14808,"prepare.queue_time_us":26995,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":3213,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":12859,"thread_start_us":328352,"threads_started":2,"wal-append.queue_time_us":243382}
I20260709 13:06:17.823091 21908 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
W20260709 13:06:17.587596 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.660351 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.836198 21829 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:17.832261 21834 rpcz_store.cc:276] 0709 13:06:15.043345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.410134 (+366789us) service_pool.cc:224] Handling call
0709 13:06:15.930365 (+520231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.670218 (+739853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.670245 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.670654 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.718060 (+ 47406us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:16.718094 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.718211 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.879808 (+161597us) raft_consensus.cc:1685] finished
0709 13:06:16.879830 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.754739 (+874909us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54000e92d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:17.754962 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739394,"raft.queue_time_us":739876,"raft.run_cpu_time_us":39,"raft.run_wall_time_us":42,"spinlock_wait_cycles":1195582336,"thread_start_us":47069,"threads_started":1,"wal-append.queue_time_us":111983}
W20260709 13:06:17.821467 21977 rpcz_store.cc:269] 0709 13:06:16.285283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.289344 (+  4061us) service_pool.cc:224] Handling call
0709 13:06:17.756708 (+1467364us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540001f4d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:17.756890 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050655104}
I20260709 13:06:17.844198 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.848083 21831 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:17.849334 21875 leader_election.cc:400] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9.
I20260709 13:06:17.850049 21875 leader_election.cc:403] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:17.663764 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.851136 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:17.767570 24780 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:17.667606 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.825703 24750 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.864045 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:17.588984 24867 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:17.651466 24698 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:17.854635 21903 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:06:17.525699 24783 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.002s
W20260709 13:06:17.722142 24845 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
W20260709 13:06:17.824353 21799 connection.cc:256] RPC call timeout handler was delayed by -1.1560421180000731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:06:17.826488 24838 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.891s	user 0.005s	sys 0.000s
I20260709 13:06:17.515734 24586 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:17.861075 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:17.828226 24353 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:17.915192 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 97993.7us
I20260709 13:06:17.916664 21831 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:17.523054 24778 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:17.736126 24703 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.001s
I20260709 13:06:17.865854 21825 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:06:17.852898 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 177956us
I20260709 13:06:17.523330 24672 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:17.726977 24855 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:17.785136 24619 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:17.667523 24752 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.880401 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:17.756480 24644 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:17.666718 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.649267 24678 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.590440 24806 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:17.881122 22549 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:17.890775 24688 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:17.892942 24808 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:17.893700 24852 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.826288 24863 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:17.895066 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:17.863632 24781 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:17.898279 24783 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.528954 24859 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.377s
I20260709 13:06:17.862157 24841 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:06:17.902765 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.903643 21974 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:06:18.010025 21974 pending_rounds.cc:85] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 6
I20260709 13:06:18.010313 21974 pending_rounds.cc:107] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:06:18.010555 21974 raft_consensus.cc:2889] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:17.904270 24851 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:17.905165 24285 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:17.856313 24636 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:06:17.529657 24793 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.028450 24793 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:17.908609 24656 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:17.668020 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.666298 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.912166 22554 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:17.535068 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.841385 24405 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:17.923846 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:17.925755 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 87379.9us
I20260709 13:06:17.926366 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:17.927279 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.841645 24593 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:17.860006 24453 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:17.927945 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:17.929173 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:17.929306 21901 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:17.930495 21980 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:17.929850 21799 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:18.040136 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 110380us
I20260709 13:06:17.852429 24780 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:17.988054 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.946987 24644 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:17.967628 21979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.042s	sys 0.080s
I20260709 13:06:17.992916 24678 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:17.931474 24862 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:17.995810 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49124.1us
I20260709 13:06:17.997061 21983 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:17.930064 24855 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:17.998250 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:17.931885 24619 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:17.928292 24353 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:18.017243 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.942970 24752 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.033881 21907 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:18.035200 22555 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:18.035362 21903 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:17.546294 21827 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:18.037364 21908 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:18.040891 21909 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:18.041256 21901 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:17.640393 24629 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.043032 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:18.043947 21902 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:18.062767 21908 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:18.047058 21979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.042s	sys 0.080s
I20260709 13:06:17.930281 24810 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:06:18.048794 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 120956us
I20260709 13:06:18.054804 21976 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:18.000248 24808 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.061275 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1684) took 1358 ms. Trace:
I20260709 13:06:18.044694 24453 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.038573 24285 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:18.065788 21908 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.046137 24637 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:18.051941 24656 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:18.049813 24699 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:06:18.071513 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:18.102658 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:18.080410 21908 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:18.084491 24285 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.085242 24453 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:18.091728 24441 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:18.092414 24843 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:18.005937 24863 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.105222 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.107051 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1681) took 1496 ms. Trace:
I20260709 13:06:18.160749 21980 rpcz_store.cc:276] 0709 13:06:16.611142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.013171 (+402029us) service_pool.cc:224] Handling call
0709 13:06:17.013513 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.039499 (+1025986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.106764 (+ 67265us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54003a52d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:18.106978 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105097088}
I20260709 13:06:18.112756 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.162569 21976 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:06:18.063844 24866 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:18.078295 24636 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:18.126590 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:18.126847 21982 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:18.067209 22546 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:18.031038 24672 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.043056 24405 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.167892 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:18.169946 24696 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:18.170398 21905 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:06:18.021224 24586 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.157824 24793 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:18.172555 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1729) took 1101 ms. Trace:
I20260709 13:06:18.129882 24689 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:18.132993 21828 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:18.175081 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 52138.6us
I20260709 13:06:18.187431 21974 rpcz_store.cc:276] 0709 13:06:17.070974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.110306 (+ 39332us) service_pool.cc:224] Handling call
0709 13:06:17.756861 (+646555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.011109 (+254248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.111974 (+100865us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540001f4d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:18.172385 (+ 60411us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b540001f4d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:18.172503 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1822577280}
I20260709 13:06:18.183821 24664 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:18.171940 24866 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:18.185276 24661 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.126602 24688 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.190240 24698 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:18.246095 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 395084us
I20260709 13:06:18.096577 24862 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:18.182996 24644 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.187597 24656 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:18.257025 24656 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:18.257535 24656 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:18.189375 24869 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.131s	user 0.004s	sys 0.000s
I20260709 13:06:18.171762 24353 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:18.178364 24783 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.179656 24593 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.217752 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:18.262180 21827 raft_consensus.cc:2376] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6. Re-sending same reply.
I20260709 13:06:18.218870 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:18.263258 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44453.4us
I20260709 13:06:18.264207 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:18.266111 24685 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:18.266775 24752 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:18.266834 24685 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:18.267431 24685 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:18.246083 24661 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.267910 24685 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:18.268311 24678 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:18.215440 24664 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.268949 24664 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:18.269263 24656 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.230327 24866 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:18.270936 24871 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:06:18.272140 24656 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.272368 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1701) took 1259 ms. Trace:
I20260709 13:06:18.272778 21830 rpcz_store.cc:276] 0709 13:06:17.012496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.018943 (+  6447us) service_pool.cc:224] Handling call
0709 13:06:17.019236 (+   293us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:17.019579 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.019607 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:17.026628 (+  7021us) log.cc:844] Serialized 52 byte log entry
0709 13:06:17.678529 (+651901us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b180005e900. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:06:18.007194 (+328665us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:18.007246 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.007335 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.272080 (+264745us) raft_consensus.cc:1685] finished
0709 13:06:18.272099 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.272312 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":737,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":10794,"spinlock_wait_cycles":20105088,"thread_start_us":328450,"threads_started":1,"wal-append.queue_time_us":1091540}
I20260709 13:06:18.275575 24863 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:18.275409 24685 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.276129 24752 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.278393 24681 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.279330 24405 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:18.279520 21900 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:18.081012 21833 rpcz_store.cc:276] 0709 13:06:16.703268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.737111 (+ 33843us) service_pool.cc:224] Handling call
0709 13:06:16.737292 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.737446 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:16.746537 (+  9091us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.629449 (+882912us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b180031a380. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:06:18.060871 (+431422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:18.060935 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:18.061001 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.061082 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.061213 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":527,"prepare.queue_time_us":8972,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":300,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5436,"spinlock_wait_cycles":5945728,"thread_start_us":430938,"threads_started":1}
I20260709 13:06:18.187391 24793 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.180145 24619 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.131316 24843 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:18.249483 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1760) took 1888 ms. Trace:
I20260709 13:06:18.296941 21974 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:06:18.199071 24660 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:18.255972 24862 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:18.253286 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 691d4cf0a1ef4f689413711647c88f75: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:18.265682 24830 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.186689 24696 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:18.298346 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 454222us
W20260709 13:06:18.298801 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 261391us
I20260709 13:06:18.299181 21982 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:18.289981 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:18.311559 21983 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.214293 24636 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:06:18.303356 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:18.174103 24855 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.306344 21833 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:18.297114 21905 rpcz_store.cc:276] 0709 13:06:16.361288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.404196 (+ 42908us) service_pool.cc:224] Handling call
0709 13:06:18.241742 (+1837546us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54003c9954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:18.249419 (+  7677us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3811128576}
I20260709 13:06:18.314527 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.316850 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.252352 24649 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:18.297749 24793 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:18.296427 24644 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.297935 24841 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.334546 24405 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:18.281718 24707 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:06:18.296329 24685 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:18.252902 24688 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.344066 21976 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:18.351143 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.321817 21983 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:18.339437 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.255168 24698 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.353173 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.346495 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.327571 24619 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:18.340317 24864 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.349391 21832 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:18.355479 21974 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:06:18.297796 24778 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.348904 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.384580 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.385363 21982 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:18.360709 21976 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:18.361846 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:18.363384 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:18.342208 24855 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:18.366744 21980 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:06:18.371203 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.405711 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.407300 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.408773 21974 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:18.409422 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.373538 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.376004 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:18.410334 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 321478us
I20260709 13:06:18.410394 22555 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:18.411381 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.414038 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:18.414973 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:18.415647 21983 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:18.415629 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.421918 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:18.351650 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:18.444446 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.409855 21974 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:18.444891 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:18.420959 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:18.450959 21983 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:06:18.447088 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:18.450030 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.341724 24649 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:18.461248 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.461930 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:18.451084 21903 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:18.466816 21825 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:18.453401 21833 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:18.453738 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.452874 21975 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:18.454916 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:18.455055 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.456471 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:18.472043 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:06:18.456758 24881 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.002s
I20260709 13:06:18.459354 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1735) took 1364 ms. Trace:
I20260709 13:06:18.386986 24752 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:18.459810 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.346146 24644 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.473201 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:18.369762 24810 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9.
I20260709 13:06:18.475801 21901 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:06:18.477860 21909 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:18.459708 21978 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:18.486873 21901 pending_rounds.cc:85] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 2
I20260709 13:06:18.444033 24637 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:18.349740 24841 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.352351 24405 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.476930 21979 rpcz_store.cc:276] 0709 13:06:17.094836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.125740 (+ 30904us) service_pool.cc:224] Handling call
0709 13:06:17.125987 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.126258 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:17.423289 (+297031us) log.cc:844] Serialized 14 byte log entry
0709 13:06:18.174905 (+751616us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b180033cee0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a
0709 13:06:18.408416 (+233511us) log.cc:844] Serialized 14 byte log entry
0709 13:06:18.459055 (+ 50639us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:18.459099 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:18.459139 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.459202 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.459307 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53266,"prepare.queue_time_us":250438,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":62619,"spinlock_wait_cycles":11988736,"thread_start_us":1154119,"threads_started":3,"wal-append.queue_time_us":639741}
I20260709 13:06:18.487102 21978 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:18.502305 21908 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:06:18.476943 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57261us
I20260709 13:06:18.502839 21908 pending_rounds.cc:85] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 4
I20260709 13:06:18.487257 21901 pending_rounds.cc:107] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:06:18.487453 21828 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:18.402518 24808 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.488336 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:18.506924 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:18.488864 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1681) took 1008 ms. Trace:
I20260709 13:06:18.450191 24694 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:18.493721 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.448668 24489 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:18.461234 22546 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:18.503161 21908 pending_rounds.cc:107] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:18.503420 21901 raft_consensus.cc:2889] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.486371 24325 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:18.525293 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:18.509114 21829 rpcz_store.cc:276] 0709 13:06:17.480691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.837648 (+356957us) service_pool.cc:224] Handling call
0709 13:06:17.838060 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.842403 (+  4343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.842456 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.856747 (+ 14291us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.323815 (+467068us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:18.323870 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.323955 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.488670 (+164715us) raft_consensus.cc:1685] finished
0709 13:06:18.488690 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.488812 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23659,"raft.queue_time_us":15478,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":22089,"thread_start_us":432103,"threads_started":1,"wal-append.queue_time_us":565879}
I20260709 13:06:18.444379 24851 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:06:18.356650 24843 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.473781 24659 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:18.481698 24660 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:18.520788 21908 raft_consensus.cc:2889] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.521186 24636 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:18.501423 24645 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:18.388312 24864 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:18.535847 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 173553us
I20260709 13:06:18.560041 21978 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.515738 24707 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:18.486240 24678 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:06:18.527277 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 313010us
I20260709 13:06:18.597790 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:18.522413 24656 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:18.576942 21906 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:18.519814 24876 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.606675 24876 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.609225 24876 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.525913 24325 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.493362 24752 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.612296 24752 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:18.518422 24880 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:18.580494 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 131964us
I20260709 13:06:18.614125 24880 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.618547 24880 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:18.619674 24325 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:18.537350 24681 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:18.558921 24285 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:18.536876 24661 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.634292 24629 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:18.579137 24636 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:18.638494 24636 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:18.638865 24793 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.640859 24793 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:18.536065 24810 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:06:18.643117 24661 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:18.643462 24661 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:18.644199 24661 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.645406 24661 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:18.645355 24644 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.654932 24778 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:18.655839 24870 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.309s	user 0.000s	sys 0.000s
I20260709 13:06:18.521512 24489 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.658902 24489 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.663020 21974 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:18.664064 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet add79beae9d04c6983a531c46dc72deb: Illegal state: Replica 3d76b2c4699e43fba10eeb81a91e4913 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:18.562592 24660 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:18.685722 24875 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:18.698151 21873 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.538s (SENT) [suppressed 17 similar messages]
I20260709 13:06:18.701752 24886 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:18.705780 24405 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.707978 24900 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:18.710275 24883 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:06:18.675853 24649 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.713407 24678 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:18.715168 24678 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:18.718501 24830 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.719571 24885 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:06:18.720856 24453 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
I20260709 13:06:18.721390 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:18.724647 24644 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:18.726686 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1772) took 1091 ms. Trace:
I20260709 13:06:18.741914 21906 rpcz_store.cc:276] 0709 13:06:17.635254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.857045 (+221791us) service_pool.cc:224] Handling call
0709 13:06:18.726493 (+869448us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540034ab54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:18.726621 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178965888}
I20260709 13:06:18.729115 24707 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:18.667377 24862 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.721350 24453 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.634338 24285 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:18.781239 24285 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.782580 24285 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:18.787256 22554 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: [3.6-6.7]
W20260709 13:06:18.776930 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55642.5us
I20260709 13:06:18.684391 24660 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:18.790261 21873 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:18.686900 24688 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.793890 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:06:18.802939 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 296051us
I20260709 13:06:18.803915 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:18.810719 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:18.812635 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:18.795321 24664 consensus_meta.cc:287] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
W20260709 13:06:18.825598 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.795699 24885 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:18.830806 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 243288us
I20260709 13:06:18.795683 24877 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:18.817886 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:18.789160 24698 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:18.734109 24636 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:18.832500 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 218258us
W20260709 13:06:18.838812 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 414203us
I20260709 13:06:18.740741 24875 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.839525 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:18.839851 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:18.812417 24830 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:18.819988 24688 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:18.838976 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:18.819157 24637 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:18.847594 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:18.831925 24707 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:18.872016 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.847903 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.832969 24885 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.847998 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.857698 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.827214 24806 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:18.850435 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:18.877321 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:18.873688 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.879855 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.875252 21979 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:18.881764 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.875926 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:18.883271 21981 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:18.850208 24698 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:18.849237 24810 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:18.865522 24851 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.868172 24644 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:18.868602 24843 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:18.870522 24688 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.893652 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:18.831544 24664 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.873250 24904 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.873389 24778 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.876893 24885 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:18.874871 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:18.906978 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:18.908782 21979 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:18.890417 24841 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:18.912042 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 314309us
I20260709 13:06:18.912384 21875 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:18.915622 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:18.916332 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:18.889115 24586 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:06:18.923146 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:18.924805 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:18.924885 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:18.925412 24661 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:18.902045 24806 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.837563 24877 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.901898 24644 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:18.909763 24688 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:18.904971 24783 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:18.952836 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 113582us
I20260709 13:06:18.910362 24698 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:18.923221 24891 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:06:18.958292 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:18.958948 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:18.959493 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.901814 24851 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.008893 21834 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:18.931348 24593 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:19.013283 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 95557.9us
I20260709 13:06:18.931180 22546 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:19.013674 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:18.959880 24890 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:06:18.932363 24903 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:19.011971 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 201349us
I20260709 13:06:19.033252 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:19.026891 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.028034 22555 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:18.954182 24644 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:18.960601 24866 consensus_meta.cc:287] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.000s
I20260709 13:06:18.919212 24778 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:18.963186 24661 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:18.919301 24904 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.048467 24694 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.049924 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.051743 21834 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:19.054090 21827 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:06:18.956545 24637 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:18.954447 24859 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:06:19.056000 24859 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:19.046036 24866 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.018075 24864 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.043947 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:18.954703 24806 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.045737 21983 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:19.042896 24353 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.093158 21830 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:19.032784 24903 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.064105 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.008206 24783 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.089839 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:18.955111 24862 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:06:19.105182 22553 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:19.027848 21832 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
W20260709 13:06:19.110497 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.119451 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.943178 24453 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.059521 24664 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:19.107081 24353 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.112920 24694 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:19.128331 24851 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.130568 24689 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.132748 24780 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.047341 24661 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:19.110176 24890 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:06:19.134718 24636 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.080480 24698 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:06:19.166215 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 241379us
I20260709 13:06:19.112440 24862 consensus_queue.cc:1243] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:19.107923 24903 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:19.134300 24619 consensus_meta.cc:287] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.001s
I20260709 13:06:19.089330 24877 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.180821 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 304) took 1123 ms. Trace:
I20260709 13:06:19.196821 21948 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:19.190353 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:19.151945 24841 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.192538 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.192898 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.194983 21907 rpcz_store.cc:276] 0709 13:06:18.058986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.077096 (+ 18110us) service_pool.cc:224] Handling call
0709 13:06:18.077512 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:18.103173 (+ 25661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.103207 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:18.160243 (+ 57036us) log.cc:844] Serialized 52 byte log entry
0709 13:06:18.221363 (+ 61120us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4800261e58. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:06:18.516659 (+295296us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:18.516708 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.516785 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.167179 (+650394us) raft_consensus.cc:1685] finished
0709 13:06:19.167206 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.180756 (+ 13550us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":717,"raft.run_cpu_time_us":2802,"raft.run_wall_time_us":136439,"spinlock_wait_cycles":31320960,"thread_start_us":302615,"threads_started":1,"wal-append.queue_time_us":501818}
I20260709 13:06:19.165068 24694 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:19.199914 21908 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:19.208667 21901 pending_rounds.cc:85] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 3
W20260709 13:06:19.209522 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 274243us
I20260709 13:06:19.212412 21901 pending_rounds.cc:107] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:19.212783 21901 raft_consensus.cc:2889] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:19.211098 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:19.213375 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 77479.6us
I20260709 13:06:19.183758 24901 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:19.180351 24661 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.220283 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:19.221763 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:19.223284 21902 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:19.223845 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.224694 21909 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
W20260709 13:06:19.229542 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.225936 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.176373 24664 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:06:19.184875 24649 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:19.251384 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.183175 24689 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.211098 24877 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:19.216526 24694 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:19.214267 24780 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.262259 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.215986 24841 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.292649 24933 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.293181 24933 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.300601 24689 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.257047 24831 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:06:19.255074 24859 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.306815 24806 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:19.308468 24778 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:19.310456 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:19.310730 24925 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:06:19.260689 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:19.311667 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.312548 21904 raft_consensus.cc:2410] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:06:19.305955 24325 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.004s
I20260709 13:06:19.313355 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:19.313601 24325 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.313071 24933 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.316341 24325 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:19.320040 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:19.321451 21906 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:19.294405 24907 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:06:19.356427 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.362437 24353 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.295014 24875 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:19.367764 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:19.341171 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:06:19.360070 24916 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:06:19.290452 24660 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.380904 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.359802 24859 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:19.386211 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 164546us
I20260709 13:06:19.389705 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:19.400014 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:19.399149 22553 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:19.400668 24938 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:19.402812 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:19.402526 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.405776 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.406602 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.406651 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.410210 21834 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:19.410210 21829 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:19.385689 24859 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:19.414065 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.424702 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.410655 21827 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:19.427171 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.431730 21828 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:19.435348 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:19.436184 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:19.436935 24843 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 13:06:19.437145 21901 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:06:19.437479 24644 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.430987 21830 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:19.412271 21904 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:19.408878 24933 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.409094 24780 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:19.443485 24780 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.443930 24780 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:19.444917 24919 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:06:19.446379 24915 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.446889 24915 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.450390 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:19.451409 24707 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 13:06:19.451651 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:19.451766 24861 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:19.451938 24707 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.439792 24694 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:19.452651 24855 consensus_meta.cc:287] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.004s	user 0.004s	sys 0.005s
I20260709 13:06:19.452419 24861 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.454411 24694 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.455045 21982 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:19.425832 24859 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.456393 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:19.378146 24688 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.452339 21981 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:19.402068 24806 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:06:19.465792 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:19.398007 24875 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:19.412606 24904 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.457767 21828 raft_consensus.cc:2368] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10.
I20260709 13:06:19.460196 21827 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:06:19.450501 24915 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.409587 24783 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.413671 24938 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:19.469511 21904 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:19.471740 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1687) took 1121 ms. Trace:
I20260709 13:06:19.472112 21976 rpcz_store.cc:276] 0709 13:06:18.349832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.351382 (+  1550us) service_pool.cc:224] Handling call
0709 13:06:18.360463 (+  9081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.403227 (+ 42764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.471558 (+1068331us) spinlock_profiling.cc:243] Waited 8.79 ms on lock 0x7b54003fa050. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:19.471687 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20214656}
I20260709 13:06:19.473177 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1743) took 2306 ms. Trace:
I20260709 13:06:19.474287 21909 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:19.482764 21975 rpcz_store.cc:276] 0709 13:06:17.166738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.478096 (+311358us) service_pool.cc:224] Handling call
0709 13:06:17.478468 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.471037 (+992569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.472978 (+1001941us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54002c8b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:19.473132 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240521600}
I20260709 13:06:19.484830 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:19.484918 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:19.485622 21975 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:19.473258 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:19.486476 21976 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
W20260709 13:06:19.486737 24912 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.175s	user 0.000s	sys 0.003s
I20260709 13:06:19.486557 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:19.488840 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:19.489089 24660 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.489223 24696 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.490056 24644 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:19.490272 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:19.492949 24864 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:19.494274 24864 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.487303 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:19.495026 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:19.494431 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.497632 21829 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:19.497025 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:19.500258 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:19.501008 24938 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.501917 24696 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:19.499020 24855 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:19.502899 24696 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:19.503371 24855 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:19.492920 24929 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:19.503865 24696 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:19.504004 24855 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:19.504246 24929 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:19.504770 24929 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:19.504642 24696 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.506485 24806 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:19.507074 24806 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.507525 24806 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:19.509176 21829 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:19.511273 21826 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:06:19.514468 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1763) took 1162 ms. Trace:
I20260709 13:06:19.514835 21980 rpcz_store.cc:276] 0709 13:06:18.352380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.355462 (+  3082us) service_pool.cc:224] Handling call
0709 13:06:18.366368 (+ 10906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.403472 (+ 37104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.514286 (+1110814us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54002d3f50. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:19.514401 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24268160}
I20260709 13:06:19.516472 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:19.505250 24855 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.500034 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:19.690488 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.540653 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1692) took 1168 ms. Trace:
I20260709 13:06:19.530278 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:19.702404 21974 rpcz_store.cc:276] 0709 13:06:18.372463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.451014 (+ 78551us) service_pool.cc:224] Handling call
0709 13:06:18.662798 (+211784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.663522 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.540416 (+876894us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54002260d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:19.540569 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486254976}
I20260709 13:06:19.693346 21832 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:19.530295 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:19.524216 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:19.531241 21828 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:19.704178 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 173947us
I20260709 13:06:19.698575 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.704761 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:19.704874 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 204900us
I20260709 13:06:19.705385 21828 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:19.517383 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.703334 21831 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:19.526906 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:19.698119 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 197916us
I20260709 13:06:19.706589 21831 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:19.707175 21829 raft_consensus.cc:2410] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:19.698539 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1780) took 1281 ms. Trace:
I20260709 13:06:19.487778 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:19.533658 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 448) took 1331 ms. Trace:
I20260709 13:06:19.701642 21978 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.472988 24681 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:19.713825 22554 rpcz_store.cc:276] 0709 13:06:18.202632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.202767 (+   135us) service_pool.cc:224] Handling call
0709 13:06:18.203234 (+   467us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:18.787836 (+584602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.533423 (+745587us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54004c4354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:19.533605 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341866368}
I20260709 13:06:19.705992 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:19.721140 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:19.721217 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:19.707521 21831 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.497725 24864 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.725122 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:19.725947 21831 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:19.725099 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39186 (request call id 1736) took 2603 ms. Trace:
I20260709 13:06:19.727067 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:19.506016 24696 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.716892 24808 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:19.632817 24861 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:19.637176 24885 consensus_meta.cc:287] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.000s
I20260709 13:06:19.736125 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:19.595165 24694 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.605454 24843 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:06:19.734848 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 90821f4436f045a0a3847b276293f36f: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:19.684264 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 430) took 1271 ms. Trace:
I20260709 13:06:19.751116 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.731384 21978 rpcz_store.cc:276] 0709 13:06:17.110968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.141198 (+ 30230us) service_pool.cc:224] Handling call
0709 13:06:19.514455 (+2373257us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540005a5d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd5a3d 00007fb763fa5cd0 00007fb75d52a254 00007fb75d52a1e2 00007fb75d52a111 00007fb75d52a08c 00007fb75d529342 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:19.714498 (+200043us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3030421760}
I20260709 13:06:19.712262 21900 rpcz_store.cc:276] 0709 13:06:18.416829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.416951 (+   122us) service_pool.cc:224] Handling call
0709 13:06:18.417310 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:18.793771 (+376461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.793799 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:18.805500 (+ 11701us) log.cc:844] Serialized 52 byte log entry
0709 13:06:18.932165 (+126665us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:18.942837 (+ 10672us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.531423 (+588586us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b18002f8a20. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf 00007fb75eff8038
0709 13:06:19.531605 (+   182us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.559049 (+ 27444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.559144 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.594928 (+ 35784us) raft_consensus.cc:1685] finished
0709 13:06:19.594966 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.698469 (+103503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":611646,"prepare.queue_time_us":609393,"prepare.run_cpu_time_us":16821,"prepare.run_wall_time_us":48107,"raft.queue_time_us":293047,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":19006,"spinlock_wait_cycles":8185088,"thread_start_us":424320,"threads_started":2,"wal-append.queue_time_us":580595}
I20260709 13:06:19.689374 24688 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.731951 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:19.470257 24875 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:19.753582 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 98243.3us
I20260709 13:06:19.723906 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:19.537715 24915 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:19.536091 24905 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:19.729332 24810 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:19.612874 22548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 439) took 1953 ms (client timeout 1941 ms). Trace:
I20260709 13:06:19.733717 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:19.741269 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.716717 24796 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:19.735298 24698 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.740052 24926 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:19.729646 24949 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:19.734890 24353 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:06:19.717087 24681 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:19.724345 24672 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:19.729298 24593 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:19.785027 24593 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:19.785456 24593 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:19.787528 24950 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:06:19.788852 24943 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:06:19.788913 24672 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.770763 24796 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.789999 24796 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.790743 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:19.792198 24930 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.485s	user 0.001s	sys 0.004s
I20260709 13:06:19.524171 24793 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.223s
I20260709 13:06:19.650548 24780 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.803624 24780 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.542472 24661 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.805394 24661 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.764952 24905 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.810470 21828 raft_consensus.cc:2410] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:19.763195 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.739820 21829 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:19.738559 24808 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.740131 24855 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:19.734970 24908 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:19.748543 24783 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.752820 21830 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:19.590803 24903 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.729089 24752 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:19.613919 24929 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.778681 21831 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:19.738453 24911 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:06:19.760214 22548 rpcz_store.cc:269] 0709 13:06:17.659842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.660011 (+   169us) service_pool.cc:224] Handling call
0709 13:06:19.612676 (+1952665us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004920d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:19.612804 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379683712}
I20260709 13:06:19.815218 21900 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:19.851186 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.851979 21900 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:19.853089 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:19.772045 24926 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.754905 24843 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.817279 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:19.821125 24808 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:19.748456 24931 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:06:19.749768 24885 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.829900 24901 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:19.830597 21829 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:19.831015 24353 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:19.832115 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:19.773943 24698 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.865185 24901 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.871717 24698 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.834478 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:19.834784 24875 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.778636 24949 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.835306 24783 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.877825 24949 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.805886 24806 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.749929 22549 rpcz_store.cc:276] 0709 13:06:18.412663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.445069 (+ 32406us) service_pool.cc:224] Handling call
0709 13:06:18.523520 (+ 78451us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:18.701902 (+178382us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:18.701939 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:18.702588 (+   649us) log.cc:844] Serialized 52 byte log entry
0709 13:06:18.883873 (+181285us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:18.890321 (+  6448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.683698 (+793377us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54002508d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:19.683766 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.683835 (+    69us) raft_consensus.cc:1685] finished
0709 13:06:19.683854 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.684186 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110157,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":15892,"spinlock_wait_cycles":364196096,"thread_start_us":168456,"threads_started":1,"wal-append.queue_time_us":527739}
I20260709 13:06:19.842480 21830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:19.879858 21830 raft_consensus.cc:606] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:19.761256 24699 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:06:19.847424 21976 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:19.855856 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:19.858649 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 864ca05a434d488c83f87f71e27dfa63: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:19.883237 21904 raft_consensus.cc:2368] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
I20260709 13:06:19.883788 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.884497 21900 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:19.859822 21902 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:19.859997 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 521) took 1027 ms. Trace:
I20260709 13:06:19.885174 22552 rpcz_store.cc:276] 0709 13:06:18.832567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.832670 (+   103us) service_pool.cc:224] Handling call
0709 13:06:19.817100 (+984430us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:06:19.859917 (+ 42817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12941184}
I20260709 13:06:19.760654 24694 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.873349 21908 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:19.874577 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:19.886130 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:19.824795 24908 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.852178 24796 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.877488 24353 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.886726 21826 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:19.888196 24353 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.836009 24859 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.888406 24796 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.888478 24908 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.888751 24694 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:19.859664 24926 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:19.889263 21975 raft_consensus.cc:2368] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
I20260709 13:06:19.890772 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.892107 21900 raft_consensus.cc:2368] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
I20260709 13:06:19.892457 21901 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:19.892804 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:19.893294 24962 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:19.893894 21900 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.898952 24903 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.899348 24843 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.901393 24885 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.901868 24963 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:19.902462 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 525) took 1001 ms. Trace:
I20260709 13:06:19.902420 24963 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.903352 22555 rpcz_store.cc:276] 0709 13:06:18.901537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.901787 (+   250us) service_pool.cc:224] Handling call
0709 13:06:19.027858 (+126071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.034372 (+  6514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.902274 (+867902us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002debd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:19.902403 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289324800}
I20260709 13:06:19.904974 24963 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.905324 24864 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.897284 24806 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.909438 24783 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.906869 24929 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.911624 24859 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:19.915294 24901 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.915977 24841 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.921619 22547 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:19.925107 24901 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:19.925755 24864 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:19.926720 24958 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:06:19.928840 24924 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.618s	user 0.001s	sys 0.001s
I20260709 13:06:19.936825 24644 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.937341 24644 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:19.937382 24810 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:19.938992 24937 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.628s	user 0.002s	sys 0.000s
I20260709 13:06:19.938889 24810 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.940825 24886 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:19.941128 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:19.942252 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:19.942659 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 51143.1us
I20260709 13:06:19.944676 22555 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:19.941272 24886 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:19.940848 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1779) took 1524 ms. Trace:
I20260709 13:06:19.893882 24962 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:19.957995 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 107646us
I20260709 13:06:19.963160 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:19.944489 24681 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:19.959229 21905 rpcz_store.cc:276] 0709 13:06:18.416500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.416624 (+   124us) service_pool.cc:224] Handling call
0709 13:06:18.459589 (+ 42965us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:18.790056 (+330467us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:18.790107 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:18.792010 (+  1903us) log.cc:844] Serialized 52 byte log entry
0709 13:06:18.930154 (+138144us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:18.930212 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.930274 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.928258 (+997984us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:19.940536 (+ 12278us) raft_consensus.cc:1685] finished
0709 13:06:19.940563 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.940788 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29657,"raft.queue_time_us":109428,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":18456,"spinlock_wait_cycles":16842624,"thread_start_us":332146,"threads_started":2,"wal-append.queue_time_us":492420}
W20260709 13:06:20.004985 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 49152.5us
I20260709 13:06:20.009734 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:20.029012 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.054476 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:20.368649 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:20.184024 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.169209 21900 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
W20260709 13:06:20.369969 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:20.033818 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 70768.9us
I20260709 13:06:20.371348 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:20.211138 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1776) took 1012 ms. Trace:
I20260709 13:06:20.379514 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:20.372398 21980 rpcz_store.cc:276] 0709 13:06:19.198793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.798350 (+599557us) service_pool.cc:224] Handling call
0709 13:06:19.798654 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.798851 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:19.799135 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:06:20.210787 (+411652us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.210839 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:20.210881 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.210944 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.211075 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":36755,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":20372,"spinlock_wait_cycles":41344,"thread_start_us":411273,"threads_started":2,"wal-append.queue_time_us":82017}
I20260709 13:06:20.389030 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:20.392331 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:20.067039 24913 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.761s	user 0.003s	sys 0.000s
I20260709 13:06:20.038460 24851 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:20.401340 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:20.047438 24644 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:20.047693 24965 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.401552 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:20.372087 24855 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.403473 24353 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:20.403825 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:20.405876 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.406874 21900 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:20.397156 24931 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:20.410774 24931 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:20.410866 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.411238 24931 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:20.408138 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:20.408133 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.408917 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.412169 21829 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:20.409215 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.412137 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:20.413384 21905 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:20.038980 24885 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.367s
I20260709 13:06:20.058799 24926 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.404343 24970 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:20.092674 24808 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.415723 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:20.042775 24593 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.422963 21829 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:20.423928 21900 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:20.414777 24752 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:20.427584 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:20.428241 21900 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:20.058276 24962 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.418885 24963 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.056901 24949 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.419796 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:20.411986 24353 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.430356 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:20.433734 21905 raft_consensus.cc:2410] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:20.434520 24963 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.432956 24752 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.441244 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:20.432533 24967 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:20.411864 24933 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:06:20.051234 24886 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.410868 24855 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.418401 24969 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:20.435006 24353 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:20.489332 24784 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:20.434001 24970 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:20.486125 24963 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:20.487885 24949 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:20.444482 24866 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:20.413365 24965 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:20.489203 24971 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:06:20.490222 24808 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:20.489621 24926 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:20.492136 24880 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:20.519258 24784 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:20.539546 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1720) took 1047 ms. Trace:
I20260709 13:06:20.539865 24855 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:20.543664 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1715) took 1352 ms. Trace:
I20260709 13:06:20.544154 21906 rpcz_store.cc:276] 0709 13:06:19.191197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.191347 (+   150us) service_pool.cc:224] Handling call
0709 13:06:20.543398 (+1352051us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54002382d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:20.543588 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247291648}
I20260709 13:06:20.540014 21825 rpcz_store.cc:276] 0709 13:06:19.492242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.493300 (+  1058us) service_pool.cc:224] Handling call
0709 13:06:19.493568 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.493753 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:19.697725 (+203972us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.775554 (+ 77829us) log.cc:844] Serialized 14 byte log entry
0709 13:06:20.538986 (+763432us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b1800230e00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:06:20.539142 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.539199 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:20.539249 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.539327 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.539474 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4481,"prepare.queue_time_us":13106,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":14728,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2195,"spinlock_wait_cycles":43512960,"thread_start_us":269219,"threads_started":2,"wal-append.queue_time_us":146841}
I20260709 13:06:20.534392 24593 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:20.552155 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 756857us
I20260709 13:06:20.557113 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.557989 21982 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:20.555675 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.560058 21976 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
I20260709 13:06:20.561422 24752 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:20.560804 21980 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:20.549948 21906 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 13:06:20.567037 21906 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:20.582790 24672 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:20.546059 24855 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.585362 24855 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.586949 24636 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:20.587332 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.587533 24855 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:20.587719 24636 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:20.590624 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 716048us
I20260709 13:06:20.591030 24636 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:20.536633 24880 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.594498 24699 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:20.595146 22554 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:20.607924 24933 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.593525 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:20.609368 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 454) took 1056 ms. Trace:
I20260709 13:06:20.609819 22547 rpcz_store.cc:276] 0709 13:06:19.552757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.552914 (+   157us) service_pool.cc:224] Handling call
0709 13:06:19.590655 (+ 37741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:19.922050 (+331395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.609096 (+687046us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54004f79d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:20.609308 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760520576}
I20260709 13:06:20.611434 24672 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.611708 24949 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:06:20.612136 24672 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.613678 21906 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:20.595475 24593 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:20.614609 24593 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.616787 24593 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:20.595970 24830 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.617913 24830 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.596163 24906 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:20.620208 24906 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:20.596724 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1725) took 1373 ms. Trace:
I20260709 13:06:20.598320 24784 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.598093 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1725) took 1090 ms. Trace:
I20260709 13:06:20.622360 21832 rpcz_store.cc:276] 0709 13:06:19.507870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.508248 (+   378us) service_pool.cc:224] Handling call
0709 13:06:19.508508 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.717008 (+208500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.597841 (+880833us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540011dd54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:20.598028 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364872064}
I20260709 13:06:20.593650 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:20.600445 21908 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:20.621379 21909 rpcz_store.cc:276] 0709 13:06:19.223624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.225719 (+  2095us) service_pool.cc:224] Handling call
0709 13:06:20.596535 (+1370816us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002e81d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:20.596665 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561000320}
I20260709 13:06:20.624871 21909 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:20.626691 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:20.602989 24866 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.628707 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:20.602263 21903 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:20.605787 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1774) took 1486 ms. Trace:
I20260709 13:06:20.589949 24637 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:20.612627 24949 consensus_queue.cc:1243] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:20.573197 24353 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.632361 21799 leader_election.cc:400] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
I20260709 13:06:20.642709 21799 leader_election.cc:403] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:20.643991 21906 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:20.632972 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 217327us
I20260709 13:06:20.630944 21974 rpcz_store.cc:276] 0709 13:06:19.119279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.703850 (+584571us) service_pool.cc:224] Handling call
0709 13:06:19.704136 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.865876 (+161740us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:19.882950 (+ 17074us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.935231 (+ 52281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.935277 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:19.935319 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.605576 (+670257us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54002260d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:20.605621 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.605735 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17704,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":447,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":371523328,"thread_start_us":51935,"threads_started":1,"wal-append.queue_time_us":399527}
I20260709 13:06:20.646523 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.646868 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:20.648001 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.624423 24886 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:20.648464 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:20.628572 24689 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:20.630497 24699 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:20.653512 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.657335 21825 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:20.658128 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.659155 21825 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:20.653906 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:20.654844 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:20.653038 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:20.655772 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:20.660472 21829 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:20.671391 21829 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:20.635097 24830 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:20.675963 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:20.621112 24906 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.655485 24855 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:20.651006 24707 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:20.685348 21827 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:20.697160 24752 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:06:20.723353 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:20.679924 24689 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.724619 24880 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:20.725039 24903 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:20.651160 24672 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:20.679270 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:20.673032 24694 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:20.635116 24866 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.738452 24689 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.740317 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.742982 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.758795 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.759800 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.743237 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.745863 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.760789 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.761441 21983 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:20.761788 21976 raft_consensus.cc:2410] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:20.763219 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.747866 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.764005 21978 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:20.749235 21829 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:20.642877 24637 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.769555 24637 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:20.705694 24830 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.672478 24938 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:20.676882 24285 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:20.752089 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.786965 21980 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:20.755786 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.761790 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.789336 21974 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:20.705097 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1780) took 1238 ms. Trace:
I20260709 13:06:20.789830 21975 rpcz_store.cc:276] 0709 13:06:19.470908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.487575 (+ 16667us) service_pool.cc:224] Handling call
0709 13:06:20.704910 (+1217335us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54001f5c54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:20.705038 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403312384}
I20260709 13:06:20.791059 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.791975 21975 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:20.754271 24906 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:20.781697 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.802635 21976 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:20.649243 24778 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:20.794425 22552 raft_consensus.cc:2410] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:06:20.794560 21827 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:20.807444 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.812695 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:20.816994 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.799388 21978 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:20.824250 21829 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:20.825698 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:20.827044 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:20.753151 24880 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:06:20.829031 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:20.785281 24976 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:20.752557 24903 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.777628 21983 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:20.869354 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.803445 24656 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:20.788383 24967 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:06:20.834734 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.836484 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:20.837621 21829 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:20.877805 21980 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:20.842523 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 236638us
I20260709 13:06:20.771746 24931 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.880592 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1802) took 1131 ms. Trace:
I20260709 13:06:20.757840 24694 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.881132 21908 rpcz_store.cc:276] 0709 13:06:19.748913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.549714 (+800801us) service_pool.cc:224] Handling call
0709 13:06:20.600107 (+ 50393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.623698 (+ 23591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.880308 (+256610us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b54002e81d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:20.880486 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114906496}
I20260709 13:06:20.873327 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:20.792804 24830 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:20.899475 21983 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:20.903944 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:20.906389 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.794116 24938 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:20.908862 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.906569 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:20.912091 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 186940us
I20260709 13:06:20.872170 24976 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:20.917651 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:20.919121 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 81814us
I20260709 13:06:20.922206 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.923035 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:20.929455 21980 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:20.934762 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.935560 21829 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:20.935559 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:20.909509 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:20.915167 24353 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:20.954075 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.948040 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1732) took 1228 ms. Trace:
I20260709 13:06:20.948918 24696 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:20.952071 24975 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:06:20.952211 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:20.954952 21829 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:20.954716 21826 rpcz_store.cc:276] 0709 13:06:19.719184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.719800 (+   616us) service_pool.cc:224] Handling call
0709 13:06:19.720054 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.887052 (+166998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.947716 (+1060664us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540017e8d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:20.947967 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382692096}
I20260709 13:06:20.955920 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:20.961678 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:20.920825 24984 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:20.962426 21831 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:20.930622 22546 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:20.920703 24976 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:20.964107 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:20.964654 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.921645 24694 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:20.952783 24985 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:20.937834 24489 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:20.963809 24659 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:20.994501 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:20.994983 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:20.965173 24967 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:21.004189 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:21.003731 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:20.980283 24489 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:20.987280 24637 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:20.979640 24880 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:21.003080 24694 raft_consensus.cc:993] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
W20260709 13:06:21.010571 24942 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.698s	user 0.006s	sys 0.017s
I20260709 13:06:20.961220 24696 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.011664 24752 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:20.976598 24984 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.007462 24810 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.010342 24855 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.009887 24933 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:21.010373 24967 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:21.032224 24880 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:21.013691 24866 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.018911 24489 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.000718 24659 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.018368 24637 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:21.030941 24793 raft_consensus.cc:1081] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:20.980907 24985 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.029884 24689 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.032630 24752 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:21.015654 24977 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:06:21.099028 24994 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:21.104437 24696 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.109357 24977 consensus_queue.cc:1243] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:06:21.109926 24986 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:06:21.111713 24979 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:06:21.115407 24938 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.117308 24984 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.118956 24830 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:21.119535 24983 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:21.091315 24752 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.122195 24985 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.043533 24931 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.041714 24933 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.020046 24987 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:06:21.125049 24987 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:21.125546 24987 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:21.126087 24933 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.127235 24903 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.038501 24810 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.133190 24810 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.118999 24967 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.126739 24987 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.143755 24987 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.190485 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:21.203944 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.206144 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1796) took 1469 ms. Trace:
I20260709 13:06:21.208081 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.209136 21909 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:21.208689 21900 rpcz_store.cc:276] 0709 13:06:19.736383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.439384 (+703001us) service_pool.cc:224] Handling call
0709 13:06:20.442550 (+  3166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.442964 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.442990 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.451776 (+  8786us) log.cc:844] Serialized 26 byte log entry
0709 13:06:20.752309 (+300533us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:20.752351 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.752420 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.205359 (+452939us) raft_consensus.cc:1685] finished
0709 13:06:21.205400 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.205819 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11748,"raft.queue_time_us":87,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8053,"thread_start_us":233390,"threads_started":1,"wal-append.queue_time_us":499409}
I20260709 13:06:21.210858 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.212078 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.212466 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:21.213075 21900 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:21.213367 21909 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.204389 21830 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.215179 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.015353 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.220497 21904 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:21.222479 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1801) took 1474 ms. Trace:
I20260709 13:06:21.222990 21905 rpcz_store.cc:276] 0709 13:06:19.747987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.446311 (+698324us) service_pool.cc:224] Handling call
0709 13:06:20.453863 (+  7552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.494816 (+ 40953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.494865 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.517422 (+ 22557us) log.cc:844] Serialized 26 byte log entry
0709 13:06:20.803118 (+285696us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:20.828546 (+ 25428us) log.cc:844] Serialized 14 byte log entry
0709 13:06:20.828829 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.828894 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.221938 (+393044us) raft_consensus.cc:1685] finished
0709 13:06:21.222011 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.222283 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40524,"prepare.queue_time_us":25196,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":49108,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":17250,"thread_start_us":285338,"threads_started":1,"wal-append.queue_time_us":420717}
I20260709 13:06:21.227345 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1708) took 2368 ms. Trace:
I20260709 13:06:21.228713 21900 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:06:21.227813 21977 rpcz_store.cc:276] 0709 13:06:18.859229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.883917 (+ 24688us) service_pool.cc:224] Handling call
0709 13:06:18.884211 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:19.119220 (+235009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.119251 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:19.145548 (+ 26297us) log.cc:844] Serialized 26 byte log entry
0709 13:06:19.250749 (+105201us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:19.260006 (+  9257us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.260996 (+   990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.914799 (+653803us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540005afd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:19.914863 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:20.830675 (+915812us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:21.226741 (+396066us) raft_consensus.cc:1685] finished
0709 13:06:21.226784 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.227083 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12940,"prepare.queue_time_us":9903,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":3751,"raft.queue_time_us":22790,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":63863,"spinlock_wait_cycles":500244480,"thread_start_us":39727,"threads_started":1,"wal-append.queue_time_us":131469}
W20260709 13:06:21.235179 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.238940 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.239900 21904 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:21.241159 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.243052 21905 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:21.243713 21905 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:21.247174 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 410632us
I20260709 13:06:21.246567 21905 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.248564 21905 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.241993 21904 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:21.249413 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.250196 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:21.251567 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.031554 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 152203us
I20260709 13:06:21.254143 21830 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:21.280782 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:21.283679 21830 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.284175 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:21.286134 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:21.322466 21829 pending_rounds.cc:85] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 6
I20260709 13:06:21.322840 21829 pending_rounds.cc:107] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:06:21.323179 21829 raft_consensus.cc:2889] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:21.255750 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 298865us
I20260709 13:06:21.257201 22551 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:21.254518 21904 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:21.328009 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.286294 21827 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:21.331497 22521 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.333807 21831 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:21.280938 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:21.335466 21825 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.336592 21830 raft_consensus.cc:2410] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:21.339473 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:21.302140 21834 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:21.306452 24489 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.344373 24489 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.307540 21905 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:21.358355 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:21.359406 21909 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:21.359838 21906 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:21.362812 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.046382 24637 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.364185 24593 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:21.365535 21902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1728) took 2138 ms (client timeout 1782 ms). Trace:
W20260709 13:06:21.370030 21902 rpcz_store.cc:269] 0709 13:06:19.226491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.261795 (+ 35304us) service_pool.cc:224] Handling call
0709 13:06:21.364945 (+2103150us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54002f58d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:21.365167 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361578368}
I20260709 13:06:21.370275 24593 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.372753 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.375437 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.375717 24644 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:21.376890 24593 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.376976 24644 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.377590 24593 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.378347 24593 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.379163 22549 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:06:21.379616 22549 pending_rounds.cc:85] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 7
I20260709 13:06:21.379959 22549 pending_rounds.cc:107] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:06:21.380267 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:21.379626 24644 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.382401 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.383208 24644 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.383545 21908 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:21.383975 22549 raft_consensus.cc:2889] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:21.382409 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:21.385944 22548 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:21.386973 24593 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.389358 24637 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.392072 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.392375 24659 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.395504 24656 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:21.402701 24707 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.000s
I20260709 13:06:21.403554 24855 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.404404 24806 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:21.408524 24861 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.412724 24926 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:21.464391 24637 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.413594 24931 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:21.415445 24909 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:21.437954 21825 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
W20260709 13:06:21.439419 21797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.034s	sys 0.050s
W20260709 13:06:21.441537 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 110314us
I20260709 13:06:21.462936 21826 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
W20260709 13:06:21.463426 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 208656us
I20260709 13:06:21.466619 24905 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:21.481976 21797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.034s	sys 0.051s
I20260709 13:06:21.461493 24707 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
W20260709 13:06:21.466627 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 462622us
W20260709 13:06:21.442035 24988 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:06:21.460507 24656 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:21.474766 21799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.012s	sys 0.029s
I20260709 13:06:21.412842 24880 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.468016 24681 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:21.487473 21799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.012s	sys 0.029s
I20260709 13:06:21.477821 24593 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:21.500792 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.017s	sys 0.024s
W20260709 13:06:21.501220 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.017s	sys 0.024s
W20260709 13:06:21.502279 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 566757us
I20260709 13:06:21.503283 21798 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.505656 24659 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:21.506111 24659 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:21.505683 24905 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.506680 24659 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.506803 24905 consensus_queue.cc:1243] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:21.510288 24855 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.513504 24855 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:21.514694 24934 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:21.515412 24934 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.518288 24931 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.521102 24931 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:21.523671 24984 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.525628 22521 leader_election.cc:400] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10.
I20260709 13:06:21.525954 22521 leader_election.cc:403] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:21.526435 24909 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:21.527806 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.528563 24909 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10.
I20260709 13:06:21.137384 24976 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.529100 24861 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.529006 24984 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:21.531530 24976 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.531922 24985 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:21.533205 24985 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:21.533568 24985 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:06:21.535116 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 143252us
I20260709 13:06:21.536067 24984 consensus_queue.cc:1243] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:21.538614 21798 leader_election.cc:400] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
I20260709 13:06:21.539562 21798 leader_election.cc:403] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:06:21.544548 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.544796 24984 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:21.517999 24934 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.556818 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.551554 24984 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:21.493458 24926 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:21.578632 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 233086us
I20260709 13:06:21.535689 24985 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:21.581554 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 171931us
I20260709 13:06:21.572589 24637 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
W20260709 13:06:21.580127 24906 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.728s	user 0.003s	sys 0.009s
W20260709 13:06:21.602733 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 96676.9us
W20260709 13:06:21.584416 21979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.022s	sys 0.018s
I20260709 13:06:21.606204 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:21.588203 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.588802 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.589334 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.589516 24993 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.589819 25016 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:21.590142 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.590333 25013 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:21.590889 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46532.4us
I20260709 13:06:21.610958 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:21.613574 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.613638 22549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:06:21.614591 22549 raft_consensus.cc:606] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:21.615008 22549 raft_consensus.cc:614] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:21.616477 21903 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:21.591091 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.591704 24965 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:21.591984 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:21.592801 24636 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:21.595798 24926 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.608340 21905 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:21.573411 24855 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:21.605767 24659 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.576318 24905 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:06:21.661222 21902 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:21.648474 24855 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:21.663458 21909 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 2.
W20260709 13:06:21.669395 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.670789 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50866.4us
W20260709 13:06:21.672665 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 91986.8us
I20260709 13:06:21.674917 21826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:21.675540 21826 raft_consensus.cc:606] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:21.675472 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:21.676106 21826 raft_consensus.cc:614] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:21.676716 24593 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:21.676815 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:21.675386 22552 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:21.682760 21832 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
W20260709 13:06:21.683264 24752 consensus_meta.cc:287] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.003s
I20260709 13:06:21.683360 21978 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:21.684433 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.684053 24752 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.686508 24752 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.686676 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.687464 21975 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:21.688247 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.688855 21982 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:21.668833 24855 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.689664 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:21.697707 24637 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:21.698177 24637 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:21.698658 22551 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:21.690483 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.699266 24637 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.700774 24637 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:21.701177 25013 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.702838 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:21.703626 21909 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:21.705790 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 308) took 2258 ms. Trace:
I20260709 13:06:21.706210 21907 rpcz_store.cc:276] 0709 13:06:19.412046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.441434 (+ 29388us) service_pool.cc:224] Handling call
0709 13:06:19.441684 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:19.461754 (+ 20070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.461779 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:19.462317 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:06:19.527556 (+ 65239us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b180039e920. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:06:19.739045 (+211489us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:19.739288 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.748506 (+  9218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.748597 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.900684 (+152087us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b180039e920. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb762eb258f 00007fb75bef1571 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd
0709 13:06:19.936639 (+ 35955us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180039e920. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb762eb258f 00007fb75bef1571 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd
0709 13:06:21.543715 (+1607076us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b180039e920. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:21.663265 (+119550us) raft_consensus.cc:1685] finished
0709 13:06:21.663286 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.669930 (+  6644us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63076,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":3880,"raft.queue_time_us":30221,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":9073,"spinlock_wait_cycles":21537664,"thread_start_us":211322,"threads_started":1,"wal-append.queue_time_us":301326}
W20260709 13:06:21.708842 24987 consensus_meta.cc:287] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.000s
W20260709 13:06:21.694546 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 81136.3us
I20260709 13:06:21.693167 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:21.720813 22548 raft_consensus.cc:2410] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:21.718794 24656 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.692030 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:21.695358 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:21.723169 24656 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.695240 24984 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.692382 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:21.730054 22547 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:21.729971 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:21.730543 24841 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:21.731421 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:21.731773 24841 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:21.694828 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:21.736939 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.724745 24984 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.739542 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:21.745563 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 97661.1us
I20260709 13:06:21.748261 21979 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:21.750960 21977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:06:21.696156 24967 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.755116 21977 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:21.759198 21977 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:21.734727 24593 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:21.751649 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.764411 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 438) took 1694 ms. Trace:
W20260709 13:06:21.764977 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.764671 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.770558 21901 raft_consensus.cc:2410] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:06:21.771570 25018 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:21.772123 25018 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.772583 25018 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.774467 24808 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:21.774852 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.775794 24784 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:21.776049 24933 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:06:21.782824 21825 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:21.782802 21826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:21.783560 21826 raft_consensus.cc:606] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.783923 21826 raft_consensus.cc:614] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:21.784175 21830 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:21.784766 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.785548 21828 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:21.752357 24841 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:21.790242 24656 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.790566 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:21.790745 24656 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.791813 24905 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:21.792366 24905 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:21.792695 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.793349 24905 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.793915 24906 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.793004 24656 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.796540 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:21.796890 25019 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.797574 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.797750 25019 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:21.796433 24593 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:21.804621 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 127967us
I20260709 13:06:21.803668 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:21.805285 21977 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:21.831672 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.834301 21977 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:21.836527 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.836835 24841 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.838446 24974 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:21.839450 24974 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.840408 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.764823 22555 rpcz_store.cc:276] 0709 13:06:19.954456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.954640 (+   184us) service_pool.cc:224] Handling call
0709 13:06:19.955005 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.955256 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:20.386517 (+431261us) log.cc:844] Serialized 14 byte log entry
0709 13:06:20.386884 (+   367us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.343073 (+956189us) spinlock_profiling.cc:243] Waited 987 us on lock 0x7b180004e280. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75eb94d70 00007fb75eb88293 00007fb75eb7dcea 00007fb75eb7e23a 00007fb75efe8a2a 00007fb75eff80bf 00007fb75eff8038
0709 13:06:21.565762 (+222689us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.566920 (+  1158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.567571 (+   651us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:21.575207 (+  7636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.581804 (+  6597us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.648910 (+ 67106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46352,"prepare.queue_time_us":659163,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":125,"raft.queue_time_us":100939,"raft.run_cpu_time_us":550,"raft.run_wall_time_us":27711,"spinlock_wait_cycles":2269440,"thread_start_us":219396,"threads_started":2}
I20260709 13:06:21.842284 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.843004 21982 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:21.843508 24875 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:21.803664 25018 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.844151 24875 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.845096 21825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff74442193fb468c966c8842f014e361"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:21.845707 21825 raft_consensus.cc:606] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:21.846077 21825 raft_consensus.cc:614] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:21.846429 24977 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:21.847026 25018 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:21.847007 24977 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.848708 25018 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.849351 24977 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.849220 25018 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.851056 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.852236 24934 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:21.852660 25018 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:21.854200 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:21.855613 21831 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:21.856770 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.857191 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.857538 21830 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 2.
I20260709 13:06:21.857946 21826 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:21.858759 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.832239 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.859228 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.859784 21831 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:21.860004 21827 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:21.860349 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.860745 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.861066 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:21.861395 21873 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:21.862928 21828 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:21.864154 24934 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:21.864780 24934 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:21.866304 24933 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.867287 24933 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.871572 24969 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.872448 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.876720 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.876847 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:21.877519 21831 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:21.877624 21833 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:21.866019 24934 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.880560 21833 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:21.878371 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.881659 21833 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:21.882241 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 121175us
I20260709 13:06:21.879189 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.882908 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.883236 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.884186 24644 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.884696 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:21.885527 24644 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:21.886106 24644 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:21.886313 21978 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:21.887194 24644 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.889122 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:21.889777 21982 raft_consensus.cc:2368] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
I20260709 13:06:21.869925 24933 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:21.891149 21980 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:21.891695 24875 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:21.891865 24985 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.801851 25019 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:21.881701 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 83787.2us
I20260709 13:06:21.801783 24808 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:21.895565 21979 pending_rounds.cc:85] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 3
I20260709 13:06:21.902506 21979 pending_rounds.cc:107] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:21.902916 21979 raft_consensus.cc:2889] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:21.860986 21834 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:21.905925 24659 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.841850 24974 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:21.893193 24946 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:21.906616 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.883239 21833 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:21.908464 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 82013.4us
I20260709 13:06:21.910017 21975 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:21.919837 21974 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:21.925257 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:21.926352 21834 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.927320 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:21.930356 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.907038 25019 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.928185 21981 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:21.935755 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:21.939638 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.944504 24681 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:21.939194 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:21.945291 24681 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.945478 22548 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:21.945649 21825 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:21.945791 25003 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:21.945497 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.950153 21874 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:21.943827 24699 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:06:21.943650 24808 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.929845 24974 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:06:21.953902 24974 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:21.950488 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.954291 24974 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:21.955065 24977 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:21.950697 24656 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.955461 24974 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.956871 24977 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.957235 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.957304 25002 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:21.957979 24977 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:21.958441 25002 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:21.958791 24946 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:21.959076 25002 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:21.958495 24977 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:21.960098 25002 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.960959 24977 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.951149 24926 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:21.958513 24353 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:21.965219 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:21.966136 24906 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:21.966251 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:21.966663 24906 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:21.967358 24906 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.968734 24637 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:21.969132 24637 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:21.969239 21901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1798) took 2232 ms (client timeout 2111 ms). Trace:
I20260709 13:06:21.969542 24637 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:21.969699 21901 rpcz_store.cc:269] 0709 13:06:19.736841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.942975 (+206134us) service_pool.cc:224] Handling call
0709 13:06:21.969006 (+2026031us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54002e6dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:21.969151 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4021187456}
I20260709 13:06:21.966280 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:21.971642 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1711) took 1319 ms. Trace:
I20260709 13:06:21.971691 24353 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:21.972255 24353 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.972148 21832 rpcz_store.cc:276] 0709 13:06:20.652238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.652707 (+   469us) service_pool.cc:224] Handling call
0709 13:06:21.971433 (+1318726us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540011ec54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:21.971577 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946346368}
I20260709 13:06:21.972757 24353 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.961453 25002 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.949249 24681 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:21.870015 24855 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.975962 21830 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:21.977411 24855 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:21.977403 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 70878.3us
I20260709 13:06:21.979326 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:21.980134 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:21.980933 24637 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:21.982460 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:21.982986 25013 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:21.983392 24977 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.984336 24993 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:21.984701 24993 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:21.985750 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:21.985654 24993 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:21.986375 24699 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:21.986807 24699 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:21.986804 24993 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.987239 24699 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.987031 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:21.988776 24926 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:21.989172 24926 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:21.989542 24962 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.989459 25003 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.989845 24875 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:21.991176 24926 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.991602 24963 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:21.992012 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:21.994894 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:21.998612 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 48549.3us
W20260709 13:06:21.983016 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.957041 24974 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:22.016469 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.010113 21834 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:22.025843 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:21.915221 24659 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:06:21.992018 24963 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:22.035207 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 55828.4us
I20260709 13:06:22.030730 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:22.041705 21826 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:22.042184 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:22.025987 24946 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:22.044164 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 105783us
I20260709 13:06:22.047911 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:22.048452 24780 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:22.048882 24780 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.049173 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:22.050534 24681 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:22.050282 24963 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.050935 21731 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.051707 24963 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:22.052793 21731 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 7, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 7 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.053630 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.054134 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.054265 21907 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:22.055476 21900 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:22.047075 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:22.051751 24949 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:22.058753 24949 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:22.059234 24949 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.059636 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.060938 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.061579 21909 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:22.062582 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.063434 21905 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:22.064263 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.065024 21908 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:22.035673 24707 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:22.064728 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:22.066896 24707 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.067332 24707 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:22.069621 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.035382 24933 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:22.101761 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:22.102568 24962 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:22.102240 24933 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.076892 24793 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:22.103571 24793 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.104064 24793 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.105579 24933 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:22.070672 24659 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:22.106433 24659 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:22.107601 24659 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.109035 24659 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.076375 21975 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:22.080780 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:22.086143 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:22.086259 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.088469 25019 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.049219 24780 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.098780 24637 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.099045 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:22.099900 24984 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:22.100004 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:22.063938 25003 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.100991 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:22.102972 24962 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:22.103505 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:22.084715 24353 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.078404 24926 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.070850 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:22.121106 25002 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:22.132604 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 46479.7us
I20260709 13:06:22.086229 21731 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 8, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 8 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:22.170662 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 99869.5us
I20260709 13:06:22.128546 24637 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:22.174578 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.136010 24962 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:22.109674 24906 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.199210 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.169452 24933 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:22.204012 21978 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:22.168242 24977 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.165387 25002 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:22.202798 21731 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 3 to 8, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 8 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.178741 24967 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:22.226121 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 51658.6us
I20260709 13:06:22.218789 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:22.232030 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 178823us
I20260709 13:06:22.232573 21975 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:22.196532 24808 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:22.169224 25003 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.221433 25002 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.253185 21976 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:22.254338 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 83947.7us
I20260709 13:06:22.170519 24984 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.220271 25018 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:22.248924 21731 catalog_manager.cc:5697] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 2 to 4, term changed from 3 to 6, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to <none>, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:22.231101 24681 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:22.209909 24656 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:06:22.281289 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:22.244045 24637 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:22.273264 24967 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:22.221374 24977 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.283361 22553 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:22.291088 24974 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:22.291220 24905 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:22.291929 24905 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:22.291664 24974 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.293751 24974 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:22.294705 25035 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:06:22.296643 25032 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:22.303714 25003 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.304963 24353 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:22.306692 24681 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.307907 24984 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.309144 24926 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:22.311456 25019 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:22.279541 24808 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.317543 24808 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:22.319190 22548 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:22.319921 24977 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:22.289291 24949 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.322796 24949 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.326604 24967 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.332439 24977 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:22.333051 24977 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:22.334048 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 81887.4us
I20260709 13:06:22.334836 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:22.335115 24977 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:22.335690 24977 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:22.336053 24977 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.336745 24977 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.336728 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.270756 24987 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:06:22.337980 24987 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:22.338352 24987 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:22.339502 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:22.339191 24987 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.340394 24987 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.342751 24784 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:22.348816 21982 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:22.349905 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:22.350253 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:22.358033 21978 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:22.315256 24906 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.356323 21833 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:22.363533 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:22.375231 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:22.376166 21829 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.378558 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:22.379518 21975 raft_consensus.cc:2410] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:06:22.380393 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:22.381021 21834 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:22.381778 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:22.382702 24699 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.383464 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:22.345896 25018 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:06:22.343180 24784 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:22.372709 24636 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.350435 24880 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:22.384491 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:22.385262 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:22.385970 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:22.415668 21975 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:22.387593 24707 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.388168 24987 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:22.389539 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:22.390417 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:22.391185 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.391254 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:22.398712 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:22.378472 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:22.432504 21977 raft_consensus.cc:2368] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:22.399317 24353 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:22.376452 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:22.375751 21731 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 6 to 7, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 7 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:22.412201 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:22.375311 21831 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.435513 21826 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:22.426834 21834 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:22.433012 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.419486 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 361407us
I20260709 13:06:22.376982 24806 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:22.411494 24784 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.438118 22550 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
W20260709 13:06:22.441663 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 50537.6us
I20260709 13:06:22.416917 24963 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:22.461866 24984 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:22.462451 24984 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:06:22.465952 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53850.4us
W20260709 13:06:22.442356 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 377714us
I20260709 13:06:22.442497 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:22.444527 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:22.475463 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.444285 24806 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.444162 21731 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 6, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 6 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.444303 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:22.377243 24985 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:06:22.491851 22546 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:22.492100 22549 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:22.493680 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 51278.8us
I20260709 13:06:22.440342 22548 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.495988 21831 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:22.496546 21826 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:22.497474 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:22.500396 21977 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
W20260709 13:06:22.498000 21732 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33528 (request call id 222) took 28459 ms (client timeout 15000 ms). Trace:
W20260709 13:06:22.506276 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.485280 24969 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:22.512007 24969 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.512346 24969 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:22.512902 24780 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.485522 24963 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:22.519047 24793 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.520700 25019 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:22.521088 25019 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:22.521445 25019 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:22.498500 21731 catalog_manager.cc:5697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.483762 24880 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:22.463711 24707 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.518931 24963 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.526487 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.533227 21909 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:22.475029 24636 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.530633 21731 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 9, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 9 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:06:22.537864 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.539189 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.539750 21906 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.535132 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.541090 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.541800 21909 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:22.550372 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53337.6us
I20260709 13:06:22.544018 21731 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.557039 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.557821 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.558422 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.561738 24780 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:22.565461 24780 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:22.567922 21906 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:22.532632 24987 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:22.530066 24841 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:22.565986 24780 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.575163 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.580156 21904 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:22.582197 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.582926 21905 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.580535 21731 catalog_manager.cc:5697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 5, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 5 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:22.540403 24880 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:22.600298 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:22.601958 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.525141 24962 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.608886 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:22.610038 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.605927 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:22.611435 21831 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:22.613777 21731 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.616777 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:22.617750 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 417871us
I20260709 13:06:22.577639 24987 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:22.618063 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.634876 21826 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:22.623853 21731 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:22.645362 21909 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:22.649827 24636 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.650439 21904 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:22.625326 24993 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:22.653324 21798 leader_election.cc:400] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
I20260709 13:06:22.660236 21798 leader_election.cc:403] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:06:22.656245 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.667690 21905 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:22.668919 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.626139 24793 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.673727 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.671766 21731 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 3 to 7, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 7 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:22.677832 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 396624us
I20260709 13:06:22.678220 21975 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:22.679175 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.679695 21904 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:22.681496 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.683733 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:22.684101 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.685832 21905 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.670989 24699 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:22.671540 24993 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:22.695304 21829 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:22.696456 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:22.698660 24967 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:22.699513 24967 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:22.700105 24967 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:22.678470 24636 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9.
I20260709 13:06:22.693171 21731 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 8, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 8 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.650900 24353 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:06:22.690843 24659 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.004s
W20260709 13:06:22.694730 25036 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:06:22.701294 24967 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.713455 24778 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:22.714102 24778 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:22.715173 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.715128 24778 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.716060 21901 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:22.717566 21901 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:22.678959 24855 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:22.716136 25010 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:22.712906 21731 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 6, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 6 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:22.721979 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:22.704190 24993 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:22.724661 21798 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:22.705464 24707 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:22.730010 24962 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:22.501434 21732 rpcz_store.cc:269] 0709 13:05:53.914691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.918063 (+  3372us) service_pool.cc:224] Handling call
0709 13:05:54.076654 (+158591us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b540037bed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef48090 00007fb75efe6f3a 00007fb764d9d1cc 00007fb764e9b37e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc 00007fb76335b392 00007fb75d31948c 00007fb75d3188c6
0709 13:06:22.359098 (+28282444us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:17.427105 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:17.464967 (+ 37862us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:17.465004 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:06:17.465023 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:17.496762 (+ 31739us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:17.496830 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:17.496865 (+    35us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:17.504218 (+  7353us) tablet.cc:701] Row locks acquired
0709 13:06:17.504240 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:06:17.504393 (+   153us) write_op.cc:270] Start()
0709 13:06:17.504525 (+   132us) write_op.cc:276] Timestamp: P: 1783602377504344 usec, L: 0
0709 13:06:17.504543 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:06:17.505282 (+   739us) log.cc:844] Serialized 4403 byte log entry
0709 13:06:18.122378 (+617096us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:18.712904 (+590526us) op_driver.cc:464] REPLICATION: finished
0709 13:06:19.007446 (+294542us) write_op.cc:301] APPLY: starting
0709 13:06:19.018816 (+ 11370us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:19.110939 (+ 92123us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:19.114859 (+  3920us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:19.304722 (+189863us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:19.304975 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:06:19.305022 (+    47us) write_op.cc:312] APPLY: finished
0709 13:06:19.305325 (+   303us) log.cc:844] Serialized 83 byte log entry
0709 13:06:19.305501 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.305655 (+   154us) write_op.cc:454] Released schema lock
0709 13:06:19.305713 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:19.306119 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.306156 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1255,"reported_tablets":41,"spinlock_wait_cycles":45448064,"child_traces":[["op",{"apply.queue_time_us":234509,"apply.run_cpu_time_us":4475,"apply.run_wall_time_us":349318,"num_ops":11,"prepare.queue_time_us":313883,"prepare.run_cpu_time_us":48429,"prepare.run_wall_time_us":411157,"raft.queue_time_us":453667,"raft.run_cpu_time_us":15122,"raft.run_wall_time_us":179423,"replication_time_us":1208206,"spinlock_wait_cycles":7360896,"thread_start_us":870836,"threads_started":4,"wal-append.queue_time_us":526658,"wal-append.run_cpu_time_us":19193,"wal-append.run_wall_time_us":2275100}]]}
I20260709 13:06:22.702664 24985 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:06:22.742321 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.743273 21901 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:22.706933 24906 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:22.745622 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:22.745707 21731 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.735085 21905 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:22.733960 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:22.739624 24659 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:22.734073 21799 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:22.733206 24806 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.709021 25002 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.751350 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.739480 24707 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:22.705427 24987 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:22.750123 25040 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:06:22.763015 21901 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:22.764494 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:22.773787 21982 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.754343 21731 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 6, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 6 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:22.767889 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:22.769451 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:22.782136 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 48243.9us
I20260709 13:06:22.783654 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:22.776427 21731 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.787973 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:22.782747 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:22.789529 21977 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.753451 24780 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:22.754886 24659 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.791052 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:22.770931 24707 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:22.718571 24880 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:22.793313 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 59350.2us
W20260709 13:06:22.822213 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 220363us
W20260709 13:06:22.835413 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51875.8us
I20260709 13:06:22.836355 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:22.821620 21981 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.773041 24806 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:22.781396 24793 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:22.783069 24985 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.796416 24644 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:06:22.842366 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:22.842458 24974 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:22.822104 24659 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.787340 24977 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.850926 21825 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:22.862418 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 16eb6999a3524d59835c31e2b76d09da: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:22.854524 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:22.859108 22520 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:22.859790 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 108483us
I20260709 13:06:22.940026 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:22.869071 21981 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:22.840137 21904 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:22.854969 21831 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:22.882355 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.942433 21906 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.856047 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:22.882015 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.943724 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:22.943961 21908 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.880029 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:22.885842 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 189450us
I20260709 13:06:22.881682 21905 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:22.857659 21834 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:22.936152 21983 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:22.838148 25046 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:22.937608 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.858387 24875 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:22.855432 24933 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:22.971163 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 112165us
W20260709 13:06:22.929466 25040 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:06:22.936525 21977 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:22.867013 24699 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:22.897977 25047 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.856276 25010 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:22.950868 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:22.855532 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:22.949807 24353 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.873234 25045 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:22.896979 25042 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:22.937043 24987 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.976094 21978 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:06:22.874455 24806 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:22.933022 24974 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:23.044237 24974 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:22.979496 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.839059 25003 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:22.855530 24681 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:06:22.982471 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:22.932437 24969 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.989461 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:06:23.056607 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 116650us
W20260709 13:06:22.965322 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.942014 24780 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:23.013727 21982 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:22.958622 24875 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:22.971010 24933 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:23.024456 25045 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:22.882884 24984 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:23.013937 22546 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:23.034861 25002 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:23.041481 22548 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.004s
I20260709 13:06:23.042331 25042 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:22.981616 25010 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:22.941962 24985 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:22.991959 25047 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.047171 25003 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.057736 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.067083 24933 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:23.084617 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:22.975610 24699 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:23.048740 25040 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:23.068234 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.046033 24974 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:23.054242 24806 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:23.071297 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 88904us
I20260709 13:06:23.060714 24855 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:23.055094 21906 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:23.068397 24644 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:22.983186 25046 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:23.069677 25045 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:23.088536 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.093866 21903 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:23.106294 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:23.071079 22548 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:23.089141 24880 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:23.105768 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:23.084192 24984 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:23.088943 24934 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:23.101572 25055 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:23.071388 24780 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.123922 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:23.128579 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.136840 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 68667.1us
I20260709 13:06:23.137601 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:23.138428 24962 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:23.142124 24841 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:23.142516 24977 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:23.143131 24977 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.143225 25053 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:23.143658 24977 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.144781 25053 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:23.145356 25053 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.133019 24967 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:23.148764 25010 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:23.149999 25010 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:23.135010 24808 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:23.102073 25057 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:23.160115 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54429.5us
I20260709 13:06:23.145912 24977 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:23.193881 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:23.124387 24905 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:23.129237 24926 raft_consensus.cc:2764] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:23.134613 25055 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:06:23.197932 24784 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.008s
W20260709 13:06:23.213176 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 75646.5us
I20260709 13:06:23.223280 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.212405 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:23.219431 21909 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:23.195439 24644 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.211700 25060 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:06:23.211474 25067 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:06:23.243083 21834 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:23.245941 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:23.105607 24875 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.251748 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:23.215752 24808 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.219079 25055 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:23.252266 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.252755 21830 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:06:23.251222 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:23.260115 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.263731 21828 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:23.269740 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:23.269932 21827 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:23.271613 21825 raft_consensus.cc:2368] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
W20260709 13:06:23.270605 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47436.9us
I20260709 13:06:23.270080 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:23.279004 21826 raft_consensus.cc:2376] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9. Re-sending same reply.
I20260709 13:06:23.280153 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.281047 21831 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:23.285440 24793 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:23.286010 24793 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.252499 24644 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.286866 21828 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:23.287899 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.288064 24793 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:23.289544 21828 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:23.295310 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 68491.4us
I20260709 13:06:23.291195 24707 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:23.291432 25002 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:23.293550 24841 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:23.297236 21832 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:23.297396 24707 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:23.245604 24637 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.294557 21826 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:23.242991 24977 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:23.290653 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:23.310994 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:23.314796 21798 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.317561 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:23.318207 21831 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:23.232393 24784 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:23.280278 25068 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:23.318075 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.296962 24841 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:23.331310 21981 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:23.334189 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:23.338668 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:23.342211 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 129887us
I20260709 13:06:23.342487 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:23.342650 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:23.340973 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:23.343091 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:23.344540 21873 leader_election.cc:400] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:23.345067 21873 leader_election.cc:403] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:23.294427 24875 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.344560 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.346362 21974 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:23.328351 24963 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.344728 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:23.351058 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.352263 21828 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:23.353055 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:23.349886 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:23.354806 21907 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:23.356925 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 383399us
I20260709 13:06:23.359534 25066 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:23.360044 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.325373 24707 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:23.362989 21826 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:23.364145 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.325089 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:23.364701 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:23.334318 24985 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:06:23.373184 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:23.372121 21825 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:23.391175 21975 raft_consensus.cc:2368] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:23.341979 25050 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.396417 24659 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.397703 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:23.402137 21978 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:23.354084 24681 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:23.362615 24905 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:23.360340 24636 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:23.398716 21976 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:23.400528 22555 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:23.400657 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:23.386389 25065 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:23.422912 21827 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:23.424423 21831 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:23.368518 25003 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:23.427188 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.432052 21979 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:23.349327 24637 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:23.415385 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:23.440653 21834 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:23.415670 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:23.325799 24880 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:06:23.360042 25066 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.365036 24656 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:23.327010 24977 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:23.394503 25042 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:23.459290 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 6bde6ac1d042400fbc88831c01b9fdda: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:23.435197 21976 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:06:23.434935 25061 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
I20260709 13:06:23.438829 22549 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:06:23.414887 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51235.3us
I20260709 13:06:23.361476 24967 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:06:23.261066 25046 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.452212 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.348125 24963 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:23.467263 25043 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:23.468631 24784 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:23.475739 21908 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
I20260709 13:06:23.512913 21908 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:23.485116 21979 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:23.428239 22546 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:23.423810 25068 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:06:23.450232 25050 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.515076 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 87987.4us
I20260709 13:06:23.515982 22547 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:06:23.450125 25066 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:23.511083 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 58960.9us
I20260709 13:06:23.531844 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.483763 24780 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:23.471151 25045 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:23.511097 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51506.2us
I20260709 13:06:23.538965 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:23.531303 22547 pending_rounds.cc:85] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 6
I20260709 13:06:23.484027 24707 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:23.512378 24593 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:23.509881 25043 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:23.517093 24841 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:23.549340 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:23.506111 24636 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.516731 25065 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:23.513996 25053 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:23.537048 21874 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:23.538000 24784 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:23.524026 21978 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:23.541939 22547 pending_rounds.cc:107] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:06:23.508832 25078 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:06:23.516400 25010 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:06:23.547859 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:23.572239 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:23.550684 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:23.547434 25056 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:06:23.565860 25069 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:06:23.564903 25093 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.565357 25076 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:06:23.564905 25065 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.550189 21976 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:23.575096 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:23.575384 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 43662.2us
I20260709 13:06:23.549436 24841 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:23.552021 25019 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.030s	user 0.014s	sys 0.000s
I20260709 13:06:23.586546 21901 raft_consensus.cc:2410] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:23.590099 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:23.590830 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:23.547145 24593 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:23.550823 25043 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:23.593732 25063 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:06:23.594436 25086 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.599404 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:23.603575 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:23.621193 24841 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:23.614063 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.615886 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.613940 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:23.570485 24880 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:23.620857 21909 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:23.570214 24780 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:23.570010 22547 raft_consensus.cc:2889] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:23.631331 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:23.526139 25050 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.708878 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:23.624338 21834 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:06:23.632503 21975 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:23.598589 25097 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.633940 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:23.547245 25082 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:23.638077 24784 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:23.646736 21873 leader_election.cc:400] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:23.721263 21873 leader_election.cc:403] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:06:23.721766 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 75248.2us
I20260709 13:06:23.576514 21826 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:23.570392 24967 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:06:23.651085 24963 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:23.653206 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:23.660471 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:23.673926 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 101804us
I20260709 13:06:23.586799 24636 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.673523 25042 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:23.704545 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:23.635444 25002 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:23.705435 21907 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:23.652395 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:23.614500 25093 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:23.736084 25091 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:06:23.673810 25053 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.743208 25053 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.745627 25053 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:23.619807 25068 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:06:23.747025 24636 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:23.748015 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:23.748824 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:23.635556 24905 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:23.632514 25019 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:23.728231 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:23.741981 24974 consensus_meta.cc:287] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.645s	user 0.003s	sys 0.004s
I20260709 13:06:23.704423 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:23.756510 21831 raft_consensus.cc:2410] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:06:23.748701 21901 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:23.699484 24880 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:23.718027 24780 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:23.752952 24993 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.005s	user 0.013s	sys 0.000s
I20260709 13:06:23.792366 21875 leader_election.cc:400] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:23.718307 25100 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:23.805469 21980 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:23.643911 24707 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:23.782809 25055 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.003s
I20260709 13:06:23.727744 24946 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:23.738054 25093 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:23.794095 24880 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:23.764775 24963 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:06:23.784126 24875 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.938551 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 113415us
I20260709 13:06:23.748342 24681 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:06:23.819219 21908 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:23.678236 25086 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:23.829367 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 106349us
I20260709 13:06:23.822690 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1830) took 1289 ms. Trace:
I20260709 13:06:23.763584 24784 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.939673 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:23.965512 21900 rpcz_store.cc:276] 0709 13:06:22.526656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.533142 (+  6486us) service_pool.cc:224] Handling call
0709 13:06:22.556294 (+ 23152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.569515 (+ 13221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.569557 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.870724 (+301167us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b2c00010828. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:06:22.871161 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.075365 (+204204us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:23.075426 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.075523 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.789546 (+714023us) raft_consensus.cc:1685] finished
0709 13:06:23.789576 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.816064 (+ 26488us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5853,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":9427328,"thread_start_us":203732,"threads_started":1,"wal-append.queue_time_us":230324}
I20260709 13:06:23.831326 25045 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:23.994681 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 55125.4us
I20260709 13:06:23.995302 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:23.995597 21875 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:23.818584 24993 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:23.997390 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.996698 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:24.011137 21834 raft_consensus.cc:606] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:24.011548 21834 raft_consensus.cc:614] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:23.771173 24593 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.818902 25090 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.405s
I20260709 13:06:24.013041 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:24.017840 25062 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:06:24.017761 25087 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 13:06:23.981860 25100 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:06:23.828274 25055 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:24.028842 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.031272 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:24.037863 22554 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:24.010054 25069 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:23.952889 24875 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:23.832145 24699 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:24.046056 21799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.004s
W20260709 13:06:24.042253 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76928.9us
W20260709 13:06:24.044667 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.054394 21799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.017s	sys 0.004s
W20260709 13:06:24.055151 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 517854us
I20260709 13:06:24.055666 21977 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:24.058544 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:24.059083 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.059095 21905 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.061640 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.062217 21901 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:24.020078 24974 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:24.069962 21905 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:24.014124 24855 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:24.041855 25083 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:24.041692 25082 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.038818 25018 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:24.097048 25018 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.097440 25018 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:24.098042 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.038002 24707 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:24.072465 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
W20260709 13:06:24.086692 22548 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.000s
I20260709 13:06:24.086807 25069 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.081648 24699 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.088158 24985 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:24.089389 25092 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.409s	user 0.001s	sys 0.000s
W20260709 13:06:24.090158 25108 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:06:24.092303 25050 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.093066 24841 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.083473 25053 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:24.086095 25019 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:24.095278 24933 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.997s	user 0.008s	sys 0.005s
I20260709 13:06:24.096446 25086 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.103440 21829 raft_consensus.cc:606] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:24.020179 24780 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.066584 24946 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:24.041929 25084 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:24.077651 24593 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.997921 24905 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.042362 25100 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:06:24.083592 24855 consensus_queue.cc:1243] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:24.081605 25120 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.115726 24906 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:24.054778 24963 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.111049 24707 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.119529 25107 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:24.110575 24806 consensus_meta.cc:287] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.008s	user 0.011s	sys 0.000s
I20260709 13:06:24.113368 24985 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.122943 24934 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:24.124644 24644 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.125787 25047 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:24.117599 25085 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 13:06:24.129194 25086 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:24.120554 24933 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.136299 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:24.082007 24949 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:24.105535 22548 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:24.313642 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:24.118177 21829 raft_consensus.cc:614] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:24.128492 24946 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:24.111153 25069 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:24.204499 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 208972us
I20260709 13:06:24.201359 25100 consensus_queue.cc:1243] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:24.205428 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:24.237886 22550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.012s	sys 0.012s
W20260709 13:06:24.248898 21982 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.020s	sys 0.057s
W20260709 13:06:24.309902 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 173659us
W20260709 13:06:24.202826 25108 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:24.199667 21979 raft_consensus.cc:2368] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10.
I20260709 13:06:24.197580 24993 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:24.247040 25078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.002s	sys 0.021s
I20260709 13:06:24.209533 25082 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:24.205606 24784 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.235451 25042 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:24.307807 24934 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:24.320803 21982 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.030s	sys 0.075s
W20260709 13:06:24.316917 24984 consensus_meta.cc:287] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.187s	user 0.015s	sys 0.004s
I20260709 13:06:24.320667 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:24.341387 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:24.338842 22550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.019s	sys 0.037s
I20260709 13:06:24.315724 25050 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:24.345724 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 545) took 1079 ms. Trace:
I20260709 13:06:24.230611 24906 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:24.336159 25078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.002s	sys 0.022s
I20260709 13:06:24.318892 25124 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:24.311290 24806 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.336711 25055 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.333925 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 544) took 1053 ms. Trace:
I20260709 13:06:24.337240 25077 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:24.348066 24987 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.315s	user 0.007s	sys 0.005s
I20260709 13:06:24.352434 25114 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 13:06:24.340453 25041 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:24.317471 25086 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:24.344347 25010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.012s	sys 0.026s
I20260709 13:06:24.356599 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1782) took 1138 ms. Trace:
I20260709 13:06:24.346231 22550 rpcz_store.cc:276] 0709 13:06:23.266278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.266420 (+   142us) service_pool.cc:224] Handling call
0709 13:06:23.281670 (+ 15250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.335042 (+ 53372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.335105 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.335573 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.495142 (+159569us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:23.626583 (+131441us) log.cc:844] Serialized 14 byte log entry
0709 13:06:24.345422 (+718839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.345510 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.345549 (+    39us) raft_consensus.cc:1685] finished
0709 13:06:24.345562 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.345676 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4426,"prepare.queue_time_us":231933,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":465532,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":161,"thread_start_us":991975,"threads_started":4,"wal-append.queue_time_us":135034}
I20260709 13:06:24.346246 25090 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:24.316541 24963 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.346452 25050 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.350713 24993 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.236526 25120 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.345839 25083 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:24.376214 25130 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:24.371421 25066 consensus_meta.cc:287] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.829s	user 0.010s	sys 0.001s
W20260709 13:06:24.381500 24353 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.368s	user 0.008s	sys 0.004s
I20260709 13:06:24.363020 25077 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:24.375272 25116 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:06:24.374488 25132 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.353672 25124 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.374993 25041 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.358366 24875 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:24.376531 25119 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:24.356840 25126 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:06:24.376650 25101 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.318640 25107 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.381767 21906 rpcz_store.cc:276] 0709 13:06:23.218440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.218607 (+   167us) service_pool.cc:224] Handling call
0709 13:06:23.218923 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.231831 (+ 12908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.231865 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.241181 (+  9316us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.361786 (+120605us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:23.361829 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.361894 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.356397 (+994503us) raft_consensus.cc:1685] finished
0709 13:06:24.356411 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.356537 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6332,"raft.queue_time_us":12847,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":9206,"thread_start_us":81600,"threads_started":1,"wal-append.queue_time_us":245773}
I20260709 13:06:24.446539 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:24.447957 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:24.448638 25123 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.356s	user 0.002s	sys 0.000s
I20260709 13:06:24.448607 22553 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:24.376751 25079 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:24.451885 21902 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.389575 24993 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:24.456640 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.456928 24993 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:24.457221 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.353466 25042 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:24.484385 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.485571 21979 raft_consensus.cc:2410] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:24.488011 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:24.488245 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.390480 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1832) took 1079 ms. Trace:
W20260709 13:06:24.391289 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50016.6us
I20260709 13:06:24.388077 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:24.390995 22552 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:24.375771 24933 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:24.535050 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.535187 21974 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:06:24.535264 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44827.4us
I20260709 13:06:24.535629 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.541196 21975 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:24.489806 21982 rpcz_store.cc:276] 0709 13:06:23.310582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.311030 (+   448us) service_pool.cc:224] Handling call
0709 13:06:23.311297 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.311495 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:23.393161 (+ 81666us) log.cc:844] Serialized 14 byte log entry
0709 13:06:24.388132 (+994971us) log.cc:844] Serialized 14 byte log entry
0709 13:06:24.389912 (+  1780us) log.cc:844] Serialized 14 byte log entry
0709 13:06:24.390078 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.390127 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:24.390192 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.390259 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.390392 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":129856,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"raft.queue_time_us":15656,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":2422,"spinlock_wait_cycles":11008,"thread_start_us":1048063,"threads_started":4,"wal-append.queue_time_us":174918}
W20260709 13:06:24.391407 25010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.012s	sys 0.027s
I20260709 13:06:24.389338 25050 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.562374 25107 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.493860 25090 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:24.564136 25042 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:24.564008 25090 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.393440 25130 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.567353 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:24.568827 25130 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.569161 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.569612 24875 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:24.415823 25101 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.539029 21983 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:24.534652 24793 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:24.395944 24880 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.487254 24808 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:24.604657 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.604753 24808 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.605437 21974 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:24.408957 25069 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.583585 24593 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.607182 24808 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:24.406190 25077 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:24.392397 24906 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.607795 25055 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.608343 25055 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.609175 24934 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.609709 25050 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.410758 25132 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.399938 24806 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:24.615792 25132 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.616065 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1781) took 1398 ms. Trace:
I20260709 13:06:24.616530 21902 rpcz_store.cc:276] 0709 13:06:23.218078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.218216 (+   138us) service_pool.cc:224] Handling call
0709 13:06:23.237233 (+ 19017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.452342 (+1215109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.615835 (+163493us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540034b554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:24.616009 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2792955776}
I20260709 13:06:24.410096 24707 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:24.613330 24880 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:24.619410 25018 consensus_meta.cc:287] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.003s
I20260709 13:06:24.617946 25050 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:24.407526 25117 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:06:24.407356 24985 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.378408 24946 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.622282 24946 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.493013 25125 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.623025 25125 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.625293 25125 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.570375 24875 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.560128 24993 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.627758 24875 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.627818 24993 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.628971 25101 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:24.486830 25043 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.834s	user 0.010s	sys 0.000s
I20260709 13:06:24.634579 25043 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.637367 25043 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.638926 25112 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:24.639472 25112 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:24.617906 21982 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:24.640645 25112 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.641570 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.642413 21982 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:24.644570 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1756) took 1069 ms. Trace:
I20260709 13:06:24.403932 24353 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:24.589118 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.583709 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:24.603871 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.602216 24793 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.413569 25041 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.571447 24963 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.611956 25084 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.612385 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.578575 25042 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:24.619977 25018 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.412393 25124 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:24.391892 24841 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.400751 24969 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.392269 25120 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.409483 25133 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:24.568965 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:24.693254 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 124411us
W20260709 13:06:24.693444 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 109804us
I20260709 13:06:24.690614 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:24.694097 21875 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:24.695247 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.696308 21982 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:24.696113 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:06:24.648139 22521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.067s	sys 0.072s
I20260709 13:06:24.355372 22548 rpcz_store.cc:276] 0709 13:06:23.265627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.272932 (+  7305us) service_pool.cc:224] Handling call
0709 13:06:24.319131 (+1046199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:24.647559 22550 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:24.645094 21831 rpcz_store.cc:276] 0709 13:06:23.574700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.574816 (+   116us) service_pool.cc:224] Handling call
0709 13:06:24.644328 (+1069512us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540017fcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:24.644497 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358578560}
W20260709 13:06:24.697718 22521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.067s	sys 0.072s
I20260709 13:06:24.611543 24934 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:24.696190 25133 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.398546 22549 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:24.710834 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 549) took 1035 ms. Trace:
I20260709 13:06:24.711359 22555 rpcz_store.cc:276] 0709 13:06:23.675286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.675599 (+   313us) service_pool.cc:224] Handling call
0709 13:06:24.690400 (+1014801us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:06:24.710756 (+ 20356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66522368}
I20260709 13:06:24.396391 25066 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.407662 25086 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.703308 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:24.707144 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.707571 25043 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:24.733402 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:24.697535 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:24.708616 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.016s	sys 0.014s
I20260709 13:06:24.733765 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:24.734184 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.017s	sys 0.014s
I20260709 13:06:24.733830 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:24.734849 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 703643us
I20260709 13:06:24.735867 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:24.734321 21832 raft_consensus.cc:2410] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:24.732712 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:24.733075 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.742722 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:24.697688 24793 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:24.686982 25055 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.693751 24993 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.689518 24977 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:24.693205 25084 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:24.744469 21829 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:24.686618 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:24.747041 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.747819 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:24.749181 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.705935 24946 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:24.704493 24985 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:24.754495 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.752295 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:24.735219 24984 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.778991 21901 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:24.782802 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:24.714039 25042 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.734989 25041 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:24.734236 25124 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:24.781993 21833 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:24.786378 21983 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:24.759182 24963 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.782224 21903 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:24.746276 25086 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:24.801220 24967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.048s	sys 0.075s
I20260709 13:06:24.757676 24987 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:24.806979 21900 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.012s	sys 0.041s
W20260709 13:06:24.818722 21900 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.013s	sys 0.041s
I20260709 13:06:24.781153 24985 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.781123 24780 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.811033 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:24.820147 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:24.820945 21903 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.745038 25043 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.813501 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.796283 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:24.790825 25078 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:24.817490 22551 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:24.802619 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:24.781850 25070 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:24.825359 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:24.807484 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53553.1us
I20260709 13:06:24.825932 21901 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
W20260709 13:06:24.818377 24967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.048s	sys 0.076s
I20260709 13:06:24.817785 25086 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.828682 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:24.839852 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:24.839967 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:24.832331 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:24.800679 24984 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.822217 24656 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:24.822121 24985 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.846450 21909 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:24.850436 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.851198 25066 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.851835 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.852293 25018 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.848774 24656 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:24.850651 21833 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.856134 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.861685 21948 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:24.821707 25124 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.821851 24963 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.838199 24993 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:24.846005 25086 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.849587 24946 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:24.855317 25010 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:24.827386 24780 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.877584 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:24.848776 24905 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:24.858242 25134 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.854817 24656 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.882359 24967 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:24.870182 24969 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:24.888626 21982 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:24.889114 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.875195 25018 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.849095 25070 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.876091 24875 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:24.887023 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:24.898312 21905 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:24.880496 25010 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.886408 24880 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:24.895551 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.887254 24946 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:24.886278 24905 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:24.903796 21907 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:24.905515 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.907207 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.914772 21905 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:24.914736 21900 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:24.900254 24656 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.902120 25010 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:24.902611 24969 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:24.904867 24880 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.926770 24880 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:24.930291 25140 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:06:24.931348 25070 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.908154 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:24.890300 25134 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.914705 24905 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:24.896476 24967 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.937831 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:24.900472 25018 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.939584 21975 raft_consensus.cc:2368] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:24.939399 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:24.945801 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.946465 21907 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:24.947408 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:24.947911 21907 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:24.956172 21907 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:24.956943 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.957665 21907 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:24.960744 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.961560 21907 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:24.962438 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:24.963014 21907 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:24.965588 24880 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:24.966332 24880 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:24.968822 24880 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.968891 25113 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.969869 25113 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:24.970597 25002 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:24.970925 24963 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:24.971693 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1786) took 1364 ms. Trace:
I20260709 13:06:24.972205 24780 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:24.972726 25124 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:24.976050 25154 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:24.971084 25002 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:24.980499 25118 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.885s	user 0.004s	sys 0.000s
I20260709 13:06:24.982913 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1783) took 1376 ms. Trace:
I20260709 13:06:24.983328 21904 rpcz_store.cc:276] 0709 13:06:23.606655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.606833 (+   178us) service_pool.cc:224] Handling call
0709 13:06:23.607246 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.652993 (+ 45747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.653041 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.708542 (+ 55501us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.962129 (+253587us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:23.962199 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.962290 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.979930 (+1017640us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:24.982633 (+  2703us) raft_consensus.cc:1685] finished
0709 13:06:24.982655 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.982857 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19564,"raft.queue_time_us":22172,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":49516,"spinlock_wait_cycles":24694144,"thread_start_us":194637,"threads_started":1,"wal-append.queue_time_us":367492}
I20260709 13:06:24.984477 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:24.985221 21799 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbb4eb8dd14248918867a27aa6d9bac9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.985555 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.986543 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:24.987468 21827 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:06:24.985237 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:24.989532 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:24.971016 25113 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:24.972074 21908 rpcz_store.cc:276] 0709 13:06:23.615744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.753152 (+137408us) service_pool.cc:224] Handling call
0709 13:06:23.788299 (+ 35147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.952713 (+164414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.971481 (+1018768us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b54003c9e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:24.971642 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70219520}
I20260709 13:06:24.996006 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:25.030519 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1828) took 1728 ms. Trace:
I20260709 13:06:25.030706 21906 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.032148 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:25.033522 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1826) took 1732 ms. Trace:
I20260709 13:06:24.942193 25042 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.044785 21907 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:25.050978 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:25.053160 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:25.053942 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:25.054026 21907 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:25.049470 21977 rpcz_store.cc:276] 0709 13:06:23.301878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.302032 (+   154us) service_pool.cc:224] Handling call
0709 13:06:23.331209 (+ 29177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.056168 (+724959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.992946 (+936778us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54002d4e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:25.030459 (+ 37513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665665280}
I20260709 13:06:25.050848 21980 rpcz_store.cc:276] 0709 13:06:23.301201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.302352 (+  1151us) service_pool.cc:224] Handling call
0709 13:06:23.337222 (+ 34870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.818220 (+480998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.993333 (+1175113us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540001efd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:25.033471 (+ 40138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076335488}
I20260709 13:06:24.983110 24987 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:25.050051 25106 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.967s	user 0.003s	sys 0.000s
I20260709 13:06:25.084008 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:25.049863 25043 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:25.090848 25018 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:25.095614 21907 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:06:25.096205 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.099133 21903 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:25.104493 21907 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:25.105598 25068 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.105820 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 468) took 1691 ms. Trace:
I20260709 13:06:25.106098 25068 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.106323 22554 rpcz_store.cc:276] 0709 13:06:23.414652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.414794 (+   142us) service_pool.cc:224] Handling call
0709 13:06:23.415092 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.038325 (+623233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.105590 (+1067265us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54005e01d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:25.105761 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429778816}
I20260709 13:06:25.108350 25133 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.111246 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1756) took 1759 ms. Trace:
I20260709 13:06:25.111653 21978 rpcz_store.cc:276] 0709 13:06:23.352165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.405251 (+ 53086us) service_pool.cc:224] Handling call
0709 13:06:23.405630 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.560718 (+155088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.111033 (+1550315us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400414454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:25.111195 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271440768}
I20260709 13:06:25.108314 25068 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.112625 25002 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.116797 24659 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.095108 25122 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.111542 25066 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.118937 24793 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.119081 25066 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.121196 24793 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:25.121321 25066 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.127760 24637 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:25.130978 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1753) took 1811 ms. Trace:
I20260709 13:06:25.055673 25130 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:25.079990 24963 raft_consensus.cc:476] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:25.048652 24993 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:25.055454 25134 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.131417 21828 rpcz_store.cc:276] 0709 13:06:23.285265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.393860 (+108595us) service_pool.cc:224] Handling call
0709 13:06:23.419222 (+ 25362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.459105 (+ 39883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.459138 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.481220 (+ 22082us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.710328 (+229108us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:23.976270 (+265942us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.998271 (+ 22001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.998339 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.454500 (+456161us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b18004ae1e0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef1522 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:24.985825 (+531325us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:25.096908 (+111083us) raft_consensus.cc:1685] finished
0709 13:06:25.096939 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.097111 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81940,"prepare.queue_time_us":37721,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":13232,"raft.queue_time_us":130820,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":18788,"spinlock_wait_cycles":10620544,"thread_start_us":426793,"threads_started":2,"wal-append.queue_time_us":303516}
I20260709 13:06:25.149245 21903 pending_rounds.cc:85] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 3
I20260709 13:06:25.160871 21903 pending_rounds.cc:107] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:25.161230 21903 raft_consensus.cc:2889] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:25.164016 21906 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:25.135241 25130 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.173482 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:25.175441 21832 raft_consensus.cc:606] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:25.175901 21832 raft_consensus.cc:614] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:25.141490 24656 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.079957 24946 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.181404 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.162931 24793 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:25.097486 24969 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.190997 21828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:25.199030 21828 raft_consensus.cc:606] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:25.178854 25130 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:25.185314 21827 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
W20260709 13:06:25.205287 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 151986us
I20260709 13:06:25.184484 25002 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.211978 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:25.213551 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:25.214088 22554 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.214828 21828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:25.215322 21828 raft_consensus.cc:606] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:25.183048 24656 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.205879 24984 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.218024 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:25.186863 25084 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.220162 22551 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:06:25.220212 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:25.209307 25078 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:25.211408 25072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.105s	user 0.000s	sys 0.028s
I20260709 13:06:25.201768 24793 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.216559 25134 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:25.234102 25134 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.234524 25134 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.240973 25130 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.244747 25086 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.244390 25134 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.215911 24637 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:06:25.246917 25002 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:25.247315 25002 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:25.247609 25134 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.248683 25130 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.248286 25002 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.249795 25002 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.216929 25010 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.230099 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:25.227322 25072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.000s	sys 0.029s
I20260709 13:06:25.252120 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:25.222080 24985 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.226486 22554 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:25.265013 21828 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.266067 25122 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:25.267532 22547 raft_consensus.cc:2410] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:25.269083 25010 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.275348 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.279733 21978 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:25.280776 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.281203 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.281528 21981 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:25.282011 21976 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:25.270141 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:25.276924 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:25.274685 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:25.275004 21983 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:25.285025 21829 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.275712 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.286412 21980 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:25.286464 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:25.287175 21833 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.290896 21982 pending_rounds.cc:85] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 3
I20260709 13:06:25.291254 25103 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:25.291765 25103 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:25.292562 25103 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.295230 24905 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.297163 24905 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.298623 24656 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.299418 25086 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.300961 24793 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:25.301256 21829 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:25.302201 21873 leader_election.cc:400] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:25.302502 21873 leader_election.cc:403] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.291260 21982 pending_rounds.cc:107] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:25.303920 21982 raft_consensus.cc:2889] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:25.305517 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:25.307808 21833 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:25.310410 21828 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
W20260709 13:06:25.275390 25159 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:06:25.312458 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:25.314347 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:25.325253 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:25.325524 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:25.330724 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 471) took 1090 ms. Trace:
I20260709 13:06:25.331182 21833 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:25.331142 22552 rpcz_store.cc:276] 0709 13:06:24.240379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.240504 (+   125us) service_pool.cc:224] Handling call
0709 13:06:25.330577 (+1090073us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54004f79d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:25.330668 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175479168}
I20260709 13:06:25.332311 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.314435 24934 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:25.275321 24985 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.332986 21831 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:25.333187 21834 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:25.328410 25010 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:25.339821 25010 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:25.340508 25162 ts_tablet_manager.cc:933] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:06:25.340801 25010 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.313413 25086 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:25.324739 25041 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:25.335582 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:25.332392 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:25.351899 21828 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.343732 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.328227 25002 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.354533 21834 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:25.328111 24656 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:25.328877 25158 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:25.361997 21828 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:25.357659 24659 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:25.332521 24905 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:25.333649 24793 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.334578 24637 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.363833 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:25.364792 21831 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:25.364971 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.365159 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:25.369747 21907 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:25.363101 25086 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:25.375265 21828 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:25.364274 24659 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.366654 24946 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.382442 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:25.359154 25002 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.367499 25158 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:25.386216 21828 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:25.386083 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:25.386773 21907 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:25.388224 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:25.364374 24656 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.388537 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.369738 24637 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.389683 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:25.393175 25112 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.382999 24659 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.370472 24793 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.411301 21831 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:25.397593 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.419456 21828 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:25.420728 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:25.421319 21825 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.423193 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.424021 21833 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:25.424189 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:25.430518 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.430625 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.431639 21831 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:25.432669 25158 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.433084 25002 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.393983 24984 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:25.437819 21825 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:25.442999 21949 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:25.386564 24946 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.451653 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:25.460726 25166 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:06:25.451574 24926 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:06:25.467255 24967 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:25.467870 24967 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:25.468389 25163 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:06:25.469890 25153 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 13:06:25.471869 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 547) took 1868 ms. Trace:
I20260709 13:06:25.472309 22549 rpcz_store.cc:276] 0709 13:06:23.603270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.613704 (+ 10434us) service_pool.cc:224] Handling call
0709 13:06:23.707956 (+ 94252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.719720 (+1011764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.471632 (+751912us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54004d0154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:25.471807 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546986368}
I20260709 13:06:25.474404 25107 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:25.474838 25107 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:25.475667 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:25.475718 25107 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.476683 24934 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:25.478526 24880 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:25.479105 24880 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:25.480127 24880 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.480455 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.483855 24946 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.484653 25084 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:06:25.488716 21903 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:25.385502 25162 tablet_copy_client.cc:323] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.129:39085
I20260709 13:06:25.423576 24905 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:25.435823 25142 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.435631 25058 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:25.449887 25018 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.456461 25080 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.502986 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.486244 25113 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.506698 21831 raft_consensus.cc:2393] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:25.499737 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.442039 24963 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:06:25.457693 24984 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:25.499740 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:25.515013 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:25.502014 24946 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:25.518662 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.519543 21831 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:25.456205 25086 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.505487 25018 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:25.507431 25080 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:25.525936 21834 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:25.528832 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:25.501690 24905 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.504639 25142 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.524042 25041 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:25.506623 25058 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:25.526707 21875 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.761s (SENT) [suppressed 10 similar messages]
I20260709 13:06:25.524071 24934 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:25.516832 24946 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:25.525686 25082 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:06:25.648736 21903 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:25.536191 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.651134 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.651113 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:25.670887 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.634766 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.531073 25080 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.558979 24656 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.558487 24637 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.559315 24793 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:25.635069 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:25.554662 22550 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:25.634959 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.652084 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:25.654547 22552 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:06:25.600677 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.600116 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:25.673858 21834 raft_consensus.cc:2368] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:25.731864 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:25.750768 21975 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
W20260709 13:06:25.559813 25148 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.511s	user 0.002s	sys 0.000s
I20260709 13:06:25.555501 21979 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:25.554303 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:25.700183 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:25.705828 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.754142 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.716671 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:25.708055 21983 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:25.737129 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:25.674258 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 221458us
I20260709 13:06:25.718989 21902 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:25.757015 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:25.570025 25103 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.575222 25070 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.755113 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.759522 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:25.526345 25018 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.757763 21906 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:25.670886 25041 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.575014 25073 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:25.760300 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.780654 21976 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:25.763672 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:25.764452 25103 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.765321 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:25.705562 21905 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:25.562472 25042 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:25.682123 24946 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:25.575028 24905 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.774984 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.774994 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:25.720016 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 469) took 1052 ms. Trace:
I20260709 13:06:25.783257 21902 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:25.790490 21900 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.791081 21980 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:25.710565 25058 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:25.593645 24977 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.673996 24934 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:25.672755 24636 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.780838 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.779479 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:25.795302 21983 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:25.760696 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:25.782310 21976 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.783192 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:25.573355 25142 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:25.581321 24984 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.778386 24656 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:25.788612 22549 raft_consensus.cc:2368] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:25.696419 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:25.793196 21977 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:25.715386 24963 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:25.785439 25041 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.795457 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:25.813313 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 471) took 1115 ms. Trace:
I20260709 13:06:25.814932 22550 rpcz_store.cc:276] 0709 13:06:24.698400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.698630 (+   230us) service_pool.cc:224] Handling call
0709 13:06:25.813126 (+1114496us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b540053a7d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:25.813248 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885883264}
I20260709 13:06:25.793298 24933 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.804797 21903 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:25.796988 21798 leader_election.cc:400] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10.
I20260709 13:06:25.804714 21976 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:25.839788 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:25.774616 25070 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.846624 25122 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.875174 25122 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:25.876372 25070 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:25.877419 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 465) took 1566 ms. Trace:
I20260709 13:06:25.877776 22553 rpcz_store.cc:276] 0709 13:06:24.311390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.449641 (+138251us) service_pool.cc:224] Handling call
0709 13:06:24.449919 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.568406 (+118487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.568437 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.568489 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:24.568522 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.877216 (+1308694us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002508d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:25.877259 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.877367 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272032512}
I20260709 13:06:25.879076 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:25.873116 21798 leader_election.cc:403] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.793056 25042 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:25.798388 24636 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:25.914296 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.797338 21974 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 4.
W20260709 13:06:26.011885 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 280125us
I20260709 13:06:25.796468 24905 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:26.030069 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 503363us
I20260709 13:06:25.885787 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 335) took 1153 ms. Trace:
I20260709 13:06:26.030421 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:26.031493 22550 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:26.030977 21909 rpcz_store.cc:276] 0709 13:06:24.732292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.732841 (+   549us) service_pool.cc:224] Handling call
0709 13:06:25.885628 (+1152787us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400307854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:25.885730 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247850752}
W20260709 13:06:25.798303 25177 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.002s
W20260709 13:06:26.034086 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 155089us
I20260709 13:06:26.034802 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:25.960234 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 437769us
W20260709 13:06:26.027351 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 129233us
I20260709 13:06:26.037990 21909 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:25.954353 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.039577 24793 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:25.879233 25103 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:25.894196 25122 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.027235 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:26.027714 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 230866us
I20260709 13:06:26.029001 24637 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10.
I20260709 13:06:26.058503 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:25.847087 25182 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:26.059262 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 297358us
I20260709 13:06:25.804447 24963 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.059321 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:25.802222 24934 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:26.061295 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 324287us
I20260709 13:06:26.052856 24793 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:26.063577 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:26.089834 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:25.885821 24659 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.090798 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:25.792585 22551 rpcz_store.cc:276] 0709 13:06:24.667918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.932712 (+264794us) service_pool.cc:224] Handling call
0709 13:06:24.933091 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.220666 (+287575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.719681 (+499015us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540043cbd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:25.719937 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659596160}
I20260709 13:06:25.846762 25142 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.213s
I20260709 13:06:25.816180 25073 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.055775 25070 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:26.029827 24905 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:25.802292 24977 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.065172 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.092718 21906 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:26.036195 24933 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.098791 22553 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:26.064040 24967 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:26.091609 24793 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:26.097846 21903 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:26.064316 25182 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:26.065874 25105 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:26.105677 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:26.104311 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.109513 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:26.109586 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46058.7us
I20260709 13:06:26.088508 25103 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:26.104243 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.112048 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.068029 25178 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:06:26.109539 24905 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.149587 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:26.114692 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49551.3us
I20260709 13:06:26.129290 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:26.170748 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65130.5us
I20260709 13:06:26.106822 25070 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.169234 21905 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:26.171821 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:26.168057 21906 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
W20260709 13:06:26.138556 21979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1843) took 1587 ms (client timeout 2107 ms). Trace:
I20260709 13:06:26.149899 21900 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:26.172896 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:26.172822 21979 rpcz_store.cc:269] 0709 13:06:24.551224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.568915 (+ 17691us) service_pool.cc:224] Handling call
0709 13:06:26.138335 (+1569420us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54003fa554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:26.138464 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266685824}
I20260709 13:06:26.123960 24636 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:26.067855 24993 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:06:26.111253 24967 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.138839 25082 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.176285 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.134845 24637 raft_consensus.cc:993] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: : Instructing follower 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:26.134754 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.117712 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.168776 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:26.135807 25073 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.181056 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.181993 21905 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:26.130565 25188 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:26.135648 24353 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:26.125870 25018 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.126499 25122 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.121600 25042 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.129778 25182 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:26.189886 24841 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.175741 21907 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:26.109826 25002 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:06:26.123000 22551 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:26.130432 25058 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:26.173530 25070 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:26.112653 24946 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.216797 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.174692 24656 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:26.261664 24659 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:26.176707 25169 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 13:06:26.261911 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45184.4us
W20260709 13:06:26.217919 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49222.4us
I20260709 13:06:26.179047 25185 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.264096 25185 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.266100 25185 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:26.198438 24967 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:26.267210 25173 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.744s	user 0.009s	sys 0.000s
I20260709 13:06:26.189486 25081 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:26.271209 25081 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.219058 25105 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:26.258766 24841 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.218348 24353 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:26.274570 24841 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:26.275133 24353 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.276678 24353 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.217526 25078 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:26.227420 25073 raft_consensus.cc:1081] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Signalling peer 3d76b2c4699e43fba10eeb81a91e4913 to start an election
I20260709 13:06:26.260552 25188 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.217979 25082 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.333164 25018 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.259083 25189 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:26.275137 24841 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:26.335716 21902 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
W20260709 13:06:26.347277 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 214538us
I20260709 13:06:26.244680 25122 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.281952 25078 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:26.284441 25058 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:26.333668 25107 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.370836 25195 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:26.371417 25195 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.328290 25185 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:26.374738 21874 leader_election.cc:400] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:26.375258 21874 leader_election.cc:403] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:26.334990 25188 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:26.357179 25189 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:26.376641 24967 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.374064 25018 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:26.394462 24963 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:26.396427 25100 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:26.399456 24905 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.379391 25185 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.401626 25042 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:26.381048 25188 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.363945 24993 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:26.408879 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 374130us
I20260709 13:06:26.405962 25081 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:26.413594 25190 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:06:26.414033 25100 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:26.402776 25080 consensus_meta.cc:287] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.620s	user 0.003s	sys 0.007s
I20260709 13:06:26.423687 24946 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.424029 25185 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.431607 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:26.443475 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 271402us
W20260709 13:06:26.433488 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 169253us
I20260709 13:06:26.382062 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:26.446552 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 64611.2us
I20260709 13:06:26.417012 25043 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:06:26.434762 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 171539us
I20260709 13:06:26.456787 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.409780 25189 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:26.419034 24977 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.445798 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:26.483341 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:26.414386 25018 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.458094 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:26.486240 22553 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:26.459471 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:26.433357 24933 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.448887 25103 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:26.429843 24993 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.497112 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.441156 25073 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:26.458704 25185 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:26.488912 24969 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:26.446969 24659 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:06:26.481184 25081 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:26.442912 25080 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.448711 24637 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:06:26.489015 24353 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:26.489141 25042 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:26.486027 24963 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:26.430833 25058 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.488706 25195 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.517400 24969 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.490006 24946 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:06:26.531780 24934 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.535367 25122 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.495651 25105 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:26.492213 24880 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:26.487802 25069 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:06:26.516705 25185 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:26.516201 25103 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:26.572129 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50902.1us
I20260709 13:06:26.549257 24353 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:26.573000 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:26.574946 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 130126us
I20260709 13:06:26.567307 24969 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:26.581200 21908 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
W20260709 13:06:26.582309 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 103943us
I20260709 13:06:26.568521 25082 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.573737 25185 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.579748 25195 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:26.589222 25195 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:26.590049 25195 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.591326 25195 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.595357 24993 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.596092 25185 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.598197 25185 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:26.599270 24934 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.599936 24905 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.585194 24967 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.600852 25205 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:26.601490 25041 consensus_meta.cc:287] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.001s
I20260709 13:06:26.567894 25200 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:26.601369 25205 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.602806 25073 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:26.603422 25191 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.381s	user 0.007s	sys 0.001s
I20260709 13:06:26.603909 25205 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:26.586341 25066 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:26.605786 25066 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:26.569765 25081 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:06:26.606395 25103 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.554091 25042 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.587003 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.575686 24353 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.615074 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:26.619702 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:26.619427 25189 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:26.645233 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 68735us
I20260709 13:06:26.647135 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:26.647954 21907 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:26.648856 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.608494 25043 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:26.614468 24993 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.616645 25206 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:26.579381 25197 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:06:26.658597 21902 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:26.654892 24880 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:26.655572 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 82677.7us
I20260709 13:06:26.601939 25041 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.581729 25199 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:06:26.661099 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:26.661877 25070 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.650924 25209 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.656705 24659 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:26.676378 25194 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:26.677287 25214 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:26.677698 25214 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.678020 25214 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.660075 25081 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:26.658694 24841 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:26.660667 24637 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:26.663290 25204 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:06:26.687301 24880 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.662530 25043 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:26.671237 25105 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.670676 24946 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:26.336249 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.675199 24659 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.674896 25209 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:26.675022 25086 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.733937 24963 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.734417 25086 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.734593 24963 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.674780 25018 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:26.729332 24793 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.004s
I20260709 13:06:26.726562 24659 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:26.731565 25213 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:26.732733 25214 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.660418 24993 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.685117 25081 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.691547 24637 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.684669 25122 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:06:26.682611 25206 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:06:26.741585 25080 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:26.724305 25043 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.742664 24793 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.682849 25207 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 13:06:26.765731 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 112019us
I20260709 13:06:26.784268 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:26.751471 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.750996 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 266514us
I20260709 13:06:26.658900 25066 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.787392 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.788391 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:26.745957 24637 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.789903 24934 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:26.791383 24793 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.739495 25209 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.737538 24946 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.746229 25081 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.792131 25070 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.793092 25042 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.759732 24905 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:26.794636 24993 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.796211 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:26.801800 21949 leader_election.cc:400] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:26.822091 21949 leader_election.cc:403] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:26.818909 25211 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:26.824388 25066 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:26.826299 24353 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.828511 24353 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.755656 25086 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.830077 25199 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.830634 25199 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.832780 25199 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:26.763048 25189 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.810657 24934 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.810755 24984 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.838220 21907 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:26.802099 21978 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:26.802642 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.806308 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:26.814508 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 160744us
I20260709 13:06:26.747679 24963 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:26.804162 25185 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:26.803391 25041 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.725929 24841 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.793769 25043 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:26.859300 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 124193us
I20260709 13:06:26.748188 24926 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:26.841787 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:26.842736 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.835815 24984 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.835318 24969 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.839627 21902 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:06:26.865973 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.866956 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:26.867113 21977 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:26.841270 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.868319 21983 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:26.849643 25211 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:26.852255 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.853688 21976 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:26.871604 21980 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:26.857061 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.857698 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:26.862542 25216 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:06:26.875032 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.857069 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:26.751989 25214 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.861866 24934 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.863173 21909 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:26.844012 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:26.878005 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.863289 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.821398 24905 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:26.864823 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:26.891012 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.891377 21981 raft_consensus.cc:2368] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:26.892482 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.893254 21981 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:26.756007 25182 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.862780 24926 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:26.854566 25185 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.870755 21902 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:26.901157 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:26.907075 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.907105 21904 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.902271 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:26.858316 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 70798.4us
I20260709 13:06:26.908417 22550 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:26.874599 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.877195 22551 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:26.877306 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.878686 21977 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:26.875315 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.876310 25043 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.880564 24969 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.876755 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.912259 21983 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:26.860108 24353 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:26.866499 25200 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.887827 24984 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.885732 24637 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.858855 25189 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:26.889549 21980 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:26.922302 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:26.895026 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:26.833436 24659 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.931931 24659 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.932049 24637 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.932931 22549 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:26.933171 21904 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:26.900682 25225 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:26.933944 25100 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.870496 25107 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.872895 24993 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.869191 25218 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:26.916318 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.864338 25188 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.917673 24926 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.918365 24946 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:26.935178 24353 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.960304 24353 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:26.921520 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:26.923024 21981 raft_consensus.cc:2368] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:26.923269 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:26.901700 25070 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.924831 25189 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.926324 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.926765 22552 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:26.855924 25207 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:06:26.898890 25103 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:26.911782 25185 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:26.942808 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47857us
I20260709 13:06:26.946246 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:26.968559 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:26.918999 25043 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.922677 25200 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:26.945621 25218 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.995949 25070 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:26.945472 25225 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:26.943984 24905 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:27.001245 22553 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:27.167440 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:27.168263 21981 raft_consensus.cc:2410] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:27.168844 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:27.169083 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:27.169385 21980 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.106650 24656 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:27.170140 24656 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:27.175593 25070 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:27.023384 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.171473 25200 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:27.169667 21981 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.108219 21975 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:27.172144 24926 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.141847 25187 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:26.951166 24993 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:27.172904 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:26.999866 25211 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:27.173676 25043 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:27.147782 25193 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.176729 25200 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.176909 21980 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:27.179545 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.086356 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:26.966430 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:27.195385 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:27.191017 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:27.173329 25218 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.000406 25078 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:27.191991 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.105926 24984 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.970286 25100 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.199697 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.201421 21826 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.998864 25188 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:27.206629 21981 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:27.207755 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:27.210798 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:27.165470 25209 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:27.197144 25200 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:27.227562 21826 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:27.200806 24841 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:27.209925 24984 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:27.210083 25225 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:27.175092 24656 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:06:27.218255 25078 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:27.240777 21980 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.190248 25187 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:27.254724 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:27.246147 21826 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:06:27.248102 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.256470 21827 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:27.257579 21843 tablet_copy_service.cc:140] P 479255846c5141b584b16aa253f587c7: Received BeginTabletCopySession request for tablet dbb4eb8dd14248918867a27aa6d9bac9 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:52674)
I20260709 13:06:27.258240 21843 tablet_copy_service.cc:161] P 479255846c5141b584b16aa253f587c7: Beginning new tablet copy session on tablet dbb4eb8dd14248918867a27aa6d9bac9 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:52674: session id = 0157b4f0725d4f92a53938c921db9efc-dbb4eb8dd14248918867a27aa6d9bac9
I20260709 13:06:27.259562 24993 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:27.269034 21827 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:27.269574 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.270241 21829 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
W20260709 13:06:27.272017 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.239571 24946 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:27.202231 25193 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:27.241631 25225 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.273972 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.234119 25058 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:06:27.291471 25058 consensus_queue.cc:1243] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:27.291935 24946 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:27.292276 24963 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:27.292879 24963 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:27.273994 21980 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:27.279700 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.295949 21906 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.242321 25182 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:27.277918 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.266816 25189 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:27.274896 24353 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:27.275130 25199 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:27.277297 25188 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 13:06:27.288811 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.305485 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.302068 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:27.306273 21829 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:27.294768 24984 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:27.293965 24963 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:27.281147 25225 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:27.316479 21873 leader_election.cc:400] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:27.316906 21873 leader_election.cc:403] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:27.319227 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.319797 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.322968 21906 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
W20260709 13:06:27.363708 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.321113 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1878) took 1585 ms. Trace:
I20260709 13:06:27.320895 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:27.302748 24656 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:27.303242 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:27.365324 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49013.9us
I20260709 13:06:27.292560 25081 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:27.370438 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.365823 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:27.365020 25189 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:27.371184 21906 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:27.364460 21908 rpcz_store.cc:276] 0709 13:06:25.735623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.735720 (+    97us) service_pool.cc:224] Handling call
0709 13:06:27.320957 (+1585237us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54002f53d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:27.321057 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807765888}
I20260709 13:06:27.371089 21832 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:27.372177 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:27.365501 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44652.4us
I20260709 13:06:27.369307 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.320487 21827 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:27.367321 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.372764 21906 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:27.329789 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.303686 25199 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.375531 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.373632 21826 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 3.
I20260709 13:06:27.370048 24963 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:27.308720 25043 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:27.367378 25178 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:27.380635 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.386152 21826 raft_consensus.cc:2376] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8. Re-sending same reply.
I20260709 13:06:27.369472 24946 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:27.369378 25042 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:27.383708 21906 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:27.381476 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:27.373662 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.320437 25069 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:06:27.373045 25189 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.392941 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.322584 25182 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:27.377099 25195 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:27.431380 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57792.2us
I20260709 13:06:27.399075 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.404563 22549 raft_consensus.cc:2410] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:27.414651 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:27.425297 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:27.426316 24946 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:27.380422 25199 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.442308 21982 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:27.438817 21826 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:27.434780 21906 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:27.384495 25043 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:27.447710 25187 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:27.448122 22553 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:27.471603 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:27.449029 25193 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:27.455391 25218 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:27.365417 24880 consensus_queue.cc:1175] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 9 index: 9 } }
I20260709 13:06:27.442854 25058 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:27.397729 25189 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:27.457486 25200 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:27.457549 21978 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1862) took 1786 ms (client timeout 1730 ms). Trace:
W20260709 13:06:27.459039 25107 consensus_meta.cc:287] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 13:06:27.459829 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.461395 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:27.432277 25195 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.445138 24946 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:27.462603 25081 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:27.464377 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:27.463888 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.488368 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.489369 21909 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:27.471176 25043 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.453892 25185 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:27.476667 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 101166us
I20260709 13:06:27.480109 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:27.474368 25233 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:06:27.481531 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:27.481984 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:27.479911 21978 rpcz_store.cc:269] 0709 13:06:25.671320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.704981 (+ 33661us) service_pool.cc:224] Handling call
0709 13:06:27.457358 (+1752377us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002d3a54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:27.457472 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306359168}
I20260709 13:06:27.472721 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.471405 25209 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:27.492190 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.504633 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:27.504957 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.505534 21909 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.502965 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:27.481273 25195 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:27.473201 24984 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:06:27.511150 21903 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:06:27.511421 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.512630 24984 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:27.490125 25058 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:27.505712 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:27.507932 21908 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:27.490751 24946 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.487277 25107 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:27.511037 22555 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:27.474752 24993 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:06:27.507191 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:27.501130 21906 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:27.474323 25182 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:06:27.513835 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.716234 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.584522 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:27.720079 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.720340 21830 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:27.720850 21834 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:27.492719 25105 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.722879 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.641633 21833 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:06:27.699530 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:27.696678 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:27.602736 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:27.600608 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:27.707007 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 46453.7us
I20260709 13:06:27.615914 21905 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:27.584323 21901 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:27.730132 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:27.733198 21909 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:27.521772 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.513774 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:27.632704 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 783640us
I20260709 13:06:27.735495 24905 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:27.736603 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.775617 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.745828 21731 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 125) took 7816 ms. Trace:
W20260709 13:06:27.746349 25232 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.445s	user 0.008s	sys 0.000s
I20260709 13:06:27.744863 21906 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:27.780537 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.781448 21830 raft_consensus.cc:2368] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7.
I20260709 13:06:27.782732 21834 raft_consensus.cc:2368] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:27.760565 21729 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.768633 21908 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:06:27.766180 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.784250 21907 raft_consensus.cc:2368] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6.
I20260709 13:06:27.516157 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:27.784808 21827 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:27.784878 21831 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:27.541218 21873 leader_election.cc:400] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:27.769824 21832 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:27.770931 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:27.513883 24984 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:27.711858 25243 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:06:27.792634 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.793320 21834 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:27.794804 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 289173us
I20260709 13:06:27.786063 21827 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:27.795655 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:27.796514 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.796746 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:27.786046 21908 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:27.771461 21979 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
W20260709 13:06:27.712450 24926 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.003s
I20260709 13:06:27.787570 21873 leader_election.cc:403] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:27.789561 21907 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:27.790135 21832 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:27.711164 25245 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:06:27.832996 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 291965us
I20260709 13:06:27.834646 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.835780 21981 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:27.714723 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:27.606954 25042 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:27.798817 21905 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:27.800849 21908 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:27.791258 22519 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:27.794077 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.801124 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.802068 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:27.806497 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.704964 25252 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:27.773859 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:27.774643 25105 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:27.860121 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.860596 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.876178 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 84991us
W20260709 13:06:27.878480 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 77429.8us
I20260709 13:06:27.879375 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.880738 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.841251 21983 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:27.855150 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:27.885011 21976 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:27.844583 21977 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:27.779378 21731 rpcz_store.cc:276] 0709 13:06:19.929308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.930514 (+  1206us) service_pool.cc:224] Handling call
0709 13:06:27.745754 (+7815240us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:23.392126 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:23.405881 (+ 13755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:23.405931 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:06:23.405950 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:23.835047 (+429097us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:23.977669 (+142622us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:23.983123 (+  5454us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:06:24.099970 (+116847us) tablet.cc:701] Row locks acquired
0709 13:06:24.100014 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:06:24.100172 (+   158us) write_op.cc:270] Start()
0709 13:06:24.100320 (+   148us) write_op.cc:276] Timestamp: P: 1783602384100112 usec, L: 0
0709 13:06:24.100338 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:06:24.101069 (+   731us) log.cc:844] Serialized 7456 byte log entry
0709 13:06:25.091897 (+990828us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75bed40ac 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b
0709 13:06:25.347295 (+255398us) op_driver.cc:464] REPLICATION: finished
0709 13:06:25.375355 (+ 28060us) write_op.cc:301] APPLY: starting
0709 13:06:25.385406 (+ 10051us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:25.513781 (+128375us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:25.520420 (+  6639us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:25.578801 (+ 58381us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:25.579315 (+   514us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:06:25.579388 (+    73us) write_op.cc:312] APPLY: finished
0709 13:06:25.579932 (+   544us) log.cc:844] Serialized 132 byte log entry
0709 13:06:25.633440 (+ 53508us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.654391 (+ 20951us) write_op.cc:454] Released schema lock
0709 13:06:25.670358 (+ 15967us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:25.714618 (+ 44260us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.714669 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1693796,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":1538,"apply.run_cpu_time_us":6648,"apply.run_wall_time_us":347198,"num_ops":19,"prepare.queue_time_us":275834,"prepare.run_cpu_time_us":37789,"prepare.run_wall_time_us":1917572,"raft.queue_time_us":27832,"raft.run_cpu_time_us":1469,"raft.run_wall_time_us":11151,"replication_time_us":1246752,"spinlock_wait_cycles":17609088,"thread_start_us":1375384,"threads_started":4,"wal-append.queue_time_us":1117163,"wal-append.run_cpu_time_us":7286,"wal-append.run_wall_time_us":1359608}]]}
W20260709 13:06:27.887936 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 85927.7us
I20260709 13:06:27.822651 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.791080 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:27.823457 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.898834 21825 raft_consensus.cc:2410] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:27.824226 25185 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:27.791545 24984 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.824755 21729 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 4 to 5, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 5 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:06:27.800117 25237 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 13:06:27.592839 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:27.767338 25081 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.839679 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.852239 25218 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:27.926267 21833 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:27.792404 25241 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 13:06:27.848464 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.950968 21831 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:27.849532 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.847594 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.952560 21830 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.621151 25247 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.268s
I20260709 13:06:27.866259 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1829) took 1017 ms. Trace:
W20260709 13:06:27.851330 25244 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.348s	user 0.000s	sys 0.000s
I20260709 13:06:27.807744 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:27.888793 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:27.968063 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 79359.6us
I20260709 13:06:27.868279 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.891017 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:27.892225 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:27.812985 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.970662 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 79723.6us
I20260709 13:06:27.887125 24926 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:27.830698 24636 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:27.978081 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 384) took 1027 ms. Trace:
W20260709 13:06:27.901077 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 63768.1us
I20260709 13:06:27.851722 25193 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:27.996631 25193 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:27.997124 25193 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.902856 21974 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:06:27.918013 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.002377 21974 pending_rounds.cc:85] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 7
I20260709 13:06:27.921633 24353 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:28.002650 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.002911 21974 pending_rounds.cc:107] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:28.003096 24353 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:28.003338 21974 raft_consensus.cc:2889] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:28.003885 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.004034 24353 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.005003 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.920964 21843 tablet_copy_source_session.cc:215] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:28.002710 21827 raft_consensus.cc:2368] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:27.846957 25246 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:27.940809 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.007076 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:27.940404 21729 catalog_manager.cc:5697] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 7, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 7 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.847532 25042 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:27.899544 22547 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:27.900499 25200 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:27.958632 21904 rpcz_store.cc:276] 0709 13:06:26.849156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.161845 (+312689us) service_pool.cc:224] Handling call
0709 13:06:27.162208 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:27.162832 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:27.162864 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:27.163604 (+   740us) log.cc:844] Serialized 52 byte log entry
0709 13:06:27.440173 (+276569us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:27.440219 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.440290 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:27.865988 (+425698us) raft_consensus.cc:1685] finished
0709 13:06:27.866015 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:27.866197 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":67,"thread_start_us":276195,"threads_started":1,"wal-append.queue_time_us":338893}
I20260709 13:06:27.506115 25197 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:27.973698 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1799) took 1028 ms. Trace:
W20260709 13:06:27.921856 25100 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.712s	user 0.006s	sys 0.004s
W20260709 13:06:27.975373 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 167702us
I20260709 13:06:28.032528 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:27.972348 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:28.033550 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 61276.7us
I20260709 13:06:27.979532 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.035141 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:27.979535 21980 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:27.978655 21977 rpcz_store.cc:276] 0709 13:06:26.950959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.964066 (+ 13107us) service_pool.cc:224] Handling call
0709 13:06:27.977838 (+1013772us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b5400225bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:27.978008 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342038272}
I20260709 13:06:27.981871 24636 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:27.982527 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:27.983336 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:27.983906 25201 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:28.037254 21906 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.989126 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 561) took 1050 ms. Trace:
I20260709 13:06:28.038419 22548 rpcz_store.cc:276] 0709 13:06:26.938685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.942102 (+  3417us) service_pool.cc:224] Handling call
0709 13:06:27.775467 (+833365us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b5800201c98. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:06:27.989036 (+213569us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21497216}
I20260709 13:06:27.923056 24984 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.995309 25252 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:27.903020 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:28.042001 21833 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
W20260709 13:06:28.042846 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 139914us
I20260709 13:06:28.043195 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.043560 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:28.043880 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:28.044045 21833 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.044642 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:28.008037 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.007964 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:28.009084 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:28.010561 21875 leader_election.cc:336] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.761s (SENT)
I20260709 13:06:28.047298 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:28.006002 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.011626 21905 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:27.862059 25225 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.020227 21904 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:28.051590 21908 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:28.019372 21983 rpcz_store.cc:276] 0709 13:06:26.945679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.210485 (+264806us) service_pool.cc:224] Handling call
0709 13:06:27.973502 (+763017us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540005a5d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:27.973632 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447961344}
I20260709 13:06:27.923236 25182 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:28.052811 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:28.055495 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.046402 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:28.054570 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:28.056221 21825 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:28.055886 21729 catalog_manager.cc:5697] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 5 to 7, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 7 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.979880 25218 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:28.060014 21799 leader_election.cc:400] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6.
I20260709 13:06:28.065243 21799 leader_election.cc:403] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:28.066354 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.063087 24793 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:28.007252 24967 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:28.068341 25182 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.062405 21949 leader_election.cc:400] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7.
I20260709 13:06:27.860898 25058 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.025792 25197 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.021862 24926 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:28.051285 25246 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:28.075106 21949 leader_election.cc:403] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:28.060360 24880 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:27.955559 25081 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.117309 25081 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:28.058852 25237 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:06:28.026295 25200 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:28.065006 24656 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:28.069093 25209 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6.
I20260709 13:06:28.094375 24841 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:28.094511 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.134239 21825 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:28.096589 24963 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.000s
I20260709 13:06:28.097210 24636 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.075156 25247 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:28.068713 25194 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:28.099967 21826 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:28.051290 25252 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:28.060786 25069 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:28.193339 21982 raft_consensus.cc:2410] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:06:28.079370 21906 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:28.060614 24934 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:28.069685 25107 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:28.102468 25218 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:28.106594 25182 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:28.107012 25195 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260709 13:06:28.108392 25225 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:28.064177 25220 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:28.064630 25205 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:06:28.109678 25199 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.000s
I20260709 13:06:28.065155 25041 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.064477 25188 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:28.110457 25189 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.000s
I20260709 13:06:28.114346 25042 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.114581 24926 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.099347 25197 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:28.072844 21729 catalog_manager.cc:5697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.198964 25247 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:28.215576 25042 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.222569 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1821) took 1377 ms. Trace:
I20260709 13:06:28.222981 21900 rpcz_store.cc:276] 0709 13:06:26.844939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.845074 (+   135us) service_pool.cc:224] Handling call
0709 13:06:26.845438 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:26.845881 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:26.922455 (+ 76574us) log.cc:844] Serialized 14 byte log entry
0709 13:06:27.238068 (+315613us) log.cc:844] Serialized 14 byte log entry
0709 13:06:27.241275 (+  3207us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:27.241624 (+   349us) log.cc:844] Serialized 26 byte log entry
0709 13:06:27.241710 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:27.241735 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.241783 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:27.459175 (+217392us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b1800074aa0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:28.222329 (+763154us) raft_consensus.cc:1685] finished
0709 13:06:28.222360 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.222508 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8862,"prepare.queue_time_us":106492,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":6314,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":17929,"spinlock_wait_cycles":6727680,"thread_start_us":172012,"threads_started":2,"wal-append.queue_time_us":346422}
I20260709 13:06:28.073719 21833 raft_consensus.cc:2410] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:28.122197 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.226626 21827 raft_consensus.cc:2368] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6.
I20260709 13:06:28.226890 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.227308 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.227459 21833 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:28.228251 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.229655 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.230806 21833 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:28.123922 21831 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:28.121114 21832 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:28.091147 25105 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:28.128361 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.240494 21978 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:06:28.240979 21978 pending_rounds.cc:85] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 8
I20260709 13:06:28.241228 21978 pending_rounds.cc:107] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:06:28.241492 21978 raft_consensus.cc:2889] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:28.232189 21729 catalog_manager.cc:5697] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 5 to 8, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 8 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:28.245862 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:28.253063 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:28.254565 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:28.259146 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:28.130559 25198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.039s	sys 0.036s
I20260709 13:06:28.121564 25081 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:28.124302 25200 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.192337 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:28.197084 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 366686us
I20260709 13:06:28.310185 21825 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:28.133292 25246 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:28.135758 25251 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:28.134766 24656 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:28.192577 25002 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:28.195042 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.198266 24934 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:28.202987 25107 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.215974 25041 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.228302 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.121134 21830 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
W20260709 13:06:28.337551 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 271458us
W20260709 13:06:28.215436 25043 consensus_meta.cc:287] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.712s	user 0.006s	sys 0.002s
I20260709 13:06:28.235445 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.342221 21831 raft_consensus.cc:2368] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:28.235603 24946 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.266042 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:28.301892 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.302260 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 410114us
I20260709 13:06:28.215191 25189 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.299907 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 391) took 1002 ms. Trace:
I20260709 13:06:28.306001 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:28.307292 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:28.302654 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.347481 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.330641 25194 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.311702 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:28.311935 21974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39186
I20260709 13:06:28.351791 21974 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.332855 25082 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.352258 21974 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.298864 21729 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:28.353174 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:28.318828 21980 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:28.335067 24934 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.319517 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:28.208161 25195 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.325553 25251 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:28.327509 24656 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:28.303892 25198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.040s	sys 0.037s
I20260709 13:06:28.322547 24793 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:28.332208 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.370245 21829 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:28.333278 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:28.118484 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 56250.8us
I20260709 13:06:28.212212 25199 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.338055 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.377789 21903 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:28.340612 21827 raft_consensus.cc:2368] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:28.300544 24967 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:28.383183 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.343175 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.384814 21831 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:28.261783 22547 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:28.345836 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.348004 21826 raft_consensus.cc:2376] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11. Re-sending same reply.
I20260709 13:06:28.311419 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:28.348486 21979 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:28.350020 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 341018us
I20260709 13:06:28.350905 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.347343 21978 rpcz_store.cc:276] 0709 13:06:27.297567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.797848 (+500281us) service_pool.cc:224] Handling call
0709 13:06:28.240072 (+442224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.241984 (+  1912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.299609 (+ 57625us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54002265d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:28.299815 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972109696}
I20260709 13:06:28.314409 25193 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.337278 25107 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:28.358114 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:28.359840 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48241us
I20260709 13:06:28.360486 21729 catalog_manager.cc:5697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 6, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 6 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.357577 25262 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:28.371240 21949 leader_election.cc:400] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
W20260709 13:06:28.373045 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.451228 21949 leader_election.cc:403] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:06:28.234771 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 188414us
I20260709 13:06:28.380932 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.453641 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.426148 21902 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:28.433905 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:28.454782 21982 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:28.425694 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.435940 21832 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 3: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:28.456555 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.456712 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.457841 21832 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:28.426674 21827 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:28.386158 21833 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:28.369012 25069 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:28.428372 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:28.431356 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:28.477955 21825 raft_consensus.cc:2368] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:28.478408 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.478843 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.386845 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.483603 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.484752 21829 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:06:28.485255 21826 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:06:28.485924 21829 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:28.486470 21826 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:28.433974 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:28.491806 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:28.425428 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:28.494611 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 69284.5us
I20260709 13:06:28.495941 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:28.396637 21981 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 6: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:28.499439 21981 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:06:28.508957 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1892) took 1097 ms. Trace:
I20260709 13:06:28.390736 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:28.390146 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.512161 21904 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:28.457763 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.513669 21831 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:28.515223 21831 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:06:28.515573 21831 pending_rounds.cc:85] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 4
I20260709 13:06:28.515816 21831 pending_rounds.cc:107] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:06:28.516070 21831 raft_consensus.cc:2889] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:28.517531 21831 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:28.459161 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:28.344228 25043 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.520895 25043 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:28.390455 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:28.426780 21729 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 4 to 7, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 7 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:28.460713 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:28.475471 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 104425us
W20260709 13:06:28.521991 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 61354.2us
I20260709 13:06:28.487330 21827 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:28.524878 21907 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:28.524446 21729 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 4, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:28.487071 21983 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:28.525998 21729 catalog_manager.cc:5697] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.527529 21729 catalog_manager.cc:5697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 7, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 7 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.509455 21902 rpcz_store.cc:276] 0709 13:06:27.411361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.513183 (+101822us) service_pool.cc:224] Handling call
0709 13:06:27.513415 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.458353 (+944938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.508679 (+ 50326us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54000fbc54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:28.508887 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2028873600}
I20260709 13:06:28.529947 21729 catalog_manager.cc:5697] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:28.562913 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:28.364866 25082 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.552982 21729 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 7, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 7 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.470940 25262 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.574098 21825 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:06:28.569388 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1891) took 1158 ms. Trace:
W20260709 13:06:28.564147 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 51739.2us
I20260709 13:06:28.580888 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:28.359014 25194 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.580489 21903 rpcz_store.cc:276] 0709 13:06:27.411006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.511908 (+100902us) service_pool.cc:224] Handling call
0709 13:06:27.512144 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.382145 (+870001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.569074 (+186929us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540034ab54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:28.569307 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990291200}
I20260709 13:06:28.483776 25205 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.562325 25220 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:28.596146 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 260791us
W20260709 13:06:28.588613 24984 consensus_meta.cc:287] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.000s
I20260709 13:06:28.562141 25018 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:28.610441 21798 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:28.612751 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 89691.2us
I20260709 13:06:28.615736 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:28.618366 24353 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:28.582396 25250 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:28.585007 25262 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:28.588768 25264 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:28.622478 21729 catalog_manager.cc:5697] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 6 to 7, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 7 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.597370 25069 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:28.638827 25198 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.638185 21729 catalog_manager.cc:5697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 4, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 4 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.639369 25198 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.640007 21729 catalog_manager.cc:5697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:28.641423 25198 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:28.641856 25195 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:28.641352 21729 catalog_manager.cc:5697] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 3 to 6, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 6 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.643060 25194 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:28.648552 24905 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:28.649039 24905 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:28.650017 24905 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.651515 24905 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:28.656456 25209 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:28.656949 25209 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:28.657918 25209 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.659365 25209 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:28.659888 25261 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:06:28.661334 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 566) took 1192 ms. Trace:
I20260709 13:06:28.661720 22552 rpcz_store.cc:276] 0709 13:06:27.469200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.469691 (+   491us) service_pool.cc:224] Handling call
0709 13:06:27.477166 (+  7475us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:27.507699 (+ 30533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.507732 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:27.530142 (+ 22410us) log.cc:844] Serialized 52 byte log entry
0709 13:06:28.135273 (+605131us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:28.135310 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.135385 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.661112 (+525727us) raft_consensus.cc:1685] finished
0709 13:06:28.661137 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.661276 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34951,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":448084,"threads_started":2,"wal-append.queue_time_us":679454}
I20260709 13:06:28.664819 24967 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:28.671746 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.643031 21729 catalog_manager.cc:5697] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 5, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 5 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:28.669761 21974 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.607677 24880 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:28.387149 25247 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:28.690405 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.686758 21974 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:28.694960 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 199084us
I20260709 13:06:28.630834 25187 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:28.698208 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 345109us
I20260709 13:06:28.630208 25266 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.706643 25266 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.710197 25266 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:28.696270 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:28.712478 25069 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:28.712988 25069 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:28.713464 25069 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:28.711510 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:28.715559 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:28.723294 25069 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.636000 25185 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:28.480271 25246 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.634258 25251 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:28.683704 25271 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.591560 24793 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.624366 25105 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
W20260709 13:06:28.727232 25257 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.414s	user 0.000s	sys 0.001s
I20260709 13:06:28.623128 25018 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.605283 25205 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.617259 25220 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.624238 24963 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:06:28.619575 24984 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.752597 21729 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:28.811012 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:28.832695 22552 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.732929 25185 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:28.694697 25270 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:28.726512 25086 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:28.729236 25187 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:28.624477 24841 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 13:06:28.829385 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 489613us
I20260709 13:06:28.732497 25041 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:28.635802 25250 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.793932 25182 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:28.813479 25195 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.810595 25189 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:28.817574 24946 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:28.852777 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 257335us
I20260709 13:06:28.848309 25187 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.861275 21729 catalog_manager.cc:5697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 4, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 4 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:28.867681 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.815099 24880 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.879349 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:28.847891 24993 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:28.867681 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:28.876631 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:28.877749 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:28.840675 25267 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:28.852059 24656 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.879920 21904 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.848263 25199 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:28.852170 25069 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:28.863137 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 252755us
I20260709 13:06:28.902689 21902 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.903646 21900 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:28.901691 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 490) took 1314 ms. Trace:
I20260709 13:06:28.880007 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:28.809727 25271 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.901183 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 491) took 1313 ms. Trace:
I20260709 13:06:28.915599 22553 rpcz_store.cc:276] 0709 13:06:27.587623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.719351 (+131728us) service_pool.cc:224] Handling call
0709 13:06:27.719681 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.719920 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:28.013314 (+293394us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.349244 (+335930us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.901278 (+552034us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b18004af620. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287
0709 13:06:28.901367 (+    89us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:28.901414 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:28.901457 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.901535 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.901641 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4653,"prepare.queue_time_us":490193,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":642466,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":56086,"spinlock_wait_cycles":5474688,"thread_start_us":898961,"threads_started":3,"wal-append.queue_time_us":624939}
I20260709 13:06:28.866729 25086 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:28.919032 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:28.919178 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 202392us
W20260709 13:06:28.942525 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.923837 22554 rpcz_store.cc:276] 0709 13:06:27.588229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.777516 (+189287us) service_pool.cc:224] Handling call
0709 13:06:27.799150 (+ 21634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.799339 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:28.189063 (+389724us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.882756 (+693693us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:28.900801 (+ 18045us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:28.900884 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.901010 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.901124 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85924,"prepare.queue_time_us":412489,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":4118,"raft.queue_time_us":303878,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9830,"thread_start_us":926338,"threads_started":3,"wal-append.queue_time_us":491554}
I20260709 13:06:28.880272 25287 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:28.956056 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.970772 25273 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.337s	user 0.000s	sys 0.000s
W20260709 13:06:28.974102 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55168.4us
I20260709 13:06:28.975487 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:28.977857 21904 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:06:28.864260 25182 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.882803 24984 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:28.982396 21979 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.595s	user 0.002s	sys 0.010s
W20260709 13:06:28.994908 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 114971us
I20260709 13:06:28.879096 25105 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:06:28.993635 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1820) took 1480 ms. Trace:
I20260709 13:06:28.995386 21979 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:28.907313 25078 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:28.954360 25194 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:29.022953 25162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb4eb8dd14248918867a27aa6d9bac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.922184 25193 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:28.922364 25264 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:28.954743 25086 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.906936 25249 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:29.048461 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1837) took 1195 ms. Trace:
I20260709 13:06:29.003855 21828 rpcz_store.cc:276] 0709 13:06:27.513347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.513457 (+   110us) service_pool.cc:224] Handling call
0709 13:06:27.513719 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:27.514040 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:27.514076 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:27.514546 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.190479 (+675933us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:28.190536 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.190635 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.993420 (+802785us) raft_consensus.cc:1685] finished
0709 13:06:28.993440 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.993580 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":690,"raft.run_cpu_time_us":4094,"raft.run_wall_time_us":60533,"thread_start_us":484530,"threads_started":1,"wal-append.queue_time_us":587477}
I20260709 13:06:29.006520 21904 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:28.868119 25195 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.944821 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:29.010432 21900 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:29.008080 24636 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:29.010776 25069 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:29.074353 25069 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:29.076627 25200 consensus_meta.cc:287] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.000s
W20260709 13:06:29.011955 25276 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:06:29.012396 25250 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:29.013145 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:29.078642 25272 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:29.014286 25265 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:06:28.911737 25269 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:06:29.014019 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:29.080919 21905 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:29.002434 25199 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:29.008383 25274 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:29.017055 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:28.978868 25287 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:29.082690 25188 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:29.083140 25188 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:29.018117 24841 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.018752 25271 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:29.094094 25262 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:29.094337 24841 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:29.095000 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:29.019685 25182 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:29.020159 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:29.020880 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:29.021384 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:29.022819 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:29.024231 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1761) took 1230 ms. Trace:
I20260709 13:06:28.997956 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:29.025136 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:29.108240 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:29.109695 21980 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:28.897127 24880 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:29.047612 25086 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:29.132558 25263 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.674s	user 0.001s	sys 0.001s
W20260709 13:06:29.135547 24934 consensus_meta.cc:287] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.000s
I20260709 13:06:29.136023 24934 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:29.137213 21903 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:29.137769 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:29.138707 21979 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:29.034350 21983 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:29.050678 21826 rpcz_store.cc:276] 0709 13:06:27.852705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.490094 (+637389us) service_pool.cc:224] Handling call
0709 13:06:28.490368 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.490542 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:28.832965 (+342423us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.046294 (+213329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.047238 (+   944us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:29.048127 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.048227 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.048386 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":461786,"threads_started":3}
I20260709 13:06:29.002691 25281 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.062960 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:29.158952 21902 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:29.159888 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:29.036737 25041 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:29.061478 25193 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.078814 21907 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 5: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:29.013192 25277 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:06:29.080862 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1899) took 1634 ms. Trace:
I20260709 13:06:29.082124 25264 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:28.898240 25280 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:06:28.927954 24656 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:06:28.973899 25002 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:06:29.085772 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.092072 25188 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:29.077005 25069 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:29.031400 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1842) took 1177 ms. Trace:
I20260709 13:06:29.196015 25086 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:29.200484 21829 rpcz_store.cc:276] 0709 13:06:27.854148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.490204 (+636056us) service_pool.cc:224] Handling call
0709 13:06:28.490544 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.490869 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:28.849973 (+359104us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.031081 (+181108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:29.031134 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:29.031182 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.031248 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.031349 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91750,"raft.queue_time_us":48325,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":420600,"threads_started":2}
I20260709 13:06:29.107959 21906 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:29.112903 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:29.174106 25209 consensus_meta.cc:287] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.003s
I20260709 13:06:29.077076 25200 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:28.923265 25251 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:29.108541 21833 rpcz_store.cc:276] 0709 13:06:27.794073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.481020 (+686947us) service_pool.cc:224] Handling call
0709 13:06:28.575219 (+ 94199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.575591 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.575631 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.589162 (+ 13531us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.848126 (+258964us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:28.848166 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.848230 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.024046 (+175816us) raft_consensus.cc:1685] finished
0709 13:06:29.024064 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.024179 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67824,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":225195,"threads_started":1,"wal-append.queue_time_us":406289}
I20260709 13:06:29.120642 24880 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:29.126627 25220 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:29.127208 25205 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:29.138814 22552 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:29.140163 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:29.139294 22519 leader_election.cc:336] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.519s (SENT)
I20260709 13:06:29.167954 24934 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:29.168543 25187 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:29.169099 25281 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:29.073689 25282 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:29.175601 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:29.177063 21909 rpcz_store.cc:276] 0709 13:06:27.446748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.768909 (+322161us) service_pool.cc:224] Handling call
0709 13:06:27.769178 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:27.769468 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.769494 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:27.838208 (+ 68714us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.335789 (+497581us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:28.335849 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.335955 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.080651 (+744696us) raft_consensus.cc:1685] finished
0709 13:06:29.080671 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.080808 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":249,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":15312,"thread_start_us":437321,"threads_started":1,"wal-append.queue_time_us":975120}
W20260709 13:06:29.181790 24905 consensus_meta.cc:287] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 13:06:29.182495 25058 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:29.182857 25199 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:29.180124 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 71352.5us
I20260709 13:06:29.189540 25078 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:29.191942 25018 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:29.107640 24636 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:29.194262 25041 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:29.137848 25197 consensus_meta.cc:287] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.899s	user 0.010s	sys 0.001s
I20260709 13:06:29.194912 21826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
W20260709 13:06:29.195442 25042 consensus_meta.cc:287] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.975s	user 0.009s	sys 0.000s
W20260709 13:06:29.171063 25299 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:06:29.114303 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:29.209717 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:29.210888 25086 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:29.214663 25249 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:29.174664 25081 consensus_meta.cc:287] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.000s
W20260709 13:06:29.222590 21949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.005s	sys 0.039s
I20260709 13:06:29.099882 25262 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:29.226032 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.120961 25105 raft_consensus.cc:2955] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:06:29.198318 25252 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.996s	user 0.011s	sys 0.000s
I20260709 13:06:29.248605 25280 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.199173 25193 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:29.818998 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.879902 25307 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.162s	user 0.001s	sys 0.001s
I20260709 13:06:29.833515 24880 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.944131 21826 raft_consensus.cc:606] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:29.264091 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.274981 21875 leader_election.cc:336] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.864s (SENT)
I20260709 13:06:29.947206 21826 raft_consensus.cc:614] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:29.702498 25205 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.948367 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 673398us
W20260709 13:06:29.951056 21875 leader_election.cc:336] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.878s (SENT)
W20260709 13:06:29.935842 25107 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.500s	user 0.012s	sys 0.000s
I20260709 13:06:29.951920 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:06:29.950503 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.952556 21974 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:29.301169 21976 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:29.952229 25107 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:29.585487 21729 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.014s	sys 0.019s
I20260709 13:06:29.946269 25297 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:29.590314 25069 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:29.953372 25197 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:29.950786 25205 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:29.955169 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 568) took 2178 ms. Trace:
I20260709 13:06:29.955950 22554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:06:29.956758 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 495) took 1219 ms. Trace:
I20260709 13:06:29.958961 25041 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:29.989117 22555 rpcz_store.cc:276] 0709 13:06:27.776732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.854111 (+ 77379us) service_pool.cc:224] Handling call
0709 13:06:27.854403 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.237165 (+382762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.237194 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.314147 (+ 76953us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.840263 (+526116us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:28.840301 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.841329 (+  1028us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.954952 (+1113623us) raft_consensus.cc:1685] finished
0709 13:06:29.954973 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.955094 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18072,"raft.queue_time_us":63035,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":857116,"threads_started":2,"wal-append.queue_time_us":736294}
W20260709 13:06:29.973887 25182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.003s	sys 0.010s
I20260709 13:06:29.961333 25187 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:29.963196 24636 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:29.555365 25308 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:06:29.965685 25281 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:29.966022 21906 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:29.966545 25280 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:29.967079 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:29.967310 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:29.968182 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:29.968597 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:29.969321 25274 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:29.969976 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:29.944088 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 968606us
I20260709 13:06:30.033511 21834 raft_consensus.cc:2368] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9.
I20260709 13:06:30.033783 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:29.995929 25182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.003s	sys 0.010s
I20260709 13:06:29.945690 24880 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:29.420248 21799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.000s	sys 0.008s
W20260709 13:06:30.039163 21799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.172s	user 0.004s	sys 0.014s
I20260709 13:06:29.974278 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:29.982375 21729 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.014s	sys 0.060s
I20260709 13:06:29.985440 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:30.040462 21902 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:30.041640 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:30.042469 21902 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
W20260709 13:06:29.943719 21949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.012s	sys 0.044s
I20260709 13:06:29.986284 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:30.044608 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 1.42884e+06us
I20260709 13:06:30.045509 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:29.646857 24793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.009s	sys 0.005s
I20260709 13:06:30.051396 24905 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.051528 24880 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:30.051788 24793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.011s	sys 0.006s
I20260709 13:06:30.052525 24793 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.052059 24905 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.053026 24793 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:29.986825 21904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.001s	sys 0.018s
I20260709 13:06:30.054337 25310 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.259884 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 120634us
W20260709 13:06:29.988569 25304 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:06:30.055092 25310 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.056458 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1764) took 2261 ms. Trace:
I20260709 13:06:30.056847 21832 rpcz_store.cc:276] 0709 13:06:27.794828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.481815 (+686987us) service_pool.cc:224] Handling call
0709 13:06:28.482131 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.482447 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:28.482485 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.572407 (+ 89922us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.948217 (+375810us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:28.948343 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.948549 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.056260 (+1107711us) raft_consensus.cc:1685] finished
0709 13:06:30.056281 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.056400 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":337844,"threads_started":1,"wal-append.queue_time_us":992412}
I20260709 13:06:30.058578 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:30.058391 25282 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:30.059841 25188 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.063001 24793 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:29.990859 22554 raft_consensus.cc:606] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:29.990782 22552 rpcz_store.cc:276] 0709 13:06:28.737467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.737658 (+   191us) service_pool.cc:224] Handling call
0709 13:06:29.956686 (+1219028us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:29.994719 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:29.311138 24656 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:29.258460 25189 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:30.066710 25189 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.069240 25189 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:29.842024 25220 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.070330 24934 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:30.070091 25220 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.070851 24934 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.071125 25205 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:29.995041 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44012.5us
W20260709 13:06:30.073035 21875 leader_election.cc:336] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.955s (SENT)
I20260709 13:06:29.973744 25078 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.073494 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:29.996541 21978 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:06:29.981855 25081 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7.
I20260709 13:06:29.989207 25018 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.078821 22554 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:30.079049 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:30.083915 21832 raft_consensus.cc:606] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:30.084375 21832 raft_consensus.cc:614] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:30.008129 21906 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
W20260709 13:06:30.022710 25312 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.340s	user 0.000s	sys 0.000s
I20260709 13:06:29.986086 25042 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.034927 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:30.073982 25280 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:29.971132 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:29.997359 25269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.000s	sys 0.021s
W20260709 13:06:30.140973 25269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.000s	sys 0.022s
I20260709 13:06:30.037652 25281 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.050544 25195 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.050943 25313 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:30.054358 21904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.001s	sys 0.018s
I20260709 13:06:30.079854 25041 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:29.972172 25249 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:29.981455 25252 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.078033 24636 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:30.087250 22548 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:30.088339 21905 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:30.079689 24967 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.094652 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 496) took 1356 ms. Trace:
W20260709 13:06:30.099929 25309 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.552s	user 0.001s	sys 0.012s
I20260709 13:06:30.094319 25018 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.105711 25082 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.033102 25274 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:30.157847 25274 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.158429 22546 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:30.099996 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1912) took 1225 ms. Trace:
I20260709 13:06:30.159116 25274 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.159242 21903 rpcz_store.cc:276] 0709 13:06:28.875031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.875160 (+   129us) service_pool.cc:224] Handling call
0709 13:06:28.875430 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.137593 (+262163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.099699 (+962106us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54002f5dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:30.099918 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601652480}
W20260709 13:06:30.160461 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.161418 25078 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.163040 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1915) took 1285 ms. Trace:
I20260709 13:06:30.164486 25078 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:30.163491 21908 rpcz_store.cc:276] 0709 13:06:28.877669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.882913 (+  5244us) service_pool.cc:224] Handling call
0709 13:06:28.899360 (+ 16447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.899786 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:28.899813 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.900300 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.342050 (+441750us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:29.342112 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.342225 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.162777 (+820552us) raft_consensus.cc:1685] finished
0709 13:06:30.162804 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.162973 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"raft.queue_time_us":82,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":15076,"thread_start_us":362501,"threads_started":1,"wal-append.queue_time_us":1093326}
I20260709 13:06:30.158005 25252 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:30.146869 25316 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:30.166391 25316 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.166810 25316 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.171481 25107 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:30.172384 22553 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:30.151429 25193 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:30.175976 25281 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.177192 25316 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.176705 25281 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:29.990738 25069 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.179075 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1879) took 1920 ms. Trace:
I20260709 13:06:30.179456 21978 rpcz_store.cc:276] 0709 13:06:28.258225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.492801 (+234576us) service_pool.cc:224] Handling call
0709 13:06:28.493155 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:30.076179 (+1583024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.178812 (+102633us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540001ead4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:30.179013 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3456843520}
I20260709 13:06:30.180297 21900 raft_consensus.cc:2410] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:06:30.180495 25316 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.130300 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:30.152521 24636 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:30.130903 21834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1765) took 2314 ms (client timeout 1746 ms). Trace:
W20260709 13:06:30.190222 21834 rpcz_store.cc:269] 0709 13:06:27.795068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.868061 (+ 72993us) service_pool.cc:224] Handling call
0709 13:06:30.109004 (+2240943us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54002887d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:30.109166 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4735876352}
I20260709 13:06:30.191663 24636 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:30.132033 25081 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.192767 24636 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:30.192559 25081 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.193485 24636 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.195290 25081 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:30.139232 25187 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:06:30.196658 24636 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.151332 25041 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:30.199023 25041 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.072364 25220 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:30.039940 25200 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:30.136770 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:30.223207 21832 raft_consensus.cc:606] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:30.142405 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 107545us
I20260709 13:06:30.225538 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:30.057787 25310 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.121699 25201 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:30.231271 25201 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:30.237102 25201 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.239936 24656 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:30.240782 22519 leader_election.cc:336] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.841s (SENT)
I20260709 13:06:30.241403 24656 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:30.242432 21980 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:30.241955 24656 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:30.243662 25018 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.244261 24656 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.231139 24636 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.234777 24905 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.251994 25162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60034 (request call id 475) took 5044 ms. Trace:
W20260709 13:06:30.276230 22519 leader_election.cc:336] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.926s (SENT)
W20260709 13:06:30.286566 22519 leader_election.cc:336] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.939s (SENT)
I20260709 13:06:30.297765 21978 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:29.983264 25199 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.152748 22547 rpcz_store.cc:276] 0709 13:06:28.738266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.738399 (+   133us) service_pool.cc:224] Handling call
0709 13:06:28.738726 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.880772 (+142046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.880807 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:28.880855 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:28.880894 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.094409 (+1213515us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54007044d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:30.094460 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.094592 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326255872}
I20260709 13:06:30.142534 25313 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.156603 24934 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:30.156323 24967 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.176033 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1911) took 2375 ms. Trace:
I20260709 13:06:30.181447 25069 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.182489 25287 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:29.990037 25297 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.183398 25281 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:30.183346 25185 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.188169 25197 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.115813 21949 leader_election.cc:400] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6.
I20260709 13:06:30.152196 21977 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:30.245908 24656 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.333050 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.333886 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.329802 25288 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:30.335632 21979 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:30.325685 21901 rpcz_store.cc:276] 0709 13:06:27.800305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.855094 (+ 54789us) service_pool.cc:224] Handling call
0709 13:06:27.855508 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:27.855977 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:27.856293 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.205578 (+349285us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:28.306298 (+100720us) log.cc:844] Serialized 52 byte log entry
0709 13:06:28.306494 (+   196us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:28.306552 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.306638 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.131973 (+825335us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:30.175486 (+1043513us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54001494a0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef53dbe 00007fb75ef5e930 00007fb75ef5e8d8 00007fb75ef5e858 00007fb75ef5e813 00007fb75ef5da9c 00007fb764e49626 00007fb764e43dd8 00007fb75ef9a7cb 00007fb75ef9d2c0
0709 13:06:30.175801 (+   315us) raft_consensus.cc:1685] finished
0709 13:06:30.175824 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.175979 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5302,"prepare.queue_time_us":163,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":5658,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":2947,"spinlock_wait_cycles":122820096,"thread_start_us":343365,"threads_started":1,"wal-append.queue_time_us":486063}
I20260709 13:06:30.341456 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:30.343549 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:30.346627 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 230991us
I20260709 13:06:30.351907 21832 raft_consensus.cc:606] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:30.352101 21974 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:30.352375 21832 raft_consensus.cc:614] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:30.352371 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.353745 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.349440 21978 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:30.355705 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.357200 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.334709 21982 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:30.347127 21983 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:30.359516 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.363531 21981 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:30.364792 21979 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:30.357884 21978 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:30.365650 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:30.366935 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:30.369484 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.370494 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:30.371685 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:30.372700 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:30.375800 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.376617 21974 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:30.376750 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:30.379000 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:30.377712 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.384871 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 310953us
I20260709 13:06:30.385047 24353 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:30.385195 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.385667 21875 leader_election.cc:336] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.970s (SENT)
I20260709 13:06:30.386188 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:30.386449 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:30.387418 21978 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.353029 25018 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:30.387576 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:30.360749 25185 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.436990 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.376427 25081 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.494221 25018 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.497124 25018 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.252556 25162 rpcz_store.cc:276] 0709 13:06:25.207452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.213440 (+  5988us) service_pool.cc:224] Handling call
0709 13:06:25.340850 (+127410us) ts_tablet_manager.cc:934] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
0709 13:06:28.906851 (+3566001us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:29.959946 (+1053095us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:29.960070 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:30.250938 (+290868us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:30.251366 (+   428us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:30.251783 (+   417us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:30.251867 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":21485,"tablet-copy.queue_time_us":119555,"thread_start_us":137522,"threads_started":2}
I20260709 13:06:30.389156 25195 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.382189 25269 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:30.376582 25107 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:06:30.504906 21978 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
W20260709 13:06:30.502604 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 112679us
W20260709 13:06:30.522933 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 131711us
I20260709 13:06:30.524392 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1856) took 1456 ms. Trace:
I20260709 13:06:30.394891 25187 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.388636 25189 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:30.374534 25252 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:30.504953 25105 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 13:06:30.377527 25220 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 13:06:30.548359 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.532327 25193 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.550031 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.550885 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.552321 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.506060 25282 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.361336 25288 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.503185 25310 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.556253 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:30.581769 21875 leader_election.cc:336] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.530s (SENT)
I20260709 13:06:30.581982 21978 raft_consensus.cc:2376] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8. Re-sending same reply.
I20260709 13:06:30.556500 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.569912 25313 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:30.532500 25280 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:30.558209 24636 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:30.503243 24793 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.587656 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:30.588167 21978 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.564239 21905 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:06:30.588897 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.566030 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.566823 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:30.476732 25058 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 13:06:30.395774 25182 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 13:06:30.549163 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.570847 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:30.572134 21832 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:30.572690 21825 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:30.600962 21825 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:30.578114 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.601552 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:30.556906 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:30.603049 21978 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:30.603317 21979 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:06:30.604019 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:30.585023 21974 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:30.584978 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:30.605145 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 58363.8us
I20260709 13:06:30.500648 25314 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:06:30.559064 24841 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.563037 25200 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:30.606350 25200 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.606753 25200 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.606055 24841 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.612823 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.613512 21832 raft_consensus.cc:2368] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9.
I20260709 13:06:30.613874 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.614374 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.615209 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.615835 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:30.582864 21875 leader_election.cc:336] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.574s (SENT)
I20260709 13:06:30.616626 21828 raft_consensus.cc:2410] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:06:30.617074 21875 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.576s (SENT)
W20260709 13:06:30.618105 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 230567us
I20260709 13:06:30.617317 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:30.634719 21875 leader_election.cc:336] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 2.093s (SENT)
W20260709 13:06:30.637465 21875 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 2.095s (SENT) [suppressed 28 similar messages]
I20260709 13:06:30.637538 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:30.638119 21875 leader_election.cc:336] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 2.130s (SENT)
I20260709 13:06:30.638532 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:30.634997 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.638989 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.639283 21834 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:30.640161 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.640952 21834 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:30.640650 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:30.541534 25195 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.563268 25278 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:06:30.610692 24841 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.645818 25278 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:30.646225 25278 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.646297 25195 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:30.646624 25278 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:30.648392 25188 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.001s
I20260709 13:06:30.648468 25205 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:30.649025 25188 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:30.649057 25205 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.598878 24636 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.651582 21975 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
W20260709 13:06:30.652621 21875 leader_election.cc:336] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 2.154s (SENT)
I20260709 13:06:30.649578 25188 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.601711 21825 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.660351 21825 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.660704 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.658808 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.661684 21832 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:30.663334 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.642668 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:30.677278 25107 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.682132 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.684723 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:30.676594 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 67842us
I20260709 13:06:30.687394 21974 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:30.688402 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.691980 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.694833 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.695420 21978 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:30.698423 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.696871 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:30.699424 21978 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:06:30.702732 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.703161 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.703832 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.704250 21830 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:30.704416 21834 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:30.705394 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.705638 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.706422 21828 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.708662 24636 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:30.708887 25333 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:06:30.592512 25313 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.578775 25285 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:06:30.568179 25252 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.584398 25282 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.582690 25193 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.724329 21825 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:30.728617 21828 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:30.742506 21829 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:30.743319 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.716639 21981 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
W20260709 13:06:30.733084 21875 leader_election.cc:336] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.737s (SENT)
I20260709 13:06:30.703977 25188 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.659448 25270 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:30.703146 25042 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:30.587172 25310 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.762784 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.768816 21830 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:30.770426 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:30.598724 25280 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.598990 24793 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.772441 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:30.774243 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.784193 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:30.742496 24967 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:30.781241 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.777163 21978 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.788859 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.789776 21830 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:30.717648 25082 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:06:30.710587 25041 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:06:30.793833 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 227122us
I20260709 13:06:30.763571 25189 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:30.763741 25270 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.825452 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.780196 24934 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:30.741799 25287 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:06:30.827915 21831 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:30.827886 21978 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:30.721731 25313 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:30.799538 21832 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:30.874641 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:30.887226 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:30.822248 25082 consensus_queue.cc:1243] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:30.877238 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.835074 25205 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:30.881670 21834 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:30.909654 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:30.911525 25349 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:06:30.912336 25338 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:06:30.911631 25287 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:30.912827 25287 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:30.913849 25162 tablet_copy_client.cc:806] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:30.914708 25162 tablet_copy_client.cc:670] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:30.913931 25287 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:30.915961 25287 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.917062 25351 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:30.919358 25310 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:30.887881 25350 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:06:31.020853 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:30.891463 24993 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:30.878319 25200 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:31.025152 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 124609us
I20260709 13:06:31.026254 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:30.921918 25324 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:30.907887 25081 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:31.021958 25185 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.005s
I20260709 13:06:31.027117 24993 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:31.058420 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 357495us
I20260709 13:06:31.040072 25285 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:31.040609 25324 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:31.068238 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:31.073928 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47825.9us
I20260709 13:06:31.074092 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.075361 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.078791 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:31.064718 21830 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:31.070456 25339 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:06:31.088491 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.085726 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.063504 25345 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:31.070956 25324 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:31.089237 22551 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:31.120428 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:31.121918 25341 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 13:06:31.126246 25335 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:06:31.127671 25348 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 13:06:31.128051 25252 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:31.128513 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:31.131085 25249 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.978s	user 0.008s	sys 0.003s
I20260709 13:06:31.131723 25280 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.120464 25288 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.137427 25313 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:31.136729 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:31.138324 25193 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.047536 25189 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.149642 21834 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:31.085503 24793 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.120851 25269 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.136512 25188 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.078156 25285 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:31.155450 25345 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:31.130086 25278 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.166791 25200 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:31.169242 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:31.151872 24656 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.798s	user 0.007s	sys 0.007s
I20260709 13:06:31.227046 21833 raft_consensus.cc:2410] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:31.170354 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:31.170925 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 388609us
W20260709 13:06:31.202427 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.172979 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1857) took 1190 ms. Trace:
I20260709 13:06:31.228931 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:31.230139 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:31.231570 25313 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:31.231709 25205 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:31.231879 25310 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.237366 25310 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.237731 25310 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:31.240633 25201 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.003s	user 0.011s	sys 0.000s
I20260709 13:06:31.241120 25201 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.228279 21909 rpcz_store.cc:276] 0709 13:06:29.982606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.982754 (+   148us) service_pool.cc:224] Handling call
0709 13:06:29.984781 (+  2027us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:30.361251 (+376470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.361294 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:30.361870 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 13:06:30.594453 (+232583us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:30.765936 (+171483us) log.cc:844] Serialized 14 byte log entry
0709 13:06:30.767167 (+  1231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.767235 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.172647 (+405412us) raft_consensus.cc:1685] finished
0709 13:06:31.172677 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.172901 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12924,"prepare.queue_time_us":126594,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":30,"raft.queue_time_us":19708,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":14912,"thread_start_us":519852,"threads_started":3,"wal-append.queue_time_us":470289}
I20260709 13:06:31.165086 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:31.245236 24793 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:31.219692 25188 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:31.163619 25249 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.247531 21830 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:31.244962 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:31.264564 25193 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:31.265367 25193 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.268743 25193 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:31.271934 21826 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:31.271834 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:31.277034 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:31.278322 21798 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:31.282459 21830 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.284158 21830 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.253619 25344 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.291810 21875 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:31.287123 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 514718us
I20260709 13:06:31.247313 25345 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:31.275931 25205 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:31.276304 25288 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:31.208973 25368 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
W20260709 13:06:31.300722 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 225712us
I20260709 13:06:31.297374 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:31.298635 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1873) took 3046 ms. Trace:
I20260709 13:06:31.292801 24656 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.303712 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:31.292887 25313 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:31.308794 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 1.25797e+06us
I20260709 13:06:31.309546 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:31.310652 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:31.304133 21976 rpcz_store.cc:276] 0709 13:06:28.252041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.252184 (+   143us) service_pool.cc:224] Handling call
0709 13:06:28.252544 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.982580 (+1730036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.298313 (+1315733us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400413f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:31.298550 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411004800}
I20260709 13:06:31.289395 25201 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:31.316380 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1860) took 1331 ms. Trace:
I20260709 13:06:31.316982 21978 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:31.297796 25287 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.322032 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1824) took 1353 ms. Trace:
I20260709 13:06:31.317793 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:31.322480 21980 rpcz_store.cc:276] 0709 13:06:29.968239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.968365 (+   126us) service_pool.cc:224] Handling call
0709 13:06:31.321864 (+1353499us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540005a0d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:31.321975 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487826176}
I20260709 13:06:31.318274 21974 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:31.323096 21979 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:31.295975 25344 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.319221 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:31.319895 21900 rpcz_store.cc:276] 0709 13:06:29.984548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.984684 (+   136us) service_pool.cc:224] Handling call
0709 13:06:31.316182 (+1331498us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540034a654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:31.316328 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261694208}
I20260709 13:06:31.325139 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:31.317122 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:31.303840 25187 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.002s
I20260709 13:06:31.334980 25187 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:31.300771 25205 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:31.336768 25205 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.338688 25205 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:31.338677 25278 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:31.325601 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:31.306664 24656 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.343134 24656 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.344847 25249 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:31.329299 25326 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.346724 25326 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.330998 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:31.350881 21831 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:31.351044 25368 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.351887 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:31.331641 21977 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 1871) took 3075 ms (client timeout 2028 ms). Trace:
I20260709 13:06:31.334261 25344 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.351749 25368 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:31.353590 21977 rpcz_store.cc:269] 0709 13:06:28.251444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.254303 (+  2859us) service_pool.cc:224] Handling call
0709 13:06:31.326501 (+3072198us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b540001f4d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:31.326635 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4224925568}
I20260709 13:06:31.352825 21831 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:31.357859 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.317363 24793 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:31.359589 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:31.353394 25274 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.167s	user 0.010s	sys 0.002s
I20260709 13:06:31.318864 25193 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.359218 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:31.372809 21902 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:31.308038 25313 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.366868 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.320437 25360 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:31.374476 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:31.394505 25360 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:31.395211 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:31.395856 21831 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:31.395526 25360 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.396459 25310 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.398572 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:31.399163 22555 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.302405 25269 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.378489 25313 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:31.378628 25345 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.303043 25285 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.379910 24793 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:31.373566 25193 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.413431 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1899) took 1076 ms. Trace:
I20260709 13:06:31.405261 21902 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:31.380757 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:31.414800 21828 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:31.415565 21831 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:31.415875 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:31.416461 21828 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.416761 21831 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:06:31.382807 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.383826 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.385375 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:31.385717 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.356861 25187 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:31.387355 25368 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.389038 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.419768 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:31.420141 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 141920us
I20260709 13:06:31.360138 25082 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:31.402062 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.404134 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.439436 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:31.404438 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.391961 25326 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.421234 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:31.414001 21982 rpcz_store.cc:276] 0709 13:06:30.336526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.362815 (+ 26289us) service_pool.cc:224] Handling call
0709 13:06:31.412457 (+1049642us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:06:31.412718 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.412963 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.413004 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.413065 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:31.413115 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.413196 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.413354 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085568}
I20260709 13:06:31.437068 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:31.441859 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.452344 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.455750 21831 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:06:31.457134 21831 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:31.427408 25193 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.459650 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:31.461971 21828 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 4.
I20260709 13:06:31.448550 25368 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:31.443881 25287 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.452550 25326 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.470409 22555 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:31.471666 22547 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:31.467382 21949 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:31.454675 25199 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:31.474012 25269 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:31.448504 25058 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:06:31.459872 25310 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:31.482209 25324 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.482848 25310 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:31.483772 25310 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:31.484309 25324 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:31.484833 21901 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:31.443729 25187 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.489838 24656 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.491953 24656 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.479869 24993 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:31.492770 25270 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260709 13:06:31.493196 25270 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.478452 25069 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.492010 25187 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:31.604981 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 138931us
I20260709 13:06:31.561903 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.539773 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.569594 21905 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:06:31.609416 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:31.495447 21875 leader_election.cc:336] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 2.364s (SENT)
I20260709 13:06:31.611598 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:31.495831 22550 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:31.614018 21949 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:31.616194 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:31.617134 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:31.619058 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:31.619863 21834 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:31.621842 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:31.625906 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:31.627103 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:31.627686 21834 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:31.467128 25188 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:31.634205 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 138755us
I20260709 13:06:31.633704 25249 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:31.659987 21834 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:31.661386 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:31.662138 21834 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:31.672333 21834 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:31.659056 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.657946 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.678121 21903 raft_consensus.cc:2410] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:06:31.499933 25205 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:31.510617 24905 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:31.509454 24841 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:31.475981 25368 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:31.507589 25282 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.742187 21834 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:31.634696 24963 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:31.735256 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:31.743424 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 355182us
I20260709 13:06:31.744215 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.745424 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.656965 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:31.494058 24993 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.613649 25316 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:31.596830 25082 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:31.476358 25326 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.600387 25343 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:31.648996 25324 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.743752 21905 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
W20260709 13:06:31.737136 25374 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:06:31.752161 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 95292.1us
I20260709 13:06:31.740728 25187 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.753525 21903 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:31.475260 25287 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.508603 25297 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:31.679999 21902 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:31.769170 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.643633 25069 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.737577 25201 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.505777 25193 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.738222 25361 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.744907 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:31.757634 25188 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.678933 25249 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.497068 22548 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.770223 21905 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:31.744010 25344 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.784412 21907 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:31.650125 25189 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:31.748518 25282 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.782684 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:31.777526 25201 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.807050 25361 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.655005 24656 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:31.813630 21900 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.814374 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.767701 21949 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:31.761950 24905 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:31.764266 25082 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.791910 25188 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.825841 21905 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:31.826038 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58439.4us
I20260709 13:06:31.827812 21830 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:31.792143 25380 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:31.777675 25187 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.826943 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:31.835246 21906 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:31.769038 25343 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.828555 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:31.821784 25201 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.837716 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:31.807176 24793 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:31.830499 25269 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:31.830415 25188 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.832495 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 571) took 2827 ms. Trace:
I20260709 13:06:31.855304 24353 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:31.821614 25282 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.843544 25297 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:31.844251 25373 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.895788 25349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.016s	sys 0.020s
I20260709 13:06:31.925203 25326 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.925696 22548 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:31.926540 25344 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:31.814971 25368 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.859597 24793 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.927614 25249 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.927803 25082 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.929562 25282 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.835675 25380 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.936327 24963 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:31.936987 25377 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:06:31.937063 25274 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:31.961400 25380 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:31.937875 25387 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:06:31.962518 25380 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:31.962716 25385 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:06:31.940383 25193 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:31.861217 24905 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.963165 25380 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:31.963716 24905 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:31.964184 25382 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:06:31.825131 24656 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:31.934367 25379 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:31.949204 25349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.016s	sys 0.020s
I20260709 13:06:31.974982 25349 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:31.976078 25349 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.936991 25199 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:31.978840 25343 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:31.947875 25297 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.945585 25269 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:31.964387 25380 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.983588 25287 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:31.985368 25313 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.003s
I20260709 13:06:31.951195 25373 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:31.987849 25270 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:31.985899 25313 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:31.998852 25314 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:31.999420 25314 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:32.000556 25314 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.003193 25316 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:32.003821 25316 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.001909 25314 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:31.821790 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 400587us
W20260709 13:06:32.124522 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.126574 25380 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.127568 25380 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.128249 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:32.129148 21979 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:31.988771 25297 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.405839 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:32.070194 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.075611 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1853) took 1526 ms. Trace:
I20260709 13:06:32.076253 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.079986 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.084867 21903 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.086723 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.089089 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 365) took 1544 ms. Trace:
I20260709 13:06:32.136672 21901 rpcz_store.cc:276] 0709 13:06:30.544649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.544773 (+   124us) service_pool.cc:224] Handling call
0709 13:06:31.316309 (+771536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.485222 (+168913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.087610 (+602388us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540034a654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:32.088517 (+   907us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b540034a650. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:32.088818 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2160880640}
I20260709 13:06:32.137346 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.137666 21906 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:32.138298 21976 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:32.137336 21827 raft_consensus.cc:2368] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
W20260709 13:06:32.139490 21827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1813) took 1525 ms (client timeout 1737 ms). Trace:
W20260709 13:06:32.139978 21827 rpcz_store.cc:269] 0709 13:06:30.613932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.614110 (+   178us) service_pool.cc:224] Handling call
0709 13:06:32.075795 (+1461685us) spinlock_profiling.cc:243] Waited 902 us on lock 0x7b5800010598. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9eee 0000000000375939 00007fb763f2d1e0 00007fb763ff60c4 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:06:32.139346 (+ 63551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112128}
I20260709 13:06:32.139989 21832 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:32.132033 21982 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:32.083069 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.091343 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:32.094421 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 1867) took 1448 ms. Trace:
I20260709 13:06:31.933259 21949 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:31.932730 21983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1826) took 1961 ms (client timeout 2219 ms). Trace:
W20260709 13:06:32.156942 21983 rpcz_store.cc:269] 0709 13:06:29.970768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.970894 (+   126us) service_pool.cc:224] Handling call
0709 13:06:31.860949 (+1890055us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54003a52d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:31.932596 (+ 71647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475538688}
I20260709 13:06:31.857357 22546 rpcz_store.cc:276] 0709 13:06:29.005060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.009054 (+  3994us) service_pool.cc:224] Handling call
0709 13:06:29.068399 (+ 59345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.158937 (+1090538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.817240 (+1658303us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54004f7ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:31.830895 (+ 13655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468693760}
I20260709 13:06:31.959813 24963 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:32.162801 24963 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:32.026368 25361 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:32.164644 24963 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:32.010865 25357 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.092s	user 0.003s	sys 0.001s
I20260709 13:06:32.166602 24963 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:32.022675 25337 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.110s	user 0.003s	sys 0.007s
W20260709 13:06:32.025789 25383 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 13:06:31.988484 25373 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:32.096840 21907 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:32.116642 25269 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.119166 25069 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:32.122026 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.174904 21978 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
W20260709 13:06:32.122394 25351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.204s	user 0.011s	sys 0.016s
I20260709 13:06:30.542732 21904 rpcz_store.cc:276] 0709 13:06:29.068292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.159844 (+ 91552us) service_pool.cc:224] Handling call
0709 13:06:29.160256 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:29.160733 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.160774 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:29.161446 (+   672us) log.cc:844] Serialized 52 byte log entry
0709 13:06:30.143030 (+981584us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:30.499949 (+356919us) log.cc:844] Serialized 14 byte log entry
0709 13:06:30.523743 (+ 23794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.523894 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.523962 (+    68us) raft_consensus.cc:1685] finished
0709 13:06:30.524014 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.524273 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22543,"raft.queue_time_us":23557,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":22236,"thread_start_us":1317220,"threads_started":2,"wal-append.queue_time_us":922969}
W20260709 13:06:32.176016 25351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.011s	sys 0.016s
W20260709 13:06:32.156064 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 222769us
I20260709 13:06:32.177798 25313 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:32.130113 25205 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:32.179262 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:32.144245 21833 rpcz_store.cc:276] 0709 13:06:30.646331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.128285 (+481954us) service_pool.cc:224] Handling call
0709 13:06:32.093977 (+965692us) spinlock_profiling.cc:243] Waited 73.5 ms on lock 0x7b5400031e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:32.094230 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169055616}
I20260709 13:06:32.180244 25205 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.182225 25396 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:32.133761 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.182827 25396 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:32.134444 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.184082 25396 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.184967 24656 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.186506 24656 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:32.187261 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:32.188524 25200 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:32.189122 25200 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:32.190927 25200 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.113567 25201 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.194530 21905 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:32.196578 21902 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 4: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:32.131604 25187 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:32.198412 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.201069 22548 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.206332 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.207548 25351 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:32.211902 21833 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:32.214893 25310 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:32.215587 25310 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.193923 25201 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:32.136080 21829 rpcz_store.cc:276] 0709 13:06:30.548566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.551525 (+  2959us) service_pool.cc:224] Handling call
0709 13:06:30.551850 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.743117 (+191267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.074944 (+1331827us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540009d154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:32.075386 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392981888}
I20260709 13:06:32.236756 21830 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:32.238482 25310 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:32.243741 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.214383 25188 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.263887 21903 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:32.250043 25380 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:32.265480 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:32.265053 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.295233 21829 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:32.295564 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:32.293283 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 117714us
I20260709 13:06:32.302757 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.313421 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.296778 25328 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:32.326603 25328 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:32.327167 25328 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.327246 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.328070 21908 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:32.328320 25200 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:32.329226 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.329041 25200 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.329955 21904 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:32.330922 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.330999 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.331491 25200 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:32.331880 21906 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:32.332058 25200 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.332711 25200 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.324116 25018 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:32.312507 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.333236 21974 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:32.332932 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:32.333917 25018 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:32.334535 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 243715us
I20260709 13:06:32.337168 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.334710 21905 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.338235 21981 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:06:32.341094 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:32.342602 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.339289 25200 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:32.326928 21902 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:32.366595 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.367604 21974 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:32.370015 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.370983 25393 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:32.373430 25393 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:32.374785 21979 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:32.375175 25188 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:32.375425 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.336412 25195 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:06:32.382370 25391 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:32.382933 25391 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:32.384006 25391 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.384326 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.384727 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1869) took 1737 ms. Trace:
I20260709 13:06:32.385216 25391 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.385713 25396 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:32.386264 25058 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:32.386795 25396 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.387218 25058 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.387611 25058 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:32.382445 25199 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:06:32.388616 25058 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.336437 25018 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:32.377105 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.377924 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:32.390336 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53886.3us
I20260709 13:06:32.390769 21909 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:32.391922 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.392601 21909 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 5.
I20260709 13:06:32.392763 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:32.393433 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.378552 25316 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.376296 21983 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:06:32.394138 25069 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:32.395198 25069 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:32.395529 25069 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:32.395948 25069 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.390359 21974 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:32.396858 25195 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:32.395859 25316 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:32.414880 21909 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:32.371021 21900 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:32.385133 21826 rpcz_store.cc:276] 0709 13:06:30.646834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.274974 (+628140us) service_pool.cc:224] Handling call
0709 13:06:31.275333 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.280391 (+  5058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.280436 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.281076 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.816306 (+535230us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b180036e4a0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:06:32.365438 (+549132us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:32.384129 (+ 18691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.384243 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.384289 (+    46us) raft_consensus.cc:1685] finished
0709 13:06:32.384305 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.384561 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4615,"raft.queue_time_us":21121,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":1842,"spinlock_wait_cycles":5072128,"thread_start_us":465860,"threads_started":1,"wal-append.queue_time_us":1098286}
I20260709 13:06:32.423329 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:32.387234 25396 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:32.425101 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:32.427765 21904 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.420727 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.416164 25195 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:32.429653 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:32.432024 21905 raft_consensus.cc:2410] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:32.432677 21901 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.384272 25269 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:32.437628 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.442521 25324 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:32.442896 25396 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.446676 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.446758 21976 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:06:32.447480 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:32.447618 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:32.449506 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:32.451848 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 105990us
I20260709 13:06:32.452996 25195 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.469434 25195 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:32.469465 25324 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:32.470180 25324 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:32.471093 25328 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.471382 25324 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.473245 25324 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.429749 25351 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:06:32.475431 25351 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:32.475871 25351 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:32.476854 25351 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.453644 25398 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:06:32.454322 21983 raft_consensus.cc:2410] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:06:32.455605 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.365459 25349 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
I20260709 13:06:32.462438 21904 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:32.394230 21907 raft_consensus.cc:2955] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:32.463573 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:32.493443 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 149321us
I20260709 13:06:32.494726 25396 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.495962 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:32.496745 21799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.010s	sys 0.034s
W20260709 13:06:32.497076 21799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.010s	sys 0.034s
I20260709 13:06:32.497335 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:32.500593 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53172.5us
I20260709 13:06:32.502552 25345 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:32.503011 25345 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.503355 25345 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.507215 25398 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.507651 25398 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:32.508179 21826 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:32.508044 25370 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:06:32.508671 25398 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.509403 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.510284 21826 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:32.513949 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.515563 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:32.516317 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.516672 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:32.519713 25349 consensus_queue.cc:1243] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:32.518435 25379 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.519863 21977 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:32.531723 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 139191us
I20260709 13:06:32.523434 21980 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:32.478525 25058 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:32.537617 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.473521 25328 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:32.480113 25351 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:32.497990 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 715367us
I20260709 13:06:32.539403 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:32.534523 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.555490 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:32.556597 21901 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:32.558634 21983 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:32.530375 25349 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.561232 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.491747 25187 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:32.561942 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 116269us
I20260709 13:06:32.565964 21979 raft_consensus.cc:2376] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7. Re-sending same reply.
I20260709 13:06:32.567813 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:32.559878 25398 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.562772 25349 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:32.579545 25349 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.581655 25349 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.582804 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.583976 21830 raft_consensus.cc:2410] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:32.585112 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.585875 21830 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:32.591264 24905 consensus_meta.cc:287] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.005s
I20260709 13:06:32.595234 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.594439 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.594648 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.595230 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.595911 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 385) took 1282 ms. Trace:
I20260709 13:06:32.599172 25365 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.606565 21974 raft_consensus.cc:2410] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:06:32.607949 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49713.9us
I20260709 13:06:32.608743 25270 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:32.609146 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:06:32.609607 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.611922 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:32.612042 25379 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.612771 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.615543 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:32.617215 21980 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:32.583000 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:32.643745 21825 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:32.621569 21832 rpcz_store.cc:276] 0709 13:06:31.313527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.325308 (+ 11781us) service_pool.cc:224] Handling call
0709 13:06:32.595607 (+1270299us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b540011dd54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:32.595842 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820984192}
I20260709 13:06:32.644237 21975 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:32.648000 25187 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.622617 25365 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:32.656919 21983 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:32.673943 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:32.669503 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.687673 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.710151 21980 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:32.716013 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.721261 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:32.722334 25365 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.723740 25365 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:32.731073 25297 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.006s
I20260709 13:06:32.731432 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.690611 25270 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:32.731670 25297 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.732744 24905 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.733240 24905 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.673448 25187 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.732152 21828 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
W20260709 13:06:32.737922 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.739152 21982 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:32.761737 21829 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:32.759609 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:32.770579 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 114676us
I20260709 13:06:32.771379 25187 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:32.771919 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.773723 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.776810 21832 raft_consensus.cc:2410] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:06:32.777287 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.783200 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.785180 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.786334 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:32.784479 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 191181us
I20260709 13:06:32.775985 25274 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.792059 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.774878 25069 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.800760 25069 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:32.801620 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:32.802292 25392 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.802951 25392 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.804823 25379 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:32.805214 25392 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:32.805770 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:32.806968 25418 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.225s	user 0.002s	sys 0.002s
I20260709 13:06:32.807137 21825 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:32.807533 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.808009 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.808722 21825 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:32.809530 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.805877 21830 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:32.810878 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.815435 21830 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.795276 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.813053 25297 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:32.808089 21826 raft_consensus.cc:2376] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10. Re-sending same reply.
I20260709 13:06:32.792078 24905 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:32.821316 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.822345 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:32.822592 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.824584 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:32.825171 25270 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.825644 25324 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.829757 25274 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.831426 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:32.832329 25274 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:32.832995 25410 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:06:32.832996 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.833812 25069 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:32.833858 25314 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:32.834458 25069 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:32.834885 25069 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.835325 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.835851 21827 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:32.834065 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.838719 25314 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.839224 25314 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.839890 25187 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:32.841049 25324 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.841420 25324 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:32.842502 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.842363 25324 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:32.843130 21829 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:32.844578 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.847987 21833 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:32.849694 21827 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:32.853245 25069 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.854846 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:32.857883 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:32.859027 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.874609 21832 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 5: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:32.866328 21829 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:32.859249 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:32.873733 22552 raft_consensus.cc:2410] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:32.891098 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.891515 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:32.891837 21826 raft_consensus.cc:2368] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9.
I20260709 13:06:32.895006 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1880) took 1117 ms. Trace:
I20260709 13:06:32.897994 21901 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:32.917429 21827 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [5.8-7.9]
I20260709 13:06:32.918946 21827 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:32.920075 25324 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.920297 21827 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:06:32.921481 21827 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:32.938515 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 151163us
I20260709 13:06:32.939316 25314 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.940634 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:32.942759 22549 raft_consensus.cc:2410] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:06:32.943888 25205 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:32.943174 21903 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:32.946738 25351 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:32.951606 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.953780 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 62372.1us
I20260709 13:06:32.967355 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.968029 21832 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:32.970361 25058 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:32.970855 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 176934us
I20260709 13:06:32.971040 21901 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:32.971681 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:32.956310 25297 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:32.972788 25297 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:32.959878 21828 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:06:32.974319 21828 pending_rounds.cc:85] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 4
I20260709 13:06:32.974603 21828 pending_rounds.cc:107] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.5
I20260709 13:06:32.974942 21828 raft_consensus.cc:2917] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Aborting config change with OpId 6.5: Aborted: Op aborted by new leader
I20260709 13:06:32.975164 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:32.975493 21828 raft_consensus.cc:2889] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:32.976263 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52668 (request call id 9) took 9439 ms. Trace:
I20260709 13:06:32.977496 25195 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.976581 21828 rpcz_store.cc:276] 0709 13:06:23.536966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.537430 (+   464us) service_pool.cc:224] Handling call
0709 13:06:23.731059 (+193629us) log.cc:844] Serialized 506 byte log entry
0709 13:06:24.967166 (+1236107us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b18003a2c40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:32.976144 (+8008978us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239331,"raft.queue_time_us":176409,"raft.run_cpu_time_us":2197,"raft.run_wall_time_us":52938,"spinlock_wait_cycles":9066624,"thread_start_us":41501,"threads_started":1,"wal-append.queue_time_us":449709,"wal-append.run_cpu_time_us":2679,"wal-append.run_wall_time_us":1212959}
I20260709 13:06:32.961020 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:32.978055 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:32.978541 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:32.973795 25297 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:32.979861 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:32.978691 21976 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.981747 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.982729 21906 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:32.982926 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:32.983601 21828 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 4.
I20260709 13:06:32.985991 21827 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:32.991559 25270 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:32.979924 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:32.948252 24841 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:32.980093 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:32.981055 25195 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:32.971937 25058 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:32.945760 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:33.005376 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50357.9us
I20260709 13:06:33.007754 21830 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:33.009249 21829 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: [5.7-8.9]
I20260709 13:06:33.011345 21830 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:33.007072 25345 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.012306 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:33.012934 21982 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
W20260709 13:06:32.997267 21873 leader_election.cc:336] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.667s (SENT)
I20260709 13:06:33.018297 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:32.916548 21834 rpcz_store.cc:276] 0709 13:06:31.623701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.792445 (+168744us) service_pool.cc:224] Handling call
0709 13:06:31.814714 (+ 22269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.293483 (+478769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.295427 (+  1944us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.306814 (+ 11387us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.423733 (+116919us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:32.685174 (+261441us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.690178 (+  5004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.714065 (+ 23887us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.714116 (+    51us) raft_consensus.cc:1685] finished
0709 13:06:32.714126 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.741122 (+ 26996us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22297,"prepare.queue_time_us":74490,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":178392,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":17629,"thread_start_us":744768,"threads_started":3,"wal-append.queue_time_us":199018}
I20260709 13:06:33.022138 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:33.016136 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:33.025107 21830 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:06:33.004155 24841 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:33.027935 21901 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:33.030717 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.027421 25270 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.034598 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:33.035625 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.036206 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.036373 21903 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:33.034776 25270 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.038298 21975 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:33.036743 21906 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:33.044521 21825 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:33.010300 25398 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:06:33.025583 25187 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:33.048590 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 68815.7us
I20260709 13:06:33.039738 24905 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.054567 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:33.056216 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.056496 25270 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:33.057163 25270 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:33.057533 25270 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.049073 21976 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:33.048203 22554 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:33.044394 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.030505 25324 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.030072 24841 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.057906 25270 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.050315 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.060590 21901 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:33.023329 25351 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:06:33.058094 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:33.062071 25368 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.053313 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:33.048269 25195 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:33.066514 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 94953.9us
I20260709 13:06:33.066970 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:33.068641 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 71397us
W20260709 13:06:33.069182 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 123557us
I20260709 13:06:33.071506 21903 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:33.041682 25396 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:33.063246 25328 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.058480 25345 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:33.087945 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:33.095855 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.077667 25069 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:33.105085 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 47074.6us
W20260709 13:06:33.110687 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 103039us
I20260709 13:06:33.087559 25379 raft_consensus.cc:2764] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:33.114090 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:33.075809 25187 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.092667 25368 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:33.119899 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:33.099650 25189 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:33.099150 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:33.099881 24905 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:33.099198 25361 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:33.099213 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:33.138577 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:33.099233 25427 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:06:33.134531 25069 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:33.126055 25189 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.110297 25391 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:06:33.144433 22549 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:33.151571 25328 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:33.153127 24793 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:33.163369 25187 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:33.141942 25314 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:33.137053 25368 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.133971 25361 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:33.165640 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:33.166580 25069 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:33.115809 25274 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:06:33.171267 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 104848us
I20260709 13:06:33.176128 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:33.178495 21832 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.168380 25189 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:33.177080 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:33.175937 22548 raft_consensus.cc:2410] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:33.178344 25361 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:33.198567 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 78805.1us
I20260709 13:06:33.183488 24793 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:33.187346 25187 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:33.188653 25379 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.213109 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.223307 25069 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.226497 25440 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.227030 25440 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.229246 25440 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:33.230854 25368 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:33.231158 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.231009 24963 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.231431 25162 tablet_copy_client.cc:538] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.231916 24963 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.234622 24963 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:33.236049 25439 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:33.254469 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:33.258263 21832 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
W20260709 13:06:33.260780 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 90314.2us
W20260709 13:06:33.262737 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53973.4us
W20260709 13:06:33.270576 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 105032us
I20260709 13:06:33.271298 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.272416 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:33.264372 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:33.275840 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:33.277590 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:33.278306 21976 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:06:33.281209 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 71674.7us
I20260709 13:06:33.259500 25328 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:33.283659 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:33.294189 24793 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.298326 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:33.265592 25368 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:33.305349 21874 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.309163 25270 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.281479 25314 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:33.311424 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 124518us
I20260709 13:06:33.281968 25391 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:33.313403 25373 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:33.316082 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:33.277575 24905 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:33.299304 25195 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:33.322531 21826 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
W20260709 13:06:33.328076 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50571.2us
W20260709 13:06:33.331676 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 71527.8us
I20260709 13:06:33.332854 25328 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.342989 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.332863 25446 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:33.332183 25391 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.339072 24905 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.343276 25368 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:33.333109 25314 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.342989 25449 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:33.350133 25391 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:33.355412 24905 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:33.361554 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 90323.2us
I20260709 13:06:33.355993 25446 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:33.355955 25200 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.350612 25448 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:33.367835 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:33.369992 25365 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:33.346565 25370 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:06:33.370275 25314 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:33.374583 25270 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:33.375995 24841 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.358809 25441 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:06:33.346359 25345 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:06:33.364746 25449 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:33.393671 25365 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:33.410594 25365 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.368438 25069 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.413733 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.414275 21901 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:33.412657 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.410096 25441 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:33.416291 21903 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:33.417521 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:33.418081 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.418128 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.366554 25458 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:06:33.394390 25455 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.431057 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:33.432682 21902 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:33.411866 25365 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.435938 21907 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:33.412461 25449 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:33.439311 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:33.434055 21875 leader_election.cc:400] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9.
I20260709 13:06:33.440922 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:33.439337 25368 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.419579 25441 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:33.446619 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 148381us
I20260709 13:06:33.447432 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:33.440843 25447 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:33.464689 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:33.462368 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 93927.5us
I20260709 13:06:33.446823 25441 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.468495 24841 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:33.468750 25441 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.466799 25373 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.471304 21907 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:33.472044 24905 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.473410 25361 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.474598 25373 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.475384 21904 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:33.475569 25361 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:33.476248 25456 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:33.476655 25456 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:33.477787 25379 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.477568 25456 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.478878 25456 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.479794 24905 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:33.480026 22554 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:33.478896 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.482860 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.482010 25345 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:33.444281 25269 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:33.486853 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:33.497797 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:33.497910 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66983.5us
I20260709 13:06:33.498551 22554 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:33.500749 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:33.502751 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:33.503698 21829 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:33.505324 21979 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.510352 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.511085 21904 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:06:33.517872 22550 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:06:33.518352 22550 pending_rounds.cc:85] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 8
I20260709 13:06:33.518563 22550 pending_rounds.cc:107] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:06:33.518776 22550 raft_consensus.cc:2889] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:33.486089 25447 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:33.526892 25454 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:33.527509 25447 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.529975 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.530320 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.530520 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:33.531124 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 136667us
I20260709 13:06:33.531553 21903 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:33.531741 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.531853 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:33.532575 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.532943 25195 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:33.494069 25345 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:33.495330 25349 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:33.533717 25345 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.534360 25195 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:33.497522 25446 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.496179 25269 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:33.535214 25269 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.533155 21906 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:33.531318 21902 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:33.538962 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet dbb4eb8dd14248918867a27aa6d9bac9: Aborted: Op aborted by new leader
W20260709 13:06:33.540671 25433 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.388s	user 0.002s	sys 0.000s
W20260709 13:06:33.541855 25437 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:06:33.534752 25195 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:33.499279 24841 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:33.547045 21902 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:33.547307 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.547676 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.552562 21979 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:33.552497 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.517869 25458 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:33.579620 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.581161 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:33.582027 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 71760us
I20260709 13:06:33.545383 25058 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.603677 25349 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:33.547057 25297 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:33.549878 24841 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.617959 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 275861us
I20260709 13:06:33.619133 21900 raft_consensus.cc:2410] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:33.627164 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.622746 21908 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:33.634694 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:33.634923 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:33.634768 25189 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.636127 21908 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:33.636409 21981 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:33.637156 25189 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:33.637415 24841 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:33.541961 25391 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.639812 25391 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:33.611141 25195 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.641363 25195 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.580679 25458 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.623099 25316 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:06:33.626446 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.668298 21904 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:33.646008 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.621534 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:33.677974 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 130727us
I20260709 13:06:33.682324 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:33.680832 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 59524.6us
I20260709 13:06:33.606005 25427 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:33.684345 21798 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:33.689472 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 175666us
I20260709 13:06:33.619699 25297 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.674525 25443 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.457s	user 0.008s	sys 0.000s
I20260709 13:06:33.693301 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.645210 25458 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.645568 25324 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.671303 25398 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:33.655261 25162 tablet_bootstrap.cc:492] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:06:33.685792 25392 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:33.712688 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 159514us
I20260709 13:06:33.710103 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:06:33.715369 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 69463.5us
W20260709 13:06:33.712041 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.712785 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet ae693bf6616e4755b822cea96cf12222: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:33.661298 24841 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.642139 25269 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.697161 25297 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.718569 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:33.687978 25379 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:06:33.719864 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:33.689131 25370 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:06:33.725401 21829 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:33.728464 21832 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:33.707058 25427 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.727100 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:33.730722 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.730680 21833 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:33.723954 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.727392 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:33.727638 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44716.3us
I20260709 13:06:33.703256 25316 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:33.706396 25398 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:33.716446 25392 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.734619 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:33.733078 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:33.692982 25345 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.692179 25449 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:33.745957 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50879.5us
I20260709 13:06:33.746928 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:33.742918 25392 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:33.744761 25361 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:33.766360 22550 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:33.766337 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:33.776072 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:33.776701 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.730043 25447 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:33.799312 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.753800 25368 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.765415 25270 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:33.782470 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.783210 25398 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.804664 25269 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:33.807765 25398 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.807999 25370 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:33.808530 25370 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:33.750494 25328 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.786239 25468 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:33.820971 25468 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:33.822008 25468 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:33.786844 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 65001.3us
I20260709 13:06:33.787269 25467 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:33.803421 25452 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.809366 25370 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.821026 25328 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.791563 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:33.851979 21834 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:33.828310 25449 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:33.775525 25058 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.801394 22549 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:33.855777 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 57800.3us
I20260709 13:06:33.805874 25200 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.806067 25447 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:06:33.858305 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 78953.5us
W20260709 13:06:33.863397 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 87399.4us
I20260709 13:06:33.864108 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:33.852008 25269 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:33.859309 25187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.002s	sys 0.014s
I20260709 13:06:33.850226 25270 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:33.857970 25380 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.861337 25398 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:33.870807 25187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.002s	sys 0.014s
I20260709 13:06:33.876861 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.863605 25368 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.860338 25058 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:33.868084 25069 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:06:33.880640 25447 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.881266 25187 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:34.033744 25471 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:06:34.034869 25442 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.819s	user 0.001s	sys 0.002s
W20260709 13:06:34.035171 25474 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:06:34.037400 25187 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:34.038703 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 161920us
W20260709 13:06:34.039037 25476 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:06:34.039510 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:33.966208 25485 raft_consensus.cc:2764] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:06:34.083577 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.958107 25314 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:34.095909 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 56496.9us
W20260709 13:06:34.096653 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 223311us
I20260709 13:06:33.897342 25456 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:33.881439 25380 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:33.881691 25398 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.020414 25269 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:33.892973 25368 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.159497 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:34.085539 25379 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:34.108449 25345 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:34.031733 25447 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:34.184219 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 85000.9us
W20260709 13:06:34.167397 25441 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.007s
W20260709 13:06:34.188786 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 312617us
I20260709 13:06:34.199536 21903 raft_consensus.cc:2410] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:34.202025 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:34.215910 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.218956 25482 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:06:34.226027 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 67586us
I20260709 13:06:34.149348 25270 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.232563 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:06:34.233845 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.238756 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:34.184893 25269 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.178366 25314 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.241873 25490 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:34.249617 25379 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:34.249615 25487 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:34.293977 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 73324.5us
I20260709 13:06:34.261550 25490 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.298956 25396 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:34.300145 25189 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:34.301669 24841 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:34.301757 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:34.304622 25495 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.305660 25441 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:34.306496 25502 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:34.267086 25187 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.330611 21834 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:34.266394 25058 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:34.326401 25297 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.003s
W20260709 13:06:34.347975 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46290.6us
I20260709 13:06:34.351819 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:34.328122 25490 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.364820 25274 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:34.365314 25274 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:34.365732 25274 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.369606 25499 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.370132 25499 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.371474 25484 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:34.372256 25484 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:34.372558 25499 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.374590 24841 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.375741 25484 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:34.380013 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 111454us
I20260709 13:06:34.380306 21907 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:34.336539 25495 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:34.388550 25495 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:34.411942 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.382418 25448 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:34.344311 25441 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.384948 25380 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:34.349364 25187 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.423076 25368 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:06:34.424151 25187 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.425311 25314 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:34.411568 25398 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.426270 25269 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:34.381867 25297 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.428458 25297 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:34.428503 25447 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:34.430313 25494 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:34.430815 25494 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.431509 25441 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.431892 25447 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.432538 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:34.432816 25494 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.434288 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:34.434968 25391 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:34.435364 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:34.436411 25391 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:34.436830 25391 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:34.437216 25391 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.438841 21827 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:06:34.419567 25448 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.439610 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:34.440182 21825 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:34.441112 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:34.441279 25448 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:34.438946 21834 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:34.442498 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:34.443123 21831 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
W20260709 13:06:34.443493 25392 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
I20260709 13:06:34.443902 25392 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.349050 25502 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:34.421314 25458 consensus_meta.cc:287] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.000s
I20260709 13:06:34.446789 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:34.446990 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:34.432449 25447 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.445188 25445 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:34.468510 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:34.472402 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 101657us
I20260709 13:06:34.453630 21875 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:34.454129 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:34.480506 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:34.448261 25458 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:34.461388 25467 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.002s
I20260709 13:06:34.485349 25205 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:34.495416 25205 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:34.495864 25205 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.449482 24793 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:34.450449 25448 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:34.479297 25445 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:34.498307 25467 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:34.485809 25187 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:34.485481 25392 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:34.507016 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 112498us
I20260709 13:06:34.509158 25508 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:06:34.511478 25490 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.506789 25188 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:34.514016 25490 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.500006 24793 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:34.515034 24793 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.522372 25274 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.524644 25274 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:34.516729 25205 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.527455 25447 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.528033 25447 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.528554 25447 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.448024 25487 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:06:34.502636 25448 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:34.533435 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52997.6us
W20260709 13:06:34.540249 21873 leader_election.cc:336] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.585s (SENT)
I20260709 13:06:34.542271 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:34.549027 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 80619.5us
I20260709 13:06:34.530368 25205 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.508318 25187 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.550043 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:34.531975 25508 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:34.556034 21979 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:34.542598 25448 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.559350 21983 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:34.561642 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:34.561777 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:34.562052 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:34.562712 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:34.562903 21982 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:34.548720 25487 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:34.564478 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:34.566490 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:34.561806 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:34.564411 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:34.567108 21976 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:34.571308 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1950) took 1023 ms. Trace:
I20260709 13:06:34.571719 21900 rpcz_store.cc:276] 0709 13:06:33.548367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.548514 (+   147us) service_pool.cc:224] Handling call
0709 13:06:34.571114 (+1022600us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b54003ca854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:34.571235 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85060864}
I20260709 13:06:34.554601 25187 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.572834 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:34.564299 21978 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:34.574095 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:34.574133 25447 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:34.582284 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:34.560603 25380 raft_consensus.cc:2764] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:06:34.574823 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:34.543777 25274 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:34.559857 25270 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:34.576990 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:34.579981 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:34.554711 25508 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:34.583014 21976 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:34.548666 25495 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.584280 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:34.590569 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:34.574863 24841 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.583829 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:34.591328 21981 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:34.587666 21904 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:34.589949 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:34.592319 21905 raft_consensus.cc:2376] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9. Re-sending same reply.
I20260709 13:06:34.586465 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:34.593873 21976 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 13:06:34.595813 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:34.595959 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:34.596254 21909 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:34.596668 21908 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:34.599437 24793 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:34.600286 25480 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.714s	user 0.004s	sys 0.000s
I20260709 13:06:34.602818 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:34.603417 21978 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.604835 21981 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:34.583950 25205 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:34.610092 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:34.610796 21977 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.613576 21981 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:34.614001 21981 pending_rounds.cc:85] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 3
I20260709 13:06:34.614413 21981 pending_rounds.cc:107] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:06:34.614756 21981 raft_consensus.cc:2889] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:34.608251 25205 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:34.603868 24841 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.620730 21975 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:34.621731 24841 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:34.623049 21982 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:34.623385 25345 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:34.623890 25345 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.612942 25380 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:34.626443 25345 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.632936 25508 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.633445 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:34.634225 21904 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.634423 25508 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:34.588557 25445 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.639358 25445 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.644318 25391 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.646124 25458 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.627624 25205 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.650316 24841 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:34.650619 25361 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:34.651103 25361 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.650993 24841 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.651810 25187 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.652933 21900 raft_consensus.cc:2368] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7.
I20260709 13:06:34.654771 25495 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:34.655025 24841 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:34.659768 21833 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:34.660640 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:34.661679 25162 tablet_bootstrap.cc:492] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:06:34.662604 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:34.663280 21825 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.663350 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:34.664207 25521 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:06:34.664860 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50449.7us
I20260709 13:06:34.665627 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:34.666080 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.666420 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:34.666720 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:34.667974 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:34.667794 25205 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.664155 21832 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:34.668866 21829 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:34.669008 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:34.669433 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:34.669636 22554 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:34.669878 25458 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.670676 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:34.670487 25458 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.671927 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:34.672233 21834 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:34.672482 22555 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:34.672643 25458 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:34.674232 25487 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.674451 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:34.674743 25487 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:34.676162 25481 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.786s	user 0.001s	sys 0.000s
I20260709 13:06:34.674104 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:34.676340 21825 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:34.677057 25487 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.677053 21833 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:34.678299 25493 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.440s	user 0.001s	sys 0.000s
I20260709 13:06:34.679299 25380 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:34.681279 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:34.682317 25440 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:34.682221 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:34.682880 25440 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:34.683049 22549 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:34.683782 25440 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.684454 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:34.685484 25351 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.685632 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:34.685974 25351 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.687424 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:34.688081 25351 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.688670 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:34.689213 25324 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:06:34.689514 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.689615 25324 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:34.689767 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:34.697134 21909 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:34.698482 21982 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:34.694120 21904 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:34.694427 21977 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:34.702067 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:34.699298 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:34.705706 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:34.712172 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:34.712971 21904 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.717522 21948 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:34.720628 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:34.724076 21979 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:34.726629 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:34.701828 25351 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.731035 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:34.736479 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:34.732538 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:34.703948 24793 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.733455 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:34.716387 25274 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.739907 21906 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:34.745208 25269 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:34.721544 24841 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:34.690466 25324 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.719672 25380 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:34.644320 25448 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.750659 25187 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.750756 25314 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:34.767158 25514 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:34.770102 25495 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:34.771075 25328 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:34.751601 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:34.810344 21906 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:34.764467 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 1949) took 1217 ms. Trace:
I20260709 13:06:34.811390 21903 rpcz_store.cc:276] 0709 13:06:33.547298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.547459 (+   161us) service_pool.cc:224] Handling call
0709 13:06:34.764251 (+1216792us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400307d54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:34.764383 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490287360}
I20260709 13:06:34.720054 25391 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:34.749054 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:34.799654 25396 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:34.796826 25269 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:34.799528 25189 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:34.758359 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1898) took 1247 ms. Trace:
I20260709 13:06:34.765422 25447 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.746647 25468 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:34.750047 21981 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:34.842034 24793 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.840790 21907 rpcz_store.cc:276] 0709 13:06:33.510583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.510696 (+   113us) service_pool.cc:224] Handling call
0709 13:06:33.517091 (+  6395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.380931 (+863840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.758143 (+377212us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b54002378d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:34.758308 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984385408}
I20260709 13:06:34.800134 25514 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.812786 25515 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:34.744004 25351 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.845498 24841 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.856881 24841 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.847231 25463 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 13:06:34.812500 25365 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:06:34.860169 25365 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:34.860689 25365 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:34.862066 25365 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.776752 25274 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.849041 25514 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.843065 25058 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:34.839205 25396 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:34.844398 25468 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:34.871461 25269 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:34.873245 25189 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:34.874076 25487 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:34.874279 25463 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:34.882629 25468 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.844125 25447 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.993326 25069 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.993878 25069 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.943310 25195 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:34.943437 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1948) took 1397 ms. Trace:
I20260709 13:06:34.966310 25380 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:34.978067 25396 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.979624 25448 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:34.868784 25058 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:35.002095 25058 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.003513 25058 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:35.005349 25396 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.987421 25269 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.988969 25189 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:34.888651 25487 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:35.020704 25487 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.022294 25487 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.995038 25380 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.999584 25515 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:35.025719 25515 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:35.000640 25187 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:35.027081 25187 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:34.922989 25345 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:35.052665 25345 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:34.985656 25463 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:35.057781 25463 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.059031 25463 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.028127 25187 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.061913 25187 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:35.074887 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.084728 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:35.085732 25513 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:35.086208 25513 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.086609 25513 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.995276 21901 rpcz_store.cc:276] 0709 13:06:33.546276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.547028 (+   752us) service_pool.cc:224] Handling call
0709 13:06:33.580263 (+ 33235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.658732 (+ 78469us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:33.719370 (+ 60638us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.855822 (+136452us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.675167 (+819345us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b18004247e0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:06:34.686558 (+ 11391us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18004247e0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:34.942971 (+256413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.943047 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:34.943105 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.943214 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.943369 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17158,"prepare.queue_time_us":155262,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":49562,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":2671,"spinlock_wait_cycles":11599104,"thread_start_us":412163,"threads_started":3,"wal-append.queue_time_us":146490}
W20260709 13:06:35.156585 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 407590us
I20260709 13:06:34.789448 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:35.158133 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:35.160848 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:35.162055 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:35.163166 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:35.166253 21831 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:35.158820 21900 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:35.168414 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:35.173197 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:35.174569 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:06:35.174870 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 442334us
I20260709 13:06:35.176714 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:35.183792 21831 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:35.188339 21904 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:35.189848 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:35.193900 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:35.196008 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:35.199628 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:34.860826 21728 catalog_manager.cc:5697] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 4 to 5, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 5 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.201699 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:35.197417 25328 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:35.215819 25449 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:35.215984 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:35.217100 25503 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:35.213758 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:35.218585 22546 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:35.197234 25391 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.219460 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 43599.4us
I20260709 13:06:35.219692 25391 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.220767 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:35.221714 25391 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.222481 25446 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:35.222863 21729 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 220) took 20418 ms (client timeout 15000 ms). Trace:
I20260709 13:06:35.187747 25205 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.230311 25380 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.230609 25205 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.230216 21728 catalog_manager.cc:5697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.231055 25380 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:35.232745 25351 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.192055 25448 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:35.233232 21728 catalog_manager.cc:5697] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.236665 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:35.221807 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:35.198755 25162 tablet_bootstrap.cc:492] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:06:35.238977 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:35.223240 21729 rpcz_store.cc:269] 0709 13:06:14.804009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.804717 (+   708us) service_pool.cc:224] Handling call
0709 13:06:35.222625 (+20417908us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:29.946910 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:29.947555 (+   645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:29.947590 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:29.947606 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:29.949195 (+  1589us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:29.949271 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:29.949295 (+    24us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:06:30.026883 (+ 77588us) tablet.cc:701] Row locks acquired
0709 13:06:30.026908 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:06:30.027124 (+   216us) write_op.cc:270] Start()
0709 13:06:30.027272 (+   148us) write_op.cc:276] Timestamp: P: 1783602390027061 usec, L: 0
0709 13:06:30.027296 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:30.154773 (+127477us) log.cc:844] Serialized 8297 byte log entry
0709 13:06:30.911292 (+756519us) op_driver.cc:464] REPLICATION: finished
0709 13:06:31.130152 (+218860us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75bed40ac 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb762a14ef0
0709 13:06:31.209356 (+ 79204us) write_op.cc:301] APPLY: starting
0709 13:06:31.213499 (+  4143us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:31.242724 (+ 29225us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:31.242758 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:31.297660 (+ 54902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:31.382245 (+ 84585us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:06:31.382290 (+    45us) write_op.cc:312] APPLY: finished
0709 13:06:31.382663 (+   373us) log.cc:844] Serialized 145 byte log entry
0709 13:06:31.382820 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:31.382998 (+   178us) write_op.cc:454] Released schema lock
0709 13:06:31.383052 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:31.383398 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:31.383425 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":495003,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":260742,"apply.run_cpu_time_us":9202,"apply.run_wall_time_us":211033,"num_ops":21,"prepare.queue_time_us":916073,"prepare.run_cpu_time_us":45018,"prepare.run_wall_time_us":444779,"raft.queue_time_us":186418,"raft.run_cpu_time_us":9788,"raft.run_wall_time_us":311960,"replication_time_us":876691,"spinlock_wait_cycles":186491648,"thread_start_us":1559676,"threads_started":4,"wal-append.queue_time_us":402255,"wal-append.run_cpu_time_us":13018,"wal-append.run_wall_time_us":1835205}]]}
I20260709 13:06:35.240351 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:35.242679 21903 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:35.239982 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:35.258518 21908 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:35.245050 25069 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.286525 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:35.287477 21900 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:35.246214 21907 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:35.258912 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:35.259101 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:35.264084 25458 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.264087 21728 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 2 to 3, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.266320 22549 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:35.248476 25349 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:35.190726 25324 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.268175 22546 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:35.268440 22548 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:35.270080 25508 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.002s
I20260709 13:06:35.198518 25528 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.274693 25162 ts_tablet_manager.cc:1403] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 1.620s	user 0.041s	sys 0.024s
I20260709 13:06:35.278080 21780 placement_policy_util.cc:248] tablet 864ca05a434d488c83f87f71e27dfa63: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:06:35.278641 25274 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.282485 25391 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:35.285665 25446 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:35.292196 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:06:35.292959 21909 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.018s
I20260709 13:06:35.341240 21909 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:35.298322 25188 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.197738 25270 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:35.310320 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.191907 25495 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 13:06:35.238602 25195 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:35.315637 24793 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.311043 24841 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.350085 21907 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:35.336155 25528 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:35.351603 21981 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:35.321287 21982 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
W20260709 13:06:35.325724 21978 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.719s	user 0.005s	sys 0.018s
I20260709 13:06:35.327389 21728 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 3 to 4, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 4 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:35.331579 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:35.352366 21978 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:35.238903 25447 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.294044 25365 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:35.249111 25351 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.327567 25440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.029s	sys 0.042s
W20260709 13:06:35.339382 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 243224us
I20260709 13:06:35.323858 25458 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:35.342067 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49946.4us
W20260709 13:06:35.344295 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.248013 25467 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.340835 25391 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:35.365285 21905 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:35.366804 21905 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:06:35.368662 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.370360 21903 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:35.329963 25349 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.343253 25463 raft_consensus.cc:2764] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:06:35.374565 21948 leader_election.cc:400] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7.
I20260709 13:06:35.374910 21948 leader_election.cc:403] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:06:35.362224 25440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.030s	sys 0.042s
I20260709 13:06:35.371557 25458 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.352730 25345 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.380453 25467 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.352478 25448 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:35.373121 24793 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.353241 25528 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.385339 21728 catalog_manager.cc:5697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 2 to 3, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.387135 24793 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.387630 21728 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 4 to 5, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 5 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:35.373787 25351 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.392400 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:35.395848 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:35.395860 21728 catalog_manager.cc:5697] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 3 to 5, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 5 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:35.397859 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:35.399443 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:35.401057 25446 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:35.401440 25446 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:35.401804 25446 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.405434 25503 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.406260 25058 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:35.396907 25463 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:06:35.396705 25440 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.384047 25345 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.405503 25468 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:35.392972 25361 consensus_meta.cc:287] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.007s
I20260709 13:06:35.388350 25502 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.406708 25391 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.412412 25200 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:35.412281 25274 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:35.388046 25448 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:35.446985 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 48cad01af8fd4976ba77658d6a8e31b7: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:35.449846 21907 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:06:35.450804 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:35.459064 21907 pending_rounds.cc:85] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 5
I20260709 13:06:35.459363 21907 pending_rounds.cc:107] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:06:35.459576 21907 raft_consensus.cc:2889] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:35.445897 25349 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.427237 25440 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.447224 25502 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.446002 25513 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.437036 25361 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.430326 25515 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.461189 25200 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:35.431591 25345 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.486431 25478 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.488037 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:35.488297 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:35.489566 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:35.491302 25314 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:35.491720 21975 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:06:35.494870 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 280359us
W20260709 13:06:35.544355 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.544932 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.469691 22549 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:35.546222 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:35.547331 21833 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:35.495695 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 299753us
I20260709 13:06:35.546857 21831 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:35.549913 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:35.496838 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 339022us
I20260709 13:06:35.498370 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:35.475469 25445 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.836s	user 0.019s	sys 0.010s
I20260709 13:06:35.467486 25274 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:35.467567 25440 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.483968 25468 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:35.572579 25535 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:06:35.539991 25351 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.478206 25502 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.590078 25274 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.606567 25200 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.622987 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:35.623595 21982 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:35.624958 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:35.625638 21982 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:35.627837 25445 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:35.628298 25445 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:35.630654 25532 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:06:35.632011 25452 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:35.632638 25452 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.640486 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1919) took 1043 ms. Trace:
I20260709 13:06:35.641266 25515 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.640884 21902 rpcz_store.cc:276] 0709 13:06:34.597316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.961352 (+364036us) service_pool.cc:224] Handling call
0709 13:06:35.343091 (+381739us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5800003098. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:06:35.343281 (+   190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.351123 (+  7842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.351149 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.373643 (+ 22494us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.431985 (+ 58342us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:35.542989 (+111004us) log.cc:844] Serialized 14 byte log entry
0709 13:06:35.543270 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.543343 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.640197 (+ 96854us) raft_consensus.cc:1685] finished
0709 13:06:35.640310 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.640433 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11665,"raft.queue_time_us":6806,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":18541,"spinlock_wait_cycles":443457920,"thread_start_us":147084,"threads_started":2,"wal-append.queue_time_us":167828}
I20260709 13:06:35.651240 25503 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:35.651727 25503 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:35.652734 25503 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.655382 25513 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.656349 25195 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:35.656806 25195 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:35.657840 25195 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.659101 25195 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.671698 25361 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.609656 25162 raft_consensus.cc:359] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc [term 7 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.678772 25162 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:06:35.679632 25162 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:06:35.545855 25478 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.683929 25345 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.688104 25446 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.566984 25058 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:06:35.698226 24793 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.763600 25478 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.752770 25205 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.765213 25205 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.768229 25205 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.774909 25205 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.712292 25540 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.777611 25540 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.780202 25540 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.610642 25468 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:35.781055 25468 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.783509 25468 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:35.726513 25514 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.854s	user 0.009s	sys 0.018s
I20260709 13:06:35.784533 25514 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.786023 21980 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:35.787053 25514 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.728771 25502 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.788908 25205 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.707283 25448 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.776377 25452 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.845595 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:35.846462 21982 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:35.846566 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:35.736363 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.847537 21981 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 12: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:35.848497 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:35.848719 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:35.849262 21975 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:35.711192 24841 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.850380 25478 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.850940 25365 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.850862 25478 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.851331 25365 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.851692 25365 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.853001 25478 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:35.792780 25446 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:35.796379 25162 ts_tablet_manager.cc:1434] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.458s	user 0.010s	sys 0.000s
W20260709 13:06:35.854648 25162 ts_tablet_manager.cc:1467] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Tablet startup took 518ms
I20260709 13:06:35.800930 22547 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:35.753854 25445 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:35.675225 25528 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:35.807968 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:35.811038 21974 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:35.654153 25503 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.831799 25458 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.807758 25467 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 6. Current term is 7.
W20260709 13:06:35.869583 21974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1861) took 1313 ms (client timeout 1585 ms). Trace:
W20260709 13:06:35.869745 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 377374us
I20260709 13:06:35.870445 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:35.871682 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:35.872982 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:35.873441 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:35.870147 21974 rpcz_store.cc:269] 0709 13:06:34.555361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.555465 (+   104us) service_pool.cc:224] Handling call
0709 13:06:35.868317 (+1312852us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003a43d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:35.868438 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2316964224}
I20260709 13:06:35.876510 21904 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:35.877398 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.001s	sys 0.025s
I20260709 13:06:35.878122 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:35.879138 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.001s	sys 0.026s
W20260709 13:06:35.879519 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 697494us
I20260709 13:06:35.876507 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:06:35.882287 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.891353 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 338462us
I20260709 13:06:35.940127 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:35.941246 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:35.893537 21906 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.030s	sys 0.034s
I20260709 13:06:35.894857 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:35.942494 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:35.946014 21906 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.031s	sys 0.038s
I20260709 13:06:35.942751 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:35.943131 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.947868 21900 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.948764 21974 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:35.949991 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:35.950615 22550 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.950013 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:35.951802 22547 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:35.952880 21978 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:35.952771 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:35.954416 21980 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
W20260709 13:06:35.871048 25189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.019s	sys 0.046s
I20260709 13:06:35.882328 25478 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.964870 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:35.964975 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:35.955629 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:35.882372 25314 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.956974 21831 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:35.957413 21825 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:35.957788 21832 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:35.981961 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.023s	sys 0.052s
W20260709 13:06:35.982313 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.023s	sys 0.052s
I20260709 13:06:35.959204 21834 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:06:35.886837 25502 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.875584 25514 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:35.962731 21979 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:35.963981 22549 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:35.964339 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:35.893846 25269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.024s	sys 0.041s
I20260709 13:06:35.890234 25515 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:35.958290 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:35.974579 25189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.019s	sys 0.051s
W20260709 13:06:35.983155 22521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.004s	sys 0.025s
I20260709 13:06:35.994366 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:35.994343 22521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.025s
I20260709 13:06:35.969834 21900 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:35.960485 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:35.987443 21904 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:36.008137 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47745.4us
I20260709 13:06:35.891566 25368 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:35.885684 25452 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:06:35.953408 25540 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:35.882201 25449 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:06:35.988473 21977 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:36.009845 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:35.980485 25314 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:35.992415 25269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.024s	sys 0.046s
I20260709 13:06:36.014282 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:36.059126 25528 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:36.061491 25458 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:36.067593 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.067762 25541 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:36.068444 21827 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.069305 25541 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:36.070406 25540 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:36.071163 25540 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:35.978266 25188 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:06:36.072384 25540 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.073756 25189 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:36.074235 25189 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:36.075399 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.075275 25189 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:35.855098 25162 ts_tablet_manager.cc:1469] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Trace:
0709 13:06:25.207452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.213440 (+  5988us) service_pool.cc:224] Handling call
0709 13:06:25.340850 (+127410us) ts_tablet_manager.cc:934] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
0709 13:06:28.906851 (+3566001us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:29.959946 (+1053095us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:29.960070 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:30.250938 (+290868us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:30.251366 (+   428us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:30.251783 (+   417us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:30.251867 (+    84us) inbound_call.cc:177] Queueing success response
0709 13:06:30.913734 (+661867us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b4c00247bc0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d2aaa20 00007fb75d2bba29 00007fb75d2605e6 00007fb75d275b13 00007fb75d275945 00007fb75d2e87ad 00007fb763fbc198 00007fb763fbc137 00007fb763fbc09c 00007fb763fbc038 00007fb763fbb300
0709 13:06:33.654630 (+2740896us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:35.344141 (+1689511us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:35.380023 (+ 35882us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:35.380634 (+   611us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":21485,"mutex_wait_us":112967,"raft.queue_time_us":115964,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":110243200,"tablet-copy.queue_time_us":119555,"tablet-download-pool.queue_time_us":229,"tablet-download-pool.run_cpu_time_us":1928,"tablet-download-pool.run_wall_time_us":2271276,"thread_start_us":137522,"threads_started":2}
I20260709 13:06:36.014659 25515 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.016359 25391 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.017318 25514 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:35.890503 25468 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:06:36.130015 21825 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:36.130748 25541 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:36.018733 21826 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:06:35.975811 25478 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:35.996898 22521 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.595s (SENT) [suppressed 23 similar messages]
I20260709 13:06:36.037774 25449 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:36.044390 25314 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.077006 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.125875 22547 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:36.018882 25368 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:36.132233 21800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.002s	sys 0.023s
I20260709 13:06:36.132226 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.162485 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:36.192448 21829 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:36.192690 21900 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:36.164434 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1921) took 1566 ms. Trace:
I20260709 13:06:36.191505 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.193706 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:06:36.192096 21800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.002s	sys 0.023s
I20260709 13:06:36.194242 21826 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:36.140682 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:36.133903 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:36.196588 21903 raft_consensus.cc:2410] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:36.197778 21833 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:36.200654 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.204558 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.192691 21832 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:36.196756 21975 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
W20260709 13:06:36.220486 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.255045 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 61412.7us
I20260709 13:06:36.207237 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.324515 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.273967 21833 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:36.352423 21830 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:36.274475 21826 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:06:36.316248 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.198021 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57472.8us
W20260709 13:06:36.221486 21728 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.002s	sys 0.034s
W20260709 13:06:36.357394 21728 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.002s	sys 0.048s
W20260709 13:06:36.208658 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 223338us
W20260709 13:06:36.361285 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.256803 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.364820 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.367987 21832 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:36.131183 25541 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:36.343467 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1920) took 1745 ms. Trace:
I20260709 13:06:36.192986 25449 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:36.366675 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:36.161916 25468 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:36.197162 25368 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.386924 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.392930 21832 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:36.206645 25478 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.192961 25189 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:36.395934 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 429367us
I20260709 13:06:36.325462 25544 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:36.205761 21827 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:36.354264 25463 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.380435 25440 consensus_meta.cc:287] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.000s
W20260709 13:06:36.409987 21905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.021s	sys 0.053s
I20260709 13:06:36.412834 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:36.372522 21906 rpcz_store.cc:276] 0709 13:06:34.597507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.983047 (+385540us) service_pool.cc:224] Handling call
0709 13:06:35.154877 (+171830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.155244 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.155271 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.177962 (+ 22691us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.946574 (+768612us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:35.992508 (+ 45934us) log.cc:844] Serialized 14 byte log entry
0709 13:06:36.275098 (+282590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.275188 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.275238 (+    50us) raft_consensus.cc:1685] finished
0709 13:06:36.275255 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.343376 (+ 68121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239616,"prepare.queue_time_us":32240,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":4490,"raft.queue_time_us":341975,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":40240,"thread_start_us":720006,"threads_started":1,"wal-append.queue_time_us":820086}
I20260709 13:06:36.206941 25398 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:36.413774 21905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.021s	sys 0.054s
W20260709 13:06:36.400287 25200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.034s	sys 0.086s
W20260709 13:06:36.419269 25200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.035s	sys 0.086s
W20260709 13:06:36.422530 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.422906 25449 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.426224 25069 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:36.387872 25205 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:36.456090 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 429160us
I20260709 13:06:36.434520 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 396) took 1177 ms. Trace:
I20260709 13:06:36.400420 25361 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.412817 25365 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.003s
I20260709 13:06:36.448169 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:36.370240 25559 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:36.453253 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.412339 25297 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:36.354558 25502 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:06:36.411669 25187 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:36.456202 25324 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:36.385499 25468 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.409713 25270 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:06:36.428714 25463 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.411582 25528 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:36.411587 25440 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.476506 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.478437 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:36.451399 25458 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:06:36.446350 25539 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:06:36.500205 22550 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.003s
I20260709 13:06:36.483816 25324 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.502044 25324 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.510237 25546 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:06:36.490039 25560 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:36.470104 25365 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:36.516450 25463 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:36.483547 25297 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:36.517586 25365 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:36.499326 25528 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.520498 25528 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:36.524947 25514 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:36.500686 22550 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
W20260709 13:06:36.492798 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.495041 22547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:06:36.528012 22547 raft_consensus.cc:606] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:06:36.528388 22547 raft_consensus.cc:614] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:36.486632 25553 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:06:36.479926 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:36.538757 21903 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:36.492938 21904 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:36.482904 25448 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:36.528394 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 531486us
I20260709 13:06:36.469851 25361 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:36.549453 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:36.533676 21832 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:06:36.552357 21832 pending_rounds.cc:85] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 5
I20260709 13:06:36.552636 21832 pending_rounds.cc:107] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:06:36.552886 21832 raft_consensus.cc:2889] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:36.536017 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.551678 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.554890 21827 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:36.433854 25544 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:36.549382 22521 leader_election.cc:336] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 2.141s (SENT)
I20260709 13:06:36.500674 25458 consensus_queue.cc:1243] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:06:36.529817 25503 consensus_meta.cc:287] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.005s
I20260709 13:06:36.579555 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:36.581027 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:36.581640 21906 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:36.550431 25195 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.891s	user 0.012s	sys 0.000s
I20260709 13:06:36.514626 25560 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.485720 25559 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.616595 21904 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:36.578266 25365 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:06:36.584254 25564 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:06:36.576650 25448 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:36.575070 25514 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:36.582487 25515 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:36.623152 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:36.624159 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 74826.8us
W20260709 13:06:36.624720 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 445713us
I20260709 13:06:36.629106 21903 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:36.466555 25541 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.619753 25503 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:06:36.517663 25297 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.588088 25567 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.635739 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:36.674630 21977 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:36.680117 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44489.4us
I20260709 13:06:36.641613 25365 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:36.684136 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:36.686160 21904 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:36.688458 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 240364us
I20260709 13:06:36.691870 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:36.693176 21903 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:36.457266 21905 rpcz_store.cc:276] 0709 13:06:35.256766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.367670 (+110904us) service_pool.cc:224] Handling call
0709 13:06:35.367924 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.368123 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:35.858948 (+490825us) log.cc:844] Serialized 14 byte log entry
0709 13:06:36.434082 (+575134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:36.434146 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:36.434240 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.434322 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.434457 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17908,"prepare.queue_time_us":486459,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":15569,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2683,"thread_start_us":1039642,"threads_started":2}
I20260709 13:06:36.696720 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:36.684508 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 327968us
I20260709 13:06:36.700945 22520 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:36.703538 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:36.704298 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 245658us
I20260709 13:06:36.638994 25467 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:06:36.705576 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:36.708045 21900 raft_consensus.cc:2393] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:36.709662 21977 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:36.681537 25463 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:36.713738 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:36.715802 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:36.699038 25562 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:06:36.727783 21903 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:36.729038 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:36.677464 25514 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.676910 25269 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:06:36.730558 21902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.048s	sys 0.120s
W20260709 13:06:36.738348 21902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.048s	sys 0.120s
I20260709 13:06:36.697660 25544 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:36.741482 25559 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:36.716471 25452 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.748277 25452 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.750898 25452 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:36.716246 25528 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.751771 25528 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.686868 25314 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:36.756536 25314 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:36.743000 25502 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:36.758631 25502 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.761276 25528 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:36.695243 25555 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:36.681288 25567 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.722671 25541 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:36.763248 25502 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:36.775141 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:36.722293 25468 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:36.777666 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 70346.2us
I20260709 13:06:36.778715 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:36.779644 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:36.784776 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:36.765036 25069 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.764583 25195 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.796028 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:36.798468 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.799045 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.800661 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:36.782625 25566 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:06:36.830485 21828 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:36.834079 21904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39266
I20260709 13:06:36.834347 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.834662 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.834826 21904 raft_consensus.cc:606] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:36.835014 21828 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.835206 21827 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:36.835310 21904 raft_consensus.cc:614] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:36.835702 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.793434 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:36.773500 25440 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:36.841997 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.842813 21832 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:36.837142 21900 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:36.776970 25559 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:36.796128 25468 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:36.861857 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.852869 25361 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:36.882844 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.885434 25572 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:36.886555 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:36.887166 21825 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.894413 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:36.898726 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.737587 25448 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.799767 25069 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.895855 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:36.776139 25365 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:36.853235 25528 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.854861 25458 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:36.802574 25195 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.883737 21826 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:36.911386 21830 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:36.919695 21903 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: [8.3-10.4]
I20260709 13:06:36.930064 21825 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:36.921130 21827 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:06:36.930575 21903 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:06:36.922667 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 240206us
W20260709 13:06:36.926405 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 222972us
I20260709 13:06:36.934628 21903 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:36.936903 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:36.937129 21903 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:36.868897 25575 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.878919 25205 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:36.927676 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1928) took 2223 ms. Trace:
I20260709 13:06:36.938656 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:36.999171 22550 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.879449 25560 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:36.868628 25576 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:36.943028 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:36.865197 25324 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:36.884109 25559 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:36.944283 21825 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:36.994536 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.068259 21826 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:36.906883 25574 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.994997 21827 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:37.068354 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:37.076035 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.076797 22550 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:37.077275 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:37.048290 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.997115 21909 rpcz_store.cc:276] 0709 13:06:34.704398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.352093 (+647695us) service_pool.cc:224] Handling call
0709 13:06:35.364395 (+ 12302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.375856 (+ 11461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.375885 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.557685 (+181800us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b2c00010828. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:06:35.567730 (+ 10045us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.195973 (+628243us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:36.365002 (+169029us) log.cc:844] Serialized 14 byte log entry
0709 13:06:36.411013 (+ 46011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.411095 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.425236 (+ 14141us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b180026c380. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef1522 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:36.927414 (+502178us) raft_consensus.cc:1685] finished
0709 13:06:36.927445 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.927608 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56890,"prepare.queue_time_us":177865,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":9458,"raft.queue_time_us":59567,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":15638,"spinlock_wait_cycles":7861120,"thread_start_us":460930,"threads_started":1,"wal-append.queue_time_us":872266}
W20260709 13:06:37.024971 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.002964 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:37.079869 21825 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:37.080093 22547 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
W20260709 13:06:37.077783 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 134845us
I20260709 13:06:37.082325 21825 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:37.082412 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:37.082834 25573 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:06:37.083062 21827 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.083818 25314 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:37.084208 25314 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.084515 25314 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:37.087911 25069 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.091037 21827 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:36.925884 25270 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:37.044966 21906 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:37.108618 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:36.933092 25502 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:37.003575 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:37.127463 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 190586us
I20260709 13:06:37.051608 21832 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:37.004921 21904 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:37.003223 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:37.135949 21900 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:37.136732 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.137455 21830 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:37.139202 22554 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:37.160995 25576 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:37.162328 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:37.002909 25555 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.165285 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1938) took 1292 ms. Trace:
W20260709 13:06:37.172112 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.180200 21907 rpcz_store.cc:276] 0709 13:06:35.873157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.874418 (+  1261us) service_pool.cc:224] Handling call
0709 13:06:35.874688 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.875181 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.875210 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.887483 (+ 12273us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.461023 (+573540us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:36.461082 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.461171 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.164608 (+703437us) raft_consensus.cc:1685] finished
0709 13:06:37.164671 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.165098 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251233,"raft.queue_time_us":7918,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8568,"thread_start_us":496402,"threads_started":1,"wal-append.queue_time_us":638696}
I20260709 13:06:37.182322 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.065866 25503 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:37.074759 25572 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:36.931892 25528 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.107287 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:36.944373 25365 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:37.045368 25274 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.164s
W20260709 13:06:37.273590 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 373906us
W20260709 13:06:37.122967 25189 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.007s
I20260709 13:06:36.941318 25539 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:37.125391 25069 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.272763 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.162374 25269 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:37.178227 25581 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:37.286949 25581 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:37.287415 25559 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.244858 25452 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.162593 25205 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:37.289770 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.296074 21826 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:37.251416 25440 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.245923 25514 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:36.939880 25458 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.281924 25539 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.186096 25468 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:37.305707 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.130280 25270 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:37.311977 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 126969us
I20260709 13:06:37.285554 25580 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.108035 25574 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.312858 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:37.180179 25502 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.287844 25581 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.201989 25555 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.335204 25467 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.335731 25467 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.336575 25555 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:37.337668 25467 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:37.341039 25463 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:37.341431 25463 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:36.995379 25575 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.342228 25463 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.343495 25463 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:37.343760 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 144081us
I20260709 13:06:37.344851 25579 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:36.193948 21901 rpcz_store.cc:276] 0709 13:06:34.597773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.094086 (+496313us) service_pool.cc:224] Handling call
0709 13:06:35.241211 (+147125us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b5800003098. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:06:35.241373 (+   162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.241672 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.241698 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.293727 (+ 52029us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.493242 (+199515us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:35.877260 (+384018us) log.cc:844] Serialized 14 byte log entry
0709 13:06:36.131672 (+254412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.131736 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.131775 (+    39us) raft_consensus.cc:1685] finished
0709 13:06:36.164196 (+ 32421us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.164364 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":220205,"prepare.queue_time_us":361789,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":257801,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":55988,"spinlock_wait_cycles":137966848,"thread_start_us":536747,"threads_started":2,"wal-append.queue_time_us":238433}
I20260709 13:06:37.346590 25579 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:37.347877 25579 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:37.282397 25576 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.304716 25591 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:37.248945 25582 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:06:37.326400 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.362455 21832 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:37.330752 25324 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.303040 25452 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.367772 25195 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.367856 25452 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:37.331219 25565 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:06:37.331365 22551 pending_rounds.cc:85] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 6
I20260709 13:06:37.369447 22551 pending_rounds.cc:107] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:06:37.369715 22551 raft_consensus.cc:2889] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:37.361910 25396 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.370726 25396 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.280253 25503 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.311345 25539 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:37.357975 25579 consensus_queue.cc:1243] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:06:37.371413 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.334641 25546 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:37.371544 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1936) took 1499 ms. Trace:
I20260709 13:06:37.304450 25440 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.378001 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:37.326248 25567 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.289394 25069 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.377314 25591 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:37.378134 25270 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.390877 21902 rpcz_store.cc:276] 0709 13:06:35.871914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.872046 (+   132us) service_pool.cc:224] Handling call
0709 13:06:35.894308 (+ 22262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.894533 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.894558 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.940425 (+ 45867us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.764252 (+823827us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:36.764315 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.764406 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.371339 (+606933us) raft_consensus.cc:1685] finished
0709 13:06:37.371358 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.371489 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":823423,"threads_started":1,"wal-append.queue_time_us":927595}
I20260709 13:06:37.323770 25269 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:37.394735 25546 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.400892 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:37.400960 25574 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.401654 25458 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.401769 22549 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:37.324141 25589 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:06:37.380165 25544 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:37.387636 21828 consensus_meta.cc:287] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.004s
W20260709 13:06:37.429219 25398 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.978s	user 0.006s	sys 0.005s
I20260709 13:06:37.430573 25449 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:37.432361 25546 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.433130 25269 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.324652 25580 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.391629 25205 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.455343 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1961) took 1258 ms. Trace:
I20260709 13:06:37.509320 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:37.451707 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.552027 22546 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
W20260709 13:06:37.553659 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.529142 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.553983 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.526469 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:37.521265 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 208468us
I20260709 13:06:37.439682 22554 raft_consensus.cc:2410] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:06:37.554718 21977 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:37.555020 22547 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:37.550908 21828 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:37.533455 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.492455 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:37.556622 21832 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:37.557396 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:37.561663 21905 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:37.551611 21831 rpcz_store.cc:276] 0709 13:06:36.196570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.196687 (+   117us) service_pool.cc:224] Handling call
0709 13:06:36.196960 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.526607 (+329647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.526646 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:36.526721 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:36.526763 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.455075 (+928312us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400336654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:37.455134 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.455282 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757615360}
W20260709 13:06:37.566224 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 261160us
W20260709 13:06:37.441076 25368 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.030s	user 0.008s	sys 0.000s
W20260709 13:06:37.444068 25569 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.929s	user 0.000s	sys 0.010s
W20260709 13:06:37.444187 25478 consensus_meta.cc:287] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.044s	user 0.010s	sys 0.000s
I20260709 13:06:37.570379 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:37.521549 25380 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:37.449745 25553 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:06:37.436846 25391 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.307s	user 0.010s	sys 0.002s
I20260709 13:06:37.569800 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:37.558521 25398 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:37.575358 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.434263 25396 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:37.451937 25539 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.586045 25368 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.591867 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:37.594588 25606 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.595176 25575 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.435839 25528 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:37.596858 25478 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.597205 25297 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.402216 25468 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.597739 25188 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:37.598068 25588 raft_consensus.cc:2764] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:37.598603 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1937) took 1725 ms. Trace:
I20260709 13:06:37.599032 25554 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.599151 24841 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.598987 25274 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.602016 25445 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:37.602146 25058 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:37.434998 25502 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:37.603226 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:37.606601 21874 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:37.590741 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:37.435312 25503 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:37.541621 25314 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:37.622341 21833 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.010s	sys 0.033s
W20260709 13:06:37.630558 25584 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:06:37.630857 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:06:37.558141 25544 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.668288 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:37.639711 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.632377 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.632359 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.632989 22552 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:06:37.633829 22555 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:37.644130 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:37.605715 25553 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:37.665652 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:06:37.725853 25612 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:37.609117 25458 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:37.437847 25591 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.755251 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:37.945411 22553 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:37.945700 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 339080us
I20260709 13:06:37.729259 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.748947 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:37.633549 25541 consensus_meta.cc:287] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.851s	user 0.005s	sys 0.005s
I20260709 13:06:37.947908 21831 raft_consensus.cc:2376] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9. Re-sending same reply.
I20260709 13:06:37.615144 25440 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:37.948343 25528 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:37.695155 25580 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:37.713696 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:37.948812 21829 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:37.756641 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:37.865339 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46757.4us
I20260709 13:06:37.949460 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.949751 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.908454 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.950138 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:37.659204 25606 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.697679 22548 raft_consensus.cc:2368] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:37.632732 25069 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.696621 22550 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:37.950699 21828 raft_consensus.cc:2376] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13. Re-sending same reply.
W20260709 13:06:37.946710 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 343564us
I20260709 13:06:37.950524 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.767689 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.910126 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:37.969033 21976 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:37.948777 25528 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:37.969794 25528 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:37.970014 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.971050 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.972617 25297 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.974243 25572 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:37.974330 25544 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:37.974606 25297 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:37.974982 25445 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.974766 25572 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:37.976269 25572 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.976372 25553 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.976949 25445 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:37.977411 25553 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:37.947770 21833 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.010s	sys 0.039s
I20260709 13:06:37.947307 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.982913 21982 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:37.983848 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:37.984336 21982 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:37.951498 22546 raft_consensus.cc:606] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:37.950609 21826 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 12 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:06:37.978680 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:37.978657 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 387978us
I20260709 13:06:37.968946 21908 rpcz_store.cc:276] 0709 13:06:35.872829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.875293 (+  2464us) service_pool.cc:224] Handling call
0709 13:06:35.875639 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.883768 (+  8129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.883813 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.888060 (+  4247us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.062258 (+174198us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b18004a53c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:06:36.412090 (+349832us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:36.412132 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.412211 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.443462 (+1031251us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:37.598404 (+154942us) raft_consensus.cc:1685] finished
0709 13:06:37.598425 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.598553 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250530,"raft.queue_time_us":10107,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":50535,"spinlock_wait_cycles":38353408,"thread_start_us":349635,"threads_started":1,"wal-append.queue_time_us":626369}
I20260709 13:06:37.708042 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:37.987996 21832 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.979321 21830 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:37.988907 22521 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:37.849406 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.979959 21948 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:37.777961 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.991032 21983 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:37.986083 22546 raft_consensus.cc:614] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:37.992364 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.993136 21983 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:37.993479 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:37.945851 21979 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:37.994490 25588 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:37.995319 21830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:37.996616 21830 raft_consensus.cc:606] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:37.997006 21830 raft_consensus.cc:614] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:37.763833 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.950663 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:37.780788 25614 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:37.998674 21831 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:37.999509 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.999912 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96da242efa5849aab4168785047cff48"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:38.000168 21983 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:38.000595 21831 raft_consensus.cc:606] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:38.001116 21831 raft_consensus.cc:614] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:38.001221 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.004058 21983 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
W20260709 13:06:38.004647 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 44364.7us
I20260709 13:06:37.994040 21974 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.745571 25368 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.008597 21976 raft_consensus.cc:2368] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:38.013262 21982 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:38.007927 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:37.997915 21981 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:38.014058 21905 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:38.014779 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.016005 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:38.016021 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:38.016773 21979 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:38.020156 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:38.017617 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.020478 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:38.021152 21905 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:38.027928 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.029242 21906 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:06:37.979198 24841 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:37.982944 25554 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.033901 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.036187 21977 raft_consensus.cc:2393] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:37.871109 25539 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:37.847242 25448 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.051017 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:38.051887 21981 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.037695 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.038470 21908 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:37.780194 25478 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.042610 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.043154 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.041782 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:37.982086 25579 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:38.050915 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.054332 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.059413 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.060107 21909 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:38.059919 21906 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:38.040846 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:38.066148 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.066984 21907 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:38.053175 21905 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
W20260709 13:06:38.068822 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 63753.3us
I20260709 13:06:38.004527 25458 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:38.078701 21902 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:38.081046 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:37.977433 25058 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.084409 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:38.015031 25588 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.092252 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.038820 25544 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:38.095228 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.095453 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:38.008880 22549 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:37.977748 25188 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:37.981117 25274 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.053902 25502 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:06:38.058470 25582 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:38.054577 25575 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:38.103871 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 62193.9us
I20260709 13:06:38.059303 25449 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:06:38.111398 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.119813 22553 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:38.120044 21904 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:38.059051 25069 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:06:38.116588 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:38.121191 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:38.108717 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.118371 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.117962 21982 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
W20260709 13:06:38.127435 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.128196 21832 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:38.132242 21981 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:38.134580 25544 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:38.134624 25069 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:38.134954 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.135308 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.135818 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:38.136945 21982 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:06:38.136546 25458 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.134900 21980 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:38.073655 25448 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.137387 25575 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.138286 25582 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:38.110071 25588 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.069191 25627 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.148458 21979 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:38.135835 25189 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:38.152480 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.153904 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 545) took 1217 ms. Trace:
W20260709 13:06:38.161870 22548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 600) took 2217 ms (client timeout 1951 ms). Trace:
I20260709 13:06:38.163319 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.165570 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.234689 22550 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
W20260709 13:06:38.166314 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.236548 21975 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
W20260709 13:06:38.236917 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.237964 21975 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:38.182931 25069 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.170971 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.172128 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.233599 22552 rpcz_store.cc:276] 0709 13:06:36.936141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.936269 (+   128us) service_pool.cc:224] Handling call
0709 13:06:37.002985 (+ 66716us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.946119 (+943134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.153649 (+207530us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54006801d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:38.153840 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448199296}
I20260709 13:06:38.172137 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.125883 25555 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:38.249119 25555 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:38.172839 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.174779 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.175812 24841 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:38.126780 25574 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:38.223030 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 152859us
W20260709 13:06:38.227227 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 91486.3us
I20260709 13:06:38.229373 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.230695 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.251832 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:38.231016 25449 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.231469 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:38.257432 21981 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:38.257768 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:38.233768 22548 rpcz_store.cc:269] 0709 13:06:35.944652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.944777 (+   125us) service_pool.cc:224] Handling call
0709 13:06:38.161653 (+2216876us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400705154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:38.161776 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3959551744}
I20260709 13:06:38.236002 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:38.240741 22547 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:38.252311 22553 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:38.231294 21980 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:38.255909 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:38.170183 21974 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:38.234854 25502 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:38.263410 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.249542 25555 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:38.242110 25069 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.267128 25577 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.268687 25575 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.238998 25627 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.271142 25448 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.265743 25502 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.251796 25314 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:38.252148 25574 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:38.258339 24841 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:38.290844 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 169709us
I20260709 13:06:38.294515 21906 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:38.278625 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.281951 25581 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.264777 25440 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:38.311146 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53469.3us
I20260709 13:06:38.316417 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:38.316782 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:38.292127 25577 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:38.320952 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 54236.3us
I20260709 13:06:38.304654 25502 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:38.346387 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 110467us
I20260709 13:06:38.310592 25574 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:38.316267 25440 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.349696 25458 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:38.310649 25448 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:38.321449 25632 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.328301 25606 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:38.377333 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61397us
I20260709 13:06:38.321753 25638 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:38.300693 25544 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.334203 25188 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:38.364779 25440 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:38.384750 21875 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:38.365025 25458 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.299575 25582 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:38.386142 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 69422.2us
I20260709 13:06:38.390203 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:38.396845 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:38.377046 25639 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:38.383621 25638 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.386935 25629 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:38.387521 25458 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:38.419589 25631 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:38.425102 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1969) took 1893 ms. Trace:
I20260709 13:06:38.411789 25638 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.407475 25639 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.435101 25640 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:38.455530 25640 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.455879 25640 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:38.456384 25058 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:38.435153 21903 rpcz_store.cc:276] 0709 13:06:36.531720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.937754 (+406034us) service_pool.cc:224] Handling call
0709 13:06:36.938040 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.364354 (+426314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.364400 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.377735 (+ 13335us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.586563 (+208828us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:37.586610 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.424585 (+837975us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54002f67d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:38.424659 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.424735 (+    76us) raft_consensus.cc:1685] finished
0709 13:06:38.424755 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.425029 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1853,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":97,"spinlock_wait_cycles":979371392,"thread_start_us":191123,"threads_started":1,"wal-append.queue_time_us":264458}
I20260709 13:06:38.464447 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:38.440212 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.465606 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:38.440349 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 875294us
I20260709 13:06:38.467279 21903 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.468896 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:38.439832 25593 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:06:38.471724 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet ad9d9c562d2d411db01a7eaf4427d325: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:38.446100 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.475962 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.446621 25639 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.447566 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.480789 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.480978 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.481324 21825 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:38.447736 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.450770 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.448019 21834 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:38.465601 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.481595 21909 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:38.436998 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:38.486930 22546 raft_consensus.cc:1217] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-7.8]   Dedup: 7.8->[]
I20260709 13:06:38.450489 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:38.529426 21905 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:38.452194 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:38.482267 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.449436 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1982) took 1512 ms. Trace:
I20260709 13:06:38.451756 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 542) took 1516 ms. Trace:
I20260709 13:06:38.535395 21900 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.529376 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.529772 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:38.530766 21901 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
W20260709 13:06:38.531297 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 94409.8us
I20260709 13:06:38.536206 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1976) took 2001 ms. Trace:
I20260709 13:06:38.536840 22546 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:06:38.541304 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.534586 22555 rpcz_store.cc:276] 0709 13:06:36.935129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.935254 (+   125us) service_pool.cc:224] Handling call
0709 13:06:38.451568 (+1516314us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54004c4fd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:38.451686 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149709184}
I20260709 13:06:38.542160 21980 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:38.552094 21829 rpcz_store.cc:276] 0709 13:06:36.534913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.535038 (+   125us) service_pool.cc:224] Handling call
0709 13:06:36.535297 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.949214 (+1413917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.536038 (+586824us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54002882d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:38.536151 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3250135936}
I20260709 13:06:38.530092 21834 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:38.554473 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.554746 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.555534 22547 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:06:38.556347 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 330801us
I20260709 13:06:38.534461 21833 rpcz_store.cc:276] 0709 13:06:36.936626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.087282 (+150656us) service_pool.cc:224] Handling call
0709 13:06:37.087579 (+   297us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:37.352213 (+264634us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b48000030d8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:06:37.982855 (+630642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.982901 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:37.983665 (+   764us) log.cc:844] Serialized 78 byte log entry
0709 13:06:38.107594 (+123929us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:38.239917 (+132323us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.448787 (+208870us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.449006 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.449080 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.449190 (+   110us) raft_consensus.cc:1685] finished
0709 13:06:38.449211 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.449371 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":384555,"prepare.queue_time_us":212062,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"raft.queue_time_us":370689,"raft.run_cpu_time_us":2091,"raft.run_wall_time_us":79526,"spinlock_wait_cycles":8382720,"thread_start_us":1015299,"threads_started":3,"wal-append.queue_time_us":115504}
W20260709 13:06:38.452901 25609 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.772s	user 0.004s	sys 0.000s
I20260709 13:06:38.558293 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.563216 21903 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:38.562983 21900 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:38.576684 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:38.572465 22554 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:38.450603 25589 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.579300 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:38.450696 25468 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.581018 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.436667 25632 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:38.514319 25595 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:38.449177 25567 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:38.439368 24793 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:38.586638 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:38.587606 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:38.602646 21828 raft_consensus.cc:2376] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11. Re-sending same reply.
W20260709 13:06:38.594887 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 91268f1f8ef64ef4b455bead2f60e2ff: Illegal state: Replica 3d76b2c4699e43fba10eeb81a91e4913 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:38.600394 22551 raft_consensus.cc:2368] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:38.445696 25572 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.588260 21834 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:38.573421 25528 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.005s
I20260709 13:06:38.559931 25580 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:38.603027 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:38.642840 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:38.649173 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 46184.1us
I20260709 13:06:38.650414 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:38.657977 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.658838 21828 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:38.659992 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:38.661896 21828 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.578208 25577 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:38.660398 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:38.667557 21948 leader_election.cc:400] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:38.709671 21948 leader_election.cc:403] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:38.593719 25558 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:38.710245 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 50159.3us
I20260709 13:06:38.710214 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.715368 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:38.716645 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 266215us
I20260709 13:06:38.717538 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:38.655835 25609 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:38.717996 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.599308 25629 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:38.720420 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:38.738029 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:38.727109 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:38.740161 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:38.642344 25553 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:38.601814 25589 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:38.733319 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 65935.7us
I20260709 13:06:38.607659 25606 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:38.598335 25188 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.598835 25559 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:38.749713 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.747624 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1983) took 1806 ms. Trace:
I20260709 13:06:38.436255 25644 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.273s
I20260709 13:06:38.593498 25593 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.610823 25569 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:38.598302 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.708077 25645 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:38.643263 25541 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:06:38.714279 25391 raft_consensus.cc:2764] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:38.603547 25540 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.142s
I20260709 13:06:38.641990 25567 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.741456 25269 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:38.607276 25380 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 13:06:38.732613 25398 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.721963 25627 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:38.747656 21828 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:38.789781 25567 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.747011 25558 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:38.658859 25580 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.751037 21827 rpcz_store.cc:276] 0709 13:06:36.941120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.092078 (+150958us) service_pool.cc:224] Handling call
0709 13:06:37.092397 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:37.208301 (+115904us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:37.309899 (+101598us) log.cc:844] Serialized 14 byte log entry
0709 13:06:37.519899 (+210000us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b1800368b60. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb762eb258f 00007fb75bef1571 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd
0709 13:06:37.537297 (+ 17398us) log.cc:844] Serialized 14 byte log entry
0709 13:06:37.543951 (+  6654us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:37.557860 (+ 13909us) log.cc:844] Serialized 52 byte log entry
0709 13:06:37.558012 (+   152us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:37.558280 (+   268us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.439189 (+880909us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b1800368b60. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb762eb258f 00007fb75bef1571 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd
0709 13:06:38.439494 (+   305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.439597 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.452388 (+ 12791us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:38.470089 (+ 17701us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800368b60. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1
0709 13:06:38.471206 (+  1117us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b1800368b60. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:38.747338 (+276132us) raft_consensus.cc:1685] finished
0709 13:06:38.747367 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.747539 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1052547,"prepare.queue_time_us":70014,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":104,"raft.queue_time_us":1223539,"raft.run_cpu_time_us":512,"raft.run_wall_time_us":27248,"spinlock_wait_cycles":91697152,"thread_start_us":137270,"threads_started":3,"wal-append.queue_time_us":340576}
I20260709 13:06:38.791543 25589 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:38.642237 24793 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.790895 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.878902 21828 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:38.767313 25572 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.746484 25606 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.795468 25587 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:38.759397 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:38.776465 25541 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:38.702450 25528 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.607455 25595 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.763389 21843 tablet_copy_service.cc:342] P 479255846c5141b584b16aa253f587c7: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-dbb4eb8dd14248918867a27aa6d9bac9 received from {username='slave'} at 127.0.0.1:52674
I20260709 13:06:38.744266 25599 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:38.772405 25269 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.757531 25576 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:38.760955 25559 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.923807 21843 tablet_copy_service.cc:434] P 479255846c5141b584b16aa253f587c7: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-dbb4eb8dd14248918867a27aa6d9bac9 on tablet dbb4eb8dd14248918867a27aa6d9bac9 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:38.924995 25595 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.925163 25559 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.752465 25553 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:38.925627 21825 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:38.879901 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:38.926376 21828 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:38.917135 25069 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
I20260709 13:06:38.794394 25605 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.188s
W20260709 13:06:38.922031 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 271719us
I20260709 13:06:38.882617 21832 raft_consensus.cc:2376] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5. Re-sending same reply.
I20260709 13:06:38.883599 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.884020 25580 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:38.601322 25468 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.885676 24793 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.955701 21901 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:38.956920 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.886106 21829 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:38.886659 25274 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:38.861501 25554 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:38.899650 25638 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.900713 25587 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.901233 25606 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.886130 25652 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:38.751657 25188 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:38.760771 25593 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.913959 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:38.879627 25555 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 13:06:38.875792 25448 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:38.767030 25588 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.931646 21827 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:38.909700 25541 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:38.937690 21828 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:38.938248 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:38.945083 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.016119 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.016716 21900 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:38.946442 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.017608 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.947755 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.960034 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:38.969267 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:39.018692 21832 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.018759 21829 raft_consensus.cc:2376] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10. Re-sending same reply.
W20260709 13:06:38.970384 25656 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:06:39.021328 21731 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.970878 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.023888 21826 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:39.023955 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.024724 21902 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:39.025772 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.954741 25069 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.026944 25528 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:39.027782 25528 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:39.028178 25528 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:38.931090 25605 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:39.029080 25069 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:39.030431 21907 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:39.031736 25593 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:39.032027 21907 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:39.013456 25448 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.032795 25448 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.033142 21907 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:38.927045 25599 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:38.972661 25639 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.036329 25639 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.973083 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:38.974738 22547 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:38.978483 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:38.984035 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.037585 22555 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:39.038576 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:39.039094 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:39.039589 21900 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:39.039657 22555 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.039597 21827 raft_consensus.cc:2410] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:06:39.039678 25555 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.043005 21827 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:06:39.043445 25541 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.044189 25555 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:39.044706 25541 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.029096 25528 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.029893 25069 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.046008 25069 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.046514 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:39.048058 25599 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:39.048170 21828 pending_rounds.cc:85] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 6
I20260709 13:06:39.048576 21828 pending_rounds.cc:107] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:06:39.048846 21828 raft_consensus.cc:2889] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:39.049810 25069 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:39.050661 21902 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:39.052675 21982 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:38.984979 25502 consensus_meta.cc:287] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.002s
W20260709 13:06:38.987967 25640 consensus_meta.cc:287] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.001s
I20260709 13:06:38.989665 25205 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:38.989948 25468 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:38.991930 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:38.993605 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:38.994616 21904 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:38.996604 25638 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:38.965057 25587 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:39.001250 25581 consensus_meta.cc:287] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.684s	user 0.005s	sys 0.007s
I20260709 13:06:39.001888 21831 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:38.964722 25652 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:39.002811 25627 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:39.003569 25655 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:39.065397 25642 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:06:38.985930 25440 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
W20260709 13:06:39.008139 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 94259.5us
I20260709 13:06:39.090606 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.091241 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:39.091670 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:38.922778 25576 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:38.926280 25269 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.021068 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:39.021404 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:39.022006 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet ae693bf6616e4755b822cea96cf12222: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:38.971182 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:39.026842 21829 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:39.058525 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:39.117826 21829 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:39.119627 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 61458.1us
W20260709 13:06:39.068194 21873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.003s
W20260709 13:06:39.121315 21873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.008s	sys 0.003s
W20260709 13:06:39.121671 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 579729us
I20260709 13:06:39.049746 22555 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:39.122305 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:06:39.078742 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 340799us
I20260709 13:06:39.012744 24793 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:39.004522 22546 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:39.088194 21832 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:39.091807 22553 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:39.004568 21834 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:39.065209 25205 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:39.130441 24793 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:39.130767 25205 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.131528 25605 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:39.131888 25605 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:39.131982 25205 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:39.133052 25605 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.107972 25274 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.134562 25605 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.134514 25274 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.134835 22553 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:39.136596 21831 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:39.136659 25274 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:39.093984 21798 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:39.137728 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 43819.9us
I20260709 13:06:39.138357 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.139340 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.140117 25380 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:39.140914 25380 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:39.141453 25380 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:39.142459 25380 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.079912 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:39.110589 21731 catalog_manager.cc:5697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 10, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 10 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:39.131924 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.146301 24793 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:39.108775 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1965) took 1004 ms. Trace:
I20260709 13:06:39.146961 21982 rpcz_store.cc:276] 0709 13:06:38.104101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.230554 (+126453us) service_pool.cc:224] Handling call
0709 13:06:38.230808 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.053164 (+822356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.108514 (+ 55350us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54003a57d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:39.108709 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889604352}
I20260709 13:06:39.149977 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.151484 25546 raft_consensus.cc:2764] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:06:39.153247 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.153980 25558 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:39.153303 25559 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:06:39.155118 25578 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:39.155606 25578 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:39.155827 25559 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:39.156338 25559 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:39.156533 25578 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.157420 25559 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.159288 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:39.159828 25559 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.160207 25558 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:39.160740 25558 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:39.161158 25558 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:39.165071 22521 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:39.167006 25582 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:39.167168 25578 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.173106 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:39.174309 22553 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:06:39.176688 22555 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:39.186074 21834 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:06:39.205217 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 429528us
I20260709 13:06:39.067286 25555 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:06:39.078600 25655 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:39.078231 25652 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:39.195295 21829 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.248447 21829 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:39.230363 25205 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:39.217329 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.233201 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:39.188223 21731 catalog_manager.cc:5697] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 6 to 7, leader changed from <none> to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 7 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:06:39.234582 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 112358us
I20260709 13:06:39.234902 21982 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:39.235266 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.113648 25599 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:39.069159 25640 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.069965 25502 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.112474 25576 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:39.196623 25449 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:39.237684 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 157863us
I20260709 13:06:39.261533 21874 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.262701 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.249116 21978 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:39.251935 21907 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:39.118784 25572 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.118717 25468 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:39.250188 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.268303 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.251946 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:39.263689 21874 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.255808 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.258615 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:39.192186 25627 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:39.260393 21980 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:39.265648 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:39.272097 21982 raft_consensus.cc:2410] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:39.256610 25297 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:39.273167 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.274577 25575 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:39.275753 25575 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:39.276117 25575 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:39.276985 25575 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.278294 25572 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.280412 25572 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:39.281224 25515 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:39.281626 25515 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.281953 25515 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.283257 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.285645 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.286295 25069 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:39.283824 24841 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:39.286933 25069 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:39.287047 24841 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:39.287310 25577 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:39.287739 25577 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.288166 25577 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.287843 25069 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.288056 24841 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:39.291049 25642 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:39.247713 25644 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:39.286392 25503 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:39.294426 25644 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:39.294628 25503 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.294855 25644 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:39.295189 25503 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:39.068789 25553 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.282964 25528 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:39.306702 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:39.236792 21830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.003s	sys 0.018s
I20260709 13:06:39.247989 25655 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.256831 25058 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:39.299006 25660 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:39.321790 25188 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:39.298300 25638 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:39.325176 25640 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:39.327611 25269 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:39.248893 25628 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:39.197099 25580 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:06:39.334872 25627 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.303354 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.304561 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.336994 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:39.252494 25589 consensus_queue.cc:1175] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d76b2c4699e43fba10eeb81a91e4913" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:39.112747 25440 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.260666 25449 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:39.341025 25448 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.247645 25398 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:06:39.343151 21978 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:39.347220 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 91505.9us
W20260709 13:06:39.307772 25458 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.794s	user 0.015s	sys 0.000s
I20260709 13:06:39.318518 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.350916 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.425726 21949 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:39.354651 21830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.003s	sys 0.018s
I20260709 13:06:39.353403 21731 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:39.356206 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 104331us
W20260709 13:06:39.359722 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53114.7us
I20260709 13:06:39.427022 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:39.362071 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.002s	sys 0.019s
W20260709 13:06:39.427857 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.003s	sys 0.019s
I20260709 13:06:39.427457 21731 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 6 to 8, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 8 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:39.428476 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 688329us
W20260709 13:06:39.363131 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 98503.4us
I20260709 13:06:39.366698 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:39.368402 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:39.370000 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:39.374373 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:39.429914 21731 catalog_manager.cc:5697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:39.317725 25515 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.389114 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:39.392640 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.392635 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:39.319658 25502 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:39.404546 25468 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.363876 25575 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:39.383635 25544 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.359318 25058 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:39.465466 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.385856 25638 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.419584 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:39.473158 21832 raft_consensus.cc:2376] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10. Re-sending same reply.
I20260709 13:06:39.474054 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:39.474881 21832 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:39.319342 25652 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:39.407208 25574 consensus_meta.cc:287] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.036s	user 0.015s	sys 0.001s
I20260709 13:06:39.432116 21731 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:39.486332 21731 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 9 to 11, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 11 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:39.440899 21908 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:39.359776 25555 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:39.400907 25660 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:39.446584 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:39.492165 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46131.8us
I20260709 13:06:39.493160 21834 raft_consensus.cc:2410] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:06:39.387163 25629 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.036s	sys 0.118s
I20260709 13:06:39.384284 25567 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:39.429536 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.408727 25640 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:39.461009 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.465121 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:39.466265 21728 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33508 (request call id 200) took 36586 ms (client timeout 15000 ms). Trace:
I20260709 13:06:39.411373 21902 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:06:39.498195 21980 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:39.498800 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.469944 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1996) took 1025 ms. Trace:
I20260709 13:06:39.422597 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.500977 21906 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
W20260709 13:06:39.408893 24793 consensus_queue.cc:1175] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0157b4f0725d4f92a53938c921db9efc" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: [5.7-7.8]" } } last_received_current_leader { term: 8 index: 9 } }
I20260709 13:06:39.478348 21982 raft_consensus.cc:2368] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10.
I20260709 13:06:39.493515 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.420892 25449 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.495141 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 408) took 1059 ms. Trace:
I20260709 13:06:39.505204 25599 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:39.505807 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 76344us
I20260709 13:06:39.505882 25541 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:39.484419 25554 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:39.440023 25645 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:39.472728 25269 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:39.472712 25058 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:39.522683 21905 rpcz_store.cc:276] 0709 13:06:38.436157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.533566 (+ 97409us) service_pool.cc:224] Handling call
0709 13:06:38.563444 (+ 29878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.563678 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:39.078151 (+514473us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.494798 (+416647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.494849 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:39.494905 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.494981 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.495087 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22795,"prepare.queue_time_us":309264,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":33461,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":874821,"threads_started":2}
I20260709 13:06:39.472803 25595 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:39.527689 21731 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:39.530352 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:39.472659 25664 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.484514 25638 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:39.531805 21799 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:39.638959 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 107220us
I20260709 13:06:39.640992 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.432947 25606 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.642915 25188 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.643393 25188 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.643878 25606 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:39.644656 25567 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:39.645488 25567 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:39.647384 25567 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:39.645308 25188 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:39.448894 25458 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.507102 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:39.497341 21728 rpcz_store.cc:269] 0709 13:06:02.862868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.863090 (+   222us) service_pool.cc:224] Handling call
0709 13:06:02.977854 (+114764us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b54001e0690. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beba0b2 00007fb764e33a89 00007fb764dcbda6 00007fb764d9d088 00007fb764e9b37e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc
0709 13:06:03.032039 (+ 54185us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54001e0690. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beba640 00007fb764d91b76 00007fb764e9bc3e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc 00007fb76335b392 00007fb75d31948c 00007fb75d3188c6
0709 13:06:39.449180 (+36417141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:36.488695 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:36.643250 (+154555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:36.678437 (+ 35187us) write_op.cc:435] Acquired schema lock
0709 13:06:36.682337 (+  3900us) tablet.cc:662] Decoding operations
0709 13:06:36.761399 (+ 79062us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:36.761490 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:36.761533 (+    43us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:36.762426 (+   893us) tablet.cc:701] Row locks acquired
0709 13:06:36.762467 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:06:36.762655 (+   188us) write_op.cc:270] Start()
0709 13:06:36.762817 (+   162us) write_op.cc:276] Timestamp: P: 1783602396762590 usec, L: 0
0709 13:06:36.762843 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:06:36.849277 (+ 86434us) log.cc:844] Serialized 3253 byte log entry
0709 13:06:37.567408 (+718131us) op_driver.cc:464] REPLICATION: finished
0709 13:06:37.695750 (+128342us) write_op.cc:301] APPLY: starting
0709 13:06:37.695838 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:37.696044 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:37.696178 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:37.790476 (+ 94298us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:37.990926 (+200450us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:06:37.990979 (+    53us) write_op.cc:312] APPLY: finished
0709 13:06:37.991339 (+   360us) log.cc:844] Serialized 65 byte log entry
0709 13:06:37.991519 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:37.991631 (+   112us) write_op.cc:454] Released schema lock
0709 13:06:37.991691 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:38.038895 (+ 47204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.050670 (+ 11775us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44750,"reported_tablets":47,"spinlock_wait_cycles":46315136,"child_traces":[["op",{"apply.queue_time_us":115774,"apply.run_cpu_time_us":12220,"apply.run_wall_time_us":296386,"num_ops":8,"prepare.queue_time_us":880328,"prepare.run_cpu_time_us":30562,"prepare.run_wall_time_us":795431,"raft.queue_time_us":142780,"raft.run_cpu_time_us":18822,"raft.run_wall_time_us":114170,"replication_time_us":804352,"spinlock_wait_cycles":1958272,"thread_start_us":1276489,"threads_started":4,"wal-append.queue_time_us":452919,"wal-append.run_cpu_time_us":12028,"wal-append.run_wall_time_us":1664758}]]}
I20260709 13:06:39.583202 21980 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:06:39.584614 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.492298 25555 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:39.479238 25274 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:06:39.614730 21829 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:39.471792 25468 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.509327 25662 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:39.529592 25657 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:39.631120 21731 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 6 to 7, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 7 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:39.683749 21731 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 8 to 9, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 9 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:06:39.682418 21900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.014s	sys 0.014s
W20260709 13:06:39.685294 21900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.014s	sys 0.015s
W20260709 13:06:39.632490 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 102204us
I20260709 13:06:39.687178 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:39.648972 25567 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:39.496284 25629 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.037s	sys 0.118s
I20260709 13:06:39.649946 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:39.495070 25574 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.523746 25605 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:06:39.594978 25269 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:39.667685 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 160652us
I20260709 13:06:39.719949 25269 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:39.720849 21873 leader_election.cc:400] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
I20260709 13:06:39.721159 21873 leader_election.cc:403] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:39.671283 25555 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:39.654677 25380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.030s	sys 0.063s
W20260709 13:06:39.722774 25666 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
W20260709 13:06:39.722934 25380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.031s	sys 0.064s
I20260709 13:06:39.723270 25559 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:39.723685 25559 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:39.723778 25671 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:06:39.723801 25667 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8.
W20260709 13:06:39.676641 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 199935us
I20260709 13:06:39.727625 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.734978 25515 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:39.678768 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 1999) took 1233 ms. Trace:
I20260709 13:06:39.738866 21829 rpcz_store.cc:276] 0709 13:06:38.445347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.026342 (+580995us) service_pool.cc:224] Handling call
0709 13:06:39.026714 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.594948 (+568234us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b5400473c20. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef55dc0 00007fb75efe0d87 00007fb75efe1470 00007fb75efddd8f 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c
0709 13:06:39.678468 (+ 83520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.678705 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61657984}
I20260709 13:06:39.740272 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1922) took 1233 ms. Trace:
I20260709 13:06:39.740880 21826 rpcz_store.cc:276] 0709 13:06:38.506786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.024610 (+517824us) service_pool.cc:224] Handling call
0709 13:06:39.024891 (+   281us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:39.025294 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.025320 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:39.026577 (+  1257us) log.cc:844] Serialized 52 byte log entry
0709 13:06:39.476054 (+449477us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:39.476124 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.476262 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.739951 (+263689us) raft_consensus.cc:1685] finished
0709 13:06:39.739971 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.740206 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1201,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":448944,"threads_started":1,"wal-append.queue_time_us":698219}
I20260709 13:06:39.624114 25205 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:39.685562 21731 catalog_manager.cc:5697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 1 to 8, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 8 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:06:39.693552 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:39.499562 21830 rpcz_store.cc:276] 0709 13:06:38.444647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.481112 (+ 36465us) service_pool.cc:224] Handling call
0709 13:06:38.481352 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.481537 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:38.481833 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.469540 (+987707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.469606 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:39.469668 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.469744 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.469882 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42994,"prepare.queue_time_us":683,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":46535,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":11962,"thread_start_us":944330,"threads_started":1,"wal-append.queue_time_us":964357}
I20260709 13:06:39.718263 25673 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:39.718731 25663 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:39.762828 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 285503us
W20260709 13:06:39.795765 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 68807.6us
I20260709 13:06:39.670504 25502 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:39.591655 25558 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.810226 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:39.718153 25578 consensus_meta.cc:287] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.003s
I20260709 13:06:39.709491 25644 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:39.813638 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 120145us
I20260709 13:06:39.822314 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.594444 25660 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:39.815002 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.742120 25069 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:39.704116 25632 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:39.811510 21798 leader_election.cc:400] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10.
I20260709 13:06:39.703368 25629 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:39.795246 25546 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:39.713698 25576 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.824019 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:39.835089 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:39.834484 22546 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:39.826654 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:39.835644 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.820194 25205 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.844954 21798 leader_election.cc:403] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:39.814610 25554 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.852804 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.869892 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:39.882656 21906 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:39.867478 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:39.812834 25448 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:39.844682 25639 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:39.871551 22551 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.872501 21900 raft_consensus.cc:2368] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12.
W20260709 13:06:39.873180 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 46589.3us
I20260709 13:06:39.903259 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:39.870739 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 229807us
I20260709 13:06:39.801204 25582 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.818889 25673 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:39.823444 25657 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:39.880110 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 68786.6us
I20260709 13:06:39.833158 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:39.845429 25606 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:39.896690 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.845044 25628 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:39.814556 25058 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.910504 21825 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:39.911830 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:39.912853 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.702930 25662 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.886765 25578 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.884574 25440 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:39.879809 25069 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:39.917706 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.921829 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:06:39.896862 25314 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.027s	sys 0.038s
I20260709 13:06:39.925442 25069 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.921377 25639 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:39.910234 25606 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:39.936985 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:39.937006 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.939146 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:39.886515 25554 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.812887 25663 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.884487 25205 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:39.934855 25069 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.917531 25448 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:39.970779 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:39.939504 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.920606 25652 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:39.924045 25667 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.922816 25593 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:06:39.999594 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 155971us
W20260709 13:06:39.935333 22549 consensus_meta.cc:287] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.822s	user 0.009s	sys 0.004s
I20260709 13:06:39.911240 25657 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:39.801417 25645 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.934727 25690 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:39.947778 25540 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:39.970750 25685 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:06:39.915781 25567 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:06:39.976781 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:39.920607 25514 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:06:39.917397 25599 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:06:39.921823 25380 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:39.929261 25314 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.027s	sys 0.038s
I20260709 13:06:39.948091 25675 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:39.966622 25670 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:06:39.919464 25582 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.943431 25606 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:40.041957 25683 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:06:39.965178 25629 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:40.013857 25672 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:06:39.978495 25297 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:40.015944 25577 consensus_meta.cc:287] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.727s	user 0.011s	sys 0.000s
I20260709 13:06:39.998481 25589 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:40.060618 25559 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.062001 25559 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:40.030205 25657 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.978502 25448 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.063393 25448 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.048337 25574 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.037717 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:40.074630 21978 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:40.037719 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 61041.4us
I20260709 13:06:40.076263 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:40.078121 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:40.030369 25687 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.213s	user 0.002s	sys 0.001s
I20260709 13:06:40.039086 21977 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:40.089406 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.089679 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:40.039636 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:40.040532 21976 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:40.027738 25640 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:40.032776 25503 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.003s
W20260709 13:06:40.032924 25587 consensus_meta.cc:287] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.952s	user 0.012s	sys 0.000s
I20260709 13:06:40.030534 25398 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.031138 25458 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.030445 22549 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 5.
I20260709 13:06:40.033089 25541 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:39.921125 25628 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.037971 25593 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:40.028573 25673 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.054255 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1976) took 1657 ms. Trace:
W20260709 13:06:40.056384 25688 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:40.057790 25582 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:40.049126 25677 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:06:40.031061 25638 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.058051 25696 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:40.059890 25681 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:06:39.968873 25669 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:40.072364 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.074342 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:40.203619 25678 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:06:40.222182 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:40.222450 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.172772 25514 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.094123 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:40.227360 21976 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:40.094805 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:40.100307 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:40.055120 25644 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.043823 25449 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.104489 21834 pending_rounds.cc:85] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 3
I20260709 13:06:40.235072 21834 pending_rounds.cc:107] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 10.4
I20260709 13:06:40.235347 21834 raft_consensus.cc:2889] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.115185 21829 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:40.210261 25058 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.036442 25468 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.173347 21909 rpcz_store.cc:276] 0709 13:06:38.396419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.534457 (+138038us) service_pool.cc:224] Handling call
0709 13:06:38.570743 (+ 36286us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:38.855508 (+284765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.855542 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:38.861803 (+  6261us) log.cc:844] Serialized 52 byte log entry
0709 13:06:39.383736 (+521933us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:39.436989 (+ 53253us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.465749 (+ 28760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.465819 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.716093 (+250274us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800456100. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:40.053931 (+337838us) raft_consensus.cc:1685] finished
0709 13:06:40.054034 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.054200 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155882,"prepare.queue_time_us":57085,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":5734,"raft.queue_time_us":209065,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":4151,"spinlock_wait_cycles":26180864,"thread_start_us":708861,"threads_started":2,"wal-append.queue_time_us":788632}
W20260709 13:06:40.194478 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 135410us
I20260709 13:06:40.202543 25701 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.202411 25700 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 13:06:40.203624 24841 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:40.204216 25689 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:06:40.245842 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:40.206209 25661 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.113554 25587 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.095207 25599 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:40.087107 25589 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.091380 25576 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.211040 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.277163 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:40.277999 22555 raft_consensus.cc:2368] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10.
I20260709 13:06:40.277878 21832 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:40.101631 25574 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.044680 25639 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.073112 25577 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.114048 25541 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:40.219012 21780 placement_policy_util.cc:248] tablet 864ca05a434d488c83f87f71e27dfa63: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:06:40.073348 25297 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:39.946861 25674 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:06:40.091912 25380 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:06:40.091467 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:40.221076 21830 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:40.225854 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2006) took 1630 ms. Trace:
I20260709 13:06:40.228128 22548 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:40.216396 25528 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.854s	user 0.011s	sys 0.000s
I20260709 13:06:40.240525 25514 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.235913 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:40.113927 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:40.238623 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:40.105386 25503 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:40.240509 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 162012us
I20260709 13:06:40.243314 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:40.213029 25675 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.145409 25398 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:40.205010 25682 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:06:40.247155 21982 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.246447 25644 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:40.262337 25554 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:40.240176 25567 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:06:40.386194 25699 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.352s	user 0.001s	sys 0.003s
I20260709 13:06:40.449267 21978 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:40.277012 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 330817us
I20260709 13:06:40.451982 21982 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:40.346683 25576 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.247133 25205 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:40.292006 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.237145 25593 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.366858 21799 leader_election.cc:400] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10.
I20260709 13:06:40.469650 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:40.302264 22553 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:40.425153 21977 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:40.385560 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.426841 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.380437 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:40.426013 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 190153us
I20260709 13:06:40.427829 21975 raft_consensus.cc:2368] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:40.324154 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.472854 21909 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:40.472050 21832 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:40.425901 21825 rpcz_store.cc:276] 0709 13:06:38.595793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.120219 (+524426us) service_pool.cc:224] Handling call
0709 13:06:39.120461 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.916253 (+795792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.225577 (+309324us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540017e8d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:40.225777 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798760192}
I20260709 13:06:40.262796 25661 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.274386 25599 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.220661 25662 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.424353 25667 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:40.233006 22551 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:40.449929 25380 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:40.434792 25675 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.284397 25589 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.459700 25657 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:40.461190 25555 consensus_meta.cc:287] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.000s
W20260709 13:06:40.461746 25686 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.287s	user 0.000s	sys 0.000s
I20260709 13:06:40.462436 25717 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.498435 25717 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.443935 25644 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.524183 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.480458 25576 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.508229 25589 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:40.502007 25544 consensus_meta.cc:287] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.029s	user 0.001s	sys 0.007s
I20260709 13:06:40.531608 25544 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.516821 25577 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:40.532873 25449 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:40.501428 25664 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.868s	user 0.007s	sys 0.000s
I20260709 13:06:40.469895 21799 leader_election.cc:403] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:40.539788 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 173155us
I20260709 13:06:40.471992 21900 raft_consensus.cc:2368] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12.
I20260709 13:06:40.303066 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.472649 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:40.434695 25582 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:40.447707 25689 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:40.302650 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1936) took 1389 ms. Trace:
I20260709 13:06:40.471858 21830 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:06:40.481223 21978 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
W20260709 13:06:40.447475 25269 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.003s
I20260709 13:06:40.439087 25663 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.486474 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.457247 21981 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:40.487978 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:40.476837 25575 consensus_meta.cc:287] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.999s	user 0.009s	sys 0.001s
I20260709 13:06:40.488708 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:40.492406 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:40.469534 25567 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.435505 25574 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.255438 25701 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.484122 25599 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.496645 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.578572 21832 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.525976 25715 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.467262 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:40.535712 25644 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.535105 25638 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:40.501811 25697 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
W20260709 13:06:40.525394 25655 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.140s	user 0.008s	sys 0.000s
W20260709 13:06:40.520936 25720 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:06:40.541519 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:40.541733 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 69194.3us
I20260709 13:06:40.492681 25541 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.545984 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.497313 25555 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.579180 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.542884 21831 rpcz_store.cc:276] 0709 13:06:38.913233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.139047 (+225814us) service_pool.cc:224] Handling call
0709 13:06:39.139338 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.363328 (+223990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.363372 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.363908 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.684633 (+320725us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:39.684769 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.733318 (+ 48549us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540017f7d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:39.733545 (+   227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.276073 (+542528us) raft_consensus.cc:1685] finished
0709 13:06:40.276101 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.302571 (+ 26470us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110938,"raft.queue_time_us":134032,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":19696,"spinlock_wait_cycles":258994048,"thread_start_us":257648,"threads_started":1,"wal-append.queue_time_us":507005}
I20260709 13:06:40.582599 25675 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.584160 25701 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.584654 25574 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.509157 25398 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:40.508996 25704 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.502434 25587 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.587656 21982 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:40.600453 25578 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.002s
I20260709 13:06:40.529560 25674 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.551231 25581 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.613484 25398 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.619915 25674 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.600049 25655 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.613835 25704 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.620009 25578 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10.
I20260709 13:06:40.593386 21977 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:40.543582 25664 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:40.542748 25582 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.678507 25582 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.680048 25661 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.501703 25606 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.682101 25555 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:40.683637 25606 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:40.598511 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.542133 22551 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:40.684185 21903 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:40.549073 25205 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.684981 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.685186 25205 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.686143 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.687212 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.687412 25655 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.685907 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:40.688519 21979 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:06:40.688743 21903 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:40.546370 25589 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.601117 21909 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:40.602849 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.691093 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.585997 25567 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.609635 21830 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:40.692029 21977 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:40.692251 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.692497 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.612634 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.528353 25380 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:40.695525 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:40.576746 25269 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.699656 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 423) took 2127 ms. Trace:
I20260709 13:06:40.700031 21827 rpcz_store.cc:276] 0709 13:06:38.572320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.043692 (+471372us) service_pool.cc:224] Handling call
0709 13:06:39.043969 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.044330 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.044359 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.064154 (+ 19795us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.475246 (+411092us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:39.819478 (+344232us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.819782 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.819849 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.698132 (+878283us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b180035e600. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:40.699389 (+  1257us) raft_consensus.cc:1685] finished
0709 13:06:40.699491 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.699602 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":454126,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":710,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":20381,"spinlock_wait_cycles":6937984,"thread_start_us":723682,"threads_started":2,"wal-append.queue_time_us":760739}
I20260709 13:06:40.701246 21978 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:40.701313 25269 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:40.671413 21832 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:40.597429 25715 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.707928 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.708490 21832 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:40.708777 25576 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.689162 25587 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.709261 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.709725 25715 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.710554 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.711090 21832 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.619191 25541 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:40.714239 25693 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.743s	user 0.000s	sys 0.001s
W20260709 13:06:40.710583 25559 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
I20260709 13:06:40.715489 25589 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10.
I20260709 13:06:40.676995 25657 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.692994 21982 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:40.693861 21831 raft_consensus.cc:2410] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:06:40.717171 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.717754 21831 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:40.718336 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 476649us
I20260709 13:06:40.720166 21832 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:40.720969 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.721455 21832 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.721724 25540 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:40.728919 21907 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:40.726653 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:40.726987 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:40.731263 22546 raft_consensus.cc:2368] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:40.732717 22551 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:40.728348 21799 leader_election.cc:400] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12.
I20260709 13:06:40.736626 21799 leader_election.cc:403] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.725782 21831 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:40.745669 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:40.673625 25448 consensus_meta.cc:287] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 13:06:40.694160 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:40.613265 21975 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:40.695461 21834 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:40.696175 21900 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.672163 25398 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.697834 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.749547 21825 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:40.698457 25380 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.702256 21980 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:40.701913 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.755226 21827 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:40.755872 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:40.756280 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.757079 21827 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:40.670955 25574 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.722137 25540 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:40.759402 25574 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.760033 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.759796 25540 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.760715 21831 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:40.760982 25540 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.762029 25574 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.762979 25715 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.763460 25715 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.763684 25628 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.765362 25715 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:40.703080 25661 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.765846 25380 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.704778 25567 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.706737 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.789233 21830 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:40.790035 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.790586 21830 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:40.675239 25674 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.730489 21832 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:40.757794 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:40.758071 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.765988 25661 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.687945 25205 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.766984 25582 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:40.723071 25069 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.696s	user 0.006s	sys 0.005s
I20260709 13:06:40.772599 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:40.775074 25599 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.776396 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.839773 21900 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:40.844349 21907 raft_consensus.cc:2410] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 13 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:06:40.786557 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:40.844609 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:40.845011 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58530.2us
I20260709 13:06:40.695430 21829 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:40.845350 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:40.794581 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:40.846570 22546 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:40.796860 22551 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:40.709825 25587 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.822715 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.845402 21900 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.847791 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:40.843281 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49015.1us
I20260709 13:06:40.849351 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:40.819078 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:06:40.853680 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.853888 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:40.854456 21903 raft_consensus.cc:2368] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:40.855314 21907 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.843622 25380 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.855978 25716 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:06:40.859903 25661 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.792150 25558 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.863082 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:40.862831 21825 raft_consensus.cc:2410] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:06:40.857894 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:40.868626 21907 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:40.886819 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:40.886152 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:40.888692 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:40.889298 21907 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:40.889840 21900 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:40.891237 21826 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:40.858119 25628 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:40.795615 25605 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12.
I20260709 13:06:40.893302 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:40.893369 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:40.893641 21827 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:06:40.786599 25576 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.903146 21873 leader_election.cc:400] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:40.903599 21873 leader_election.cc:403] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.895592 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:40.858143 25675 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:40.791898 25448 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.899555 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.853176 25715 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:40.907018 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:40.864995 25574 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:40.859515 25398 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.862756 25674 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:40.900900 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:40.916395 21907 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:40.916654 21830 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:40.894539 25708 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:40.928655 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.898828 25629 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:40.898955 25644 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.898687 24841 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.856843 25704 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.929481 21907 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:40.929284 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:40.902927 25297 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:40.930634 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.911804 25502 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:40.911550 25667 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:40.917413 25575 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:40.857088 25069 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.919517 25715 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.947218 25715 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.930473 25727 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:06:40.949519 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:40.949702 25727 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:40.950217 25727 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:40.950527 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:40.951128 25727 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:40.951751 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:40.952286 21906 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:40.952157 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 623) took 1114 ms. Trace:
I20260709 13:06:40.919862 25574 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.953018 25574 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:40.931605 25632 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:40.953163 25725 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:06:40.953971 25632 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:40.954970 25632 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.919277 25628 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:40.926519 25674 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.939901 25502 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:40.958401 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:40.958621 25502 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.959021 25587 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.959293 21976 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:40.958442 25674 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:40.960400 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:40.951632 25069 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:40.953399 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1999) took 1070 ms. Trace:
I20260709 13:06:40.961200 21906 rpcz_store.cc:276] 0709 13:06:39.883099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.963271 (+ 80172us) service_pool.cc:224] Handling call
0709 13:06:40.953228 (+989957us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b5400077954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:40.953348 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2248276224}
I20260709 13:06:40.945148 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:40.943320 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:40.963485 21831 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:40.961444 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:40.964969 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.965591 21906 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:40.966434 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:40.966672 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:40.967815 25628 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.968425 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1923) took 2461 ms. Trace:
I20260709 13:06:40.969225 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:40.912958 25576 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:40.934924 25663 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:40.952737 22553 rpcz_store.cc:276] 0709 13:06:39.837596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.837877 (+   281us) service_pool.cc:224] Handling call
0709 13:06:40.951918 (+1114041us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b5400673754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:40.952101 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962699648}
I20260709 13:06:40.961036 21983 raft_consensus.cc:2376] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6. Re-sending same reply.
W20260709 13:06:40.992657 21874 leader_election.cc:336] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Timed out: RequestConsensusVote RPC to 127.20.53.132:38783 timed out after 1.649s (SENT)
I20260709 13:06:40.952615 25727 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.968822 21833 rpcz_store.cc:276] 0709 13:06:38.507059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.037301 (+530242us) service_pool.cc:224] Handling call
0709 13:06:39.103323 (+ 66022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.113229 (+  9906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.113262 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.237040 (+123778us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.584773 (+347733us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:39.584815 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.584882 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.106541 (+521659us) raft_consensus.cc:1685] finished
0709 13:06:40.106569 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.968183 (+861614us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b540008af50. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:40.968365 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23360,"raft.queue_time_us":17509,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":20288,"spinlock_wait_cycles":151145216,"thread_start_us":294032,"threads_started":1,"wal-append.queue_time_us":412129}
W20260709 13:06:41.017225 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76578.3us
I20260709 13:06:41.017598 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:41.022656 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:41.012955 25696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.024s	sys 0.050s
I20260709 13:06:40.939815 25629 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:41.028077 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 98870.5us
W20260709 13:06:41.031291 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.033066 25719 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:06:41.033466 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:41.034610 25069 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:41.034943 25717 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.035027 25069 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.035735 25069 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.036259 25715 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.034097 21831 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
W20260709 13:06:41.039835 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 284022us
I20260709 13:06:41.020296 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:41.041018 21948 leader_election.cc:400] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12.
I20260709 13:06:41.041326 21948 leader_election.cc:403] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:41.041195 21833 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:41.042408 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.045540 21833 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.028100 25581 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:41.047044 25581 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.047465 25581 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.020264 25593 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.050583 25593 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.052640 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:41.053004 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.016798 25449 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:41.054538 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1991) took 1164 ms. Trace:
I20260709 13:06:41.058674 21974 rpcz_store.cc:276] 0709 13:06:39.875153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.875392 (+   239us) service_pool.cc:224] Handling call
0709 13:06:39.895849 (+ 20457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.222327 (+326478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.222352 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.222756 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.379173 (+156417us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.379210 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.379278 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.039024 (+659746us) raft_consensus.cc:1685] finished
0709 13:06:41.039044 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.039180 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14352,"raft.queue_time_us":71888,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":40799,"thread_start_us":467188,"threads_started":2,"wal-append.queue_time_us":273596}
I20260709 13:06:41.016381 25468 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.012274 25663 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.019866 25555 raft_consensus.cc:2764] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:41.061901 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:41.070457 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 92802.1us
I20260709 13:06:40.941656 24841 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.023097 25297 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:06:41.022910 25558 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.066417 25599 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.066507 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:41.077327 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:41.028620 25696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.024s	sys 0.050s
I20260709 13:06:41.071593 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:41.022759 25575 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:41.073807 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.074909 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.071427 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:41.080621 21983 raft_consensus.cc:2368] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12.
I20260709 13:06:41.081357 21831 raft_consensus.cc:2410] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:41.081916 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.058076 25188 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:41.065986 25593 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:41.091794 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50928.6us
I20260709 13:06:41.032491 25644 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:06:41.094827 21977 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:41.070700 25663 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.092542 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.096769 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.099385 21974 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:41.099851 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.102322 25515 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:41.079407 25558 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.105443 25515 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.105870 25515 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.088140 25667 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.102952 25575 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.103040 25629 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.103513 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:41.104122 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.104280 25448 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.098374 25582 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:41.102326 25602 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:06:41.078878 25657 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.075207 25581 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.110106 21948 leader_election.cc:400] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:41.120693 21948 leader_election.cc:403] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:41.091543 25188 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.113716 21831 raft_consensus.cc:606] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:41.123086 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1991) took 1287 ms. Trace:
I20260709 13:06:41.123235 21831 raft_consensus.cc:614] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:41.113626 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.072742 25468 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.107722 21833 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:41.119630 21904 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:41.120046 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.119061 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1990) took 1283 ms. Trace:
W20260709 13:06:41.122467 21901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 1977) took 2167 ms (client timeout 1855 ms). Trace:
W20260709 13:06:41.125150 21901 rpcz_store.cc:269] 0709 13:06:38.951986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.956668 (+  4682us) service_pool.cc:224] Handling call
0709 13:06:41.118979 (+2162311us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540020b2d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:41.119124 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4377465088}
I20260709 13:06:41.124702 21902 rpcz_store.cc:276] 0709 13:06:39.835270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.835387 (+   117us) service_pool.cc:224] Handling call
0709 13:06:39.835780 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.848337 (+ 12557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.848365 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.848403 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:39.848448 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.118833 (+1270385us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54002378d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:41.118883 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.119000 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28415616}
I20260709 13:06:41.123464 21908 rpcz_store.cc:276] 0709 13:06:39.835546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.836007 (+   461us) service_pool.cc:224] Handling call
0709 13:06:39.836262 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.015381 (+179119us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:40.028148 (+ 12767us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.253539 (+225391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.253586 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:40.253636 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.122896 (+869260us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54003c9e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:41.122937 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.123039 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40516,"prepare.queue_time_us":12559,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":25332,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":19152,"spinlock_wait_cycles":411223936,"thread_start_us":225094,"threads_started":1,"wal-append.queue_time_us":459130}
I20260709 13:06:41.128206 21902 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:06:41.128958 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1993) took 1015 ms. Trace:
I20260709 13:06:41.129251 21902 rpcz_store.cc:276] 0709 13:06:40.113848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.127616 (+1013768us) service_pool.cc:224] Handling call
0709 13:06:41.127942 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:41.128666 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.128899 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.134931 25714 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12.
I20260709 13:06:41.135656 25730 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:41.136243 25544 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:41.136650 25730 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:41.137058 25730 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:41.137526 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:41.142333 25729 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.081s	user 0.000s	sys 0.002s
I20260709 13:06:41.142941 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.117924 25718 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:41.144074 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:41.145192 21902 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:41.153257 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.153486 21909 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:41.154706 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1992) took 1052 ms. Trace:
I20260709 13:06:41.155244 21909 rpcz_store.cc:276] 0709 13:06:40.102683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.122916 (+1020233us) service_pool.cc:224] Handling call
0709 13:06:41.150536 (+ 27620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.154469 (+  3933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.154654 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.154663 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:41.125990 25188 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.157475 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.158313 25665 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:41.161672 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.163388 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:41.159152 25274 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:41.165232 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.165745 25274 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:41.166297 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:41.167397 21982 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:41.167043 25274 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.168056 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.173511 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:41.112836 25667 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.121609 25657 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.150872 25718 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.174589 21982 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:41.152220 25606 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:41.159510 25189 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.160634 25449 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:41.163070 25544 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:41.181599 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.184636 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.186002 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.187122 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:41.188982 21831 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:41.153167 25574 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.190263 21909 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:41.180176 25718 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.179503 25665 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:41.183650 25576 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.198334 22553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:06:41.199693 22553 raft_consensus.cc:606] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:41.200119 22553 raft_consensus.cc:614] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:41.201761 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:41.137948 25730 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.203928 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:41.190816 25593 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.206377 21906 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:41.208047 25665 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.211436 25502 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.214819 25593 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.217007 25593 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:41.206844 25708 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:41.230857 25546 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:41.231333 25546 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.235203 25657 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:41.235839 21831 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:06:41.205595 25740 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:06:41.195680 25449 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:41.240013 21948 leader_election.cc:400] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:41.197579 25558 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:41.253986 25468 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:41.241773 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:41.254978 21909 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:41.236253 25655 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:41.256669 25730 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.244310 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:41.251392 25449 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.272018 21903 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:41.260023 24841 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:41.275521 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 553) took 2341 ms (client timeout 1649 ms). Trace:
I20260709 13:06:41.275694 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.263028 25546 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:41.275956 22549 rpcz_store.cc:269] 0709 13:06:38.934429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.955257 (+ 20828us) service_pool.cc:224] Handling call
0709 13:06:41.275340 (+2320083us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b54006743d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:41.275454 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30619904}
I20260709 13:06:41.277845 25546 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:06:41.278736 25580 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:41.279129 25580 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.233807 25674 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.265844 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "865ede4842b04242930bf2619bb09d16"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:41.288539 21831 raft_consensus.cc:606] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:41.288957 21831 raft_consensus.cc:614] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:41.270681 25515 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.264220 25715 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:41.264986 25574 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.269656 25663 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.287825 25580 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:41.291524 24841 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:41.310516 21983 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:06:41.307621 25581 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.302294 25069 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:41.339636 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.322454 24841 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:41.344674 21903 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:41.349771 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:41.352469 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.354802 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:41.357303 21978 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:41.351287 25739 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:06:41.348349 25602 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:41.361289 21905 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:06:41.398090 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.399142 21905 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:41.397009 25069 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.364482 24841 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.403740 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 430) took 1168 ms. Trace:
I20260709 13:06:41.421030 25580 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.405274 25674 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.407407 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1995) took 1570 ms. Trace:
I20260709 13:06:41.426968 21900 rpcz_store.cc:276] 0709 13:06:39.836779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.894757 (+1057978us) service_pool.cc:224] Handling call
0709 13:06:40.895136 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.895574 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:40.986426 (+ 90852us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.122801 (+136375us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.123230 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.123394 (+   164us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:41.123433 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.123500 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.407209 (+283709us) raft_consensus.cc:1685] finished
0709 13:06:41.407231 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.407351 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2906,"prepare.queue_time_us":177167,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":3577,"raft.queue_time_us":4524,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":12783,"thread_start_us":184553,"threads_started":2,"wal-append.queue_time_us":133696}
I20260709 13:06:41.408213 25663 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.410953 21902 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:41.413633 25502 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.432824 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:41.415774 21905 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:41.418470 25748 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.096s	user 0.003s	sys 0.000s
I20260709 13:06:41.424237 21833 rpcz_store.cc:276] 0709 13:06:40.235369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.126828 (+891459us) service_pool.cc:224] Handling call
0709 13:06:41.127145 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:41.127514 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.127541 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:41.149779 (+ 22238us) log.cc:844] Serialized 52 byte log entry
0709 13:06:41.309096 (+159317us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:41.309153 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.309229 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.397442 (+ 88213us) raft_consensus.cc:1685] finished
0709 13:06:41.397460 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.403662 (+  6202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":824,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":130827,"threads_started":1,"wal-append.queue_time_us":169376}
I20260709 13:06:41.421182 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1988) took 1574 ms. Trace:
I20260709 13:06:41.435760 21833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96da242efa5849aab4168785047cff48"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:41.436486 21833 raft_consensus.cc:606] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:41.436827 21833 raft_consensus.cc:614] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:41.437153 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.438308 21900 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:41.421831 25188 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.422499 25718 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:41.404230 25746 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.066s	user 0.000s	sys 0.003s
I20260709 13:06:41.433642 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:41.435794 21982 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:41.435633 21980 rpcz_store.cc:276] 0709 13:06:39.847073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.847255 (+   182us) service_pool.cc:224] Handling call
0709 13:06:39.848467 (+  1212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.754747 (+906280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.420953 (+666206us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54002c8b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:41.421121 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963064192}
I20260709 13:06:41.446297 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:41.425966 25743 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.230s	user 0.003s	sys 0.000s
I20260709 13:06:41.427021 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.449522 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.452124 21833 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.437695 25449 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.456504 21978 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:41.440485 25398 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:41.460522 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:41.461660 21902 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:41.443293 25468 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.443686 25605 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.464702 21833 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:41.477430 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.478154 21833 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.474248 25696 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:06:41.483843 25514 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:41.453150 25593 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:41.484035 25515 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:41.485015 25593 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:41.485374 25593 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:41.464183 25449 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.485811 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 1996) took 1648 ms. Trace:
I20260709 13:06:41.486213 25593 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.486369 21906 rpcz_store.cc:276] 0709 13:06:39.837037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.095000 (+1257963us) service_pool.cc:224] Handling call
0709 13:06:41.095375 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.206713 (+111338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.485516 (+278803us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54003c9454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:41.485737 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250268544}
I20260709 13:06:41.487397 25593 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:41.487603 25449 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:41.466936 25502 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.453542 25581 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:41.489120 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 2014) took 1400 ms. Trace:
I20260709 13:06:41.602396 21826 rpcz_store.cc:276] 0709 13:06:40.088511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.222195 (+133684us) service_pool.cc:224] Handling call
0709 13:06:41.488953 (+1266758us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540040cc54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:41.489057 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133165312}
I20260709 13:06:41.603619 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.604261 21826 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.453209 25576 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:06:41.464046 24793 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:41.490142 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1990) took 1615 ms. Trace:
I20260709 13:06:41.610685 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:41.448518 25665 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:41.444348 25274 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:06:41.629791 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:41.630383 22553 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:41.507923 21833 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:41.631963 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.632421 21833 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:41.451144 25558 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:41.517344 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:41.521922 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.543526 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.489248 25733 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:41.611645 22551 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:41.453263 25691 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:06:41.490975 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 1986) took 2058 ms. Trace:
I20260709 13:06:41.464787 25398 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.628541 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:41.607411 25581 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.452574 25599 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 13:06:41.453017 25715 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.155s
I20260709 13:06:41.610611 24793 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:41.610829 21979 rpcz_store.cc:276] 0709 13:06:39.874745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.874951 (+   206us) service_pool.cc:224] Handling call
0709 13:06:39.875226 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.688897 (+813671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.489909 (+801012us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54002274d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:41.490085 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1869869440}
I20260709 13:06:41.641376 21833 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:06:41.645123 22551 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:41.650429 25733 consensus_queue.cc:1243] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:41.650678 25069 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.682806 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:41.639082 25558 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.601675 25541 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.656342 22546 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:41.660815 25398 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:41.652784 21981 rpcz_store.cc:276] 0709 13:06:39.432389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.432507 (+   118us) service_pool.cc:224] Handling call
0709 13:06:39.432798 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.545502 (+1112704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.490760 (+945258us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540005b4d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:41.490924 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2355293568}
I20260709 13:06:41.661453 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:41.637934 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:41.628690 25729 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:06:41.655612 21826 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:41.492177 25468 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.473977 25605 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.677237 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.677520 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.660486 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.634591 25696 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:41.682252 22555 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:41.650795 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:41.683908 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:41.684350 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 410) took 1220 ms. Trace:
I20260709 13:06:41.684633 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.693588 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.696764 22554 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:41.699231 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:41.607169 25727 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.610086 25502 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.661326 25581 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.701529 25558 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.723719 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:41.702881 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:41.724666 21903 raft_consensus.cc:2376] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6. Re-sending same reply.
I20260709 13:06:41.754941 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:41.704427 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.756093 21981 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:41.706375 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:41.757731 21826 raft_consensus.cc:2410] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:41.713655 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:41.715330 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1994) took 1533 ms. Trace:
I20260709 13:06:41.758549 21908 rpcz_store.cc:276] 0709 13:06:40.181781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.128676 (+946895us) service_pool.cc:224] Handling call
0709 13:06:41.128991 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.138521 (+  9530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.138553 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.139000 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.183044 (+ 44044us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:41.183107 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.183195 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.425466 (+242271us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:41.700427 (+274961us) raft_consensus.cc:1685] finished
0709 13:06:41.700456 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.715254 (+ 14798us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":933,"raft.queue_time_us":6287,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":7439232,"thread_start_us":43636,"threads_started":1,"wal-append.queue_time_us":57000}
I20260709 13:06:41.716355 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:41.721465 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:41.762315 21833 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:41.763281 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.764469 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:41.760856 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:41.724246 21980 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:41.723235 21909 rpcz_store.cc:276] 0709 13:06:40.463402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.259411 (+796009us) service_pool.cc:224] Handling call
0709 13:06:41.290026 (+ 30615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.300538 (+ 10512us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:41.308942 (+  8404us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.417357 (+108415us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b18004c0b40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:06:41.683422 (+266065us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.683553 (+   131us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:41.683698 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.683950 (+   252us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.684259 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12252,"prepare.queue_time_us":8191,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":778,"raft.queue_time_us":43113,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":24260,"spinlock_wait_cycles":13412224,"thread_start_us":239310,"threads_started":1}
I20260709 13:06:41.682742 25559 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:06:41.702363 25681 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.274s	user 0.008s	sys 0.021s
W20260709 13:06:41.812135 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 98590.5us
I20260709 13:06:41.807899 21908 raft_consensus.cc:2410] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:41.700763 25069 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.808624 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:41.814677 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 297423us
W20260709 13:06:41.821090 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.772447 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.807301 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.837626 21826 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.838227 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:41.722426 22549 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:41.846817 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2022) took 1638 ms. Trace:
W20260709 13:06:41.844424 21829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 2021) took 1662 ms (client timeout 1873 ms). Trace:
I20260709 13:06:41.853572 21827 rpcz_store.cc:276] 0709 13:06:40.208020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.793554 (+585534us) service_pool.cc:224] Handling call
0709 13:06:40.843621 (+ 50067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.901395 (+ 57774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.846509 (+945114us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54002882d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:41.846735 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114465152}
W20260709 13:06:41.854017 21829 rpcz_store.cc:269] 0709 13:06:40.181838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.274324 (+ 92486us) service_pool.cc:224] Handling call
0709 13:06:41.844220 (+1569896us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540017edd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:41.844354 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301746048}
I20260709 13:06:41.742579 25717 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.708876 25555 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:41.843633 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.814343 25576 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.857405 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:41.856245 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 83908.9us
I20260709 13:06:41.865257 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:41.865273 21826 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:41.719631 25605 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.868698 21908 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:41.818624 25638 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:41.722086 25718 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:41.869833 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:41.867741 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:41.850307 25660 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.742376 25727 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.717794 25468 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.876608 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.862030 25715 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:41.883728 21832 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:41.865833 25555 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:41.866276 25514 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:41.884578 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2027) took 1090 ms. Trace:
I20260709 13:06:41.878750 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.865028 25730 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:41.723124 25675 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.153s
I20260709 13:06:41.868185 25274 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:41.873740 25188 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:41.897444 21908 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:41.879369 25605 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:41.896513 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 211964us
I20260709 13:06:41.900465 21900 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:41.910554 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:41.714911 25541 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:41.902848 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.881568 25691 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:41.904358 22551 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:41.894629 21832 rpcz_store.cc:276] 0709 13:06:40.794137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.873959 (+1079822us) service_pool.cc:224] Handling call
0709 13:06:41.883524 (+  9565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.884297 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.884519 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.721397 25696 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.867551 25717 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.872643 25576 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.895781 25468 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.902570 25664 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:41.914073 25751 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:06:41.931649 25696 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.912523 25599 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:41.916584 25691 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.909750 25514 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:41.933949 25664 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:41.935276 25069 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:41.936460 25398 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:41.937564 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:41.938745 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:41.942395 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.955654 21832 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:41.883348 25189 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:41.885283 25660 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.915210 25605 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.913713 25546 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:41.949923 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 424) took 3375 ms. Trace:
I20260709 13:06:41.902426 25730 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:41.953474 21833 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:41.962644 21828 rpcz_store.cc:276] 0709 13:06:38.572555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.047585 (+475030us) service_pool.cc:224] Handling call
0709 13:06:39.047889 (+   304us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:06:39.049836 (+  1947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.049875 (+    39us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:06:39.057332 (+  7457us) log.cc:844] Serialized 104 byte log entry
0709 13:06:39.520066 (+462734us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:39.807193 (+287127us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.815522 (+  8329us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.816057 (+   535us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.816222 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.816292 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.674256 (+1857964us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b2400120c68. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf3009d 00007fb75eb6210e 00007fb75eb7988c 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221
0709 13:06:41.947551 (+273295us) raft_consensus.cc:1685] finished
0709 13:06:41.947570 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.947707 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2152,"prepare.queue_time_us":863248,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":93,"raft.queue_time_us":7051,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":6544,"spinlock_wait_cycles":8213248,"thread_start_us":704125,"threads_started":2,"wal-append.queue_time_us":806682}
I20260709 13:06:41.965350 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:41.965993 21828 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:41.953675 25755 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:06:41.957489 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.948055 21830 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:41.975606 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.993896 21798 leader_election.cc:400] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12.
I20260709 13:06:41.995121 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:41.927511 25468 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.009850 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:42.011765 25468 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.015151 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:42.015956 22546 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:42.016902 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:42.017356 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:42.018242 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:42.017485 25730 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:42.022539 22553 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:42.023865 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:41.951174 25691 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.954272 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:41.953066 25717 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.028539 22554 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:42.028898 22555 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:42.029765 21828 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:42.041316 21830 raft_consensus.cc:2410] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:42.053416 21832 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:42.056344 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:42.056524 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:42.057109 21828 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:42.057952 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:42.058423 21828 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.951599 25599 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.059273 25546 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:42.062743 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1926) took 2021 ms. Trace:
I20260709 13:06:42.042709 25468 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.064055 21975 rpcz_store.cc:276] 0709 13:06:40.041122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.587058 (+545936us) service_pool.cc:224] Handling call
0709 13:06:40.587351 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.748757 (+161406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.062478 (+1313721us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b54003fa054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:42.062676 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57213696}
I20260709 13:06:42.070721 21828 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:42.072618 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1951) took 1543 ms. Trace:
I20260709 13:06:42.071933 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:42.058638 25502 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.075186 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:42.074345 21831 rpcz_store.cc:276] 0709 13:06:40.529345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.310224 (+780879us) service_pool.cc:224] Handling call
0709 13:06:41.322519 (+ 12295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.322838 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.322865 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.323203 (+   338us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.432827 (+109624us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:41.432882 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.432969 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.072359 (+639390us) raft_consensus.cc:1685] finished
0709 13:06:42.072385 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.072555 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":535,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":1155,"thread_start_us":84119,"threads_started":1,"wal-append.queue_time_us":314686}
W20260709 13:06:42.063925 25756 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:06:42.079783 21828 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:42.059293 25667 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:41.954844 25555 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:42.118808 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.061293 22549 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:42.042953 25759 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:42.121850 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:42.127032 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:42.127712 22547 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 6: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:42.129624 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:42.130153 21831 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.095912 21832 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:42.132244 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 262515us
I20260709 13:06:42.133123 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:42.137354 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 142325us
I20260709 13:06:42.141037 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:42.149230 21828 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:42.149979 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2028) took 1346 ms. Trace:
I20260709 13:06:42.150362 21828 rpcz_store.cc:276] 0709 13:06:40.803571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.148617 (+1345046us) service_pool.cc:224] Handling call
0709 13:06:42.148887 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.149717 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.149918 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.151895 21828 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:42.152954 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1959) took 1317 ms. Trace:
I20260709 13:06:42.153519 21828 rpcz_store.cc:276] 0709 13:06:40.834716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.151219 (+1316503us) service_pool.cc:224] Handling call
0709 13:06:42.151541 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.152282 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.152471 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.155004 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2029) took 1318 ms. Trace:
I20260709 13:06:42.155424 21828 rpcz_store.cc:276] 0709 13:06:40.836253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.154221 (+1317968us) service_pool.cc:224] Handling call
0709 13:06:42.154460 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.154632 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.154667 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.154721 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:42.154771 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.154838 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.154951 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.159674 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 626) took 1403 ms. Trace:
I20260709 13:06:42.160583 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:42.161327 22546 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:42.163761 21834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1942) took 1711 ms (client timeout 1788 ms). Trace:
I20260709 13:06:42.074016 25664 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:42.164194 21834 rpcz_store.cc:269] 0709 13:06:40.452322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.523910 (+ 71588us) service_pool.cc:224] Handling call
0709 13:06:42.163606 (+1639696us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540017fcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:42.163708 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384358656}
I20260709 13:06:42.164566 25398 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:42.114655 25514 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.165495 21834 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:42.160450 25774 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:42.077906 25546 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:42.170207 21828 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:42.073416 25762 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:42.117692 25468 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.179028 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 1944) took 1726 ms. Trace:
I20260709 13:06:42.179492 21825 rpcz_store.cc:276] 0709 13:06:40.452791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.750362 (+297571us) service_pool.cc:224] Handling call
0709 13:06:42.175815 (+1425453us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b540009d154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:42.178959 (+  3144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32635264}
I20260709 13:06:42.122243 25764 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.147941 25763 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:42.188699 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:42.182518 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:42.198370 21832 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:42.203918 25581 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.206666 25768 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.207154 25768 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.208328 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:42.209120 25768 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:42.209659 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:42.211979 22555 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:06:42.194372 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:42.162459 25715 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:42.217339 22546 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:42.217753 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:42.176472 25727 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:42.174942 25555 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.232043 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:42.234476 21831 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:42.241334 22547 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:06:42.219348 25593 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.005s
I20260709 13:06:42.252017 25787 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:42.254261 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 105587us
I20260709 13:06:42.254688 25777 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:42.255125 25777 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:42.255525 25777 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.190061 25767 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:42.269829 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:42.271422 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:42.272781 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:42.187602 25468 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.238241 25764 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:42.236936 25763 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:42.243322 25541 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.267099 25576 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:42.265866 25775 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.278631 25730 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.284359 25718 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:42.287771 24841 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:42.360680 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 91378.2us
I20260709 13:06:42.285241 25664 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:06:42.301599 25605 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.363413 21798 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:42.329324 25775 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.397205 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:42.307476 25715 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.398341 25664 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:42.399655 25664 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.401147 25274 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:42.401623 25274 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:42.278282 25593 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:06:42.289525 25660 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.315093 25599 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.286123 25727 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:06:42.316468 25763 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.293095 25759 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:42.407846 25468 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.408751 25605 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:42.407614 25593 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:42.413300 25605 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:42.413672 25593 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.413794 21828 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:42.408118 25718 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:42.413873 25759 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.415007 25605 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.415413 25718 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.288059 25760 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:42.417230 25760 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:06:42.418772 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.418936 25760 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.419934 25718 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:42.258476 25790 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:06:42.367349 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 149537us
I20260709 13:06:42.284823 25546 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:42.393586 25558 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
I20260709 13:06:42.394599 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:42.396955 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:42.311174 25581 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:42.406670 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 43785.6us
I20260709 13:06:42.409273 21833 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:42.317615 25768 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:42.421218 25593 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.422827 25274 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.456497 25768 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.459975 25768 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.460697 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2017) took 1259 ms. Trace:
I20260709 13:06:42.418990 25605 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:42.452039 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:42.470774 25514 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:42.472661 25514 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:42.473186 25514 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:42.160339 22548 rpcz_store.cc:276] 0709 13:06:40.755988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.756183 (+   195us) service_pool.cc:224] Handling call
0709 13:06:40.756505 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.756975 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:41.743508 (+986533us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b1800405100. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf 00007fb75eff8038
0709 13:06:41.978481 (+234973us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.134625 (+156144us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.135153 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.135305 (+   152us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:42.135343 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.135399 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.159354 (+ 23955us) raft_consensus.cc:1685] finished
0709 13:06:42.159451 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.159612 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1314343,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":25571,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":4399,"spinlock_wait_cycles":8014592,"thread_start_us":354732,"threads_started":2,"wal-append.queue_time_us":125326}
I20260709 13:06:42.457960 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:42.416821 25767 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:06:42.497193 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45382.4us
I20260709 13:06:42.498462 21798 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:42.499960 25696 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:42.500547 25696 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.501099 25696 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.503743 22547 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 13: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:42.508816 21832 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 5.
I20260709 13:06:42.509984 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:42.512291 25503 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:42.512594 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:42.516350 25664 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:42.487428 25558 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.519587 25515 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:42.520030 25515 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:42.520733 25558 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.521247 25515 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.525924 21827 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:42.528453 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2026) took 1784 ms. Trace:
I20260709 13:06:42.528759 21827 rpcz_store.cc:276] 0709 13:06:40.743612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.865260 (+1121648us) service_pool.cc:224] Handling call
0709 13:06:41.865609 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.526416 (+660807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.528109 (+  1693us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54002896d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:42.528367 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517536768}
I20260709 13:06:42.490967 24841 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:42.534498 25632 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:42.534967 25632 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:42.535542 25558 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:42.479481 25514 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.536151 25632 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.537503 25632 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.537678 25514 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.542424 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:42.545276 25776 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:06:42.548260 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:42.549214 21977 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:42.534426 24841 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.550369 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:42.551878 25274 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:42.554371 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:42.555261 22548 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:42.554399 21832 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.461194 21901 rpcz_store.cc:276] 0709 13:06:41.201475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.852875 (+651400us) service_pool.cc:224] Handling call
0709 13:06:41.853191 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.943122 (+ 89931us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:42.137568 (+194446us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.244248 (+106680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.244293 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:42.244336 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.460113 (+215777us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b540020a8d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:42.460178 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.460436 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":266389,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":71,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":10090,"spinlock_wait_cycles":365491328,"thread_start_us":291303,"threads_started":2,"wal-append.queue_time_us":173540}
I20260709 13:06:42.560387 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:42.561802 25691 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.562762 21831 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:42.563680 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2041) took 1105 ms. Trace:
I20260709 13:06:42.564105 21980 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:06:42.564088 21831 rpcz_store.cc:276] 0709 13:06:41.457833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.561854 (+1104021us) service_pool.cc:224] Handling call
0709 13:06:42.562340 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.563310 (+   970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.563573 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.568261 25580 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:42.573541 25691 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:42.575457 25794 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:06:42.566069 21831 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:42.530032 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:42.402150 25777 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.586663 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1945) took 1398 ms. Trace:
I20260709 13:06:42.587371 21978 rpcz_store.cc:276] 0709 13:06:41.188435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.446408 (+257973us) service_pool.cc:224] Handling call
0709 13:06:41.446693 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.462749 (+ 16056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.586026 (+1123277us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b5400413f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:42.586440 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21776256}
I20260709 13:06:42.589777 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2043) took 1126 ms. Trace:
I20260709 13:06:42.590346 21831 rpcz_store.cc:276] 0709 13:06:41.458114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.565279 (+1107165us) service_pool.cc:224] Handling call
0709 13:06:42.565771 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.584536 (+ 18765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.584766 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.556927 25718 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:06:42.608567 21827 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:42.608851 21833 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:06:42.612944 24793 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:42.609220 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 51839.7us
I20260709 13:06:42.621451 21832 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:42.609047 25515 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:42.641664 21827 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:42.650437 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:42.651824 25559 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:42.653045 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:42.654389 25790 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:42.654525 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:42.655200 25790 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.656345 25763 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:42.656750 25763 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.657099 25763 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.657780 25790 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:42.658463 24793 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:42.663149 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 1987) took 3359 ms. Trace:
I20260709 13:06:42.663592 21904 rpcz_store.cc:276] 0709 13:06:39.303664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.303790 (+   126us) service_pool.cc:224] Handling call
0709 13:06:41.119423 (+1815633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.124302 (+  4879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.662725 (+1538423us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b540020b2d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:42.662961 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4160235392}
I20260709 13:06:42.665175 21827 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:42.655653 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:42.666524 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2045) took 1011 ms. Trace:
I20260709 13:06:42.672037 21831 rpcz_store.cc:276] 0709 13:06:41.635964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.597447 (+961483us) service_pool.cc:224] Handling call
0709 13:06:42.624938 (+ 27491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.642015 (+ 17077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.642041 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.646759 (+  4718us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:42.646785 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.646823 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.646902 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.676452 25468 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:42.677423 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:42.678216 21978 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:42.681517 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:42.681344 25763 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.684075 25764 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.684854 25764 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.685431 25763 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:42.685782 25189 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:42.686564 25189 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.687129 25763 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:42.687513 25764 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.688454 25763 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:42.688633 25189 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:42.689175 25777 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:42.689532 25763 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:42.690232 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.691761 21831 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:42.704500 25733 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:42.704989 25733 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:42.707681 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:42.708386 25782 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.391s	user 0.003s	sys 0.000s
I20260709 13:06:42.708622 21982 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:42.711230 25767 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.675603 21833 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:06:42.720162 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2049) took 1024 ms. Trace:
I20260709 13:06:42.720461 21833 rpcz_store.cc:276] 0709 13:06:41.695999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.623897 (+927898us) service_pool.cc:224] Handling call
0709 13:06:42.640441 (+ 16544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.719921 (+ 79480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.720116 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.665148 25715 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:42.706035 25733 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.728448 21834 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:42.728963 25696 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.731238 22547 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:42.731865 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:42.731133 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:42.732441 25795 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260709 13:06:42.735786 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:42.736744 25797 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:42.738421 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.740299 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 460) took 1594 ms. Trace:
I20260709 13:06:42.740841 21983 rpcz_store.cc:276] 0709 13:06:41.145422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.145620 (+   198us) service_pool.cc:224] Handling call
0709 13:06:41.160460 (+ 14840us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:41.311997 (+151537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.739604 (+1427607us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54000b7554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:42.740094 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344529792}
I20260709 13:06:42.743402 25448 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.744061 25448 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.748196 21982 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:42.689230 25189 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:42.727089 21799 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.132:38783 timed out after 1.768s (SENT) [suppressed 31 similar messages]
I20260709 13:06:42.764137 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:42.768520 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.768747 21834 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:42.769531 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:42.770579 21901 raft_consensus.cc:2410] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:42.770671 25448 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.771559 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:42.772492 21901 raft_consensus.cc:2393] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:42.772580 25645 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.773404 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:42.773258 25645 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.774118 21901 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:42.777372 22547 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:42.777887 25696 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.779218 21908 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:42.779532 25733 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:42.780751 21908 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:42.781949 21908 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:42.774516 25797 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:06:42.765332 25715 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:42.786270 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:42.782805 25189 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.784426 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:42.800817 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:42.806310 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:42.806530 22549 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:42.806957 21983 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:42.810242 25718 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.810551 21834 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:06:42.810966 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.812212 25593 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.816020 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:39266
I20260709 13:06:42.818329 25314 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:42.818830 25314 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:42.819909 25314 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:42.821312 25778 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.505s	user 0.003s	sys 0.001s
I20260709 13:06:42.821507 25314 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.825604 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:42.826375 25458 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.827438 25448 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:42.827163 25458 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:42.827692 25803 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:06:42.827998 25448 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:42.828518 25701 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:42.828962 25701 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:42.829505 25458 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.829164 25448 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:42.831039 25788 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.514s	user 0.003s	sys 0.000s
I20260709 13:06:42.833036 21833 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:42.833369 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:42.834275 25458 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:42.826310 21827 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:42.834638 21833 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:42.830029 25701 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.835098 21906 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.835693 25701 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:42.836998 25458 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:42.834439 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:42.839334 21832 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:42.840585 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:42.842283 21901 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:42.845453 25458 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.848095 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2038) took 1390 ms. Trace:
I20260709 13:06:42.848433 21828 rpcz_store.cc:276] 0709 13:06:41.457405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.171020 (+713615us) service_pool.cc:224] Handling call
0709 13:06:42.413364 (+242344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.414442 (+  1078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.847933 (+433491us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54000311d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:42.848046 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547560832}
I20260709 13:06:42.850068 25541 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:42.854398 25690 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:42.855140 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2039) took 1397 ms. Trace:
I20260709 13:06:42.855940 25690 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:42.856413 25690 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:42.857066 25781 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.547s	user 0.003s	sys 0.000s
I20260709 13:06:42.854526 25665 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:42.855170 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:42.874396 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:42.810813 25718 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.844347 25593 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:42.880102 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:42.855566 21826 rpcz_store.cc:276] 0709 13:06:41.457560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.422895 (+965335us) service_pool.cc:224] Handling call
0709 13:06:42.423433 (+   538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.424091 (+   658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.424122 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.424811 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.674960 (+250149us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:42.675002 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.675118 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.854798 (+179680us) raft_consensus.cc:1685] finished
0709 13:06:42.854828 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.854952 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1571,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":28210,"thread_start_us":249693,"threads_started":1,"wal-append.queue_time_us":425664}
I20260709 13:06:42.890590 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:42.857637 25690 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:42.893965 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:42.896068 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:42.899434 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.850726 25541 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:42.930403 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2024) took 2187 ms. Trace:
I20260709 13:06:42.930984 21829 rpcz_store.cc:276] 0709 13:06:40.742662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.865219 (+1122557us) service_pool.cc:224] Handling call
0709 13:06:42.166240 (+301021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.229579 (+ 63339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.229623 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.230204 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.361052 (+130848us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:42.361194 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.830178 (+468984us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:42.895841 (+ 65663us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b540017fcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:42.895900 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.895952 (+    52us) raft_consensus.cc:1685] finished
0709 13:06:42.895965 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.929998 (+ 34033us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540017fcd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:42.930161 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1432,"raft.queue_time_us":30059,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":1063270784,"thread_start_us":130104,"threads_started":1,"wal-append.queue_time_us":86124}
I20260709 13:06:42.937456 21983 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:42.937858 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1963) took 1022 ms. Trace:
W20260709 13:06:42.941816 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.943056 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:42.943400 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:42.951279 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.988997 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 261918us
I20260709 13:06:42.993602 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:42.945281 21977 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.938340 21831 rpcz_store.cc:276] 0709 13:06:41.915719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.692905 (+777186us) service_pool.cc:224] Handling call
0709 13:06:42.693321 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.693779 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:42.702596 (+  8817us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.937490 (+234894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.937545 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.937595 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.937663 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.937799 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47633,"prepare.queue_time_us":8231,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":175390,"threads_started":1}
I20260709 13:06:43.008622 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2040) took 1480 ms. Trace:
I20260709 13:06:43.009250 25644 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:43.009884 21831 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:06:43.010371 21831 pending_rounds.cc:85] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 5
I20260709 13:06:43.010653 21831 pending_rounds.cc:107] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:06:43.010970 21831 raft_consensus.cc:2889] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:43.009892 25644 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:43.008494 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.011394 21831 pending_rounds.cc:107] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:06:43.014784 21831 raft_consensus.cc:2889] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:43.015568 21834 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:43.016783 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1974) took 1080 ms. Trace:
I20260709 13:06:43.017130 21834 rpcz_store.cc:276] 0709 13:06:41.936607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.811488 (+874881us) service_pool.cc:224] Handling call
0709 13:06:42.811889 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.015995 (+204106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.016552 (+   557us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540017e3d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:43.016719 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428129152}
I20260709 13:06:43.017819 25188 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:43.018357 25188 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:43.017814 21831 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:06:43.021090 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 128056us
I20260709 13:06:43.012877 25644 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.035358 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:43.032775 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 91990.5us
I20260709 13:06:43.042693 25599 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.043058 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1976) took 1105 ms. Trace:
I20260709 13:06:43.043200 25599 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.043424 21833 rpcz_store.cc:276] 0709 13:06:41.937198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.835668 (+898470us) service_pool.cc:224] Handling call
0709 13:06:42.835973 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.836207 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:42.837530 (+  1323us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.042746 (+205216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.042796 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:43.042837 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.042898 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.043012 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42431,"prepare.queue_time_us":224,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":42587,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":162222,"threads_started":1}
I20260709 13:06:43.045276 25599 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.048586 21834 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:43.049578 25645 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:43.049611 25696 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.050813 25696 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.052541 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:43.053206 21983 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.053428 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52668 (request call id 11) took 2506 ms. Trace:
I20260709 13:06:43.056476 21833 rpcz_store.cc:276] 0709 13:06:40.544629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.046335 (+2501706us) service_pool.cc:224] Handling call
0709 13:06:43.050673 (+  4338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:43.061909 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:43.065522 25541 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:43.080196 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.082623 21983 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:43.087580 21906 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:43.090925 21908 raft_consensus.cc:606] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:43.091332 21908 raft_consensus.cc:614] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:43.091923 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 60216.2us
I20260709 13:06:43.098284 25763 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:43.030865 25665 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:06:43.103211 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:43.103906 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.103986 21909 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
W20260709 13:06:43.105245 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.105158 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:43.106874 21903 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:06:43.107823 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 212600us
I20260709 13:06:43.110306 25714 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.110471 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:43.110944 25714 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.111533 21833 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:43.005489 25715 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:43.112902 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:43.113344 25714 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:43.009104 21830 rpcz_store.cc:276] 0709 13:06:41.457700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.554523 (+1096823us) service_pool.cc:224] Handling call
0709 13:06:42.554956 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.555266 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:42.555589 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.925988 (+370399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.926040 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:42.938317 (+ 12277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.938405 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.938551 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26283,"prepare.queue_time_us":2005,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":52358,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":60450,"thread_start_us":317855,"threads_started":1}
I20260709 13:06:43.118778 21832 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
W20260709 13:06:43.123612 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 54157.2us
I20260709 13:06:43.111586 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:43.116839 21826 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:43.074425 25690 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.129549 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:43.131013 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.129582 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:43.094961 25632 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.143966 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.154393 21833 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: [12.10-13.11]
I20260709 13:06:43.153985 25733 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:43.144609 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:43.182556 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:43.188725 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:43.190186 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:43.190927 25645 raft_consensus.cc:2764] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:43.188725 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:43.192514 21902 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:43.193454 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:43.197116 25718 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:43.201279 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.154035 25787 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:43.202045 25787 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.179188 25790 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.203405 25790 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.208424 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:43.029860 25188 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.150486 25632 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:43.320479 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.136003 25760 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:43.318104 21906 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:43.271296 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:43.443166 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 294728us
W20260709 13:06:43.248739 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 93410.3us
I20260709 13:06:43.332276 21874 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:43.297971 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 58929.9us
I20260709 13:06:43.217221 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:43.466553 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 337012us
W20260709 13:06:43.474241 21829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.003s	sys 0.007s
W20260709 13:06:43.476557 21829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.003s	sys 0.007s
I20260709 13:06:43.478034 21977 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:43.248101 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:43.480219 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:43.337989 25701 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 13:06:43.421772 25714 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:43.461227 25790 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:43.484941 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.217684 25761 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:43.488770 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.218261 25733 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:43.445326 25797 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.489120 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.435693 25663 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.489238 21909 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:43.494011 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.217285 25792 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:43.451620 25767 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:43.506462 25767 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:43.472424 25189 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:43.472569 25760 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:43.429234 25639 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:43.495786 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:43.249548 25458 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.240s
I20260709 13:06:43.208891 25645 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.155735 25448 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.331s
I20260709 13:06:43.494869 25696 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.503799 25663 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:43.505065 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 257218us
I20260709 13:06:43.512169 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:43.490455 25468 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:43.490965 25761 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.519109 21826 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:43.531261 21830 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.519596 25718 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:43.532976 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:43.538756 25718 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:43.539314 25718 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:43.540627 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 32a7f60c55ae4cc99c25348a1d82e6de: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:43.540427 25718 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:43.522396 25767 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.523247 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:43.523983 21832 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:43.502578 25714 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:43.527886 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 403660us
W20260709 13:06:43.506069 25812 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.289s	user 0.000s	sys 0.009s
I20260709 13:06:43.523288 25760 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:43.503269 25792 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:43.532964 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:43.532066 25468 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.492138 25665 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.540839 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:43.541364 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.568315 25468 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:43.568740 25815 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
W20260709 13:06:43.520787 25813 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 13:06:43.546551 25663 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.552346 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:43.555466 25817 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:06:43.557782 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.558348 25639 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:43.560125 25821 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:43.561093 25696 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:43.528929 25188 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.570052 21798 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:43.569998 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:43.530025 25733 raft_consensus.cc:2764] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:06:43.571587 21830 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
W20260709 13:06:43.573982 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.575156 22547 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:43.576074 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:43.517707 25797 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:43.563117 25761 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.569425 25448 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:43.584709 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.587594 25714 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.588984 21977 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:43.589342 25808 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.151s	user 0.000s	sys 0.002s
W20260709 13:06:43.595453 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.577600 25639 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:43.595502 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.600813 25733 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.583451 25599 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:43.571159 25645 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.583869 25663 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:43.606648 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 75307us
W20260709 13:06:43.598474 25314 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.001s
I20260709 13:06:43.608306 21798 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:43.600893 25797 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.599759 25639 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.601001 25696 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.577369 25665 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.616041 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.591471 25448 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:43.616971 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.625753 21977 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:43.619868 21980 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:06:43.621007 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.606027 25718 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.628821 21978 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:43.629086 25716 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.630479 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.631826 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.633230 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.634770 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:43.634860 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:43.638587 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:43.607568 25189 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.640298 25189 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.641940 25189 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:43.642311 21976 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:43.628839 25701 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:43.643180 25701 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:43.643647 25701 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:43.645334 21977 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:43.646090 25790 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.646939 21976 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:43.646780 25790 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:43.649437 25790 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:43.656533 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:43.620488 25733 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:43.661413 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:43.661463 21974 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:43.604368 25715 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:06:43.665555 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.668059 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:43.629729 25716 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:43.672118 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.672857 21978 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
W20260709 13:06:43.670081 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44501.5us
I20260709 13:06:43.668325 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 443) took 1514 ms. Trace:
W20260709 13:06:43.675349 25822 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:06:43.676622 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.677335 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 442) took 1523 ms. Trace:
I20260709 13:06:43.677713 21828 rpcz_store.cc:276] 0709 13:06:42.153995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.849382 (+695387us) service_pool.cc:224] Handling call
0709 13:06:42.849818 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:42.869870 (+ 20052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.869919 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:42.924569 (+ 54650us) log.cc:844] Serialized 52 byte log entry
0709 13:06:43.342308 (+417739us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:43.475654 (+133346us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.475816 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.475861 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.588215 (+112354us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b1800466d20. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:06:43.677036 (+ 88821us) raft_consensus.cc:1685] finished
0709 13:06:43.677128 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.677281 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":133141,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1451,"raft.queue_time_us":18333,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":215,"spinlock_wait_cycles":11555584,"thread_start_us":260645,"threads_started":1,"wal-append.queue_time_us":620631}
I20260709 13:06:43.679214 25665 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:43.681614 25696 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.685684 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:43.686797 25787 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.687268 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:43.687508 25787 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.688758 25790 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:43.689169 25790 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.689570 25790 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.690593 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:43.691329 22555 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:43.693657 25716 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:43.671868 25733 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:43.696130 25733 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.698051 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.698560 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.710090 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.710762 21974 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:43.711097 21980 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:43.713615 22547 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:43.715652 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.716467 21980 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:43.721304 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:43.723817 21979 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:43.726119 21975 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:43.717988 21829 rpcz_store.cc:276] 0709 13:06:42.154286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.933238 (+778952us) service_pool.cc:224] Handling call
0709 13:06:42.933654 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.933909 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:42.936272 (+  2363us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.559452 (+623180us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:06:43.667837 (+108385us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.668023 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.668067 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:43.668113 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.668184 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.668278 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4112,"prepare.queue_time_us":19023,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":7257,"raft.queue_time_us":3097,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":9166,"spinlock_wait_cycles":42748672,"thread_start_us":730522,"threads_started":2,"wal-append.queue_time_us":569541}
I20260709 13:06:43.729367 21983 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:06:43.748761 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.775882 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.726526 25696 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:43.779788 25541 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.805016 21982 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
W20260709 13:06:43.785738 25830 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:06:43.786273 22547 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:43.763656 25663 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:43.810853 25663 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.812752 25632 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.813292 25663 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.834141 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:43.803755 25696 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.834827 21834 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:43.834794 22547 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
W20260709 13:06:43.835570 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.000s	sys 0.008s
W20260709 13:06:43.841109 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.000s	sys 0.009s
W20260709 13:06:43.839090 21901 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.003s	sys 0.006s
I20260709 13:06:43.720459 25792 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:43.842437 21901 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.003s	sys 0.006s
I20260709 13:06:43.801920 25468 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.859496 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:43.842202 25696 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:43.815025 25541 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.866261 25792 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.866358 25663 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:06:43.823782 25448 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.867751 21834 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:06:43.867606 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 334732us
W20260709 13:06:43.867633 25806 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.847s	user 0.004s	sys 0.005s
I20260709 13:06:43.866365 25639 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:43.870707 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.861143 21829 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:43.815287 25701 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:43.875543 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 267296us
I20260709 13:06:43.881134 22521 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:43.884327 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.887825 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:43.887989 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 758606us
I20260709 13:06:43.916491 25541 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.916998 25834 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:43.917552 25834 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.917953 25834 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:43.917687 25541 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.961215 21978 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:06:43.961429 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 82685.2us
I20260709 13:06:43.871793 25790 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:43.964480 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:43.968730 21982 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:43.882532 25632 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:43.965823 25644 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:43.975632 25644 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:43.975096 25541 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.976486 25644 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:43.977759 25644 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:43.978546 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 90115.4us
I20260709 13:06:43.978824 25835 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:43.979146 25838 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:43.978097 25541 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:43.979756 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50153.6us
I20260709 13:06:43.966321 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:43.955439 25645 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:43.993961 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:43.974079 25632 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:44.019734 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.989331 25665 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:44.023761 25665 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.026911 25665 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.982795 25828 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:06:44.031572 25828 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:44.032102 25828 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:44.032598 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:44.032969 25828 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.036165 25701 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:43.989780 25599 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:43.993903 25541 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.020785 25632 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:43.993744 25840 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.042259 25645 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
W20260709 13:06:44.046636 25839 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:06:44.053349 25701 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:44.058523 25840 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.059867 25701 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:44.060271 25701 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:44.061354 25840 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.048175 25790 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:44.022405 25833 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:44.062515 25790 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:44.020284 25448 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.063180 25790 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:44.064306 25820 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.587s	user 0.006s	sys 0.000s
I20260709 13:06:44.065855 25790 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.061553 25701 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.067984 25701 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:44.068801 25825 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.562s	user 0.008s	sys 0.002s
I20260709 13:06:44.046795 25842 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.070977 25842 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.073206 25842 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.075762 25639 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:44.076936 25555 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:44.077112 25639 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:44.077907 25189 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:44.083981 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 235404us
W20260709 13:06:44.084435 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 161137us
W20260709 13:06:44.088464 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.090085 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.077991 25555 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:44.093997 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52472.8us
W20260709 13:06:44.094702 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.090842 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 247870us
I20260709 13:06:44.046329 25468 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:44.150501 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 60718.4us
I20260709 13:06:44.152163 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:44.152972 22547 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:44.155733 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:44.094432 25555 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:44.088459 25541 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.140713 25838 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:44.168776 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:44.156034 25663 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.153167 25759 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.173666 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 207451us
I20260709 13:06:44.142215 25188 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:06:44.161161 25468 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.188467 21981 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:44.156594 25696 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.171332 25838 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:44.202252 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 222640us
W20260709 13:06:44.206480 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.206396 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:44.217857 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 185378us
W20260709 13:06:44.205626 25819 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.783s	user 0.007s	sys 0.006s
I20260709 13:06:44.204264 25838 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:44.201900 25663 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:06:44.200454 25468 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.185886 25599 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:44.233320 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.242722 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.243146 25696 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:44.243342 21983 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:44.246508 25855 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:44.246965 25855 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:44.247318 25855 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.249712 25541 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.250574 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.251380 21978 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:44.251215 25644 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:44.252065 25644 consensus_queue.cc:1243] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:44.203830 25690 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:44.252842 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:44.207967 25188 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:44.257112 22547 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:44.258852 22555 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:44.283043 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:44.253916 25787 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.004s
I20260709 13:06:44.222651 25834 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.214748 25759 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:44.293035 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.306975 25866 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:06:44.321249 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 92990.1us
I20260709 13:06:44.322494 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:44.323663 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:44.325973 25857 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:44.326469 25857 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.326787 25857 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:44.328141 25854 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:44.328562 25854 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:44.329345 25854 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:44.330272 25844 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.187s	user 0.001s	sys 0.001s
W20260709 13:06:44.330727 25847 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:06:44.330547 25864 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:44.232088 25851 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:06:44.288121 25833 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:06:44.217823 25555 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:44.325500 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 98848.2us
I20260709 13:06:44.370743 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2015) took 1278 ms. Trace:
W20260709 13:06:44.406256 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 183219us
I20260709 13:06:44.260601 25852 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:44.373662 22555 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
W20260709 13:06:44.369678 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47260.3us
W20260709 13:06:44.482532 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 159807us
W20260709 13:06:44.482831 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 195921us
W20260709 13:06:44.348394 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.510905 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:44.543085 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:06:44.514241 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.543296 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:44.454212 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 253193us
W20260709 13:06:44.472891 25761 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.860s	user 0.009s	sys 0.000s
I20260709 13:06:44.479472 21901 rpcz_store.cc:276] 0709 13:06:43.091928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.100362 (+  8434us) service_pool.cc:224] Handling call
0709 13:06:43.135037 (+ 34675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.845440 (+710403us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:43.845484 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.874157 (+ 28673us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.087454 (+213297us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:44.087487 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.087550 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.370500 (+282950us) raft_consensus.cc:1685] finished
0709 13:06:44.370520 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.370660 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25971,"raft.queue_time_us":201871,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":12407,"thread_start_us":769148,"threads_started":2,"wal-append.queue_time_us":335073}
I20260709 13:06:44.461243 25314 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:44.542138 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:44.436985 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.545017 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:44.545277 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:44.466250 25716 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:44.304250 25787 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.331542 25696 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.583022 25834 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:44.362898 25866 consensus_queue.cc:1243] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:44.304584 25827 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.265s
I20260709 13:06:44.460678 25663 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:44.478998 25468 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:44.479606 25760 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.590333 21831 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:44.358125 25864 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:44.375856 25759 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:44.594113 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48915.1us
W20260709 13:06:44.565562 25448 consensus_meta.cc:287] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 13:06:44.362718 25854 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.542533 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:44.588027 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:44.319952 25715 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.262s
I20260709 13:06:44.513743 25769 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:44.545277 25733 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.369163 25867 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:44.369783 25859 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:44.321485 25644 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.277s
I20260709 13:06:44.550024 25868 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:44.644375 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.514856 25189 consensus_queue.cc:1175] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0157b4f0725d4f92a53938c921db9efc" responder_term: 7 status { last_received { term: 7 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 7 index: 6 } }
W20260709 13:06:44.613811 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.589331 25842 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.656231 25846 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:44.656335 25842 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.641129 25448 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:06:44.470796 25857 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.658687 25842 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:44.659960 25857 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.660837 25857 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:44.661545 25857 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:44.664368 25867 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:44.666265 25541 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:44.666771 25541 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.667196 25541 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:44.668653 25850 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.437s	user 0.000s	sys 0.002s
I20260709 13:06:44.670578 25468 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:44.671258 25468 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.671780 25458 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:44.672231 25458 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:44.673065 25842 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.673554 25842 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.672250 25840 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.675112 25840 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.675735 25842 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.676261 25842 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.676741 25842 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.677279 25840 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.680678 25838 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.567655 25865 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:06:44.591816 25716 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:44.365268 25665 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:44.605552 25792 consensus_meta.cc:287] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.003s
W20260709 13:06:44.639523 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 100395us
W20260709 13:06:44.639838 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 52404.9us
I20260709 13:06:44.604197 25866 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:44.652607 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.568045 25667 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:06:44.567363 25861 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:06:44.567042 25837 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:06:44.606832 25864 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:44.368429 25632 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.675135 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:44.604282 25663 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:44.607926 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:44.687355 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 142415us
I20260709 13:06:44.687606 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:44.661903 25857 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.557061 25860 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:06:44.589489 25761 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.673851 25468 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:44.766566 25468 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:44.767076 25468 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.768941 25632 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:44.769292 25468 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.598910 25696 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.771358 25696 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.639941 25859 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.771963 25859 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:44.665504 25867 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.774569 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.597563 25314 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.639772 25769 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:06:44.695400 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.696167 21732 catalog_manager.cc:5697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.696645 25855 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.780812 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.783463 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.783953 21974 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:44.642594 25733 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.761700 25541 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.787039 25733 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.787866 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.788499 21976 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:44.697898 25866 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:44.789461 25866 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.698778 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:44.653295 25868 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:44.724144 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.689157 25865 consensus_queue.cc:1243] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:44.729704 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:44.731796 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 156939us
I20260709 13:06:44.813009 21975 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:44.738790 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:44.739432 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 231068us
I20260709 13:06:44.814733 21874 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:44.740072 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:44.815704 21982 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:44.727408 25787 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.816075 25663 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.817447 25663 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:44.817198 25787 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.818344 25870 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:44.818651 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 210812us
W20260709 13:06:44.741367 21731 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 126) took 11465 ms (client timeout 15000 ms). Trace:
I20260709 13:06:44.818943 25870 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.821424 25854 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.755039 25864 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.756805 25842 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:44.757460 25716 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.763422 25665 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:44.823997 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.824119 25874 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:06:44.824273 25665 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:44.824702 25665 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:44.825114 25665 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.825408 25715 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:44.764358 25838 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.732764 25840 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:44.778324 25857 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.826651 25840 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.784740 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:44.805876 25314 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:44.807379 25876 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:44.789937 25866 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:44.829679 25876 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:44.819410 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:44.808169 21732 catalog_manager.cc:5697] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:44.809157 25868 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:44.829272 22548 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:44.832141 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:44.832930 22547 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:06:44.835018 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 136317us
I20260709 13:06:44.830544 25861 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.845186 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.848910 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:44.849524 21834 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.732664 25862 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:06:44.857456 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.858255 21981 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
W20260709 13:06:44.859185 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.850888 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.831936 25855 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:44.852671 21980 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:44.853282 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.864526 21979 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:44.859885 21975 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:44.859930 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.836594 25864 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:44.867748 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.837661 25852 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:44.874091 21909 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:44.816604 25458 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.872116 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.878120 21976 raft_consensus.cc:2410] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:44.872478 21832 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:44.872769 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:44.878404 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:44.879168 21829 raft_consensus.cc:2410] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:44.874118 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:44.879314 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:44.880592 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:44.881296 21830 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:44.876155 21908 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:44.882059 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:44.876545 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:44.883471 21825 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:44.873484 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:44.876861 21903 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:44.836763 25448 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:06:44.885030 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:44.885087 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:44.885800 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:44.837051 25865 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:06:44.899859 21833 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:44.900105 21831 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:06:44.900478 21831 pending_rounds.cc:85] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 8
I20260709 13:06:44.900753 21831 pending_rounds.cc:107] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:06:44.900983 21831 raft_consensus.cc:2889] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:44.888111 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:44.869959 25769 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.890647 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:44.894248 25792 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.894726 25599 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:44.895776 25870 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:44.895539 21732 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.870662 25842 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:44.884531 25846 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:44.864439 25851 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.902112 21900 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:06:44.949385 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 202967us
I20260709 13:06:44.902801 21982 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:44.897459 25859 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:44.954341 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 47092.8us
I20260709 13:06:44.907080 25852 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.908234 21902 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:44.884895 25876 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.868392 25733 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.914639 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:44.916137 25882 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:44.916486 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:44.916594 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45016.6us
W20260709 13:06:44.819630 21731 rpcz_store.cc:269] 0709 13:06:33.224499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.224790 (+   291us) service_pool.cc:224] Handling call
0709 13:06:44.689888 (+11465098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:40.493199 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:40.532508 (+ 39309us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:40.532546 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:06:40.532563 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:40.535936 (+  3373us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:40.535990 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:40.536014 (+    24us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:06:40.537438 (+  1424us) tablet.cc:701] Row locks acquired
0709 13:06:40.537458 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:06:40.537594 (+   136us) write_op.cc:270] Start()
0709 13:06:40.537703 (+   109us) write_op.cc:276] Timestamp: P: 1783602400537552 usec, L: 0
0709 13:06:40.537720 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:06:40.589393 (+ 51673us) log.cc:844] Serialized 4809 byte log entry
0709 13:06:41.303982 (+714589us) op_driver.cc:464] REPLICATION: finished
0709 13:06:41.419778 (+115796us) write_op.cc:301] APPLY: starting
0709 13:06:41.419859 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:41.420521 (+   662us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:41.420666 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:41.421932 (+  1266us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:41.434786 (+ 12854us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:06:41.439920 (+  5134us) write_op.cc:312] APPLY: finished
0709 13:06:41.452929 (+ 13009us) log.cc:844] Serialized 89 byte log entry
0709 13:06:41.464014 (+ 11085us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:41.600892 (+136878us) write_op.cc:454] Released schema lock
0709 13:06:41.606844 (+  5952us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:41.628522 (+ 21678us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:41.642119 (+ 13597us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1819731,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":115544,"apply.run_cpu_time_us":4071,"apply.run_wall_time_us":192802,"num_ops":12,"prepare.queue_time_us":523359,"prepare.run_cpu_time_us":57852,"prepare.run_wall_time_us":453987,"raft.queue_time_us":160229,"raft.run_cpu_time_us":10835,"raft.run_wall_time_us":38835,"replication_time_us":766079,"thread_start_us":844751,"threads_started":4,"wal-append.queue_time_us":441455,"wal-append.run_cpu_time_us":110791,"wal-append.run_wall_time_us":1686475}]]}
I20260709 13:06:44.899714 21828 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:44.921440 25875 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.922658 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:44.873216 25555 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:44.923134 21978 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:45.069380 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.923192 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.922248 25863 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.857969 25861 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.926477 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:44.927246 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:44.845216 25838 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:44.903398 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.094427 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:44.877719 25690 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.073395 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.947523 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:44.951874 21976 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:44.955097 25188 raft_consensus.cc:2764] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:45.058775 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.106755 21902 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.059010 25541 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:45.023878 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.064129 25828 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.057013 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.061015 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:44.949317 25870 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.118364 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49713.8us
I20260709 13:06:45.119077 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:45.118968 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.120302 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.121480 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.115906 25696 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:45.122064 21905 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:45.122911 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:45.116916 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48679.6us
I20260709 13:06:45.067781 25882 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:44.972179 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.065227 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:45.062592 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 109128us
I20260709 13:06:45.125923 21982 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:06:45.055970 21948 connection.cc:256] RPC call timeout handler was delayed by -1.061996888000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2405s for a response
I20260709 13:06:44.937409 25857 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:44.956132 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:44.943140 25760 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:45.096922 21909 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:44.928113 21904 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:45.107884 21908 raft_consensus.cc:2410] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:06:45.107395 21906 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:06:45.052704 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.134773 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:45.074290 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:45.082108 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.945879 25854 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.109068 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:44.948922 25599 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:44.960516 21980 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:06:45.116380 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.142793 21980 pending_rounds.cc:85] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 8
I20260709 13:06:45.143229 21980 pending_rounds.cc:107] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:06:45.143668 21980 raft_consensus.cc:2889] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:44.946735 25792 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:45.154335 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.955829 25846 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:45.126354 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.157004 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.054009 21732 catalog_manager.cc:5697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.128086 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.132891 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:45.137071 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 62900.8us
I20260709 13:06:45.157529 21832 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:45.107105 25468 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.135141 21900 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:45.140381 21976 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:06:45.159435 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.160013 21900 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:45.129244 25882 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.065961 25639 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:06:45.067591 25767 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:06:44.957398 25842 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.070256 25733 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.160537 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:45.164563 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 143404us
I20260709 13:06:45.140775 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.123757 25870 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:44.956290 25851 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.109772 25690 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.138500 25838 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:45.165450 21909 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:45.161988 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:45.125043 25828 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.169690 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.182078 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.182731 21905 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:44.955835 25833 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.153s
I20260709 13:06:45.162748 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.184399 21906 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 5.
I20260709 13:06:45.173195 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.109949 25863 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.178057 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.167582 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:45.074244 25875 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.179533 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:45.180922 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:45.193243 21833 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:45.152781 25854 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.156424 25189 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:45.185571 21901 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:45.144316 25760 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.185917 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:45.187343 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 65953.2us
I20260709 13:06:45.193730 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:45.170720 21732 catalog_manager.cc:5697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 7 to 9, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 9 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:45.197660 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 132497us
I20260709 13:06:45.204659 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.213925 21798 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:45.219681 21978 raft_consensus.cc:2410] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:45.219726 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.186677 25714 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:45.228564 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.229351 21907 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:45.167886 25468 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:45.231541 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 52063.9us
I20260709 13:06:45.222738 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:45.224342 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.234334 21903 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.235275 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.238286 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.239039 21907 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:45.241411 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:45.244282 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.245428 21909 raft_consensus.cc:2410] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:06:45.213351 25862 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:45.200392 25833 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:45.206010 25189 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.219641 25838 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.248157 21732 catalog_manager.cc:5697] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 4 to 9, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 9 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:45.219467 25701 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:45.258771 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.272204 21905 raft_consensus.cc:2410] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:45.227490 25714 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.279209 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.274626 25189 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.272061 25696 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:45.288143 21834 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:45.294476 25879 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:06:45.296505 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.250125 25862 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.297914 22521 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:45.281723 25714 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.313992 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:45.334012 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 120172us
I20260709 13:06:45.334329 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.279830 25639 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:45.337644 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:45.335568 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.300041 25859 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:45.347889 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 136872us
I20260709 13:06:45.348129 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.296445 25696 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.314977 25862 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.304744 25701 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:45.357335 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.352222 21905 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:45.319458 25827 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:45.355651 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 228949us
I20260709 13:06:45.351055 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:45.337754 25891 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:45.276018 25833 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.361925 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.372515 21901 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.238812 25846 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.243404 25599 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.355993 25696 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:45.377995 25859 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:45.359596 25895 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.385627 25859 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.386142 25859 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:45.387338 25886 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:06:45.383792 25894 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:45.390676 25894 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.391076 25894 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.385854 25895 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:45.401608 25665 consensus_meta.cc:287] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.000s
W20260709 13:06:45.402420 25887 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:06:45.403231 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.403873 21829 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:45.394011 21902 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:45.369688 25891 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.406471 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:45.364223 25827 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:45.408973 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.411913 21732 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 4 to 6, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129), now has a pending config: VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129), VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130), VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131), NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 6 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
W20260709 13:06:45.381286 25885 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:06:45.571612 25891 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.402006 25895 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:45.568308 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.402042 25665 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.572515 25827 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.572268 21732 catalog_manager.cc:5697] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 7 to 8, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 8 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:45.573608 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 167243us
I20260709 13:06:45.554185 25897 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:06:45.551684 25875 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:45.473261 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:45.574402 25842 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:45.510579 25701 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.513492 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:45.510927 25760 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:45.442546 21903 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:45.581918 21833 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:45.585255 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.382718 25851 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:45.586194 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.555950 25663 consensus_meta.cc:287] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.002s
I20260709 13:06:45.600301 21834 raft_consensus.cc:1217] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9]   Dedup: 8.9->[]
I20260709 13:06:45.601488 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.384047 25870 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:45.602283 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 129130us
I20260709 13:06:45.636453 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:45.637538 21904 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:45.597128 21732 catalog_manager.cc:5697] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 7 to 9, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 9 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:45.570742 25854 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:45.570938 25828 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:45.579861 25690 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:45.586091 25890 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:45.607762 25900 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:45.580869 25861 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:45.627867 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.473635 25857 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:45.629042 21829 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:45.658023 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:45.658234 21979 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:06:45.633347 21834 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:06:45.658783 21981 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:45.633742 21902 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:45.609182 25875 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.643608 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:45.644568 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:45.617075 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 103635us
I20260709 13:06:45.627677 25842 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:45.665654 25864 consensus_meta.cc:287] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.001s
I20260709 13:06:45.654850 25870 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.666360 25870 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.668260 25870 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:45.669168 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 16eb6999a3524d59835c31e2b76d09da: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:45.671262 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:45.661022 25900 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:45.674072 25900 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.582458 25863 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:45.658447 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:45.674592 25868 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.832s	user 0.005s	sys 0.006s
I20260709 13:06:45.698782 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:45.644608 21732 catalog_manager.cc:5697] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 6 to 8, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 8 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:06:45.664168 21799 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.822s (SENT)
I20260709 13:06:45.700862 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:45.682783 22548 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:06:45.688627 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.649120 25890 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.698264 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:45.704974 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.707144 21900 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.001s
I20260709 13:06:45.709717 21981 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:06:45.710752 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46627.4us
I20260709 13:06:45.710148 21732 catalog_manager.cc:5697] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 4 to 5, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 5 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.708670 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:45.708832 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.716219 21902 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:45.713090 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:45.710129 21900 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:45.720718 21732 catalog_manager.cc:5697] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 5 to 6, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 6 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.723848 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:45.724426 22555 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.725872 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:45.727125 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:45.727651 21981 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
W20260709 13:06:45.728257 25913 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:45.731004 21732 catalog_manager.cc:5697] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 5 to 10, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 10 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.703197 25857 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:45.737028 25857 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.737274 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:45.738711 21976 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:06:45.738656 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 75748.8us
W20260709 13:06:45.739439 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.741125 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:45.743419 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:45.743950 21979 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.744999 21732 catalog_manager.cc:5697] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 5 to 8, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 8 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:45.749315 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.750286 21900 raft_consensus.cc:2410] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:06:45.709786 25895 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:45.752801 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 81617.4us
I20260709 13:06:45.759974 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:45.757447 22555 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
W20260709 13:06:45.757699 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 163455us
I20260709 13:06:45.759011 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.764010 21902 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:45.764371 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:45.764555 25665 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:45.764950 22548 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.766971 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.767773 21825 raft_consensus.cc:2410] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:45.768486 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:45.769114 21825 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:45.769750 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.715337 25890 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.772641 22554 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:06:45.773391 22549 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:06:45.776295 21901 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:45.774113 22548 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:45.764889 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.777920 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.777930 21902 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:45.774200 21825 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:45.781329 21982 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:45.782876 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.783576 21829 raft_consensus.cc:2368] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:45.744483 25896 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.785219 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.788622 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:45.787068 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 231158us
I20260709 13:06:45.790150 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:45.698205 25875 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:45.790627 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.760840 25842 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:45.773228 25555 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.001s
I20260709 13:06:45.794672 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:45.786500 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.795423 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.804942 21902 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:45.762975 25906 raft_consensus.cc:2764] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:45.797147 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:45.797286 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 84278.6us
I20260709 13:06:45.797292 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:45.776000 25882 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 13:06:45.710234 25868 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.836465 21979 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:45.836913 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:45.748894 25854 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:06:45.754274 25448 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:06:45.844251 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.845127 21979 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:06:45.845297 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:45.838124 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:45.838500 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.846736 21829 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.796629 25867 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:45.850468 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.852600 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:45.855976 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.856475 21901 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:45.803614 25767 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:06:45.861538 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.863778 21902 raft_consensus.cc:2368] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:45.775759 25714 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.803723 25842 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:45.865366 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:45.866359 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.868322 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.841342 25834 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:45.837814 25919 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:45.873943 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.879042 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:45.882133 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.862469 25897 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.883008 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:45.868935 25914 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:06:45.843400 25882 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.797325 25896 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.870987 25854 consensus_queue.cc:1243] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:45.898976 25555 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.931757 25555 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.899183 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:45.934643 25833 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:45.935590 25914 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:45.935993 25914 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:45.937296 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 72020.3us
I20260709 13:06:45.899567 25897 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.884342 25852 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.884601 25925 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.899900 25875 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:45.886346 22553 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:06:45.901325 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:45.949091 21825 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:45.851742 25760 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:06:45.805009 25918 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:06:45.904937 25896 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:45.906607 25866 consensus_meta.cc:287] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.077s	user 0.011s	sys 0.001s
I20260709 13:06:45.861474 25861 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:06:45.872640 25787 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:45.907874 25714 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:45.909157 25189 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.002s
I20260709 13:06:45.851445 25876 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:06:45.879467 25919 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:45.957703 25923 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:06:45.958021 25919 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.962339 25861 consensus_queue.cc:1243] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:06:45.962497 25910 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.110s	user 0.000s	sys 0.003s
I20260709 13:06:45.963999 25866 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.964596 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.966209 25866 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:45.966415 25733 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:45.967123 21983 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:45.914654 25857 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:45.971848 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:45.972090 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:45.972492 21974 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:45.973192 25859 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.004s
I20260709 13:06:45.973382 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:45.973577 25859 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.974545 25876 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:45.974920 25876 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:45.953397 25870 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.913506 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:45.976248 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 62823.2us
I20260709 13:06:45.915205 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.871345 25842 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.873356 25889 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:45.877888 25867 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:45.967654 25909 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.118s	user 0.003s	sys 0.001s
I20260709 13:06:45.923121 25895 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:45.875838 25701 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.981081 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.981032 25701 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.981775 21908 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:45.928728 21829 raft_consensus.cc:2410] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:45.982440 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:45.982700 25884 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.983125 25701 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:45.983616 25701 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.938056 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:45.933912 25555 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:45.936357 25914 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.957729 25189 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.984282 25867 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.984198 25701 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:45.986048 25189 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:45.979039 25889 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:45.986946 25889 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.989959 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 465) took 1118 ms. Trace:
I20260709 13:06:45.966006 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:45.970718 25716 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:45.990480 21982 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:06:45.991459 21907 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:06:45.991817 21907 pending_rounds.cc:85] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 10
I20260709 13:06:45.992082 21907 pending_rounds.cc:107] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:06:45.978991 25876 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.992306 21907 raft_consensus.cc:2889] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.992929 25876 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.993716 21907 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:06:45.974100 21975 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:45.993733 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:45.953866 25908 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:45.994796 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:45.994807 25918 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:45.968629 25925 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:45.995436 21975 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:45.979171 25448 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:45.995805 25925 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.996268 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:45.996402 25448 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.996838 25448 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.996961 21975 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:45.997726 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:45.951519 25868 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:45.998077 25925 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:45.998502 21982 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:45.999564 21982 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:45.968432 25852 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:45.983145 25884 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.001981 21977 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:46.002909 25701 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:46.003160 25852 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:45.990356 21832 rpcz_store.cc:276] 0709 13:06:44.871309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.159394 (+288085us) service_pool.cc:224] Handling call
0709 13:06:45.159742 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:45.315586 (+155844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.315630 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:45.344678 (+ 29048us) log.cc:844] Serialized 52 byte log entry
0709 13:06:45.606416 (+261738us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:45.641699 (+ 35283us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.641923 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.642015 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.989754 (+347739us) raft_consensus.cc:1685] finished
0709 13:06:45.989773 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.989890 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39669,"prepare.queue_time_us":35123,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":126455,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":14378,"thread_start_us":341246,"threads_started":2,"wal-append.queue_time_us":387440}
I20260709 13:06:46.005023 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.005728 21832 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:45.977703 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2040) took 1189 ms. Trace:
W20260709 13:06:45.921790 25696 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.528s	user 0.004s	sys 0.003s
I20260709 13:06:46.003180 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 473) took 1079 ms. Trace:
I20260709 13:06:46.006637 25696 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.007021 21977 rpcz_store.cc:276] 0709 13:06:44.924242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.924396 (+   154us) service_pool.cc:224] Handling call
0709 13:06:44.924679 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.002383 (+1077704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.002992 (+   609us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540001f4d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:46.003127 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476885760}
I20260709 13:06:46.008486 21900 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:46.006428 21983 rpcz_store.cc:276] 0709 13:06:44.779337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.784531 (+  5194us) service_pool.cc:224] Handling call
0709 13:06:45.968410 (+1183879us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400164c54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:45.968540 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617494912}
I20260709 13:06:46.009920 21875 leader_election.cc:400] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:46.010268 21875 leader_election.cc:403] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.954052 25863 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:06:46.010902 25852 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:06:46.011000 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:46.012233 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2040) took 1011 ms. Trace:
I20260709 13:06:46.012450 21907 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:46.012601 21908 rpcz_store.cc:276] 0709 13:06:45.000813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.155568 (+154755us) service_pool.cc:224] Handling call
0709 13:06:45.980938 (+825370us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800003098. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:06:46.012176 (+ 31238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2466560}
I20260709 13:06:46.013693 21907 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:06:46.013896 25894 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.000s
I20260709 13:06:46.014319 25894 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:46.014819 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 76833.5us
I20260709 13:06:46.010794 25890 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.016319 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:46.016819 22551 raft_consensus.cc:2368] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12.
I20260709 13:06:46.017149 25895 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.019366 25851 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:46.019739 25851 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:46.020246 25862 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.001s
I20260709 13:06:46.020659 25862 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.020505 25851 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.021623 25851 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.022830 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:46.024322 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:45.915158 21980 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
W20260709 13:06:46.026727 25917 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.123s	user 0.001s	sys 0.002s
I20260709 13:06:46.027158 25925 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:46.029317 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 78707.1us
I20260709 13:06:46.029186 21907 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:46.034754 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:46.027566 25928 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
W20260709 13:06:46.028923 25921 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.003s
I20260709 13:06:46.034773 21907 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.056798 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:46.060490 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.032740 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.025439 25895 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.069828 21907 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.984052 21974 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:46.075949 21981 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:46.063030 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.081298 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:46.081453 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 198487us
I20260709 13:06:46.038784 25925 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.003201 25884 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:46.039429 25863 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.086293 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.038786 25857 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:46.090895 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.055825 25859 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.074543 25716 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:46.099263 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:46.099609 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 246250us
I20260709 13:06:46.007231 25914 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.057412 25866 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:06:46.104575 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.096119 25925 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.099823 25895 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.103490 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:46.095470 25868 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:46.111585 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2077) took 1201 ms. Trace:
I20260709 13:06:46.098927 25761 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.115069 21826 rpcz_store.cc:276] 0709 13:06:44.909971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.404562 (+494591us) service_pool.cc:224] Handling call
0709 13:06:45.404877 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.568560 (+163683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.568598 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.571433 (+  2835us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.738967 (+167534us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:45.739003 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.739065 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.111339 (+372274us) raft_consensus.cc:1685] finished
0709 13:06:46.111366 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.111518 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81380,"raft.queue_time_us":70605,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7878,"thread_start_us":130543,"threads_started":1,"wal-append.queue_time_us":263622}
I20260709 13:06:46.111267 21982 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:46.117848 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.120316 25893 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:46.126442 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.127589 21983 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:46.128358 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 67965.6us
I20260709 13:06:46.102906 25716 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:46.107302 25859 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:46.133361 21948 leader_election.cc:400] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:46.133652 21948 leader_election.cc:403] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.134816 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.109587 25767 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:06:46.135793 25767 consensus_queue.cc:1243] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:46.136485 25890 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.136967 25767 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.122153 25448 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.140126 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:46.141285 21798 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:46.141948 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.105167 25833 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:06:46.148485 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.149392 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:46.108371 25828 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:06:46.151294 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:46.151861 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.132763 25716 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:46.139168 25891 consensus_meta.cc:287] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.005s
I20260709 13:06:46.112943 25834 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:06:46.171509 25834 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:46.171904 25834 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:46.158217 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.159463 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:46.154621 25863 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 9. Current term is 10.
I20260709 13:06:46.160115 25846 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:46.160543 25895 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.163887 25930 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:06:46.165904 25914 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.136503 25769 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.132833 25859 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:46.149155 25900 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.169734 21908 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:46.201555 21908 pending_rounds.cc:85] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 6
I20260709 13:06:46.201926 21908 pending_rounds.cc:107] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:46.202253 21908 raft_consensus.cc:2889] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:46.148278 25761 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:46.170763 25862 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:46.148138 25864 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:46.175731 21983 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.181934 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:46.184798 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 51515.2us
I20260709 13:06:46.208782 21900 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:46.199515 25922 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.161s	user 0.008s	sys 0.016s
I20260709 13:06:46.201942 25859 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.236912 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:46.241590 22520 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.205417 25761 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.206372 25840 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.211982 25895 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:46.211448 25864 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.255456 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 477) took 1329 ms. Trace:
I20260709 13:06:46.255905 21978 rpcz_store.cc:276] 0709 13:06:44.925553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.111608 (+186055us) service_pool.cc:224] Handling call
0709 13:06:46.252315 (+1140707us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b54002d4454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:46.255385 (+  3070us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139915136}
I20260709 13:06:46.256408 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.257160 21900 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.177371 25891 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.263795 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.263929 25929 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:46.271703 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2032) took 1273 ms. Trace:
I20260709 13:06:46.295778 21904 rpcz_store.cc:276] 0709 13:06:44.998231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.141116 (+142885us) service_pool.cc:224] Handling call
0709 13:06:46.271523 (+1130407us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54002f5dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:46.271631 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1086716672}
I20260709 13:06:46.272188 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.296898 21982 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.275430 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.298120 21975 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:46.278278 25895 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:46.244232 25897 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.281018 25889 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.282743 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.284811 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.284956 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.259672 25448 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.285905 25853 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:46.254148 25900 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:46.249096 25842 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.322659 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:46.287881 21978 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.264505 25833 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.264650 25898 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:06:46.334610 25882 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.335515 25767 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.336575 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 648) took 1272 ms. Trace:
I20260709 13:06:46.336982 22547 rpcz_store.cc:276] 0709 13:06:45.063943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.069760 (+  5817us) service_pool.cc:224] Handling call
0709 13:06:45.106404 (+ 36644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.240681 (+134277us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:45.570089 (+329408us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.707913 (+137824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.707988 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:45.708057 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.336330 (+628273us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54002508d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:46.336378 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.336498 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39998,"prepare.queue_time_us":137899,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":50020,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":14677,"spinlock_wait_cycles":308149120,"thread_start_us":309595,"threads_started":2,"wal-append.queue_time_us":212383}
W20260709 13:06:46.289341 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 129923us
W20260709 13:06:46.339605 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 204846us
I20260709 13:06:46.340833 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.286708 25792 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:46.354612 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:46.304322 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 128694us
I20260709 13:06:46.250535 25862 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.318140 21983 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:46.260326 25864 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.324780 21830 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:46.308915 25929 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:46.203193 25834 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.321532 25701 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.339833 22553 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:46.251310 25761 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.343413 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:46.379382 22549 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:46.383150 21900 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:46.384542 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:46.309307 25880 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:06:46.381927 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:46.402878 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.354727 25882 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:46.439976 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:46.417683 25767 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:46.388548 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.417079 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:46.418608 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.444330 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:46.372579 25929 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.447259 21907 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:06:46.448055 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.336552 25716 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.451967 21907 pending_rounds.cc:85] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 10
I20260709 13:06:46.453727 21907 pending_rounds.cc:107] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:06:46.450030 21982 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:06:46.342844 25900 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.451875 21900 raft_consensus.cc:2368] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12.
I20260709 13:06:46.451882 22554 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:46.342785 25833 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.454016 21907 raft_consensus.cc:2889] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:46.454946 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 470) took 1133 ms. Trace:
I20260709 13:06:46.455166 21831 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:46.456393 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:46.451963 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:46.362126 25925 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.441298 25895 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.443367 25880 consensus_queue.cc:1243] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:06:46.602015 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.497014 25767 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:06:46.609352 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.496663 25948 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:46.521668 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 469) took 1308 ms. Trace:
W20260709 13:06:46.514012 25934 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:06:46.513906 25931 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:06:46.493801 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.637212 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:46.546943 25919 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.001s
I20260709 13:06:46.509626 25840 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:46.487434 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:46.645807 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.502055 25665 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:06:46.519431 25716 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:46.610970 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.528755 25889 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.520109 25891 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.611999 25948 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:46.497845 25882 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:46.607457 21948 leader_election.cc:400] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12.
I20260709 13:06:46.503547 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.429430 25834 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:46.530015 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.529387 21827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 2069) took 1663 ms (client timeout 1822 ms). Trace:
I20260709 13:06:46.458997 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:46.644853 25632 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:06:46.668236 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1978) took 1024 ms. Trace:
I20260709 13:06:46.668877 25882 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:46.668637 21981 rpcz_store.cc:276] 0709 13:06:45.644041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.728603 (+ 84562us) service_pool.cc:224] Handling call
0709 13:06:45.728889 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.076503 (+347614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.667998 (+591495us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54003a43d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:46.668184 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797430144}
I20260709 13:06:46.664194 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.668643 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.640733 25944 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.590553 21826 rpcz_store.cc:276] 0709 13:06:45.321464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.116390 (+794926us) service_pool.cc:224] Handling call
0709 13:06:46.116602 (+   212us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:46.132971 (+ 16369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.133007 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:46.157714 (+ 24707us) log.cc:844] Serialized 52 byte log entry
0709 13:06:46.309771 (+152057us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:46.446261 (+136490us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.454642 (+  8381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.454716 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.454754 (+    38us) raft_consensus.cc:1685] finished
0709 13:06:46.454766 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.454896 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8088,"raft.queue_time_us":23514,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":32802,"thread_start_us":224631,"threads_started":2,"wal-append.queue_time_us":133944}
W20260709 13:06:46.616325 25949 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:06:46.637941 21904 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
W20260709 13:06:46.674901 21827 rpcz_store.cc:269] 0709 13:06:44.865725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.870297 (+  4572us) service_pool.cc:224] Handling call
0709 13:06:46.529171 (+1658874us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540017e8d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:46.529303 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3503211264}
I20260709 13:06:46.695390 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.695634 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.695986 21904 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:46.514242 25940 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:06:46.514252 25842 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.612112 21825 rpcz_store.cc:276] 0709 13:06:45.213279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.101284 (+888005us) service_pool.cc:224] Handling call
0709 13:06:46.101624 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.109682 (+  8058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.109703 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.115061 (+  5358us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.226342 (+111281us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:46.226391 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.226480 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.521460 (+294980us) raft_consensus.cc:1685] finished
0709 13:06:46.521483 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.521612 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4164,"raft.queue_time_us":6946,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":17371,"thread_start_us":77842,"threads_started":1,"wal-append.queue_time_us":294133}
I20260709 13:06:46.677386 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.701081 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.701220 21832 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:46.701642 21825 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:46.702160 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:46.677738 21903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2027) took 1802 ms (client timeout 1993 ms). Trace:
I20260709 13:06:46.678194 21909 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:46.644451 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.597822 25541 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.453975 25846 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:46.596165 25893 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:46.649703 22549 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:46.632223 25947 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.514135 25945 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.528537 25894 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:46.619886 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.671087 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 223140us
W20260709 13:06:46.671377 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.674228 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66920.1us
I20260709 13:06:46.612677 25767 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.658334 25948 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.741153 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.670991 25900 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:46.670002 25882 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.747620 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.747741 25859 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.695713 25701 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:46.676714 25665 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.675333 21949 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:46.676883 25458 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:46.702505 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:46.704845 21907 raft_consensus.cc:2376] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12. Re-sending same reply.
I20260709 13:06:46.685647 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2082) took 1735 ms. Trace:
I20260709 13:06:46.505816 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 467) took 1293 ms. Trace:
I20260709 13:06:46.706414 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:46.683019 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.685249 22547 raft_consensus.cc:2410] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:46.706732 21978 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
W20260709 13:06:46.679534 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.701260 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.685318 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.714989 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.697778 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:46.704705 21832 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:46.737246 21799 leader_election.cc:400] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12.
I20260709 13:06:46.739583 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.740478 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.744246 21976 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:46.683897 25468 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:46.705363 25944 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.810448 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:46.747112 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.748214 21981 raft_consensus.cc:2376] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11. Re-sending same reply.
W20260709 13:06:46.703490 21903 rpcz_store.cc:269] 0709 13:06:44.875071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.885620 (+ 10549us) service_pool.cc:224] Handling call
0709 13:06:46.677565 (+1791945us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002f67d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:46.677680 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389896448}
I20260709 13:06:46.825194 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.684650 25696 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:46.755178 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.809034 21900 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:46.826761 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.809273 21799 leader_election.cc:403] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.809391 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.809723 21825 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.679447 25639 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:46.752441 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.828591 21977 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:46.705709 25930 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.812978 21982 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:46.751933 21979 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:46.832412 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.812060 21974 raft_consensus.cc:2368] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13.
I20260709 13:06:46.810367 21826 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:46.833953 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.810788 21902 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:46.811077 21834 rpcz_store.cc:276] 0709 13:06:45.212261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.675870 (+463609us) service_pool.cc:224] Handling call
0709 13:06:45.676130 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.676313 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:45.721397 (+ 45084us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.505276 (+783879us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b180042bda0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a
0709 13:06:46.505461 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.505513 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:46.505566 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.505638 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.505758 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44839,"prepare.queue_time_us":53638,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":21663,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":13328128,"thread_start_us":35353,"threads_started":1,"wal-append.queue_time_us":148810}
I20260709 13:06:46.835577 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:46.817391 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 142123us
I20260709 13:06:46.746497 25833 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.828670 22548 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:46.686254 25929 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.829413 21980 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:46.829800 21976 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:46.727706 25893 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.831050 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.808781 21833 rpcz_store.cc:276] 0709 13:06:44.950396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.636759 (+686363us) service_pool.cc:224] Handling call
0709 13:06:45.652061 (+ 15302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.711234 (+ 59173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.711283 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.711871 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.056515 (+344644us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.056556 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.056634 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.685433 (+628799us) raft_consensus.cc:1685] finished
0709 13:06:46.685457 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.685588 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22129,"raft.queue_time_us":20695,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":30377,"thread_start_us":281125,"threads_started":1,"wal-append.queue_time_us":341459}
I20260709 13:06:46.842908 21907 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:46.844054 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.846292 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2046) took 1740 ms. Trace:
I20260709 13:06:46.850558 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.833015 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.851563 21981 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:46.647696 25919 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.852319 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.846680 21909 rpcz_store.cc:276] 0709 13:06:45.106406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.280758 (+174352us) service_pool.cc:224] Handling call
0709 13:06:46.677817 (+1397059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.704453 (+ 26636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.846058 (+141605us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54002f67d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:46.846228 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3212216192}
I20260709 13:06:46.750118 25859 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:46.856390 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.865597 21900 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:46.857431 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:46.856686 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 119570us
I20260709 13:06:46.866080 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.866408 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:46.866796 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:46.867219 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.714295 25541 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.868700 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:46.867805 21908 raft_consensus.cc:2376] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8. Re-sending same reply.
I20260709 13:06:46.859630 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.831909 25448 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.862512 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:46.863929 21978 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:46.842514 25690 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:46.874898 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:46.816206 25760 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.864560 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.743935 25945 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.841228 25769 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:46.870263 21830 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:46.828299 25639 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:46.872845 21980 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:46.888357 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.889469 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.890806 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.855294 21902 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:06:46.866596 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:46.862219 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:46.754834 25853 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:06:46.851927 25876 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.873576 25959 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:46.910179 25959 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:46.911042 25959 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.912163 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:46.912596 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:46.913697 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:46.877626 25632 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.916832 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.879029 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.853318 25863 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.871119 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.882436 22555 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:46.883559 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:46.920629 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.920763 21909 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:46.832159 25827 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:06:46.823655 25665 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.904881 21834 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.743798 25947 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.878098 25944 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:46.908733 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:46.827493 25701 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.921350 21982 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:46.887530 25908 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:46.917923 25889 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:46.904399 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.750744 25846 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.878789 25842 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:46.878777 25866 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.932809 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.984057 21907 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.932921 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:46.884554 25900 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:46.984872 21974 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:46.906001 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:46.985558 21980 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.886473 25769 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.988710 25769 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.888355 25760 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:46.971657 25761 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:06:46.955622 25897 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:46.869553 25864 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.924832 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:46.956595 21975 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:46.956156 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:47.021580 21832 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:47.022030 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65949.8us
W20260709 13:06:47.022306 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 153707us
I20260709 13:06:46.917201 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.962356 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 466) took 2084 ms. Trace:
I20260709 13:06:47.023721 21828 rpcz_store.cc:276] 0709 13:06:44.878132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.203569 (+325437us) service_pool.cc:224] Handling call
0709 13:06:45.226054 (+ 22485us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:06:45.275722 (+ 49668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.275793 (+    71us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:06:45.303952 (+ 28159us) log.cc:844] Serialized 104 byte log entry
0709 13:06:46.597002 (+1293050us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b180049a080. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:06:46.639267 (+ 42265us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:46.929395 (+290128us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b180049a080. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf
0709 13:06:46.929548 (+   153us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.955570 (+ 26022us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.962038 (+  6468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.962105 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.962141 (+    36us) raft_consensus.cc:1685] finished
0709 13:06:46.962152 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.962295 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18584,"prepare.queue_time_us":238500,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":127074,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":23356,"spinlock_wait_cycles":22239872,"thread_start_us":299971,"threads_started":3,"wal-append.queue_time_us":1329245}
I20260709 13:06:46.972174 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:46.975817 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 107180us
I20260709 13:06:46.976608 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:46.979766 21829 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:46.885181 25448 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:46.969692 25889 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:46.923054 25859 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:47.038823 21904 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:47.040215 21904 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:47.041687 21904 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:06:47.042853 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:47.044029 21830 raft_consensus.cc:2410] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:06:46.953052 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44368.3us
I20260709 13:06:46.962121 25908 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.969487 25733 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.976164 25879 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:46.983460 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:46.925449 25876 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:46.933439 25632 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:47.033310 22550 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:47.047067 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:47.038681 22553 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:47.055909 21901 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:47.002997 25925 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:47.002769 25900 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:47.057368 21903 raft_consensus.cc:2410] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:06:47.009985 25897 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:46.991139 25842 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:47.060055 21980 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:47.061913 21828 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.062160 21827 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:47.079440 21902 pending_rounds.cc:85] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 9
I20260709 13:06:47.079741 21902 pending_rounds.cc:107] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:06:47.031524 25914 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:47.038564 25889 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:47.053305 25908 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.079973 21902 raft_consensus.cc:2889] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.054761 25879 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.018952 25761 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:47.059259 21834 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
W20260709 13:06:47.097434 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 235289us
I20260709 13:06:47.003153 25639 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:47.095412 21907 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:47.081892 25897 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.103922 22555 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:47.074869 25973 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:47.083575 25914 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.102487 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:47.112291 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:47.097388 25879 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:47.114800 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:47.070886 25976 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:06:47.116871 21831 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:47.120636 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:47.111263 25914 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:47.123433 25968 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:06:47.121593 25925 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.120827 25894 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:47.121702 25541 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:47.123155 25975 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:47.125566 25859 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:06:47.125288 25665 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:47.150601 25966 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:06:47.233789 21826 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:47.237681 25690 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:47.238026 25970 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:06:47.238209 25690 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:47.239657 25971 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:06:47.240826 25665 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:47.214659 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 188021us
I20260709 13:06:47.217592 21825 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:47.244823 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:47.244935 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:47.246121 21826 raft_consensus.cc:2410] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:06:47.254226 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 2057) took 1043 ms. Trace:
W20260709 13:06:47.254740 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.255396 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.256500 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:47.257477 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 2056) took 1046 ms. Trace:
I20260709 13:06:47.257750 21903 rpcz_store.cc:276] 0709 13:06:46.210905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.826311 (+615406us) service_pool.cc:224] Handling call
0709 13:06:47.257310 (+430999us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540020b2d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:47.257391 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455397760}
W20260709 13:06:47.258769 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.235401 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 263313us
I20260709 13:06:47.261477 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:47.264632 21832 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:47.265189 21834 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:06:47.265792 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2000) took 1410 ms. Trace:
I20260709 13:06:47.266031 21834 rpcz_store.cc:276] 0709 13:06:45.855581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.264688 (+1409107us) service_pool.cc:224] Handling call
0709 13:06:47.264993 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.265590 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.265756 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.267297 21834 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:06:47.254619 21901 rpcz_store.cc:276] 0709 13:06:46.211210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.282513 (+ 71303us) service_pool.cc:224] Handling call
0709 13:06:47.254042 (+971529us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54002e7cd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:47.254156 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708348672}
I20260709 13:06:47.274612 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2002) took 1365 ms. Trace:
I20260709 13:06:47.276212 21825 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.275840 21834 rpcz_store.cc:276] 0709 13:06:45.909645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.266744 (+1357099us) service_pool.cc:224] Handling call
0709 13:06:47.267055 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:47.267685 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.274559 (+  6874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.277908 21826 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:06:47.278662 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1997) took 1502 ms. Trace:
I20260709 13:06:47.279042 21826 rpcz_store.cc:276] 0709 13:06:45.776551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.277313 (+1500762us) service_pool.cc:224] Handling call
0709 13:06:47.277666 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.278387 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.278605 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.276854 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1989) took 1575 ms. Trace:
I20260709 13:06:47.173062 25599 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:47.148942 25919 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:47.280238 21825 rpcz_store.cc:276] 0709 13:06:45.701745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.275494 (+1573749us) service_pool.cc:224] Handling call
0709 13:06:47.276004 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.276649 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.276808 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.283980 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:47.289906 21825 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:06:47.289822 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:47.290829 21834 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.295588 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:47.296353 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:47.290820 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2003) took 1380 ms. Trace:
I20260709 13:06:47.297705 21979 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:47.297456 21825 rpcz_store.cc:276] 0709 13:06:45.909952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.289401 (+1379449us) service_pool.cc:224] Handling call
0709 13:06:47.289700 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.290538 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.290771 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.301496 21833 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:06:47.300316 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:47.178649 25945 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:47.306671 25938 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:06:47.305953 21825 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:06:47.307323 25840 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:47.307833 21829 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:47.300316 21834 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:47.270682 25665 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:47.308626 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1995) took 1589 ms. Trace:
I20260709 13:06:47.308979 25665 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.309532 25665 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.310827 21975 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:47.309034 21829 rpcz_store.cc:276] 0709 13:06:45.719243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.283404 (+1564161us) service_pool.cc:224] Handling call
0709 13:06:47.307635 (+ 24231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.308376 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.308570 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.313519 25690 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:47.314920 21829 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:47.320188 25840 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:47.269913 25894 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:47.315022 21831 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:47.286229 25969 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 13:06:47.338711 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2008) took 1427 ms. Trace:
I20260709 13:06:47.308909 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2004) took 1398 ms. Trace:
I20260709 13:06:47.323228 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1999) took 1475 ms. Trace:
I20260709 13:06:47.310112 21830 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:47.336211 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2006) took 1425 ms. Trace:
I20260709 13:06:47.340858 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1990) took 1638 ms. Trace:
I20260709 13:06:47.340693 21829 rpcz_store.cc:276] 0709 13:06:45.910858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.314265 (+1403407us) service_pool.cc:224] Handling call
0709 13:06:47.314577 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.335962 (+ 21385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.336158 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.340072 21831 rpcz_store.cc:276] 0709 13:06:45.911375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.314450 (+1403075us) service_pool.cc:224] Handling call
0709 13:06:47.314797 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.338505 (+ 23708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.338662 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.145953 25900 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:47.340193 21833 rpcz_store.cc:276] 0709 13:06:45.847465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.258993 (+1411528us) service_pool.cc:224] Handling call
0709 13:06:47.301163 (+ 42170us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:47.322950 (+ 21787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.323177 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.280771 25959 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:47.334143 21828 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:47.285997 25701 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:47.240869 25862 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:06:47.250923 25468 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12.
I20260709 13:06:47.354525 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:47.341416 21830 rpcz_store.cc:276] 0709 13:06:45.701993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.280770 (+1578777us) service_pool.cc:224] Handling call
0709 13:06:47.309925 (+ 29155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.340533 (+ 30608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.340805 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.353909 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:47.355715 21829 raft_consensus.cc:2410] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:06:47.346393 25963 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:06:47.340078 21825 rpcz_store.cc:276] 0709 13:06:45.910311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.305372 (+1395061us) service_pool.cc:224] Handling call
0709 13:06:47.305678 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.308187 (+  2509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.308777 (+   590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.359078 21833 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:47.348091 25876 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:47.346181 25864 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:47.377640 25975 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:06:47.378997 25948 consensus_meta.cc:287] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
I20260709 13:06:47.380403 22553 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:47.345791 25665 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:47.382756 21825 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.349295 25959 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.387418 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2067) took 1167 ms. Trace:
I20260709 13:06:47.420188 21833 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:47.392185 21830 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:47.305887 25599 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:47.373396 25947 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:47.386950 25983 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:47.352319 25894 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:47.405761 21825 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.424561 25632 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:47.423658 25959 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.395339 25761 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:47.451053 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 337136us
I20260709 13:06:47.457434 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2065) took 1094 ms. Trace:
I20260709 13:06:47.402995 25948 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:47.469163 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1987) took 1768 ms. Trace:
I20260709 13:06:47.454103 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:47.428395 25983 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:47.457931 21983 rpcz_store.cc:276] 0709 13:06:46.363324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.363713 (+   389us) service_pool.cc:224] Handling call
0709 13:06:46.412194 (+ 48481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.429175 (+ 16981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.429220 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.443160 (+ 13940us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.736270 (+293110us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.736314 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.736493 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.457151 (+720658us) raft_consensus.cc:1685] finished
0709 13:06:47.457179 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.457361 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35839,"raft.queue_time_us":1435,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":25547,"thread_start_us":240780,"threads_started":1,"wal-append.queue_time_us":485472}
W20260709 13:06:47.455674 25972 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 13:06:47.493862 21976 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.009s
W20260709 13:06:47.495996 21976 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.007s	sys 0.009s
W20260709 13:06:47.493999 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 336333us
I20260709 13:06:47.519909 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:47.534713 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 273337us
I20260709 13:06:47.536688 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:06:47.516455 25918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.025s	sys 0.027s
I20260709 13:06:47.544333 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:47.544155 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:47.545265 22550 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
W20260709 13:06:47.545035 25918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.025s	sys 0.027s
W20260709 13:06:47.521865 25893 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.007s
W20260709 13:06:47.574306 25986 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:06:47.575989 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 445) took 1399 ms. Trace:
I20260709 13:06:47.578337 25991 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:47.578943 25991 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:47.579726 25864 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:47.521533 25985 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:47.576486 21900 rpcz_store.cc:276] 0709 13:06:46.176205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.925682 (+749477us) service_pool.cc:224] Handling call
0709 13:06:46.961884 (+ 36202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.962154 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.962195 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.976808 (+ 14613us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.260080 (+283272us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:47.260155 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.260258 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.575714 (+315456us) raft_consensus.cc:1685] finished
0709 13:06:47.575745 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.575914 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116315,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":13282,"thread_start_us":188600,"threads_started":1,"wal-append.queue_time_us":369971}
I20260709 13:06:47.546777 25948 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:47.609949 25990 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:06:47.612641 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 492213us
I20260709 13:06:47.613685 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:47.612097 25760 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:47.581058 25690 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:47.542476 25975 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 13:06:47.648069 21908 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.005s	sys 0.013s
W20260709 13:06:47.648679 21908 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.005s	sys 0.013s
I20260709 13:06:47.546958 25944 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:06:47.588521 25864 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:06:47.627427 25458 consensus_meta.cc:287] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.804s	user 0.009s	sys 0.005s
W20260709 13:06:47.625231 25769 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.007s
I20260709 13:06:47.665213 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:47.676728 21900 raft_consensus.cc:2368] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8.
I20260709 13:06:47.679131 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 473) took 1257 ms. Trace:
I20260709 13:06:47.682565 21906 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:47.585991 25893 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:47.680039 21834 rpcz_store.cc:276] 0709 13:06:46.421616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.324897 (+903281us) service_pool.cc:224] Handling call
0709 13:06:47.326341 (+  1444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.326580 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:47.330045 (+  3465us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.678649 (+348604us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.678744 (+    95us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:47.678809 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.678902 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.679061 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":347900,"threads_started":1}
I20260709 13:06:47.723384 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:47.724614 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:47.723384 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:47.725366 21900 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.581506 25983 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:47.697103 25880 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.682081 25945 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:47.727880 21833 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:47.863233 21900 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
W20260709 13:06:47.878027 22521 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.736s (SENT) [suppressed 25 similar messages]
W20260709 13:06:47.839237 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 115925us
I20260709 13:06:47.953554 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:47.954191 21900 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:47.954702 21799 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:47.955035 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:47.955586 21900 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.896914 26023 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.754196 25665 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:47.958544 26023 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:47.768009 25599 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:47.839636 25864 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:47.959782 25599 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:47.721422 25996 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:06:47.850045 21834 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:47.873591 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2091) took 1255 ms. Trace:
I20260709 13:06:47.966547 21900 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
W20260709 13:06:47.897383 25897 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.784s	user 0.008s	sys 0.000s
I20260709 13:06:48.002554 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:48.000741 21828 rpcz_store.cc:276] 0709 13:06:46.617788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.350528 (+732740us) service_pool.cc:224] Handling call
0709 13:06:47.364727 (+ 14199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.364995 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:47.391235 (+ 26240us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.872878 (+481643us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.872979 (+   101us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:47.873089 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.873371 (+   282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.873523 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64050,"prepare.queue_time_us":27917,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":1522,"raft.queue_time_us":85315,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":18441,"thread_start_us":416536,"threads_started":2,"wal-append.queue_time_us":507264}
I20260709 13:06:48.011406 21900 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:47.782965 25879 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.656s	user 0.004s	sys 0.007s
W20260709 13:06:47.895666 26011 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:06:47.898289 26005 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:06:48.020802 21900 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:47.897678 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2068) took 1677 ms. Trace:
I20260709 13:06:47.821892 25991 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:47.682551 25769 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:47.822540 25894 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:48.063104 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:47.962664 25880 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:47.846199 25840 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:47.972990 25994 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:06:48.136760 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:48.139907 22555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.015s
I20260709 13:06:48.140228 21825 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:48.137284 21907 rpcz_store.cc:276] 0709 13:06:46.220584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.105425 (+884841us) service_pool.cc:224] Handling call
0709 13:06:47.105838 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.108563 (+  2725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.108607 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.112809 (+  4202us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.521873 (+409064us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:47.536444 (+ 14571us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.536654 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.536729 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.897460 (+360731us) raft_consensus.cc:1685] finished
0709 13:06:47.897482 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.897619 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15721,"prepare.queue_time_us":14327,"prepare.run_cpu_time_us":5443,"prepare.run_wall_time_us":17868,"raft.queue_time_us":244896,"raft.run_cpu_time_us":2508,"raft.run_wall_time_us":40536,"spinlock_wait_cycles":21964032,"thread_start_us":374001,"threads_started":1,"wal-append.queue_time_us":725069}
W20260709 13:06:48.143148 22555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.006s	sys 0.015s
I20260709 13:06:47.864748 25760 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.972609 25908 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.000s
W20260709 13:06:48.064669 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 444391us
I20260709 13:06:48.147471 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:48.148851 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:48.149469 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 271469us
I20260709 13:06:48.058593 25983 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.143832 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:48.151306 21907 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:48.150295 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:48.142678 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 476) took 1097 ms. Trace:
I20260709 13:06:48.014029 26023 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:48.138159 25893 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:48.156102 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:48.156605 21907 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:48.157215 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2074) took 1909 ms. Trace:
I20260709 13:06:48.157516 21907 rpcz_store.cc:276] 0709 13:06:46.247962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.155194 (+1907232us) service_pool.cc:224] Handling call
0709 13:06:48.156446 (+  1252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.157018 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.157170 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.160470 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2071) took 1938 ms. Trace:
I20260709 13:06:48.160841 21903 rpcz_store.cc:276] 0709 13:06:46.221655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.280862 (+1059207us) service_pool.cc:224] Handling call
0709 13:06:47.281158 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.338564 (+ 57406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.338592 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.346746 (+  8154us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.520517 (+173771us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:47.520741 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.520843 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.160270 (+639427us) raft_consensus.cc:1685] finished
0709 13:06:48.160289 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.160411 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31562,"raft.queue_time_us":96796,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":8330,"thread_start_us":131363,"threads_started":1,"wal-append.queue_time_us":299858}
I20260709 13:06:48.150295 25760 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.166517 21826 raft_consensus.cc:2410] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:06:48.165772 26010 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:06:48.059315 25879 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.152088 21831 rpcz_store.cc:276] 0709 13:06:47.046041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.597501 (+551460us) service_pool.cc:224] Handling call
0709 13:06:47.639191 (+ 41690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.639440 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:47.654141 (+ 14701us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.142275 (+488134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.142357 (+    82us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:48.142422 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.142496 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.142621 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43323,"prepare.queue_time_us":155,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":8138,"raft.queue_time_us":1037,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4653,"thread_start_us":486538,"threads_started":1}
I20260709 13:06:48.170601 25879 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:48.178665 26022 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:06:48.143765 25998 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:48.014318 25897 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.200708 25448 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:47.420346 21904 rpcz_store.cc:276] 0709 13:06:46.220099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.046732 (+826633us) service_pool.cc:224] Handling call
0709 13:06:47.047018 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.047258 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:47.169135 (+121877us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.387020 (+217885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.387083 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:47.387145 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.387226 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.387354 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":271230,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":29,"raft.queue_time_us":33606,"thread_start_us":323828,"threads_started":2}
I20260709 13:06:48.152149 25908 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:48.213506 25973 consensus_meta.cc:287] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.092s	user 0.006s	sys 0.004s
W20260709 13:06:48.214385 25959 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.747s	user 0.006s	sys 0.005s
I20260709 13:06:48.238698 25959 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.241581 25959 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:48.215075 25914 consensus_meta.cc:287] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.043s	user 0.010s	sys 0.001s
I20260709 13:06:48.242619 25914 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.242972 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:48.243685 22555 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:48.244843 25914 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:48.246440 22547 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:48.221091 25639 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:48.251700 22555 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:48.223172 25759 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:48.201998 25998 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:48.230860 25889 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.134s	user 0.009s	sys 0.003s
W20260709 13:06:48.210588 25999 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:06:48.254642 21834 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:06:48.260911 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 71224.7us
I20260709 13:06:48.263273 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:48.260234 25973 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:48.288573 25908 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.293606 25759 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:48.265806 25914 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:48.342924 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:48.294473 25889 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.376241 25897 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:48.383154 25759 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.400933 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 1986) took 2716 ms. Trace:
I20260709 13:06:48.401471 21832 rpcz_store.cc:276] 0709 13:06:45.684532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.055566 (+1371034us) service_pool.cc:224] Handling call
0709 13:06:47.264473 (+208907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.264990 (+   517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.400633 (+1135643us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400287dd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:48.400834 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479657344}
I20260709 13:06:48.415139 21826 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.399190 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:48.480667 21830 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 8: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:48.264113 26013 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:48.556707 21901 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:06:48.303640 26032 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.223s
I20260709 13:06:48.351567 25914 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.553696 26024 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.553017 26013 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.709661 26013 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:48.710945 26024 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.738291 26013 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.741750 26013 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.745666 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:48.757114 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:48.750542 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:48.759701 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 444) took 2610 ms. Trace:
I20260709 13:06:48.781165 21902 rpcz_store.cc:276] 0709 13:06:46.148853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.922270 (+773417us) service_pool.cc:224] Handling call
0709 13:06:46.926068 (+  3798us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:47.287712 (+361644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.287749 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:47.296796 (+  9047us) log.cc:844] Serialized 52 byte log entry
0709 13:06:47.619021 (+322225us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:47.619076 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.250031 (+630955us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54002e6dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:48.250077 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.279892 (+ 29815us) raft_consensus.cc:1685] finished
0709 13:06:48.279924 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.759634 (+479710us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12119,"raft.queue_time_us":249837,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6318,"spinlock_wait_cycles":352233216,"thread_start_us":521017,"threads_started":2,"wal-append.queue_time_us":839085}
I20260709 13:06:48.794961 21826 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:48.812034 21902 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:48.785676 26013 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:48.785981 25599 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.794379 25827 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.012s
I20260709 13:06:48.815786 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2068) took 2205 ms. Trace:
I20260709 13:06:48.816227 21902 rpcz_store.cc:276] 0709 13:06:46.610058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.803501 (+2193443us) service_pool.cc:224] Handling call
0709 13:06:48.809887 (+  6386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.815519 (+  5632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.815726 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.795732 25914 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:48.813565 25983 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.002s
I20260709 13:06:48.819737 21902 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:06:48.820129 21902 pending_rounds.cc:85] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 5
I20260709 13:06:48.820371 21902 pending_rounds.cc:107] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:06:48.820647 21902 raft_consensus.cc:2889] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.821382 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2069) took 2211 ms. Trace:
I20260709 13:06:48.821722 21902 rpcz_store.cc:276] 0709 13:06:46.610390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.816991 (+2206601us) service_pool.cc:224] Handling call
0709 13:06:48.819355 (+  2364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.821136 (+  1781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.821327 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:48.822794 25827 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.010s	sys 0.013s
I20260709 13:06:48.822549 25889 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:48.786291 26024 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:48.813045 25639 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.564s	user 0.001s	sys 0.009s
I20260709 13:06:48.829625 21902 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.810133 25929 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:48.832290 21904 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:06:48.832697 21904 pending_rounds.cc:85] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 8
I20260709 13:06:48.832966 21904 pending_rounds.cc:107] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:06:48.833184 21904 raft_consensus.cc:2889] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.834306 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2078) took 2220 ms. Trace:
I20260709 13:06:48.835477 21902 rpcz_store.cc:276] 0709 13:06:46.613654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.823396 (+2209742us) service_pool.cc:224] Handling call
0709 13:06:48.829455 (+  6059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.832192 (+  2737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.834239 (+  2047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.824877 25599 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.841537 25716 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:48.842067 25716 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:48.843155 25716 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.844877 25981 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.848783 25981 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.849654 25716 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:48.870923 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 1.41678e+06us
I20260709 13:06:48.871760 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:48.871814 25866 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:48.874069 25866 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:48.874505 25981 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.905303 26002 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.905798 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2011) took 1882 ms. Trace:
I20260709 13:06:48.906517 21825 rpcz_store.cc:276] 0709 13:06:47.023489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.455441 (+431952us) service_pool.cc:224] Handling call
0709 13:06:47.456045 (+   604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.143273 (+687228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.905467 (+762194us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540011e754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:48.905716 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572977792}
I20260709 13:06:48.876809 25860 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:48.905953 26002 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.907694 25690 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.909039 26039 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:06:48.915318 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 43602.6us
I20260709 13:06:48.875033 25866 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.918936 25842 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:48.922286 25889 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:48.922618 25918 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:48.922890 25701 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.923247 25879 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.923840 25979 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.924000 25977 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.923324 25908 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.924149 25665 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.924306 25863 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:48.959069 21902 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:48.958890 25863 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.960338 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2079) took 2346 ms. Trace:
I20260709 13:06:48.960677 21902 rpcz_store.cc:276] 0709 13:06:46.613916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.836428 (+2222512us) service_pool.cc:224] Handling call
0709 13:06:48.958907 (+122479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.959479 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.960163 (+   684us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400077450. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:48.960285 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273829120}
I20260709 13:06:48.961339 25863 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:48.924728 25884 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:48.961580 25908 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.925007 26001 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:48.962531 26001 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.963604 25908 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.965068 26001 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.925364 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:48.966013 21981 raft_consensus.cc:2368] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8.
I20260709 13:06:48.966444 25701 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.967053 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:48.968362 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:48.968639 25701 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.969168 21981 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:48.969595 21976 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:48.926048 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:48.970619 21983 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:48.971415 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:48.972287 21983 raft_consensus.cc:2410] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:48.972537 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:48.973133 21976 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:48.929054 25599 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:48.929255 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:48.926245 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:48.974619 21977 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:48.927325 25998 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.930811 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:48.978402 21974 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:48.947079 25889 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.979616 21974 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:48.931464 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:48.980654 21982 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:48.939002 25981 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:48.939536 25769 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.941787 26002 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:48.947836 25979 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.947737 25879 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.938900 25690 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.954190 25977 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.948096 25918 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.992785 21978 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:48.992825 25977 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:48.993223 25918 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:48.993798 25979 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.958765 25665 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.994132 25879 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.995138 25882 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:48.995546 25882 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:48.981758 25889 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:48.995786 25665 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:48.973073 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:48.996520 21983 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:48.996371 25882 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:48.997341 25882 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:48.974095 21979 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:48.939595 26039 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:48.938078 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:06:48.999998 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 61984.7us
W20260709 13:06:48.924016 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 1.31035e+06us
I20260709 13:06:49.001211 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:48.962033 21902 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:49.001550 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:48.983603 21798 leader_election.cc:400] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8.
I20260709 13:06:48.948346 25866 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:49.003613 26039 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:49.004226 25879 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:49.004734 25879 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:49.005543 25879 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.006264 25665 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:47.470815 21827 rpcz_store.cc:276] 0709 13:06:45.701125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.079969 (+1378844us) service_pool.cc:224] Handling call
0709 13:06:47.097182 (+ 17213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.103247 (+  6065us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:47.126684 (+ 23437us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.466651 (+339967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.466717 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:47.467759 (+  1042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.467843 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.469095 (+  1252us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37632,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":117,"thread_start_us":296448,"threads_started":1}
I20260709 13:06:49.007009 25665 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:48.970018 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:49.008733 25977 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:48.958187 21901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2082) took 1690 ms (client timeout 1764 ms). Trace:
W20260709 13:06:49.010309 21901 rpcz_store.cc:269] 0709 13:06:47.267731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.283663 (+ 15932us) service_pool.cc:224] Handling call
0709 13:06:48.957980 (+1674317us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400077454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:48.958111 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270876928}
I20260709 13:06:49.011261 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2080) took 2397 ms. Trace:
I20260709 13:06:49.011634 21901 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:49.011797 21902 rpcz_store.cc:276] 0709 13:06:46.614154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.961581 (+2347427us) service_pool.cc:224] Handling call
0709 13:06:48.961875 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.010946 (+ 49071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.011190 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:49.012483 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2082) took 2153 ms. Trace:
I20260709 13:06:49.012974 21901 rpcz_store.cc:276] 0709 13:06:46.859034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.011134 (+2152100us) service_pool.cc:224] Handling call
0709 13:06:49.011422 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.012224 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.012422 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:48.989380 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:49.002364 21798 leader_election.cc:403] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:06:49.014624 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 1.29123e+06us
I20260709 13:06:48.981550 25981 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:49.002658 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.019965 21901 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:06:49.020301 21901 pending_rounds.cc:85] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 8
I20260709 13:06:49.020505 21901 pending_rounds.cc:107] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:06:49.020731 21901 raft_consensus.cc:2889] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.016896 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:49.016111 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.022466 21827 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:49.022792 21983 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:49.018654 25979 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:06:49.024443 25889 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:49.026640 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.026944 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 544) took 1922 ms. Trace:
W20260709 13:06:49.027760 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.027997 26008 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:06:49.028412 21906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2047) took 3919 ms (client timeout 2526 ms). Trace:
I20260709 13:06:49.029166 26014 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.029072 21906 rpcz_store.cc:269] 0709 13:06:45.109395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.185640 (+ 76245us) service_pool.cc:224] Handling call
0709 13:06:49.028131 (+3842491us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b54002e63d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:49.028279 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5684842880}
I20260709 13:06:49.029737 26014 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.031705 26014 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:49.032861 21905 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:49.033735 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 448) took 2856 ms. Trace:
I20260709 13:06:49.023510 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:49.028481 26008 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.027519 22547 rpcz_store.cc:276] 0709 13:06:47.104609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.104775 (+   166us) service_pool.cc:224] Handling call
0709 13:06:47.112638 (+  7863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.246872 (+1134234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.026653 (+779781us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400463f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:49.026869 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2607024384}
I20260709 13:06:49.040676 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.038820 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2085) took 1770 ms. Trace:
I20260709 13:06:49.041855 21901 rpcz_store.cc:276] 0709 13:06:47.268719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.013798 (+1745079us) service_pool.cc:224] Handling call
0709 13:06:49.014127 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.038500 (+ 24373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.038747 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:49.044996 21979 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:49.048801 21902 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:49.049677 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.050791 25761 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:49.051337 26006 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.155s	user 0.000s	sys 0.020s
I20260709 13:06:49.051385 25761 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.052104 25761 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:49.053007 25760 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:49.034075 21908 rpcz_store.cc:276] 0709 13:06:46.176913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.027123 (+850210us) service_pool.cc:224] Handling call
0709 13:06:47.027534 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.027758 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:47.649134 (+621376us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.033446 (+1384312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:49.033490 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:49.033544 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.033597 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.033689 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1156934,"prepare.queue_time_us":290514,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":847682,"threads_started":2,"wal-append.queue_time_us":410754}
I20260709 13:06:49.054675 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2084) took 1786 ms. Trace:
I20260709 13:06:49.055595 21902 rpcz_store.cc:276] 0709 13:06:47.268406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.013005 (+1744599us) service_pool.cc:224] Handling call
0709 13:06:49.046630 (+ 33625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.049331 (+  2701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.054594 (+  5263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:49.058406 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.019022 25541 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8.
I20260709 13:06:49.035835 25918 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.066532 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:49.023890 25981 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:49.062847 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.048892 25701 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.058099 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:49.048408 25716 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:49.040032 25876 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.065227 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:49.067157 22553 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:49.065630 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:49.070115 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.008092 25665 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.060897 25884 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:49.067684 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:49.074604 25919 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:49.060714 25948 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:06:49.070706 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:49.059971 25979 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:49.072887 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57626.7us
I20260709 13:06:49.061476 26002 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.063114 25863 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.056604 26001 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:06:49.078507 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:49.087414 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:49.088343 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:49.088975 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:49.069131 25985 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.120604 22549 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:49.120921 21799 leader_election.cc:400] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8.
I20260709 13:06:49.075193 25919 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:49.093564 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:49.085880 25632 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:06:49.086369 25884 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:49.089447 25541 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:49.068761 25870 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:49.110498 25448 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.110684 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.111099 25973 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:49.111225 25975 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.065181 25980 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:06:49.184077 25982 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:06:49.187182 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52668 (request call id 12) took 2282 ms. Trace:
I20260709 13:06:49.187640 21828 rpcz_store.cc:276] 0709 13:06:46.904285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.011582 (+1107297us) service_pool.cc:224] Handling call
0709 13:06:49.186796 (+1175214us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b540011e754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe4735 00007fb763fa4d29 00007fb75d5231d4 00007fb75d523162 00007fb75d523091 00007fb75d52300c 00007fb75d5222c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:49.186992 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183569152}
I20260709 13:06:49.111919 25983 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:49.113173 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:49.191314 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 481) took 1657 ms. Trace:
I20260709 13:06:49.191781 21833 rpcz_store.cc:276] 0709 13:06:47.534137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.953298 (+419161us) service_pool.cc:224] Handling call
0709 13:06:48.185322 (+232024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.185566 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:48.185849 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.478884 (+293035us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.502738 (+ 23854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.502813 (+    75us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:48.502879 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.502967 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.191115 (+688148us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400030050. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:49.191245 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":418,"prepare.queue_time_us":231,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":41059,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":21376,"spinlock_wait_cycles":470660992,"thread_start_us":218720,"threads_started":1,"wal-append.queue_time_us":638037}
I20260709 13:06:49.116955 21906 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:49.195072 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.195792 21906 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:49.196794 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.198648 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 482) took 1234 ms. Trace:
I20260709 13:06:49.198971 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 450) took 2786 ms. Trace:
I20260709 13:06:49.118376 25984 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:49.075340 26008 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.199605 21904 rpcz_store.cc:276] 0709 13:06:46.412272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.216835 (+1804563us) service_pool.cc:224] Handling call
0709 13:06:48.217240 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.833555 (+616315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.198680 (+365125us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54000fad54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:49.198904 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409805568}
I20260709 13:06:49.201236 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.204293 25690 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:49.118861 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:49.120241 25945 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:49.120126 22551 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:49.130642 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.133931 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.212214 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.213047 21901 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:49.137946 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57958.1us
I20260709 13:06:49.071609 25918 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.148347 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.071167 25862 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:06:49.073618 25716 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:49.160411 25884 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.137593 25948 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:49.152688 25448 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.163125 26001 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.142798 25541 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:49.139405 25859 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:06:49.181603 25973 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.182577 25975 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.142493 25897 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:49.121646 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:49.199101 21834 rpcz_store.cc:276] 0709 13:06:47.964708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.001768 (+ 37060us) service_pool.cc:224] Handling call
0709 13:06:49.198433 (+1196665us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540011f154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:49.198587 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268986752}
I20260709 13:06:49.226153 25864 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:49.197962 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.216281 21798 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:49.213862 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:49.217435 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 104348us
I20260709 13:06:49.210784 21902 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
W20260709 13:06:49.210587 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 58608.3us
I20260709 13:06:49.245738 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.247112 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.247938 21901 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:49.248703 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.088176 25876 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.119350 25976 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:06:49.219035 25945 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:49.141484 25701 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:06:49.202061 21904 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:49.240664 25897 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:49.243908 21908 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:49.229332 25977 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:49.249810 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.242694 25716 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.236975 25908 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:49.139223 25992 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:06:49.238543 25541 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.234881 26001 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:49.236200 25948 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:49.296399 25948 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.140463 25919 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:49.260607 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 44388.4us
I20260709 13:06:49.261616 25979 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:49.141848 25985 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.263154 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.263706 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.267571 25891 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:49.269371 25983 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:49.265584 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 146779us
I20260709 13:06:49.245678 25632 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:49.244341 25864 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.254400 25639 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:49.291157 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.330550 21906 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:49.293236 26001 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.264102 25897 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:49.301957 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 180337us
I20260709 13:06:49.297298 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:49.321807 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.265441 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.270287 25908 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:49.310395 25980 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.337075 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 91668.5us
I20260709 13:06:49.352174 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:49.352654 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:49.334628 21799 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:49.364912 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.330145 25632 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.331596 26061 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.374297 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.376057 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.382028 25448 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:49.351253 25882 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:49.378713 21902 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:49.409232 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:49.411495 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 86829.6us
I20260709 13:06:49.356899 26057 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:49.413517 25992 consensus_queue.cc:1243] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:49.377406 25863 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:49.427117 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.424695 25863 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:49.431034 25863 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:49.426301 25983 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.421617 25448 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:49.437783 21902 raft_consensus.cc:2410] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:49.378674 26000 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:06:49.372491 25879 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:06:49.422082 25929 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.364755 25980 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.439853 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.422284 25882 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:49.377889 25978 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:06:49.424352 25992 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:49.395181 26061 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.532109 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.463645 26057 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.437804 25842 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.501021 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 166444us
W20260709 13:06:49.470842 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 105992us
I20260709 13:06:49.411698 25690 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:49.539005 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:49.533062 21902 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:49.538761 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:49.412814 25864 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:49.468132 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 160707us
W20260709 13:06:49.543145 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 191024us
I20260709 13:06:49.528385 25992 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.535054 25879 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:49.572329 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:49.559002 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.537760 25918 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:49.541188 25973 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:49.428165 25979 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.545468 25929 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.544600 25975 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.500072 26008 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:06:49.531905 25632 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.550438 26000 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:49.603514 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:49.619222 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.643707 21902 raft_consensus.cc:2410] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:49.548431 25983 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.645416 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:49.609683 26064 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:06:49.630534 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.613013 26056 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:06:49.654209 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:49.603649 26059 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:06:49.579464 21908 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:49.608521 25992 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.613246 26081 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:49.644805 26068 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:49.630671 26069 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:06:49.618635 25882 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.641808 26079 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:49.593400 25925 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:49.602710 26071 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:06:49.610697 26065 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:06:49.592509 25984 consensus_queue.cc:1243] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:49.540648 26057 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.658599 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:49.675184 26070 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.677222 21949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.008s	sys 0.034s
I20260709 13:06:49.677467 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:49.712886 21949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.034s
I20260709 13:06:49.600078 25448 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:06:49.634416 26000 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:49.581209 26080 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:49.657192 25981 consensus_meta.cc:287] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.582s	user 0.004s	sys 0.003s
I20260709 13:06:49.655599 25929 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.541414 25842 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:49.630388 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 217862us
I20260709 13:06:49.734345 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2073) took 3499 ms. Trace:
I20260709 13:06:49.656410 26067 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:49.613909 26082 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.654407 26072 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:49.708915 22551 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:49.596422 25985 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.675875 25632 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:49.679098 25973 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.656325 26061 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:49.713272 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 644451us
I20260709 13:06:49.674309 26081 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.713213 21902 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
W20260709 13:06:49.713928 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 175245us
I20260709 13:06:49.690663 25925 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:49.693058 26068 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:49.734738 21900 rpcz_store.cc:276] 0709 13:06:46.234830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.151219 (+1916389us) service_pool.cc:224] Handling call
0709 13:06:48.151794 (+   575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.047952 (+896158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.047979 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.059828 (+ 11849us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.226856 (+167028us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:49.226911 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.227000 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.734095 (+507095us) raft_consensus.cc:1685] finished
0709 13:06:49.734118 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.734288 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":895981,"raft.queue_time_us":901904,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3052,"thread_start_us":151805,"threads_started":1,"wal-append.queue_time_us":247632}
I20260709 13:06:49.683504 26077 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:49.708200 25992 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:49.714850 26073 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:06:49.660226 25897 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.738776 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2077) took 3455 ms. Trace:
I20260709 13:06:49.747017 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:49.747210 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:49.730336 26000 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:49.759290 21903 rpcz_store.cc:276] 0709 13:06:46.283750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.162135 (+1878385us) service_pool.cc:224] Handling call
0709 13:06:48.162419 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.047997 (+885578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.048022 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.059245 (+ 11223us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.209320 (+150075us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:49.209373 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.209459 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.738519 (+529060us) raft_consensus.cc:1685] finished
0709 13:06:49.738547 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.738707 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":930693,"raft.queue_time_us":897947,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":1492,"spinlock_wait_cycles":17280,"thread_start_us":122549,"threads_started":1,"wal-append.queue_time_us":169519}
I20260709 13:06:49.761220 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.749776 21975 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:49.747341 25985 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.719077 25639 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.780023 25897 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.790647 25985 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.778381 25948 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:49.791349 25639 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.706290 25541 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.792781 25985 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:49.733777 26063 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:49.738049 26067 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.793865 25541 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.791368 25908 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.794286 26067 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.755807 21981 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:49.799870 21908 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:49.801501 21908 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:49.801777 21908 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.802464 21908 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.803500 21908 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:49.785058 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:06:49.787869 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:49.742758 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 88625.6us
I20260709 13:06:49.704630 26079 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.718966 25984 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:49.753729 26080 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:49.750864 25925 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:49.720510 26070 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.792066 25948 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:49.756682 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.764797 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.822281 21908 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:06:49.733479 25981 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.751056 26071 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.846568 26071 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:49.814337 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 65879.4us
I20260709 13:06:49.754812 25980 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:49.824116 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.825531 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:49.822039 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.849268 26071 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:49.850688 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.786763 26081 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.850835 25948 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:49.832147 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 67464.5us
I20260709 13:06:49.854624 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.850384 21827 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:49.856765 25541 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.790321 26072 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:49.834892 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.857437 25959 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:49.858083 21826 raft_consensus.cc:2410] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:49.858745 25897 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:49.859045 25985 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:49.806944 21873 leader_election.cc:400] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13.
I20260709 13:06:49.809501 26063 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.842368 21829 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:06:49.842855 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.859669 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.863260 25897 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:49.860098 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53274.5us
I20260709 13:06:49.865106 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:49.759742 25884 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:06:49.843231 25769 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:06:49.861521 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:49.867609 26079 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.837361 21908 pending_rounds.cc:85] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 6
I20260709 13:06:49.865957 25632 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:49.858724 26090 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:49.872519 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.868309 21908 pending_rounds.cc:107] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:06:49.838555 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.837657 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.871075 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:49.892817 21828 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:49.833794 26088 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.875874 21826 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:49.876441 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:49.874985 25761 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.822s	user 0.013s	sys 0.000s
I20260709 13:06:49.867978 26072 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:06:49.871634 26096 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.886833 21832 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:49.874013 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.835925 26057 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.893080 21827 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:49.906190 25984 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:49.906641 25984 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.906972 25984 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:49.906775 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:49.907560 26070 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:49.907825 21827 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:49.835825 25973 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:49.908831 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.909106 25973 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.910370 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:49.910714 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.911094 21827 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.911875 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:49.912930 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.913450 21828 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:49.919338 25981 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.757858 26077 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.920226 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.921490 26077 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.890973 25448 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.922251 25448 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.922365 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.922502 21827 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:49.924019 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.777477 26068 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.834066 26078 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:06:49.925293 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.925678 26078 consensus_queue.cc:1243] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:49.926265 26078 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:49.926605 26078 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:49.927495 26078 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.928735 26078 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.926124 21827 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:49.930562 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.894304 21908 raft_consensus.cc:2889] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.884768 26090 consensus_queue.cc:1243] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:49.896202 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.832633 25863 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:49.935633 26090 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.934252 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.936371 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.937206 25863 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:49.937471 21827 raft_consensus.cc:2410] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:49.874017 26080 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:06:49.874189 26071 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:06:49.938094 21976 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:49.903301 21829 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:06:49.939105 25761 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.903924 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:49.938154 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.940701 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.941011 21827 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:49.941619 21832 raft_consensus.cc:2410] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:06:49.900560 25632 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.942636 25632 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.935642 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.944561 25632 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.887864 25897 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.944891 26088 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:49.939661 26063 consensus_queue.cc:1175] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d76b2c4699e43fba10eeb81a91e4913" responder_term: 12 status { last_received { term: 10 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:49.945434 25897 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:49.944427 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:49.939584 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:49.948446 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 152743us
I20260709 13:06:49.948876 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:49.949997 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:49.924574 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.950742 21974 raft_consensus.cc:2410] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:49.950963 21828 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:49.937657 21908 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:49.953914 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:49.941872 25761 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:49.954512 21974 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:49.958026 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.957000 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:49.954707 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:49.959201 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:49.959518 21908 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:49.958969 21832 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:49.965076 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:49.971788 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:49.887724 26079 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:06:49.902841 25980 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:49.983122 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:49.985967 21980 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:49.924376 25448 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:49.990425 21832 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:49.956310 26077 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.003152 21982 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:06:49.969998 26093 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:06:49.958305 26070 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.000000 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:50.009102 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:50.005787 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:50.011240 21902 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 7.
I20260709 13:06:49.960716 25863 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:50.015133 21828 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:50.017611 21977 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:06:50.018870 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:50.019469 21980 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 6.
I20260709 13:06:50.013130 21908 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:50.020798 21830 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:49.937965 26000 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:49.945943 25897 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:50.022616 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:50.023697 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:50.024823 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:49.985340 25980 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:50.019718 25945 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.001s
I20260709 13:06:50.030881 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:50.031762 21982 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:50.034359 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:50.029608 21981 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:50.004155 25448 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.022260 25842 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:49.984460 25925 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.038552 21902 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:50.057998 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:50.058687 21902 raft_consensus.cc:2376] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13. Re-sending same reply.
I20260709 13:06:50.059620 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 428) took 4706 ms. Trace:
I20260709 13:06:50.059892 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:50.059969 21905 rpcz_store.cc:276] 0709 13:06:45.353616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.358340 (+  4724us) service_pool.cc:224] Handling call
0709 13:06:49.032588 (+3674248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.033181 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.059397 (+1026216us) spinlock_profiling.cc:243] Waited 3.67 s on lock 0x7b54002e63d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:50.059542 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8449391360}
I20260709 13:06:50.060943 21902 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:06:50.061343 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:50.062016 21905 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:50.063898 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:50.064491 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:50.077908 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 373c4d5502fd42dca6f9cbb5a894ee0b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:50.037192 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:50.079905 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:50.081820 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:50.083588 26057 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:50.068907 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:50.086346 21834 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:50.086989 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:50.043248 25979 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:50.024557 25834 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:06:50.021413 26013 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:50.045508 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 175782us
I20260709 13:06:50.057658 26077 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.021653 25863 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:50.090765 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:50.022496 26070 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:50.096652 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:50.097561 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:50.098481 22555 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.100919 25925 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:50.103223 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:50.084261 25897 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:50.102412 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:50.096181 26077 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.104732 25632 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:50.105783 25632 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:50.106302 26080 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:50.106660 26077 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:50.108008 25880 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:50.106702 26080 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:50.109305 26080 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.091282 25767 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:50.041043 25945 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.092679 25541 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.062877 25448 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.116237 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:50.092840 26013 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.096701 25930 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:50.036520 26097 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:06:50.120939 21832 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:50.106137 25632 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.101347 26105 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:06:50.130941 22550 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:50.117225 25767 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:50.135181 22555 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:50.113469 25980 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.137459 25984 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:50.097541 26085 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:06:50.122634 26013 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:50.139890 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 102810us
I20260709 13:06:50.131918 25632 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:50.119297 25769 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:06:50.148497 26104 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:50.140924 25767 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:50.151108 26102 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:06:50.153218 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:50.153718 21900 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:06:50.165396 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:50.165927 21900 pending_rounds.cc:85] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 5
I20260709 13:06:50.155527 25889 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:50.156421 25975 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:50.056007 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:50.189262 25975 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:50.164337 25980 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.190249 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:50.192576 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.163537 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47414.3us
W20260709 13:06:50.195148 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 139273us
I20260709 13:06:50.194628 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:50.197505 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.166211 21827 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:50.166277 21900 pending_rounds.cc:107] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:06:50.199532 21900 raft_consensus.cc:2889] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.199867 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:50.175522 26085 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:50.177469 25448 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:50.178551 21825 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:50.180785 25984 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:50.181257 26098 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:06:50.186862 25976 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:06:50.188092 25866 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:50.134403 25930 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:06:50.167563 25889 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:50.163245 21902 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:50.199950 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:50.200469 21979 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:50.168152 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:50.236670 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 68595.3us
I20260709 13:06:50.236930 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:50.197865 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:50.201287 21982 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:50.201977 25769 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:50.201857 25859 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:50.202584 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:50.239048 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:50.201884 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:50.204877 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:50.206450 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:50.207808 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:50.208030 25979 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:50.208230 26077 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:50.211462 25973 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.243312 21832 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:50.241170 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:50.249568 21908 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.193545 25761 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:50.214673 25870 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:50.214434 26013 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:50.253201 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:50.215435 25862 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:50.257542 25862 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:50.258608 25862 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.259791 25862 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.216538 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 2089) took 1084 ms. Trace:
I20260709 13:06:50.216686 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:50.217681 25876 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:50.262341 21901 rpcz_store.cc:276] 0709 13:06:49.131661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.379335 (+247674us) service_pool.cc:224] Handling call
0709 13:06:50.216327 (+836992us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400076f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:50.216472 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451818368}
I20260709 13:06:50.260257 21979 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:50.263203 25876 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:50.263556 25876 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.217660 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:50.263819 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:50.264501 21901 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.241915 25979 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:50.265350 25979 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.218089 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:50.266407 25979 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.218508 26001 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.251405 25870 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:50.268622 25870 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:50.224745 26114 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:06:50.221827 26000 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:50.203557 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2094) took 1095 ms. Trace:
I20260709 13:06:50.280267 21900 rpcz_store.cc:276] 0709 13:06:49.108212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.751369 (+643157us) service_pool.cc:224] Handling call
0709 13:06:49.751633 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.199974 (+448341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.203358 (+  3384us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54003c9454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:50.203506 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923901184}
I20260709 13:06:50.281987 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:50.237733 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:50.282987 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45311.1us
I20260709 13:06:50.284579 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:50.226212 26085 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.288133 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:50.243299 21828 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:06:50.240060 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:50.292987 21828 pending_rounds.cc:85] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 5
I20260709 13:06:50.253849 21906 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 6.
I20260709 13:06:50.253319 26070 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:50.256549 26115 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:50.256975 26013 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:50.234790 25866 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:50.262651 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 46051.3us
W20260709 13:06:50.298565 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 100762us
I20260709 13:06:50.241228 25769 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.249361 25977 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:50.293239 21828 pending_rounds.cc:107] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:06:50.268638 25541 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:50.297416 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:50.300108 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.263859 25876 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.252103 25761 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:50.301121 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 56578.4us
I20260709 13:06:50.273111 25870 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.296401 26057 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.302146 21828 raft_consensus.cc:2889] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.317317 21901 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:50.215756 25897 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:50.306757 21827 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:50.307335 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:50.272528 25468 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.318475 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:50.313401 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:50.302070 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:50.294881 26085 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.295006 25860 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:50.319226 21900 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:50.301723 25863 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:50.302179 25769 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:50.315635 26082 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.315523 25761 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.329742 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:50.335229 21906 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:50.320143 21982 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:50.253588 25889 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:50.271324 25975 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.309777 26000 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:50.338598 25930 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:06:50.343359 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:50.355624 21982 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.356307 25767 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:50.331558 25977 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:50.328625 25897 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:50.332882 25468 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.358835 25977 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.360066 26121 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:06:50.360726 25468 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:50.332216 25860 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.361346 25860 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.367731 21982 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:06:50.384780 21908 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
W20260709 13:06:50.421058 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.429737 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.434900 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 138751us
I20260709 13:06:50.435818 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:50.532878 26118 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:06:50.538784 26122 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:50.540189 26111 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:06:50.385635 25889 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:50.340384 26082 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.334332 26115 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:06:50.341336 25866 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:50.559478 21799 leader_election.cc:336] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 2.526s (SENT)
I20260709 13:06:50.794602 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:50.736147 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:50.796061 21982 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:50.737934 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 302216us
I20260709 13:06:50.737062 21904 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:50.588627 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.699100 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.644882 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:50.823886 21975 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:50.853698 21904 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
W20260709 13:06:50.669327 26080 consensus_meta.cc:287] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
W20260709 13:06:50.642558 26110 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 13:06:51.045776 26012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.008s	sys 0.021s
W20260709 13:06:51.224772 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.022s	sys 0.010s
I20260709 13:06:50.856242 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:51.340945 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.026s	sys 0.010s
I20260709 13:06:50.854151 21904 pending_rounds.cc:85] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 5
W20260709 13:06:50.638715 26116 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.304s	user 0.000s	sys 0.000s
I20260709 13:06:50.659122 26121 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:51.341794 21904 pending_rounds.cc:107] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:06:50.420051 26120 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:51.224133 21949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.009s	sys 0.024s
I20260709 13:06:50.560328 25767 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:51.405717 21949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.015s	sys 0.025s
W20260709 13:06:51.320518 25632 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.156s	user 0.009s	sys 0.000s
W20260709 13:06:50.897320 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 337858us
I20260709 13:06:51.406248 21904 raft_consensus.cc:2889] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.420951 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2107) took 1374 ms. Trace:
I20260709 13:06:51.421399 21904 rpcz_store.cc:276] 0709 13:06:50.046259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.853075 (+806816us) service_pool.cc:224] Handling call
0709 13:06:50.853365 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.420722 (+567357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.420901 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:50.739475 26088 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.876384 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.424798 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2011) took 1081 ms. Trace:
W20260709 13:06:51.414098 22551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.009s
W20260709 13:06:51.426069 22551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.014s	sys 0.009s
I20260709 13:06:51.372107 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 492) took 1408 ms. Trace:
I20260709 13:06:50.661600 25769 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:50.928974 25859 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:51.444655 21900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.009s	sys 0.032s
W20260709 13:06:51.277722 25870 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.961s	user 0.007s	sys 0.001s
I20260709 13:06:50.609942 25860 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:51.435516 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.426955 21829 rpcz_store.cc:276] 0709 13:06:49.963364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.983778 (+ 20414us) service_pool.cc:224] Handling call
0709 13:06:50.002563 (+ 18785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.002952 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.002990 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.003508 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.122669 (+119161us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:50.122711 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.122779 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.371893 (+1249114us) raft_consensus.cc:1685] finished
0709 13:06:51.371915 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.372048 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1499,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":14118,"thread_start_us":86650,"threads_started":1,"wal-append.queue_time_us":176464}
I20260709 13:06:50.992161 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:51.408892 25876 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.088s	user 0.001s	sys 0.012s
I20260709 13:06:50.929392 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:51.378568 25897 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:50.925657 25976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.009s	sys 0.058s
I20260709 13:06:51.443580 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:51.340252 26012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.012s	sys 0.024s
W20260709 13:06:51.445130 21900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.009s	sys 0.032s
W20260709 13:06:51.320775 26085 consensus_meta.cc:287] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.988s	user 0.005s	sys 0.005s
W20260709 13:06:51.341348 25980 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.148s	user 0.005s	sys 0.005s
W20260709 13:06:50.875957 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.405829 26121 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:51.475394 26121 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:51.341382 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 1.01018e+06us
I20260709 13:06:51.480012 26082 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.480688 26082 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.481171 26082 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:51.446028 25632 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.483556 25860 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:51.484926 25632 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:51.464383 25976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.009s	sys 0.059s
W20260709 13:06:51.486917 26053 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 2.276s	user 0.005s	sys 0.019s
I20260709 13:06:51.451948 26120 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:51.487939 26120 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:51.454525 25876 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.490845 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.491218 21901 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:48.105916 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:51.503139 25876 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.504467 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.505303 21981 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:51.505729 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2010) took 1162 ms. Trace:
I20260709 13:06:51.508733 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2113) took 1624 ms. Trace:
I20260709 13:06:51.509140 21830 rpcz_store.cc:276] 0709 13:06:49.883907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.887271 (+  3364us) service_pool.cc:224] Handling call
0709 13:06:49.887609 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.023417 (+135808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.508521 (+1485104us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54000e9cd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:51.508670 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305922432}
I20260709 13:06:51.509529 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:51.510529 21830 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:51.511186 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:51.514022 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 503) took 1551 ms. Trace:
I20260709 13:06:51.514411 21974 rpcz_store.cc:276] 0709 13:06:49.962765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.963914 (+  1149us) service_pool.cc:224] Handling call
0709 13:06:49.964227 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.115297 (+151070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.115325 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.115361 (+    36us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:50.115395 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.513796 (+1398401us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003f9654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:51.513838 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.513969 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347024640}
W20260709 13:06:51.515178 26057 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.194s	user 0.000s	sys 0.011s
I20260709 13:06:51.515727 26057 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:51.515933 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.516595 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:51.447479 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.509160 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:51.506069 21981 rpcz_store.cc:276] 0709 13:06:50.342941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.504184 (+1161243us) service_pool.cc:224] Handling call
0709 13:06:51.505664 (+  1480us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:51.371497 25761 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.030s	user 0.009s	sys 0.000s
I20260709 13:06:50.986622 25866 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:51.454133 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:51.454195 21975 raft_consensus.cc:2410] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:06:51.520892 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2007) took 1178 ms. Trace:
I20260709 13:06:51.521189 26082 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:51.521205 21975 rpcz_store.cc:276] 0709 13:06:50.342260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.879565 (+537305us) service_pool.cc:224] Handling call
0709 13:06:51.520840 (+641275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:51.523442 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.524096 21975 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:51.524596 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2012) took 1181 ms. Trace:
I20260709 13:06:51.524935 21975 rpcz_store.cc:276] 0709 13:06:50.343373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.522633 (+1179260us) service_pool.cc:224] Handling call
0709 13:06:51.524543 (+  1910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:51.425305 21982 rpcz_store.cc:276] 0709 13:06:50.343174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.876109 (+532935us) service_pool.cc:224] Handling call
0709 13:06:51.424730 (+548621us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:50.825181 26000 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.445611 25977 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.007s	sys 0.018s
I20260709 13:06:50.928881 25863 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.447679 26088 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:50.985096 26070 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.516714 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2017) took 1172 ms. Trace:
I20260709 13:06:51.519920 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 460) took 1658 ms. Trace:
I20260709 13:06:51.520123 25769 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.519523 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:51.541651 22518 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.024s	sys 0.019s
I20260709 13:06:51.538530 21974 rpcz_store.cc:276] 0709 13:06:50.344541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.515685 (+1171144us) service_pool.cc:224] Handling call
0709 13:06:51.516659 (+   974us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:51.447206 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.534444 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:51.530565 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.545161 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2116) took 1325 ms. Trace:
W20260709 13:06:51.542675 22518 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.024s	sys 0.019s
W20260709 13:06:51.545336 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.545576 21975 rpcz_store.cc:276] 0709 13:06:50.219998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.530306 (+1310308us) service_pool.cc:224] Handling call
0709 13:06:51.545110 (+ 14804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:51.533502 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.538664 21906 rpcz_store.cc:276] 0709 13:06:49.861150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.348238 (+487088us) service_pool.cc:224] Handling call
0709 13:06:50.358512 (+ 10274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.358822 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.358849 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.736975 (+378126us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.306006 (+569031us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:51.306063 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.306157 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.519739 (+213582us) raft_consensus.cc:1685] finished
0709 13:06:51.519760 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.519869 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26804,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":14350,"thread_start_us":321853,"threads_started":1,"wal-append.queue_time_us":580369}
I20260709 13:06:51.541673 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2013) took 1198 ms. Trace:
I20260709 13:06:51.547628 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 447) took 5370 ms. Trace:
W20260709 13:06:51.549635 21872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.024s	sys 0.028s
I20260709 13:06:51.547359 21981 rpcz_store.cc:276] 0709 13:06:50.343575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.519270 (+1175695us) service_pool.cc:224] Handling call
0709 13:06:51.541614 (+ 22344us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:51.550143 21872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.024s	sys 0.028s
W20260709 13:06:51.551625 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.551533 21982 raft_consensus.cc:2410] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:51.553911 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.555017 21974 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:51.555706 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2114) took 1336 ms. Trace:
I20260709 13:06:51.556115 21974 rpcz_store.cc:276] 0709 13:06:50.219569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.553674 (+1334105us) service_pool.cc:224] Handling call
0709 13:06:51.555638 (+  1964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:51.558064 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:51.553906 22552 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:06:51.355795 26080 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.562700 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:51.539196 25977 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.008s	sys 0.018s
I20260709 13:06:51.557248 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2112) took 1338 ms. Trace:
I20260709 13:06:51.586746 21975 rpcz_store.cc:276] 0709 13:06:50.218987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.554866 (+1335879us) service_pool.cc:224] Handling call
0709 13:06:51.555812 (+   946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.556463 (+   651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.556674 (+   211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:51.556891 (+   217us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:51.556952 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.557049 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.557184 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:51.579527 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2021) took 1234 ms. Trace:
I20260709 13:06:51.588336 21982 rpcz_store.cc:276] 0709 13:06:50.345324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.532732 (+1187408us) service_pool.cc:224] Handling call
0709 13:06:51.579128 (+ 46396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:51.589586 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:51.590384 21829 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:51.591434 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:51.551378 21721 maintenance_manager.cc:419] P 8f8230518d3b4d7090bda1a8eda4b421: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033359
I20260709 13:06:51.548059 21909 rpcz_store.cc:276] 0709 13:06:46.176697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.923928 (+747231us) service_pool.cc:224] Handling call
0709 13:06:46.924261 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.300803 (+376542us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:47.456566 (+155763us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.010562 (+1553996us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.010967 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.011110 (+   143us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:49.011143 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.538597 (+2527454us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000fa854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:51.538644 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.538687 (+    43us) raft_consensus.cc:1685] finished
0709 13:06:51.547441 (+  8754us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.547575 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1278010,"prepare.queue_time_us":17867,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":1420593,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":29918,"spinlock_wait_cycles":373968128,"thread_start_us":631967,"threads_started":3,"wal-append.queue_time_us":533679,"wal-append.run_cpu_time_us":2682,"wal-append.run_wall_time_us":2017272}
I20260709 13:06:51.554008 25639 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.562903 25870 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.683094 25870 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.685302 25870 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:51.585310 25983 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.566509 25980 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:51.535491 26000 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:51.529531 26085 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.687742 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 456) took 1834 ms. Trace:
I20260709 13:06:51.541280 25761 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:51.547185 26070 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.540575 25863 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.691540 21829 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:51.591951 25767 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:06:51.694523 21900 rpcz_store.cc:276] 0709 13:06:49.853078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.330726 (+477648us) service_pool.cc:224] Handling call
0709 13:06:50.331004 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.331320 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.331352 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.331782 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.466717 (+1134935us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:51.466779 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.466899 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.687520 (+220621us) raft_consensus.cc:1685] finished
0709 13:06:51.687543 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.687673 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1144,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4104,"thread_start_us":1134586,"threads_started":1,"wal-append.queue_time_us":1303209}
I20260709 13:06:51.592621 26117 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
W20260709 13:06:51.692415 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.709230 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.709648 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.710544 21982 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:51.710624 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:51.701645 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 242257us
I20260709 13:06:51.702543 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:51.707142 21900 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:06:51.712968 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2110) took 1660 ms. Trace:
I20260709 13:06:51.713467 21900 rpcz_store.cc:276] 0709 13:06:50.052934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.706396 (+1653462us) service_pool.cc:224] Handling call
0709 13:06:51.706826 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:51.712606 (+  5780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.712898 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:51.715458 21832 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:51.716828 21827 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:51.728969 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:51.692381 25983 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.732213 21900 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:51.712852 26138 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.691557 25639 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.693317 25980 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.738140 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:51.740643 25864 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:51.743398 26070 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.744262 25863 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:51.744890 26133 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:51.758076 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:51.765717 21827 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:51.771711 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 554) took 1729 ms. Trace:
I20260709 13:06:51.782672 21974 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:51.755484 25863 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.772526 22551 rpcz_store.cc:276] 0709 13:06:50.042711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.042872 (+   161us) service_pool.cc:224] Handling call
0709 13:06:50.080115 (+ 37243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.080374 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:50.139449 (+ 59075us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.770773 (+1631324us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.771356 (+   583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:51.771406 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:51.771454 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.771542 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.771657 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":427198,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":84,"raft.queue_time_us":714870,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9913,"thread_start_us":1345729,"threads_started":4,"wal-append.queue_time_us":1546513}
I20260709 13:06:51.778407 21900 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:51.786561 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:51.787880 21900 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:51.791894 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2087) took 2851 ms. Trace:
I20260709 13:06:51.792321 21978 rpcz_store.cc:276] 0709 13:06:48.930741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.931613 (+   872us) service_pool.cc:224] Handling call
0709 13:06:48.931882 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.993191 (+ 61309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.782147 (+2788956us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b5400059bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:51.782361 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139357056}
I20260709 13:06:51.796550 25983 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.797739 25761 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:51.798322 26088 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.803700 21900 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:51.803826 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:51.804457 21978 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:51.783385 25919 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:51.807931 21900 pending_rounds.cc:85] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 7
W20260709 13:06:51.802042 26124 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:06:51.812475 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:51.809047 21900 pending_rounds.cc:107] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:06:51.813426 21900 raft_consensus.cc:2889] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.800956 26063 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:51.817507 21874 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:51.819473 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:51.822496 25985 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:51.822714 25889 consensus_meta.cc:287] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.999s	user 0.012s	sys 0.000s
I20260709 13:06:51.817690 25983 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:51.823513 25889 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.824016 25889 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.825294 26080 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.826063 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:51.827842 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:51.750311 26138 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.805732 26142 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:51.829303 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 123264us
I20260709 13:06:51.799453 25863 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.815680 26140 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.833226 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:51.799227 26121 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:51.843078 25975 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:51.843863 26121 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.844524 22555 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:51.846216 26127 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:06:51.847288 25980 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:51.826501 25897 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.850258 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:51.850517 26155 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:51.832682 25870 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.851456 21948 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:51.852109 25870 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:51.852646 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:51.827788 26088 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:51.853542 26088 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:51.855683 26088 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:51.856199 25977 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:51.856808 25977 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:51.857409 25977 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:51.857738 25977 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:51.859009 26097 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:51.854082 25879 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.859392 26097 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:51.859884 25863 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:51.860023 25925 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:51.860301 26097 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.860493 25897 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:51.861336 26097 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:51.861434 25925 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:51.840674 26132 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:06:51.862407 21983 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:51.862049 25925 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:51.864929 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:51.865595 25639 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.866153 26000 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:51.867154 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2104) took 2120 ms. Trace:
I20260709 13:06:51.867890 26138 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.868250 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2106) took 1822 ms. Trace:
I20260709 13:06:51.906673 21902 rpcz_store.cc:276] 0709 13:06:50.045942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.061982 (+ 16040us) service_pool.cc:224] Handling call
0709 13:06:51.868065 (+1806083us) spinlock_profiling.cc:243] Waited 96.4 ms on lock 0x7b54000fad54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:51.868196 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221824384}
I20260709 13:06:51.908370 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:51.909215 21902 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 6.
I20260709 13:06:51.858104 25977 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:51.869216 26140 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.833423 26142 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:51.848456 26123 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.862635 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:51.897235 21978 raft_consensus.cc:2410] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:06:51.898820 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 196381us
I20260709 13:06:51.901206 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2009) took 1558 ms. Trace:
I20260709 13:06:51.903700 21976 rpcz_store.cc:276] 0709 13:06:49.748052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.748169 (+   117us) service_pool.cc:224] Handling call
0709 13:06:49.748426 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.938744 (+190318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.866920 (+1928176us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540001dbd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:51.867096 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435808000}
I20260709 13:06:51.925762 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:51.926748 21976 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:51.925143 21975 rpcz_store.cc:276] 0709 13:06:50.342719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.587635 (+1244916us) service_pool.cc:224] Handling call
0709 13:06:51.636801 (+ 49166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.637068 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:51.785218 (+148150us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.900775 (+115557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:51.900836 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:51.900895 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.900989 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.901148 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3588,"prepare.queue_time_us":188442,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":464,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4666,"thread_start_us":218521,"threads_started":2}
I20260709 13:06:51.927917 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:51.911304 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:51.899812 25632 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:51.913002 21903 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:06:51.934423 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 71877.6us
I20260709 13:06:51.934720 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:51.936247 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:51.902499 25889 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:51.939958 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 112162us
I20260709 13:06:51.937834 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:51.937987 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:51.962641 21978 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:51.930802 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:51.961656 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:51.965732 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:51.962076 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:51.966951 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:51.919878 26140 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:51.936007 26138 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.972721 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:51.937151 26078 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.981029 26078 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.971184 26088 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:51.982657 26088 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.983048 26088 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:51.985952 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.961395 26097 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:51.970108 25864 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:51.986955 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:51.971395 25889 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:51.976254 26158 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:51.961580 26147 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:51.970539 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:51.988183 21902 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:06:51.988147 21980 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 6.
I20260709 13:06:51.974964 26155 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:51.995721 21975 raft_consensus.cc:2410] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:51.967860 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:51.963587 25632 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.004462 21799 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:51.988561 25880 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:51.995702 25864 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.985505 26138 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.961472 26123 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:51.988479 25925 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.047978 25639 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:52.070667 26164 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:52.071369 25985 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.071252 25639 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.071907 25985 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.009322 25897 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:52.073344 25864 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:52.044245 21980 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:06:52.054895 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:51.989152 26067 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:52.021978 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 463) took 1914 ms. Trace:
I20260709 13:06:52.082755 21902 rpcz_store.cc:276] 0709 13:06:50.107347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.979110 (+1871763us) service_pool.cc:224] Handling call
0709 13:06:51.979532 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.008573 (+ 29041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.021894 (+ 13321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.004310 26140 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.038467 21975 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:52.084656 26140 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:52.010612 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:52.075312 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2015) took 1731 ms. Trace:
I20260709 13:06:52.012540 21978 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:52.002071 25889 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:06:51.985808 25891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.643s	user 0.029s	sys 0.040s
W20260709 13:06:52.014353 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.113698 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.085448 21904 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:52.114382 21978 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:06:52.085057 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2016) took 1740 ms. Trace:
I20260709 13:06:52.043279 26063 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:52.074009 25985 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:52.097162 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 86636.6us
I20260709 13:06:52.037860 26147 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.115108 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2018) took 1770 ms. Trace:
I20260709 13:06:52.114965 21975 rpcz_store.cc:276] 0709 13:06:50.344297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.007329 (+1663032us) service_pool.cc:224] Handling call
0709 13:06:52.038199 (+ 30870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.084816 (+ 46617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.085011 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.119608 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:52.112229 21980 rpcz_store.cc:276] 0709 13:06:50.344101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.005938 (+1661837us) service_pool.cc:224] Handling call
0709 13:06:52.043889 (+ 37951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.075038 (+ 31149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.075255 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.075014 25983 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.081926 25880 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.047957 26162 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:52.063894 25761 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:06:52.082751 25639 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:52.081983 26164 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:52.095719 26140 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:52.113328 25891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.779s	user 0.029s	sys 0.040s
I20260709 13:06:52.119503 21978 rpcz_store.cc:276] 0709 13:06:50.344729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.113811 (+1769082us) service_pool.cc:224] Handling call
0709 13:06:52.114091 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.114818 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.115050 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.112723 25889 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:52.218490 21978 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:52.219189 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2022) took 1873 ms. Trace:
I20260709 13:06:52.219555 21978 rpcz_store.cc:276] 0709 13:06:50.345549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.217592 (+1872043us) service_pool.cc:224] Handling call
0709 13:06:52.217934 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.218922 (+   988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.219136 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.220804 21978 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:52.116325 25897 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.232311 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2121) took 1335 ms. Trace:
I20260709 13:06:52.232687 21904 rpcz_store.cc:276] 0709 13:06:50.897259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.422338 (+525079us) service_pool.cc:224] Handling call
0709 13:06:52.232157 (+809819us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54002f4ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:52.232255 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431739776}
I20260709 13:06:52.233628 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.234441 21904 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
W20260709 13:06:52.234561 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.116894 25448 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.235240 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.140528 26097 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:52.150104 21980 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:52.242518 21978 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:52.147228 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2076) took 5863 ms. Trace:
I20260709 13:06:52.224633 25632 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.243172 21907 rpcz_store.cc:276] 0709 13:06:46.283486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.158153 (+1874667us) service_pool.cc:224] Handling call
0709 13:06:48.158462 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:49.062781 (+904319us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:49.218068 (+155287us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.263855 (+ 45787us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:51.742393 (+2478538us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b2c00010828. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:06:51.742906 (+   513us) log.cc:844] Serialized 52 byte log entry
0709 13:06:51.815419 (+ 72513us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:51.897633 (+ 82214us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.897897 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.898013 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.146923 (+248910us) raft_consensus.cc:1685] finished
0709 13:06:52.146955 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.147151 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":883449,"prepare.queue_time_us":212265,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":4169,"raft.queue_time_us":1019885,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":5037,"spinlock_wait_cycles":8025984,"thread_start_us":296532,"threads_started":4,"wal-append.queue_time_us":277287,"wal-append.run_cpu_time_us":2181,"wal-append.run_wall_time_us":1344774}
I20260709 13:06:52.226259 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.215322 26164 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.164395 25716 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.162874 26142 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:52.227916 26068 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:52.163697 21976 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:06:52.181310 25973 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.155736 26138 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.117334 25982 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:52.140447 26159 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:52.121246 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:52.235579 25448 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.299518 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2111) took 2246 ms. Trace:
I20260709 13:06:52.326042 21905 rpcz_store.cc:276] 0709 13:06:50.053219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.062627 (+  9408us) service_pool.cc:224] Handling call
0709 13:06:52.226070 (+2163443us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800003098. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:06:52.299448 (+ 73378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3740928}
I20260709 13:06:52.299518 21978 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:52.122707 26063 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.306644 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2020) took 1961 ms. Trace:
I20260709 13:06:52.152588 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2109) took 2100 ms. Trace:
I20260709 13:06:52.310647 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:52.311746 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.229466 25891 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:52.097163 25665 raft_consensus.cc:2764] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:52.180691 26163 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.245s
I20260709 13:06:52.148020 26123 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:52.322755 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 201581us
I20260709 13:06:52.328572 21978 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:52.179338 25919 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:52.328884 26147 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:52.330022 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.308064 26068 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:52.373167 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.373677 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:52.374068 21905 raft_consensus.cc:2410] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:06:52.308050 26097 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:52.333024 21909 rpcz_store.cc:276] 0709 13:06:50.052618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.689515 (+1636897us) service_pool.cc:224] Handling call
0709 13:06:51.689843 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.817437 (+127594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.818049 (+   612us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.829879 (+ 11830us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.095457 (+265578us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.118648 (+ 23191us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.120702 (+  2054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.120783 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.152355 (+ 31572us) raft_consensus.cc:1685] finished
0709 13:06:52.152377 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.152525 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12772,"prepare.queue_time_us":22953,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":115290,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":22808,"spinlock_wait_cycles":843520,"thread_start_us":303411,"threads_started":2,"wal-append.queue_time_us":280676}
I20260709 13:06:52.363621 21904 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:52.319228 25876 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.320518 25897 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.236220 25983 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.332283 21980 rpcz_store.cc:276] 0709 13:06:50.345129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.140029 (+1794900us) service_pool.cc:224] Handling call
0709 13:06:52.149921 (+  9892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.298601 (+148680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.306589 (+  7988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.387534 21909 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:52.372488 25919 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.388242 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2108) took 2042 ms. Trace:
I20260709 13:06:52.393354 21909 rpcz_store.cc:276] 0709 13:06:50.346122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.387002 (+2040880us) service_pool.cc:224] Handling call
0709 13:06:52.387313 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.388007 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.388195 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.394387 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:52.392462 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2114) took 2328 ms. Trace:
I20260709 13:06:52.395109 21909 raft_consensus.cc:2376] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10. Re-sending same reply.
I20260709 13:06:52.397714 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:52.398376 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.399649 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:52.400766 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:52.395742 21900 rpcz_store.cc:276] 0709 13:06:50.063683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.807314 (+1743631us) service_pool.cc:224] Handling call
0709 13:06:51.807741 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:51.814242 (+  6501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.814281 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:51.814883 (+   602us) log.cc:844] Serialized 52 byte log entry
0709 13:06:52.038821 (+223938us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:52.075498 (+ 36677us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.366357 (+290859us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.392161 (+ 25804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.392230 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.392272 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:52.392284 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.392399 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32030,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":4519,"raft.queue_time_us":39103,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":26810,"thread_start_us":478332,"threads_started":2,"wal-append.queue_time_us":218562}
I20260709 13:06:52.379588 26123 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.365813 26088 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.388144 25945 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.387567 26147 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:52.304198 26162 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.431186 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.432756 21980 raft_consensus.cc:2410] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:06:52.434733 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.435544 21900 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:52.387068 25876 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.433609 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:52.410852 25701 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.417596 25982 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.446872 21978 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:52.416152 26123 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.449440 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:52.441640 25889 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.450788 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.451098 21909 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:52.458796 21900 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:52.458866 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:52.450572 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.460240 21980 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:52.390388 26068 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.393883 25891 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.470202 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.471086 21900 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:52.455078 26123 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.419049 25977 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.463601 26136 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.475442 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:52.500905 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 397154us
I20260709 13:06:52.500079 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.493957 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.499533 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2116) took 2303 ms. Trace:
I20260709 13:06:52.502808 21900 raft_consensus.cc:2410] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:06:52.506121 21830 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:52.503273 21902 rpcz_store.cc:276] 0709 13:06:50.196255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.083892 (+1887637us) service_pool.cc:224] Handling call
0709 13:06:52.084336 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.167049 (+ 82713us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:52.167093 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.197918 (+ 30825us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.405296 (+207378us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:52.405320 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.405363 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.499326 (+ 93963us) raft_consensus.cc:1685] finished
0709 13:06:52.499347 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.499476 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38297,"raft.queue_time_us":51672,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":61,"thread_start_us":191701,"threads_started":1,"wal-append.queue_time_us":285836}
I20260709 13:06:52.507755 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:52.507889 21902 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:52.499425 26002 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.510778 26163 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:52.510964 26002 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.462945 26168 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.515513 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:52.519364 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.502094 26068 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:52.492321 26088 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.452639 26097 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:52.524240 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.520331 26136 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.476007 26063 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.527096 21833 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:52.467687 26138 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:06:52.470315 25632 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:06:52.527823 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.509259 26067 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:52.533711 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:52.534701 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.537362 21978 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:52.532629 26136 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.515936 26168 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.515200 25945 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.478744 25975 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:06:52.520547 25925 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:52.477636 26014 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:06:52.539299 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.540750 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.542667 26079 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:52.545256 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 597) took 1037 ms. Trace:
I20260709 13:06:52.557585 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:52.559900 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 461962us
I20260709 13:06:52.565575 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:52.562317 25982 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.568163 25982 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.568883 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:52.569682 26001 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.569696 22555 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:52.567350 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:52.538748 26067 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.572909 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:52.572243 22551 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:52.553848 22550 rpcz_store.cc:276] 0709 13:06:51.507970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.531884 (+ 23914us) service_pool.cc:224] Handling call
0709 13:06:51.532984 (+  1100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.533573 (+   589us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:51.690516 (+156943us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.802256 (+111740us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.544734 (+742478us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b180035e900. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:06:52.544881 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.544935 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:52.544999 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.545082 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.545199 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":735882,"prepare.queue_time_us":225807,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":745179,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":9904,"spinlock_wait_cycles":13094528,"thread_start_us":251743,"threads_started":2,"wal-append.queue_time_us":140719}
I20260709 13:06:52.582687 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:52.540300 26168 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:52.593525 22547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 551) took 3522 ms (client timeout 1927 ms). Trace:
W20260709 13:06:52.594015 22547 rpcz_store.cc:269] 0709 13:06:49.063972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.064103 (+   131us) service_pool.cc:224] Handling call
0709 13:06:52.585757 (+3521654us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b5400191ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:52.585876 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2172692352}
I20260709 13:06:52.594724 25982 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:52.499671 26147 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.553618 26079 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:52.584079 26067 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:52.579953 25983 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:52.567487 25925 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.587703 26138 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:52.577132 26001 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:52.614672 26169 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:06:52.614180 26105 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.615694 26105 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.609675 26138 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:52.614365 26079 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.619503 26079 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:52.622454 25977 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:52.624205 26140 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.616600 26162 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:52.626714 26140 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:52.616585 26136 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.673074 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:52.678453 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:52.678587 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 120432us
W20260709 13:06:52.680635 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.683050 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.684304 21904 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:52.685685 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:52.686465 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.687247 21904 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:52.698571 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.699424 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2019) took 2354 ms. Trace:
I20260709 13:06:52.700567 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.701196 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.702050 21978 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:06:52.703617 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.705147 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.702032 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.707144 21976 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:52.699862 21975 rpcz_store.cc:276] 0709 13:06:50.344931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.119733 (+1774802us) service_pool.cc:224] Handling call
0709 13:06:52.164259 (+ 44526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.164694 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.164737 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.165509 (+   772us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.411568 (+246059us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:52.533136 (+121568us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.533318 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.533387 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.698875 (+165488us) raft_consensus.cc:1685] finished
0709 13:06:52.698907 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.699189 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155285,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":17630,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":16123,"thread_start_us":341484,"threads_started":2,"wal-append.queue_time_us":308332}
I20260709 13:06:52.708256 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.708778 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.709102 21976 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:52.709640 21975 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
W20260709 13:06:52.711751 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 150736us
I20260709 13:06:52.716298 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:52.716672 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:52.717172 21900 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:52.719442 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:52.724303 21976 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:52.726429 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:52.728554 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:52.728576 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:52.730831 25632 consensus_queue.cc:1243] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:52.732003 25632 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:52.733062 25925 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.733362 25891 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:52.733982 25891 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.734102 25925 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:52.734624 25891 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.734812 25925 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:52.735481 25925 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:52.737526 25889 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:52.738471 25889 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:52.738847 25889 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.739392 25889 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.742704 25945 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:52.738713 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:52.630730 26138 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.752692 26138 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:52.753275 21901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2119) took 2550 ms (client timeout 3087 ms). Trace:
I20260709 13:06:52.629716 26123 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.760278 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:52.761402 22551 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:52.764220 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:52.764441 25980 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:52.765050 25980 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:52.765568 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:52.768316 22548 raft_consensus.cc:2368] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:52.763288 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:52.770347 26128 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.771261 26128 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.757877 26123 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:52.775297 26129 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:52.780625 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.773927 26136 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:52.782616 26136 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:52.782784 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2117) took 2562 ms. Trace:
W20260709 13:06:52.753731 21901 rpcz_store.cc:269] 0709 13:06:50.203188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.318264 (+115076us) service_pool.cc:224] Handling call
0709 13:06:52.752826 (+2434562us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540034ab54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:52.753087 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2695488768}
I20260709 13:06:52.783236 21981 rpcz_store.cc:276] 0709 13:06:50.220246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.554609 (+1334363us) service_pool.cc:224] Handling call
0709 13:06:51.593666 (+ 39057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.759742 (+166076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.759773 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:51.759813 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:51.759851 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.782328 (+1022477us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002c8654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:52.782399 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.782609 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381463424}
I20260709 13:06:52.784726 21904 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:06:52.786530 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:52.797515 25767 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:52.802659 21900 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:06:52.783895 26136 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.807245 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2006) took 2452 ms. Trace:
I20260709 13:06:52.809701 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:52.810840 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.812048 21900 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:52.813405 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:52.809908 21974 rpcz_store.cc:276] 0709 13:06:50.341912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.556922 (+1215010us) service_pool.cc:224] Handling call
0709 13:06:51.782354 (+225432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.783220 (+   866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.786498 (+1003278us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400059bd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:52.794186 (+  7688us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517467008}
I20260709 13:06:52.814953 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.820839 21907 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:52.797998 26067 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.824527 21904 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.829051 26136 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.830454 26123 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:52.830955 21948 leader_election.cc:400] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:52.831403 21948 leader_election.cc:403] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.832353 25977 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 7. Current term is 8.
I20260709 13:06:52.832442 26097 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:52.833813 26097 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:52.834409 21907 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:52.835055 21907 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:52.835250 26097 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.836064 21907 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.836475 26128 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.837742 21907 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.837129 26097 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:52.847443 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 85327.2us
I20260709 13:06:52.825032 25925 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.851166 25977 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.821098 25980 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.853681 26067 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.855144 25977 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:52.857172 21834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2017) took 3034 ms (client timeout 1639 ms). Trace:
W20260709 13:06:52.859359 21834 rpcz_store.cc:269] 0709 13:06:49.822641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.822817 (+   176us) service_pool.cc:224] Handling call
0709 13:06:52.856729 (+3033912us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400288cd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:52.856895 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517560064}
I20260709 13:06:52.865692 25925 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:52.867630 26057 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:52.868042 26057 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:52.869393 26057 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.872073 26085 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:52.889633 25864 consensus_meta.cc:287] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.008s
I20260709 13:06:52.890149 25864 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.891852 21905 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 13. Ops: []
I20260709 13:06:52.892881 25864 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.893378 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2104) took 2689 ms. Trace:
I20260709 13:06:52.893827 21905 rpcz_store.cc:276] 0709 13:06:50.203502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.376533 (+2173031us) service_pool.cc:224] Handling call
0709 13:06:52.376804 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.892389 (+515585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.893093 (+   704us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54003c9954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:52.893305 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183718784}
I20260709 13:06:52.895318 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:52.895473 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:52.895744 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:52.896093 21909 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:52.873119 26092 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.873733 26055 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.874812 26131 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.905126 26131 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.905928 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.878046 26078 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:52.879660 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:52.882915 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:52.907480 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:06:52.887132 21903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 2102) took 3134 ms (client timeout 2203 ms). Trace:
I20260709 13:06:52.899029 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.899534 26123 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:52.899655 21905 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:52.901366 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.857141 26105 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:52.904386 21983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2005) took 2560 ms (client timeout 1846 ms). Trace:
W20260709 13:06:52.908711 21903 rpcz_store.cc:269] 0709 13:06:49.752924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.760998 (+  8074us) service_pool.cc:224] Handling call
0709 13:06:52.886733 (+3125735us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54000fb254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:52.886926 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4946611968}
I20260709 13:06:52.891880 25977 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:52.911223 21983 rpcz_store.cc:269] 0709 13:06:50.341664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.490608 (+1148944us) service_pool.cc:224] Handling call
0709 13:06:52.902065 (+1411457us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54002d4954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:52.902220 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853111168}
W20260709 13:06:52.923244 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.925019 21979 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:06:52.925401 26055 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.926601 21903 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:52.927737 26055 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:52.927951 21903 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:52.931797 21833 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:52.932000 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:52.932331 21827 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:52.911741 26123 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.933773 26123 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.934644 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:52.935901 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:52.936898 26115 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:52.938717 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:52.939275 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.940176 21981 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:52.941198 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.939596 21826 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:52.942734 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.942852 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:52.943387 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:52.944093 21825 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.944407 21974 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:52.946430 21827 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:52.941869 21981 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:52.951473 26131 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:52.951766 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:52.952673 26128 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.938117 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:06:52.953949 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 74586.3us
I20260709 13:06:52.924484 26092 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:52.954454 26012 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:52.955325 26105 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.968878 21907 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:06:52.933979 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:52.969678 21974 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:52.955704 26012 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:52.969424 21907 pending_rounds.cc:85] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 7
I20260709 13:06:52.954407 25767 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:06:52.975332 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:52.975653 25767 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:52.976006 26012 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:52.976078 25767 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:52.977275 26012 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:52.972988 21907 pending_rounds.cc:107] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:06:52.982403 21907 raft_consensus.cc:2889] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:52.983083 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:52.983263 21981 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:52.958875 26190 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.140s
I20260709 13:06:52.986918 21830 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:52.987401 21981 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:06:52.987092 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.001618 21904 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:52.968036 25889 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.005875 21909 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:06:52.971741 26067 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:52.988824 26057 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.008729 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:52.988328 25919 consensus_meta.cc:287] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.005s
I20260709 13:06:53.011034 21826 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:53.008244 22552 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:53.014645 25919 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.017215 25919 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:53.018571 21833 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:53.019668 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:53.024245 21829 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:53.025156 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:52.989703 25880 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.024928 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2135) took 2734 ms. Trace:
W20260709 13:06:53.030720 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.977285 25767 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.041450 21825 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:53.043110 21981 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.046526 25930 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:53.047194 25930 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.050613 25767 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.046563 26092 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:53.055069 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:53.055711 26030 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:53.055898 26092 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:53.056173 26030 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:53.056559 26092 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:53.035926 21832 rpcz_store.cc:276] 0709 13:06:50.290826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.291017 (+   191us) service_pool.cc:224] Handling call
0709 13:06:50.314345 (+ 23328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.715883 (+1401538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.024315 (+1308432us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000ea1d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:53.024654 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3221843712}
I20260709 13:06:53.062021 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:53.063350 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.065534 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:53.069175 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:53.070753 26113 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:53.071144 26113 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:53.072062 26113 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.073276 26113 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.042861 25891 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.076248 25891 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.077610 26184 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:06:53.077688 21834 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:53.077582 21904 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:53.093039 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.097081 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.097754 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.079027 26184 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:53.097383 26168 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.099148 25925 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.100100 25448 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.100235 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.102497 25876 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.102759 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.102747 26092 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.103587 21830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
W20260709 13:06:53.103960 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.104228 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:53.097383 21798 connection.cc:256] RPC call timeout handler was delayed by -1.6217376829999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:06:53.122040 21798 connection.cc:256] RPC call timeout handler was delayed by -1.1951376829999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:06:53.122411 21798 connection.cc:256] RPC call timeout handler was delayed by -1.1951227629999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:06:53.105237 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50328.2us
I20260709 13:06:53.105454 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.107590 26190 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:53.090571 21907 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
W20260709 13:06:53.115110 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.112051 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:53.119720 21977 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:53.113641 25889 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.112494 26184 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:53.127692 21830 raft_consensus.cc:606] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:53.134698 21901 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 7: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:53.132911 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:06:53.136863 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.138715 21830 raft_consensus.cc:614] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:53.107623 26030 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.143724 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.143378 21909 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:53.150211 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.151432 21977 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:06:53.150885 26184 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.152446 26184 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.154114 25870 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:53.154893 26199 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:06:53.145380 25919 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:53.159547 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.161696 21833 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:53.162051 26070 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:53.136057 25925 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:53.162984 26197 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:06:53.164675 25925 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.165336 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.167243 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:53.168758 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:53.169540 25889 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:53.170140 25889 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:53.170787 25925 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:53.170308 21833 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:53.171633 25889 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.174600 21825 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:53.175637 25908 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.175719 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.177362 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.172587 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.181241 21907 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:53.188536 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.188973 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:53.190158 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2014) took 2846 ms. Trace:
I20260709 13:06:53.190559 21982 rpcz_store.cc:276] 0709 13:06:50.343891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.589359 (+1245468us) service_pool.cc:224] Handling call
0709 13:06:51.589767 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.711221 (+121454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.189745 (+1478524us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002260d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:53.189996 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277185408}
W20260709 13:06:53.194290 21831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2024) took 3369 ms (client timeout 2207 ms). Trace:
W20260709 13:06:53.194705 21831 rpcz_store.cc:269] 0709 13:06:49.825011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.825218 (+   207us) service_pool.cc:224] Handling call
0709 13:06:53.193919 (+3368701us) spinlock_profiling.cc:243] Waited 2.82 s on lock 0x7b540008a554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:53.194097 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6487921536}
I20260709 13:06:53.200794 21981 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:06:53.201043 21904 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:53.210561 21825 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
W20260709 13:06:53.210695 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 77904.4us
I20260709 13:06:53.178795 25919 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:53.210954 21904 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:53.211509 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:53.212038 21825 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:53.212203 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2108) took 3086 ms. Trace:
I20260709 13:06:53.211905 25919 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.212565 21906 rpcz_store.cc:276] 0709 13:06:50.046566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.564479 (+1517913us) service_pool.cc:224] Handling call
0709 13:06:51.635038 (+ 70559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.635381 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:52.905038 (+1269657us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b1800113440. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf
0709 13:06:52.905232 (+   194us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.977513 (+ 72281us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.978203 (+   690us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.978363 (+   160us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:53.129226 (+150863us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.129465 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.129543 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.132809 (+  3266us) raft_consensus.cc:1685] finished
0709 13:06:53.132835 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.133008 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":257119,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":15265,"raft.queue_time_us":127866,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":16994,"spinlock_wait_cycles":7455104,"thread_start_us":343249,"threads_started":3,"wal-append.queue_time_us":129474}
I20260709 13:06:53.214412 21976 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:53.217207 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:53.213043 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55682 (request call id 14) took 3110 ms. Trace:
I20260709 13:06:53.215152 21907 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:53.218575 21904 rpcz_store.cc:276] 0709 13:06:50.102404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.211868 (+3109464us) service_pool.cc:224] Handling call
0709 13:06:53.212921 (+  1053us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:53.228340 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.215864 26030 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:53.227335 25690 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:06:53.240517 21978 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:53.230790 26097 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:53.247043 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:53.234380 25891 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.234946 25925 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:53.252411 21981 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:53.241881 26123 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:53.254606 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 5b63bdc0c16e46fe907a6ef4f7f26653: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:53.249908 26157 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:53.250531 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 462) took 3365 ms. Trace:
I20260709 13:06:53.250972 21828 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:53.249410 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 469) took 1455 ms. Trace:
I20260709 13:06:53.241010 25870 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:53.254125 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 75404.4us
W20260709 13:06:53.254405 26204 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:06:53.254876 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 43490.7us
I20260709 13:06:53.248687 26097 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.242508 26129 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:53.268211 25690 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:53.264391 25870 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:53.259002 26131 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:06:53.271216 26154 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:53.258569 21908 rpcz_store.cc:276] 0709 13:06:49.861760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.418760 (+557000us) service_pool.cc:224] Handling call
0709 13:06:50.419124 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.419376 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:50.607379 (+188003us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.078505 (+2471126us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b180033a780. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:06:53.222147 (+143642us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.225577 (+  3430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.225651 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:53.225757 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.225846 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.227334 (+  1488us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":191071,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":33450,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":210,"spinlock_wait_cycles":153527296,"thread_start_us":61202,"threads_started":1,"wal-append.queue_time_us":2626269}
I20260709 13:06:53.276466 25870 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.258912 26057 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:53.279088 26057 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:53.279258 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.279521 26057 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:53.281312 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.274629 25876 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.282855 25761 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:53.282583 25876 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.283314 25761 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:53.283550 26070 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:53.283991 26070 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.284350 26070 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.282609 21983 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:53.287889 26154 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.259064 21902 rpcz_store.cc:276] 0709 13:06:51.747901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.510801 (+762900us) service_pool.cc:224] Handling call
0709 13:06:52.511084 (+   283us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:52.675365 (+164281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.675427 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:52.676462 (+  1035us) log.cc:844] Serialized 52 byte log entry
0709 13:06:52.692111 (+ 15649us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:52.692148 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.191558 (+499410us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b54002f62d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:53.191597 (+    39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.191636 (+    39us) raft_consensus.cc:1685] finished
0709 13:06:53.191647 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.203400 (+ 11753us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22990,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":16767,"spinlock_wait_cycles":12107648,"thread_start_us":166135,"threads_started":2,"wal-append.queue_time_us":15716}
I20260709 13:06:53.299006 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:53.267505 26097 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.305352 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:53.306113 26131 raft_consensus.cc:2764] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:06:53.308640 25980 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:53.309160 25980 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.309592 25980 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.275421 26168 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.294013 26129 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.266419 25891 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.319753 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:53.325768 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:53.284405 25761 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.315683 25690 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:53.330675 21975 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:06:53.291690 26157 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.348285 26000 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.348536 26001 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:53.353817 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.335206 26131 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:53.322285 26070 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.359862 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:53.346378 25690 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.364266 26002 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:53.364956 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2136) took 3073 ms. Trace:
W20260709 13:06:53.365764 26014 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:06:53.365856 25908 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:53.366358 25908 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.366703 25908 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.368580 21830 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:06:53.376776 26209 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:06:53.376652 25834 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:53.377285 25834 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:53.378468 21909 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:53.378552 26146 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:06:53.380574 25834 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.381793 25834 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.383687 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:53.384037 26081 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.384969 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.387275 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:53.388131 26168 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:53.388688 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:53.389484 26168 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:53.391395 25842 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:53.365418 21828 rpcz_store.cc:276] 0709 13:06:50.291657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.317548 (+ 25891us) service_pool.cc:224] Handling call
0709 13:06:53.226002 (+2908454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.274793 (+ 48791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.364737 (+ 89944us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b540008a550. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:53.364897 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6618360576}
I20260709 13:06:53.349006 26000 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:53.396842 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 82222.5us
I20260709 13:06:53.355944 26001 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:53.392131 25842 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:53.375538 26123 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:53.395617 26002 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:53.402938 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:53.404122 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44344.7us
I20260709 13:06:53.405718 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:53.405850 21977 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:06:53.406507 21977 pending_rounds.cc:85] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 6
I20260709 13:06:53.407527 21977 pending_rounds.cc:107] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:06:53.407800 21977 raft_consensus.cc:2889] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.400082 25842 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.375294 25870 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.411757 26057 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.404683 26002 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.424440 25980 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.419580 21828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:53.425498 21828 raft_consensus.cc:606] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:53.430491 25859 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:53.424849 26002 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.420127 26129 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.430881 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.415462 25842 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.430897 25859 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:53.435873 21798 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.418844 26168 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:53.438971 25859 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.440076 26168 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:53.440501 26168 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.441614 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:53.449781 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:53.413939 26001 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.451984 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:53.455037 21798 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:53.447193 25891 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.462831 25701 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:53.463161 26057 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:53.463249 25701 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.463709 25701 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.463539 26147 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:53.464183 25992 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:53.464564 25992 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.464588 26147 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:53.465040 25992 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.465219 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.450434 26055 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:53.450572 26146 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:53.477993 25978 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:53.478441 25978 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:53.478686 25930 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.479338 25978 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.480917 25978 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.482431 25665 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:53.484614 26070 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.485229 26031 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:53.485672 26031 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.486002 26031 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.470978 26085 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:06:53.489449 26085 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:53.490329 25876 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.490896 25876 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.491458 25876 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.494016 26097 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.496245 26097 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:53.499917 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.500849 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.502360 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:53.471261 25925 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:53.504976 25870 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.507643 26001 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:53.502655 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:53.457641 26123 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:53.509729 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:53.515419 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:53.502686 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.515750 26090 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:06:53.517812 26121 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:53.508580 26057 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:06:53.514317 26203 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.244s	user 0.000s	sys 0.004s
I20260709 13:06:53.519348 25925 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:53.520413 25925 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:53.521714 26154 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.521382 25925 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.522926 25925 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.523684 26037 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:53.518206 26121 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:53.524556 26037 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:53.524987 26037 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:53.525460 26121 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.525863 26037 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.546123 21901 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:06:53.546401 26037 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.546640 22519 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:53.534633 25876 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.547593 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:53.548062 25876 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.536882 26031 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.541764 26157 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.542415 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:53.539933 25842 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.544797 21909 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:53.549845 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:53.546509 21901 pending_rounds.cc:85] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 7
I20260709 13:06:53.548271 21908 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:53.549798 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:53.550333 25769 consensus_queue.cc:1175] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 10 last_received_current_leader { term: 13 index: 11 } }
I20260709 13:06:53.550675 21901 pending_rounds.cc:107] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:06:53.551023 21901 raft_consensus.cc:2889] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.548520 21900 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:06:53.551836 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:53.552176 26014 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:53.552443 21902 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.551014 21904 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:53.553108 26121 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.552681 26014 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:53.554080 26014 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.556774 26031 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.543367 22547 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:53.558207 26157 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:53.559005 25930 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:53.529083 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:53.558346 25842 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.561004 26068 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:53.561182 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.561614 26068 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:53.562668 26068 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.577175 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.585860 21902 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:53.583695 22546 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:06:53.594745 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.595567 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:53.598018 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.457641 25977 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:06:53.599016 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.607271 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:53.608172 21834 raft_consensus.cc:606] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:53.569538 25842 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.563942 26157 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:53.612241 21827 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:53.615329 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:53.595369 26090 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.593674 26092 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.619593 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:53.621891 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 156729us
I20260709 13:06:53.621500 21829 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
W20260709 13:06:53.606717 21799 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 3.087s (SENT) [suppressed 21 similar messages]
I20260709 13:06:53.629156 21979 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:53.623426 21831 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:06:53.600891 26000 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:53.617197 25889 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:53.618453 26157 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:53.637615 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:53.641866 21904 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:53.632242 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.638949 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.642354 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.643261 21829 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:53.602521 25891 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:06:53.602099 26184 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:06:53.643262 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:53.643831 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44821.9us
I20260709 13:06:53.599892 26172 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:06:53.607834 25690 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:06:53.645226 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.650766 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:53.650588 21902 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:53.659344 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.661397 26000 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:53.661931 26000 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.662338 26000 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:53.662804 26214 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:06:53.664366 26014 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.665201 25908 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.667194 25701 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.631487 26031 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:06:53.674996 21829 raft_consensus.cc:606] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:53.675377 21829 raft_consensus.cc:614] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:53.638667 26092 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.687659 25984 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:53.688735 25984 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:53.689128 25984 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:53.690546 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:53.691234 21904 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:53.691169 25992 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.694638 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:53.695581 21900 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:53.697763 25980 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:53.694805 21908 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:53.680687 26012 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:53.700353 26123 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:53.700387 25690 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:06:53.700847 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.701120 26123 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:53.701602 26014 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.701648 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:53.702837 26123 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.704175 26123 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.693719 26002 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.706369 25984 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.647965 26113 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:06:53.630090 26090 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.706986 26218 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:53.714941 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:53.717394 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 58184us
I20260709 13:06:53.708369 25876 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:53.700763 25992 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.709719 25984 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.718993 25599 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:53.719535 25599 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:53.720403 25599 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.653184 25889 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:53.724426 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.726257 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 99130.8us
I20260709 13:06:53.707665 26057 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.732966 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:53.701390 25690 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:53.736624 21832 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:53.730444 26012 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:06:53.718070 25930 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.740389 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:53.741190 21902 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:53.742079 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:53.742297 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 135730us
I20260709 13:06:53.742717 21901 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:53.744472 25980 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.744776 21827 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:53.745002 25980 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.747516 25980 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.749432 26218 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.750116 26090 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.751727 26218 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.754580 26092 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.755939 25889 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.757184 25842 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:53.735076 25859 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.759423 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.760003 25859 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.761597 25767 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:53.762280 25767 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:53.762838 26168 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.765115 26168 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.766913 21833 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:53.754282 26057 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.773123 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.776263 21902 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:53.785701 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:53.786501 22546 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:53.743714 25930 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:53.789774 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:53.790414 21903 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:06:53.791519 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.796761 21827 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:53.792968 21903 pending_rounds.cc:85] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 5
I20260709 13:06:53.802682 21903 pending_rounds.cc:107] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:06:53.802976 21903 raft_consensus.cc:2889] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.778211 26012 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:53.809834 21831 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:53.784355 25842 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.812629 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.791096 26168 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.820166 21977 raft_consensus.cc:2368] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14.
I20260709 13:06:53.819363 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.787604 26113 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:06:53.827701 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:53.830646 21979 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:53.827950 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.834028 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.834587 21827 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.837143 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.838546 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.824579 25842 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.842968 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.846791 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.847390 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:53.848376 26080 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.849117 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.827049 25992 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:06:53.853049 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.853958 21978 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:53.838850 25690 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.884548 21979 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.885180 25690 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.829594 26168 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.843268 26081 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:53.848922 26080 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.892539 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.849825 26002 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.898003 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.891266 26081 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.902762 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.910076 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.910957 21832 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:53.912034 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.912529 21832 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.920360 25842 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:53.931700 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:53.932520 21832 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:06:53.934342 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.936407 21830 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:53.942212 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.944010 21979 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:53.944303 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.945079 26168 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:53.945571 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.946269 22546 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:53.946669 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.947053 26131 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:53.947443 26131 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:53.948170 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:53.948473 26131 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.949839 26131 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.947652 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.950645 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:53.968191 21978 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.951221 26057 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:53.950874 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.967701 21828 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:53.966879 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.970482 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:53.959019 26081 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.972184 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.973528 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.971063 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.975549 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:53.976485 21828 raft_consensus.cc:2410] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:53.977475 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.978134 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:53.978192 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:53.978508 21831 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:53.980055 21978 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:06:53.981789 25897 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:53.982389 25897 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:53.983305 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.983232 25897 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:53.984010 21831 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:53.980641 25842 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:53.985750 21831 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:53.987351 25889 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:53.956954 26000 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:53.991540 21827 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:53.995529 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:53.994479 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:06:53.997979 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.999228 21828 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:54.001636 26154 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:53.906867 26157 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.005366 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.002624 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:54.006714 21978 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:54.007937 21979 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:06:54.002188 21909 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:06:54.009191 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.992686 25842 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:54.010632 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:54.010632 21977 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:54.013489 25891 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:54.013777 21834 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:06:54.014037 25891 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:54.014987 25891 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.015576 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:54.016790 26146 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:54.019202 22546 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:54.023437 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.023976 21978 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 7: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:54.030930 25889 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:54.033385 26157 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:54.038228 26139 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:54.042686 25842 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.002141 26154 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:54.052858 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.053520 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.055289 21832 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:54.056540 21827 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:54.058410 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:54.060868 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.061831 21978 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:06:54.079427 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.080222 21827 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:54.080471 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:54.081036 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:54.081208 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:54.083062 21827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:06:54.085445 25908 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:54.056064 25897 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:06:54.056334 26090 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:54.086961 26030 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:54.087402 26090 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.087585 26030 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:54.091936 26090 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.092736 26030 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.093858 26030 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.054507 26070 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:54.095212 26070 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:54.095654 26070 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:54.050639 26154 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.096838 26113 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:54.096688 26070 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.097458 26113 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.054462 26031 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:54.099448 26031 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:54.099830 26031 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:54.100899 26031 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.022756 25859 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:06:54.105993 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.107347 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.109350 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.110323 21983 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:54.110745 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.111358 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.112228 21982 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:54.113358 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.114311 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.115223 21979 raft_consensus.cc:2393] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:54.088255 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:54.090920 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.117316 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:54.119454 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 103024us
I20260709 13:06:54.128345 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.129735 21834 raft_consensus.cc:2410] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:06:54.134341 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:54.134367 25925 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:54.135452 25925 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:54.135524 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:54.135977 25889 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:54.136368 25889 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.136682 25889 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.137079 25925 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:54.137588 25925 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:54.137619 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:54.138265 21908 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.138288 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:54.139780 25767 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:54.138918 25925 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.139269 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:54.141460 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.140983 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.142356 21907 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:06:54.145639 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:54.143119 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:54.142686 21981 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:54.143404 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.147898 21982 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:54.120806 26012 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:54.150774 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:54.149525 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:54.149027 21905 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:54.141928 26031 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.141980 26070 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.165527 21905 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:54.163758 21906 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:54.114528 26081 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.149008 26113 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:54.168394 26000 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:54.168869 21905 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:54.168650 25930 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.170284 25859 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:54.170872 25859 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:54.173069 26081 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:54.159101 25984 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:06:54.153944 26121 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:54.178784 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:54.175547 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.173978 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.151072 26012 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:54.180325 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:54.188580 21906 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:54.191625 21906 pending_rounds.cc:85] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 4
I20260709 13:06:54.191898 21906 pending_rounds.cc:107] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:06:54.192117 21906 raft_consensus.cc:2889] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.171931 25859 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.221872 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:54.222584 22546 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:54.190655 25984 consensus_queue.cc:1243] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:54.178139 25930 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:54.242120 22546 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
W20260709 13:06:54.246484 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 443956us
W20260709 13:06:54.250260 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 109369us
I20260709 13:06:54.228847 25992 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:54.254549 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:54.255802 21825 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:54.253185 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.191370 25876 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:06:54.259680 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:54.264930 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 73625.5us
I20260709 13:06:54.266801 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:54.268360 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 155065us
W20260709 13:06:54.270777 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.259133 25599 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.259430 26238 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:54.282953 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.283627 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.250696 26222 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:54.273602 26000 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:54.279604 26238 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.260911 25992 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.302237 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.299537 26238 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:54.305653 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 125393us
I20260709 13:06:54.279606 25984 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:54.286875 26068 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.309653 26218 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.310250 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.309664 26146 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:54.312870 21977 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:06:54.315659 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48978.3us
I20260709 13:06:54.316401 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.298578 26000 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:54.315198 26240 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:06:54.318488 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:54.319419 21979 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:54.320254 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.286466 25767 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:06:54.331457 22547 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:06:54.331830 21825 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:54.322999 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.334259 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.334932 21979 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 13: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:54.324766 21983 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
W20260709 13:06:54.328066 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.343935 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.344691 21980 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:54.345337 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:54.345643 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:54.347987 21976 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:54.323256 26000 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:54.346276 22555 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:54.351066 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.354220 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:54.354658 21873 leader_election.cc:400] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14.
I20260709 13:06:54.354894 21873 leader_election.cc:403] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.330732 25701 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:54.342957 26234 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:06:54.339217 25876 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:54.347064 25767 consensus_queue.cc:1243] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:54.358587 22549 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:54.344821 26251 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:54.362926 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.372852 21977 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:54.372790 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.363529 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.353394 26074 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.373857 21976 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:54.338748 26092 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:54.360303 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.377274 21979 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:54.370772 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:54.349213 26057 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.372071 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.336455 25891 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:06:54.330499 26218 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.360743 25984 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:54.316835 26068 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.386287 26057 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.387240 25978 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:54.388057 26242 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:06:54.346432 26085 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:06:54.388679 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:54.389266 26074 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.388886 26092 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.416954 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:54.446444 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:54.485945 22553 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:54.371793 26251 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:54.417431 26002 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:54.479785 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.486769 26241 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.196s	user 0.001s	sys 0.004s
W20260709 13:06:54.487066 26131 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.004s
W20260709 13:06:54.497634 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 124908us
I20260709 13:06:54.498103 21977 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:06:54.483376 21908 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:06:54.502286 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:54.486543 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:54.548897 21906 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.520396 21982 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:54.522017 21979 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:54.551043 21974 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:06:54.511329 25978 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:54.530112 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 141489us
I20260709 13:06:54.556705 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:54.489670 25908 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:06:54.532074 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.537963 22554 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:54.561844 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.543288 25599 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:54.523594 21902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.046s	sys 0.105s
W20260709 13:06:54.552302 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 65828.5us
W20260709 13:06:54.567605 21902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.046s	sys 0.105s
I20260709 13:06:54.560454 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.539897 21980 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:54.569415 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:54.563776 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 72583.8us
I20260709 13:06:54.537957 25690 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:54.544003 26002 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.544323 25767 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.571763 21873 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:54.573719 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.572186 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:54.563243 25978 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.578495 25767 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.582243 26218 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:54.583180 26074 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:54.570693 25876 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:54.584777 26090 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.587749 26092 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:54.588644 21834 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 4.
I20260709 13:06:54.589665 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:54.590894 25992 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:54.591310 25889 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.594188 25701 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:06:54.572834 25908 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.598661 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:54.599783 25761 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:54.553416 25977 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.553177 26123 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:54.601617 26251 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.633421 21827 raft_consensus.cc:606] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:54.633864 21980 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:54.577209 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.637713 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2122) took 2251 ms. Trace:
I20260709 13:06:54.639997 21906 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:54.675688 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:54.574997 26131 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:54.594753 26002 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.671337 21900 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:54.683542 21906 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:54.682463 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 125843us
I20260709 13:06:54.683815 21831 raft_consensus.cc:2368] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12.
I20260709 13:06:54.670935 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:54.685284 21907 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.685864 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:54.686700 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:54.674319 21903 rpcz_store.cc:276] 0709 13:06:52.386042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.928617 (+542575us) service_pool.cc:224] Handling call
0709 13:06:52.928974 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.821074 (+892100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.633739 (+812665us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400236ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:54.637631 (+  3892us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976357120}
I20260709 13:06:54.682937 21827 raft_consensus.cc:614] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:54.658155 26147 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:54.660665 26218 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:54.662029 26085 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:54.690508 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:54.704375 21901 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:54.706933 21900 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:54.708778 21900 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:06:54.670802 26037 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.716642 21900 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:06:54.721000 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:54.672996 25761 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:54.725883 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 177364us
I20260709 13:06:54.726925 21906 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
W20260709 13:06:54.730454 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44204.3us
I20260709 13:06:54.721441 21900 pending_rounds.cc:85] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 6
I20260709 13:06:54.730919 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:54.731745 21900 pending_rounds.cc:107] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:06:54.739641 21900 raft_consensus.cc:2889] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.689460 26123 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:54.748456 21903 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.745278 21907 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:54.747633 21901 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:54.712889 26248 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:54.721319 25876 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:54.729178 26070 consensus_meta.cc:287] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.007s
I20260709 13:06:54.753003 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.686631 25977 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.751596 26081 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:54.739548 26264 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:54.725601 26147 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.731540 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:54.724413 26131 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:54.739609 26251 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:54.739705 26239 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:54.752102 26269 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:54.712412 26146 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:54.732236 21906 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:54.763908 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:06:54.764540 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 192870us
I20260709 13:06:54.721025 26085 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.754577 26068 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:54.725649 26037 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.760599 26081 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:54.774226 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:54.760267 25992 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:54.777451 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:54.743546 25701 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:54.779520 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48028.3us
I20260709 13:06:54.780900 25701 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:54.782215 25701 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.785880 25690 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:54.790655 26256 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:06:54.790460 26263 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:06:54.784264 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.798091 21833 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:54.772323 26269 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.798522 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:54.805090 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.805678 21903 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:06:54.806035 21903 pending_rounds.cc:85] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 5
I20260709 13:06:54.806306 21903 pending_rounds.cc:107] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:06:54.806538 21903 raft_consensus.cc:2889] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.806833 21903 pending_rounds.cc:107] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:06:54.807065 21903 raft_consensus.cc:2889] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.809042 26085 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:54.791867 26268 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:54.810107 26268 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:54.811198 25767 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:54.811321 26037 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:54.773260 26270 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:54.810963 26268 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:54.819592 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.811780 25767 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:54.815018 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.811962 25908 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:54.799556 25876 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:54.837863 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53699.6us
I20260709 13:06:54.803166 26269 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.836961 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.841750 21982 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:54.846367 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.846419 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.847162 21982 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
W20260709 13:06:54.842612 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 270490us
I20260709 13:06:54.802685 26249 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:54.812222 26090 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:54.848423 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.850689 21976 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:54.851454 21978 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:54.836431 26037 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:06:54.860049 21873 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:54.862974 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.865365 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.839654 26113 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:06:54.846354 25889 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:54.869208 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:54.871187 26276 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.871865 26276 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.864153 26271 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:54.874423 26272 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:54.875615 26271 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:54.875572 26272 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:54.876377 26271 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:54.876430 26272 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:54.880759 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:54.859632 26270 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:54.839030 26085 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:54.862901 25908 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.852392 26273 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:54.865052 26263 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:54.842186 26131 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.895500 21982 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:54.858515 26245 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:54.889304 25984 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14.
I20260709 13:06:54.893457 26270 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:54.913196 21975 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:06:54.908569 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:54.915819 22554 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:54.862546 25978 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:54.899329 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 56608.4us
I20260709 13:06:54.902298 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:54.902571 22553 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:06:54.903575 26080 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:54.894856 25908 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.904626 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:54.887440 26037 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:54.920081 22549 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:54.877594 26271 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.934895 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:54.916446 26000 consensus_meta.cc:287] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:06:54.893713 26263 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:54.941681 21975 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:06:54.944430 26244 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.612s	user 0.004s	sys 0.000s
I20260709 13:06:54.947724 21980 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:06:54.948673 21982 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:06:54.896668 26280 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:54.953783 25908 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:54.953967 26012 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.955133 26012 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:54.956141 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:54.932055 26037 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:54.964071 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.950920 26280 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:54.964982 26037 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.946973 26263 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:54.975894 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 106727us
I20260709 13:06:54.976938 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.947793 26000 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.968991 26280 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:54.982892 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.896649 25690 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.993413 21981 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:54.913410 26270 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:54.983378 26085 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.000054 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:55.009032 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:54.995501 26123 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:55.011766 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:55.012142 26123 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.012622 26123 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.023120 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:54.989303 26080 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:55.008122 25876 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:55.028622 26291 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:55.028993 25978 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:54.995587 25992 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.029567 26275 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:06:54.996367 26272 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.040366 25977 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.040897 26002 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:54.995409 25908 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:06:55.042599 25908 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:55.042944 25908 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:55.043718 25908 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.031679 25984 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:55.047714 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:06:55.034319 26238 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.723s	user 0.008s	sys 0.003s
I20260709 13:06:55.055976 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:55.056540 21974 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.054032 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:55.027011 25889 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:06:55.018349 26085 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.030141 26090 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:06:55.048359 26272 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.049372 26291 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:55.033913 26251 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:06:55.063100 25908 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:55.064087 25930 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.046269 25992 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.061674 26080 raft_consensus.cc:2764] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:06:55.053884 26068 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:06:55.052349 26238 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.080348 25876 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.095688 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:55.096208 21977 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.100139 22547 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:55.101298 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:55.102797 26037 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.108626 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:55.109277 22547 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.109556 26037 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.111135 26247 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:55.111573 26247 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:55.116611 26154 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.117427 21974 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:55.119480 26085 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:55.119665 26259 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.354s	user 0.000s	sys 0.002s
I20260709 13:06:55.122020 21983 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:06:55.122419 21983 pending_rounds.cc:85] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 5
I20260709 13:06:55.122646 21983 pending_rounds.cc:107] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:06:55.122900 21983 raft_consensus.cc:2889] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.123826 26238 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.124469 26123 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.126332 21826 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:55.126569 26184 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:55.127103 26184 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:55.128206 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:55.128121 26184 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.129446 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:55.107266 26253 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.723s	user 0.004s	sys 0.002s
I20260709 13:06:55.107649 26002 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.101420 22552 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:55.131069 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2069) took 1051 ms. Trace:
I20260709 13:06:55.080514 26270 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.106418 26291 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.130132 21826 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:55.131570 21831 rpcz_store.cc:276] 0709 13:06:54.080125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.080238 (+   113us) service_pool.cc:224] Handling call
0709 13:06:55.130834 (+1050596us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b5400020154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:55.130985 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382744448}
I20260709 13:06:55.135133 21983 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:06:55.141845 22547 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:55.080880 25930 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.148665 25930 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:55.149031 26285 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:55.149262 22553 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:55.150424 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:55.150722 26184 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.151010 21831 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.153148 21977 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
W20260709 13:06:55.155401 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.155578 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.159184 21826 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:55.160112 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:55.161213 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:55.162797 26293 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:55.165290 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34370 (request call id 52) took 1082 ms. Trace:
I20260709 13:06:55.169507 25767 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:55.169952 25767 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:55.170887 25767 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.172139 25767 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:55.165786 21827 rpcz_store.cc:276] 0709 13:06:54.082783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.082904 (+   121us) service_pool.cc:224] Handling call
0709 13:06:54.345100 (+262196us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b5800010598. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fbac40 00007fb763fa6bb9 00007fb763fa647c 00007fb75d52c7d4
0709 13:06:55.165035 (+819935us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540008af54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd8853 00007fb763fa660a 00007fb75d52c7d4 00007fb75d52c762 00007fb75d52c691 00007fb75d52c60c 00007fb75d52b8c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:55.165183 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673249792}
W20260709 13:06:55.179241 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.136528 26002 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:55.182983 21831 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:55.182691 26002 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.125451 25761 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.145079 26270 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.118080 26269 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.188465 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:55.191896 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:55.193161 22552 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:06:55.193673 21974 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:55.194043 26269 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.192020 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:55.198427 26289 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:55.198805 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.199081 26002 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.199707 26264 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:55.200073 26264 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:55.189231 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:55.192196 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:55.202024 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:55.202538 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:55.203398 25978 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:55.203584 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:55.204308 25977 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:55.204962 25977 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:55.205251 26147 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.205442 25977 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:55.206351 25977 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.207267 25930 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.207744 25930 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:55.208685 26246 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.834s	user 0.000s	sys 0.005s
I20260709 13:06:55.209781 25930 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.210083 26272 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:55.192030 26085 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:06:55.211105 26085 consensus_queue.cc:1243] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:55.211525 26272 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:55.211828 26272 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:55.212568 26272 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.198830 26289 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.213593 26289 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.213639 26272 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.215312 21904 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:06:55.215378 26123 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.215828 21904 pending_rounds.cc:85] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 6
I20260709 13:06:55.216166 21904 pending_rounds.cc:107] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:06:55.216396 21904 raft_consensus.cc:2889] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.220359 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:55.221118 22555 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 7.
I20260709 13:06:55.225346 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.227756 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.228183 26263 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.200811 26264 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.192309 26270 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:55.233726 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.234864 26264 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:55.236310 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.237551 21978 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 10. Ops: [8.7-8.7]
I20260709 13:06:55.238237 21908 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:55.243085 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.244822 21902 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:06:55.274742 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:55.278879 21909 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:55.279131 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:55.245149 26270 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.294328 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 246665us
I20260709 13:06:55.295253 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.245574 26269 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.298151 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:55.298831 21981 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.198859 26280 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.300958 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:55.302255 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:55.304474 21902 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.304603 21909 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:55.250056 26157 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:55.269948 26263 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.300735 21908 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:06:55.309868 21903 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:55.274369 26123 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:06:55.274498 26268 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:06:55.278472 26218 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:06:55.334954 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:55.336884 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.307869 26154 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:55.345316 21981 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:06:55.346582 21826 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:55.351300 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:55.301702 26270 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.353714 21902 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:55.354064 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.307164 26269 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.357188 21874 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:55.315850 26157 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.362699 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.362785 21874 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:55.365829 26297 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:06:55.357697 26080 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.370990 26280 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.371822 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:55.356719 25908 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.356628 26263 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:55.375783 26291 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:55.376086 26263 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:55.376528 26291 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:55.377312 26291 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.377709 26291 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.378328 26273 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:55.378712 26273 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:55.379787 25992 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.379515 26273 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.380769 26273 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.375168 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:55.377069 26263 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.385017 26081 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.385946 26291 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.383036 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.374543 25908 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.383971 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.388216 21903 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:55.384307 26074 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:55.390573 26085 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.390842 26074 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:55.391343 26074 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.391207 26085 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.392539 25992 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.392845 26269 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.393018 25992 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.394490 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:55.395051 21975 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:55.395319 26157 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.395670 25992 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.395949 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.396513 21900 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:06:55.397385 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:55.397531 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.398366 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.398732 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.398993 21829 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:55.398327 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:55.357949 25977 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:55.388300 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.401324 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:55.383344 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.376021 26262 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.402501 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.403183 21902 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:55.403723 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:55.404139 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.405521 21900 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:55.406127 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:55.406827 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.407701 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.408470 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.410290 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:55.410436 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.410842 22547 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:55.409250 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.412081 21901 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:55.387544 26081 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.420699 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:55.452165 26300 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:06:55.388376 26080 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:55.455613 26270 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.455987 26222 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:55.456082 26092 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:55.456447 26222 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:55.456866 26222 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.411561 26157 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:55.462957 26295 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:06:55.464952 26304 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:55.466416 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:55.467190 22546 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:55.469165 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:55.469851 21980 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:55.423303 25992 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:55.410962 26269 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:55.474745 26289 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.453130 26280 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.475404 26074 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.475916 26280 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.476897 26289 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.477353 26074 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.418318 26218 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:55.487210 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:55.487926 21829 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.489698 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:55.505642 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.453979 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:55.529745 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 75864.4us
I20260709 13:06:55.530666 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:55.532039 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:55.536799 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:55.549381 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:55.553325 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.413094 26168 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:55.566058 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.454393 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:55.627388 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 61435.4us
I20260709 13:06:55.482450 26218 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.494477 26123 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:55.644721 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.534334 26074 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:55.537551 26289 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:55.539016 25978 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:55.538851 26268 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:55.547945 26280 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.557932 25992 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:55.664812 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.666097 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:55.646059 26074 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.671233 21907 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
W20260709 13:06:55.672968 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.648402 26218 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:55.647985 26123 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.648260 25690 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:55.650080 25701 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.657284 26268 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.692540 26266 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:55.693516 26257 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:55.669799 26074 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.694058 21906 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:55.700526 22520 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:55.705927 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.709167 26184 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.672873 26280 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.682037 25690 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.682363 26123 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:55.722914 21976 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:55.722028 25930 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:55.723987 26184 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.691383 26268 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.736099 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:55.673944 25992 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.732957 25690 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:55.691566 25701 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:55.762022 26272 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.012s
I20260709 13:06:55.779495 21829 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:55.759016 26262 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:55.732467 26280 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.786901 21980 raft_consensus.cc:2393] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:55.787025 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 2184) took 1539 ms. Trace:
I20260709 13:06:55.789017 21834 rpcz_store.cc:276] 0709 13:06:54.247802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.251299 (+  3497us) service_pool.cc:224] Handling call
0709 13:06:55.786811 (+1535512us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540008a554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:55.786973 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754194688}
W20260709 13:06:55.792832 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 76439.7us
I20260709 13:06:55.796574 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.797192 21906 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:55.798032 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:55.787968 26184 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.806824 26276 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.807512 26000 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.808650 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:55.815407 22554 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:55.810736 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:55.818727 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:55.819300 26085 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.819461 21873 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:06:55.820477 26168 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:55.821035 26168 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:55.821580 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:55.819332 22546 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.786767 26262 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.827068 26157 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:55.844902 26157 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:55.845260 26157 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:55.845868 25701 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.846030 26157 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.847219 26157 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.847784 26262 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.849431 26280 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.854569 25599 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:55.855121 25599 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.857045 25599 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.793511 26222 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.858322 25842 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:55.859129 22546 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:55.859910 26222 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.858768 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2164) took 1079 ms. Trace:
I20260709 13:06:55.828321 26000 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:55.828742 26080 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.863987 21982 rpcz_store.cc:276] 0709 13:06:54.779632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.937216 (+157584us) service_pool.cc:224] Handling call
0709 13:06:54.938724 (+  1508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.949052 (+ 10328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.858566 (+909514us) spinlock_profiling.cc:243] Waited 9.64 ms on lock 0x7b54002c8b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:55.858717 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22164864}
I20260709 13:06:55.864434 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:55.865538 22546 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:55.822561 25930 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:55.865967 25930 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.866374 25930 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.866480 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:55.869371 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:55.834542 26308 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:06:55.821990 26168 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.873255 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:55.873483 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:55.827782 22553 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:55.832791 25761 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:55.838569 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 741707us
I20260709 13:06:55.881605 21875 leader_election.cc:400] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12.
I20260709 13:06:55.840392 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2150) took 1699 ms. Trace:
I20260709 13:06:55.840633 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:55.842064 26090 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:55.842322 25897 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:55.843262 26249 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:55.880959 26267 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.895469 25897 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:55.895367 26267 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.895907 25897 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:55.896306 26080 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:55.891776 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:55.896751 25897 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.897464 26267 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.858810 25842 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.899395 25842 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.865402 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.900557 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:55.869923 21909 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:55.901110 21901 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.901541 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:55.874012 21978 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:06:55.902182 25930 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.877089 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.877777 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.903374 21907 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:55.903822 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.904088 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.904433 21906 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:55.904706 21907 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:06:55.905242 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.905489 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:55.905776 21906 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:55.882144 21981 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:06:55.906692 21982 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:06:55.907163 21981 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:55.907846 21982 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:55.882535 21830 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:55.882543 21904 rpcz_store.cc:276] 0709 13:06:54.141254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.141480 (+   226us) service_pool.cc:224] Handling call
0709 13:06:54.141726 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.227403 (+1085677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.840152 (+612749us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400076f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:55.840333 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468190592}
I20260709 13:06:55.822832 26074 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.909471 21901 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:55.912132 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2190) took 1055 ms. Trace:
I20260709 13:06:55.912252 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:55.913152 21975 raft_consensus.cc:2410] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:06:55.887360 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.914045 21828 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:06:55.889089 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.796075 26037 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:55.858047 25599 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.890770 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.891712 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.929256 21831 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:06:55.891903 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:55.882462 26000 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.892800 21833 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:55.897580 21974 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.932184 21829 raft_consensus.cc:2410] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:55.921748 26257 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:55.836572 25908 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.906086 21907 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 7.
I20260709 13:06:55.889869 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:55.918711 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.913455 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:55.923215 21730 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:55.941967 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 52165.7us
I20260709 13:06:55.924219 26276 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:55.924784 25690 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.926863 21908 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:55.913620 26113 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.928790 21904 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:06:55.900758 26291 consensus_meta.cc:287] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 13:06:55.912504 21832 rpcz_store.cc:276] 0709 13:06:54.832902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.836097 (+  3195us) service_pool.cc:224] Handling call
0709 13:06:54.843684 (+  7587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.844001 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:55.661167 (+817166us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b18004b7060. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf
0709 13:06:55.661345 (+   178us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.887995 (+226650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.888039 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:55.888091 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.888175 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.888309 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100453,"prepare.queue_time_us":111878,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2794,"raft.queue_time_us":104852,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":73,"spinlock_wait_cycles":8653696,"thread_start_us":220422,"threads_started":2}
I20260709 13:06:55.943094 21828 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:55.944551 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.958902 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.959194 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.948544 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:55.943193 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:55.927567 26307 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.197s	user 0.003s	sys 0.000s
W20260709 13:06:55.963725 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.927824 26074 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.974902 26081 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:55.951443 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:55.958613 26113 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.977667 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:55.978258 21904 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.979281 26113 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:55.956689 26222 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:55.980269 26222 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:55.980614 26070 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:55.981205 26222 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.966962 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:55.966997 26287 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:55.967871 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.934002 25599 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.969875 26218 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:55.941829 26257 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:55.970425 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:55.971233 21979 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:06:56.012753 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.948065 26031 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:56.013281 22546 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:55.913942 26268 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.972057 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.971978 26291 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.972754 25690 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:55.972697 26085 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:55.967057 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:55.986876 26287 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:55.988547 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:55.988782 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 148372us
I20260709 13:06:55.936229 26000 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:55.940802 26316 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:55.903858 26090 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:55.987949 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:56.039702 21900 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 8: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:06:56.039623 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51739.4us
I20260709 13:06:56.040912 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:55.989192 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:56.002278 21907 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:06:56.042341 21907 pending_rounds.cc:85] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 6
I20260709 13:06:56.042593 21907 pending_rounds.cc:107] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:06:56.042795 21907 raft_consensus.cc:2889] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:56.041913 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 52787.6us
I20260709 13:06:56.009488 21904 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
W20260709 13:06:55.971500 26273 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260709 13:06:56.014257 21974 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:55.957805 25908 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:56.017099 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.022761 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:56.023869 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:56.023988 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:56.024241 26313 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:56.024438 26147 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.981223 26070 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:56.030422 21827 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
I20260709 13:06:55.988749 25930 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:56.084822 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.999397 26068 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.072320 21901 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:56.072840 22549 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.998062 25842 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:56.047256 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.039063 26316 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:56.047003 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:56.032549 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.123338 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 100695us
I20260709 13:06:56.114617 21827 pending_rounds.cc:85] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 4
W20260709 13:06:56.111064 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 66474.7us
I20260709 13:06:56.115756 26147 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.123833 21978 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:06:56.123905 21827 pending_rounds.cc:107] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 12.5
I20260709 13:06:56.124101 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:56.124401 21827 raft_consensus.cc:2889] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:56.027751 26031 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:56.128279 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 81384us
I20260709 13:06:56.075014 26272 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:56.130628 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 83465.5us
I20260709 13:06:56.075712 25701 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:56.138227 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:56.139571 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.071889 26264 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:56.132107 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:06:56.132993 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.047159 26000 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:56.144490 26000 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.144764 26330 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:56.145030 26000 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.145505 26330 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.118664 25599 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.047276 26251 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:06:56.046398 26280 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:06:56.040499 26123 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.127189 26085 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:56.129238 26074 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.125684 26068 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.141305 26272 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.047331 26238 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:06:56.119418 25977 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:06:56.156237 25908 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:56.072228 25891 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:06:56.142236 26248 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:56.147222 25859 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:06:56.143369 26184 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.160902 26264 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:06:56.181265 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55091.3us
I20260709 13:06:56.183284 26272 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:56.129463 26320 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:56.129387 26289 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:56.142885 26113 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:56.200888 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:56.181349 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57349.7us
I20260709 13:06:56.213857 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.223210 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:56.192418 26248 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.226191 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:56.227583 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.228598 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:56.228947 21829 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:56.229038 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:56.182029 26074 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.210942 25930 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.224020 26147 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:56.201629 26251 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:56.230785 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:56.238243 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:56.159133 26287 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.240624 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:56.242256 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:56.243880 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:56.245396 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:56.246300 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 114263us
I20260709 13:06:56.231316 26248 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.232371 25978 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:56.232612 26113 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:56.224822 25859 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:56.252188 21831 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:06:56.233820 26263 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.199421 26070 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.214696 26184 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.235931 26268 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.259235 21831 pending_rounds.cc:85] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 4
I20260709 13:06:56.268229 21831 pending_rounds.cc:107] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:06:56.268630 21831 raft_consensus.cc:2889] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:56.234536 26329 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:56.226598 25842 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:06:56.225737 26239 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:06:56.237249 26251 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:56.276628 26123 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:56.276765 26251 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.277806 25842 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:56.226796 26289 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.266728 21828 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:56.210062 26257 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.240324 26291 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.247107 26081 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:56.246997 26262 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:56.247321 26269 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:56.250144 26271 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:56.258765 26270 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:56.298085 22549 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:56.278206 25842 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:56.288558 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.291955 26239 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:56.267699 26280 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.278350 26251 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.238843 25930 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.272027 26090 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.273867 26329 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.326488 26329 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.326546 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:56.269830 26264 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:56.300796 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53005.8us
I20260709 13:06:56.261835 26334 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:56.278929 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:56.298863 25767 raft_consensus.cc:2764] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:56.189625 26316 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.309499 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.315428 26257 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.316874 26184 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:56.338757 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 59905us
I20260709 13:06:56.318449 26113 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:56.322281 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.342406 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 75259.2us
W20260709 13:06:56.335055 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 204062us
I20260709 13:06:56.306660 26239 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:56.296437 26031 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.323004 26068 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.343616 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:56.301137 26270 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:56.345391 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:56.345273 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:56.342973 26081 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:56.336573 25930 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:56.342743 25978 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.308830 26262 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:56.351055 21903 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:06:56.348106 26239 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.335909 26334 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.354802 21974 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:56.357818 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.363307 21976 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:56.358330 21975 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:56.343396 26330 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:56.362042 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:56.365345 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:56.346725 26090 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:56.355858 26068 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:56.357501 25761 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:06:56.364822 26074 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.308123 25842 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.365008 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:56.365311 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:56.365440 25978 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.365720 21983 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:06:56.352577 25977 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:06:56.369346 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.365000 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:56.353006 26339 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:56.366700 21909 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:56.383494 21903 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.363545 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.366930 22553 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.374955 21908 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.367120 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:56.385857 21977 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.349712 26316 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:56.332374 26247 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.352099 26270 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.376209 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:56.400339 21901 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:56.377938 21983 pending_rounds.cc:85] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 10
I20260709 13:06:56.379465 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:56.400899 21983 pending_rounds.cc:107] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:06:56.401057 22546 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.401198 21983 raft_consensus.cc:2889] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:56.379742 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:56.380409 22549 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:06:56.372582 26157 consensus_meta.cc:287] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.006s
I20260709 13:06:56.377686 25978 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.373482 25842 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:56.382683 21982 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:06:56.399863 26057 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:56.432973 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 58503.9us
I20260709 13:06:56.445174 22546 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:06:56.446552 21874 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.402424 22547 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:56.440531 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 43870.1us
I20260709 13:06:56.396130 26339 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.368136 26262 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:56.363507 26081 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:56.363196 26280 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:06:56.442548 21909 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:06:56.397990 25767 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.433671 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.369189 26335 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:56.377974 26272 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.370072 26090 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.398084 26271 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:56.443248 21907 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:56.442298 21977 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:56.443634 25859 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.407015 26068 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:56.490217 22547 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:06:56.453855 26247 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:56.492628 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44104.8us
W20260709 13:06:56.590513 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.512820 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.368981 26334 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.444176 25761 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:06:56.444329 26320 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:06:56.450874 26339 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.547921 26336 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:06:56.347045 26333 consensus_queue.cc:1175] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d76b2c4699e43fba10eeb81a91e4913" responder_term: 13 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: [12.9-12.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:56.552008 26262 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.508510 25977 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.554925 26000 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.475646 21903 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:56.558635 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.559587 26264 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.562392 26289 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.546394 26271 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.568806 26248 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.533524 26343 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:06:56.573695 26168 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:56.575804 26319 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.605s	user 0.004s	sys 0.000s
I20260709 13:06:56.559710 26329 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.579715 26218 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:56.590152 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:56.525794 21908 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:06:56.593406 22553 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:56.643715 21831 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.614737 26257 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:56.456550 26157 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:56.651455 26257 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:56.651778 26157 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:56.652910 26157 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.652809 26257 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.444578 26269 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
W20260709 13:06:56.608780 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 50217.8us
I20260709 13:06:56.610931 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.655524 26329 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:56.655427 21833 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:06:56.556676 26335 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:56.618678 26000 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:56.618448 26264 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.657119 26335 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.497112 26031 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:06:56.619211 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:56.658396 26264 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.596506 26074 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.659125 26074 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.661176 26074 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.547035 25767 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.662511 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:56.663269 25767 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.585637 26270 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.665180 26270 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.643151 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.666157 21829 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:56.667402 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:56.668402 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:56.668916 21829 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.670936 26090 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.672380 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:56.672993 22547 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:06:56.674276 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.675071 26272 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:56.675782 26272 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:56.676108 26272 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:56.676451 26272 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.679536 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.680446 21981 raft_consensus.cc:2410] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:06:56.595309 25876 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:06:56.556713 25859 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.595052 25891 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:06:56.497381 26238 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.696802 21829 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:56.702631 21831 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
W20260709 13:06:56.706296 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 113646us
I20260709 13:06:56.707063 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:56.708034 21831 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:56.708181 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:56.708729 21834 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:06:56.675087 26270 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:56.712633 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:56.710049 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.615648 25977 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.709858 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.716282 21828 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:56.716234 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.718753 21974 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:06:56.600179 26081 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:56.716351 21825 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:56.722599 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:56.723747 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.726277 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:06:56.733269 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.734023 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.739722 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50269.8us
I20260709 13:06:56.711380 26123 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.715315 26270 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:56.758262 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.717413 26287 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:56.720192 26341 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:56.704687 26264 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:06:56.769454 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.789722 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.770304 26270 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:56.713347 26238 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.794091 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:56.765453 25761 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:56.711517 26068 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.781942 26343 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:56.807343 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.792537 26341 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:56.770939 26123 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.810588 21828 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:56.772845 26339 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.800024 25876 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:56.833074 22547 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:56.837443 26238 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.805445 26287 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:56.841804 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:56.842638 21720 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.276s	user 0.005s	sys 0.003s
I20260709 13:06:56.898957 26354 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.915343 26353 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:06:56.915445 26354 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.870514 25876 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.914237 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:56.918712 21974 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:06:56.843240 26348 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:06:56.878698 26271 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.910028 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.934248 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:56.936913 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.905604 25992 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.923079 21904 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:56.924633 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:56.940838 22546 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:56.938246 21982 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:06:56.943411 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:56.926496 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:56.927740 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.946587 21833 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:56.947659 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:06:56.908308 21900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 491) took 1355 ms (client timeout 1731 ms). Trace:
I20260709 13:06:56.930970 22520 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:56.880191 26356 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:56.921893 21834 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:06:56.967608 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.938814 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:56.969018 21977 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:56.950358 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.951507 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.901788 26267 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:56.970096 21828 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:06:56.970033 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:56.952709 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.904649 25977 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:56.967574 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:56.948663 21900 rpcz_store.cc:269] 0709 13:06:55.552853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.553027 (+   174us) service_pool.cc:224] Handling call
0709 13:06:56.908078 (+1355051us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54002373d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:56.908211 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116595456}
I20260709 13:06:56.907060 25859 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:56.939877 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:56.972570 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:56.812304 26343 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.973026 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:56.969141 21979 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:56.982089 21833 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:56.987676 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:06:56.973798 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.919075 26248 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:56.842885 26269 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.877815 26341 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:56.989421 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.997761 21828 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
W20260709 13:06:56.999009 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.999787 21827 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:56.989603 21983 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:57.000799 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:56.942121 26002 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.000002 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:57.016852 22546 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:57.004667 26350 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:06:57.002347 25977 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:57.010434 26168 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:56.976222 26000 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:56.982313 26276 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:57.019656 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:56.987933 26113 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:56.984222 25992 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.976055 26267 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:56.936291 26263 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:06:56.989821 25908 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:57.002058 25978 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:57.020895 26037 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:56.941053 26271 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:06:56.879621 26090 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:57.027266 21833 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:06:57.021425 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:57.032832 22546 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:06:57.033001 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:57.020139 26002 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.018905 26329 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:57.040973 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 107237us
I20260709 13:06:57.021747 26168 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.091146 22549 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:06:57.039057 22521 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:56.999787 26335 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:06:57.001041 26269 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.032205 26113 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.046259 22555 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:57.026537 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.047453 25908 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:57.035392 25876 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.035392 22554 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:57.037220 26354 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:57.083112 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:06:57.102300 21732 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33508 (request call id 201) took 29455 ms (client timeout 15000 ms). Trace:
I20260709 13:06:57.103550 21833 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:57.047518 25978 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:57.106643 25978 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.043725 26276 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:06:57.090912 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 99042.6us
I20260709 13:06:57.002686 26287 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.116290 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:57.116503 26354 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:57.092310 26329 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.047731 26090 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:57.098479 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.128955 21827 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:06:57.033812 25977 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:06:57.037418 25992 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:57.113713 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 91268f1f8ef64ef4b455bead2f60e2ff: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:57.115242 26276 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.094158 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.092891 26168 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.125666 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:57.094055 26342 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.130125 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:57.099972 26113 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:57.102746 21732 rpcz_store.cc:269] 0709 13:06:27.586160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.586357 (+   197us) service_pool.cc:224] Handling call
0709 13:06:57.039315 (+29452958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:46.090023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:46.091051 (+  1028us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:46.091130 (+    79us) write_op.cc:435] Acquired schema lock
0709 13:06:46.091161 (+    31us) tablet.cc:662] Decoding operations
0709 13:06:46.093187 (+  2026us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:46.093331 (+   144us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:46.093376 (+    45us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:06:46.240128 (+146752us) tablet.cc:701] Row locks acquired
0709 13:06:46.252315 (+ 12187us) write_op.cc:260] PREPARE: finished
0709 13:06:46.281764 (+ 29449us) write_op.cc:270] Start()
0709 13:06:46.281918 (+   154us) write_op.cc:276] Timestamp: P: 1783602406281695 usec, L: 0
0709 13:06:46.281936 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:06:46.282567 (+   631us) log.cc:844] Serialized 5833 byte log entry
0709 13:06:47.145230 (+862663us) op_driver.cc:464] REPLICATION: finished
0709 13:06:47.680867 (+535637us) write_op.cc:301] APPLY: starting
0709 13:06:47.680990 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:47.681328 (+   338us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:47.681478 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:47.718653 (+ 37175us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:47.719217 (+   564us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:06:47.719289 (+    72us) write_op.cc:312] APPLY: finished
0709 13:06:47.719843 (+   554us) log.cc:844] Serialized 101 byte log entry
0709 13:06:47.720049 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.720207 (+   158us) write_op.cc:454] Released schema lock
0709 13:06:47.720275 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:47.720731 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.720763 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":466307,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":474601,"apply.run_cpu_time_us":4963,"apply.run_wall_time_us":46103,"num_ops":14,"prepare.queue_time_us":117617,"prepare.run_cpu_time_us":66339,"prepare.run_wall_time_us":368525,"raft.queue_time_us":389022,"raft.run_cpu_time_us":11003,"raft.run_wall_time_us":440683,"replication_time_us":826219,"thread_start_us":760010,"threads_started":4,"wal-append.queue_time_us":332905,"wal-append.run_cpu_time_us":55579,"wal-append.run_wall_time_us":2088358}]]}
I20260709 13:06:57.160154 26342 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.134243 26002 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:57.135476 26334 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.526s	user 0.004s	sys 0.004s
I20260709 13:06:57.143539 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:57.097360 26316 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:57.149708 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 110701us
I20260709 13:06:57.128376 26351 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:57.128539 26329 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.094370 26262 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:06:57.140057 26123 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:57.168345 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 215737us
W20260709 13:06:57.170869 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.184724 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.174255 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:57.127990 26355 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:06:57.190313 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.191267 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.095633 26267 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.192890 21828 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:06:57.187105 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:06:57.203984 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 78378.4us
I20260709 13:06:57.203625 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:57.205891 22553 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:57.199777 26000 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:57.207645 26000 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:57.208017 26000 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.169171 26351 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:57.203233 26123 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:57.222817 26123 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.223173 26123 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:57.225240 26272 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.548s	user 0.003s	sys 0.004s
I20260709 13:06:57.211819 25977 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.228901 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.229871 21976 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:06:57.212646 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:57.231398 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:06:57.213883 25992 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.188295 26090 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.234885 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:57.235726 26070 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:57.219833 26342 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.220785 26251 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:57.236948 26251 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:57.237001 26070 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:57.218927 25897 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.235740 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:57.212709 26270 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:57.238638 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.242952 26364 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:57.243351 26364 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:57.195472 25908 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.243599 26381 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.244087 26381 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.244238 26364 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.245661 26364 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.239559 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:57.246307 26263 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:57.246806 26081 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:57.247160 26271 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.247839 26271 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.250774 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:57.251895 26379 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:57.253765 21730 catalog_manager.cc:5697] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 5 to 6, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 6 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.243360 26343 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.246817 26263 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.257134 26329 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.257562 26263 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.257588 26090 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.258505 26366 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:57.260298 26270 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:57.260455 26375 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:57.171150 26334 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.247210 26081 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:57.202042 26376 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:57.263352 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:06:57.264490 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 134451us
I20260709 13:06:57.222118 26351 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:57.266362 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.249948 26271 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.273478 21831 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:06:57.271449 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.232360 26354 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:57.275280 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:06:57.274441 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.283123 22547 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:06:57.268695 26081 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:57.291384 21979 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:57.274191 26085 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.235105 26272 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.237920 26070 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:57.272652 26343 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:57.275695 25767 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.304141 26085 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.239933 25859 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:06:57.274121 26376 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:57.306965 21981 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:06:57.312871 22555 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:06:57.237921 26251 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.314491 26085 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:57.314553 26247 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.720s	user 0.005s	sys 0.006s
I20260709 13:06:57.303473 26381 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.331197 26376 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.308228 26343 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.332260 26343 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:57.334421 21830 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:57.315842 26329 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:57.306236 26272 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:57.343418 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.344837 21982 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:57.344038 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.345752 21976 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:06:57.348030 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.292565 26354 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.349846 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:06:57.356866 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.355027 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.361934 21982 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:57.357003 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:57.337109 25859 consensus_queue.cc:1243] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:57.336869 26336 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.372529 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.375645 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2174) took 1492 ms. Trace:
W20260709 13:06:57.358721 26380 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:57.377908 21977 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:06:57.354399 26271 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.376039 21978 rpcz_store.cc:276] 0709 13:06:55.883685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.902655 (+ 18970us) service_pool.cc:224] Handling call
0709 13:06:56.123553 (+220898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.125916 (+  2363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.375455 (+1249539us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540001efd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:57.375583 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507324288}
I20260709 13:06:57.385031 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:57.385567 21982 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:57.361829 26262 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:57.386696 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.386375 25876 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:57.372864 26342 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:57.398154 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.401438 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.354699 26247 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:06:57.405913 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.407542 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.415907 21833 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:06:57.417012 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.412576 26168 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.396175 25876 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.361469 26157 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:06:57.419437 21833 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:57.420217 21875 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:57.376154 26336 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.448670 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.460867 21982 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
W20260709 13:06:57.465821 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45707.4us
I20260709 13:06:57.448073 25876 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:57.396893 26113 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.394126 26271 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:57.478377 26392 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:06:57.483428 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2084) took 1534 ms. Trace:
I20260709 13:06:57.483830 21825 rpcz_store.cc:276] 0709 13:06:55.949176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.037784 (+ 88608us) service_pool.cc:224] Handling call
0709 13:06:56.090061 (+ 52277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.721907 (+631846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.483180 (+761273us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b5400020154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:57.483364 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439921408}
W20260709 13:06:57.493317 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 136396us
I20260709 13:06:57.469467 26270 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:57.496299 22549 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:06:57.494316 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:06:57.368649 21720 maintenance_manager.cc:643] P 8f8230518d3b4d7090bda1a8eda4b421: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.672s	user 0.167s	sys 0.071s Metrics: {"bytes_written":29583,"cfile_init":1,"dirs.queue_time_us":189549,"dirs.run_cpu_time_us":514,"dirs.run_wall_time_us":40675,"drs_written":1,"lbm_read_time_us":381,"lbm_reads_lt_1ms":4,"lbm_write_time_us":215900,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":9,"lbm_writes_lt_1ms":19,"peak_mem_usage":0,"rows_written":63,"thread_start_us":318680,"threads_started":2,"wal-append.queue_time_us":226382}
I20260709 13:06:57.469694 26334 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.501538 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:57.504577 26376 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:57.504992 26376 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:57.505388 26376 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:57.505595 25984 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:57.511849 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.515940 26376 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.517055 26267 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:57.518697 26376 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.520066 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:57.522294 26376 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:57.522392 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:57.522758 26376 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:57.522960 21982 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:57.523105 26381 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.523643 26376 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.531039 21982 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:06:57.532478 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:57.523730 26381 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.545398 26262 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:57.546527 21981 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:57.548667 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.550748 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2174) took 1681 ms. Trace:
I20260709 13:06:57.551306 21906 rpcz_store.cc:276] 0709 13:06:55.869213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.906439 (+ 37226us) service_pool.cc:224] Handling call
0709 13:06:55.906702 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.919578 (+ 12876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.919620 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.920330 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.486645 (+1566315us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b180030b860. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:06:57.504407 (+ 17762us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:57.504725 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.504926 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.505009 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.546479 (+ 41470us) raft_consensus.cc:1685] finished
0709 13:06:57.550539 (+  4060us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.550669 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11370,"prepare.queue_time_us":568,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":10667,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":149,"spinlock_wait_cycles":22024448,"thread_start_us":17557,"threads_started":1,"wal-append.queue_time_us":1623739}
I20260709 13:06:57.496336 26270 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:57.554894 26394 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:57.529716 26257 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:57.569332 21721 maintenance_manager.cc:419] P 8f8230518d3b4d7090bda1a8eda4b421: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9336 bytes on disk
W20260709 13:06:57.575201 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 108527us
I20260709 13:06:57.563529 26270 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:57.565294 26257 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.587571 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:06:57.566722 26316 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:57.570565 26262 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:57.591367 21720 maintenance_manager.cc:643] P 8f8230518d3b4d7090bda1a8eda4b421: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.016s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":2745,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3}
I20260709 13:06:57.572521 26354 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:57.613209 21831 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:06:57.613763 21831 pending_rounds.cc:85] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 7
I20260709 13:06:57.614054 21831 pending_rounds.cc:107] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:57.614363 21831 raft_consensus.cc:2889] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.572597 26273 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:57.592389 26257 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:57.593159 26398 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:57.632634 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:06:57.636273 21982 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:57.638715 22553 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:57.631198 26316 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:06:57.650529 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 56788.6us
I20260709 13:06:57.653858 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.654364 21826 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:06:57.655691 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:57.656174 21826 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.656224 21833 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:57.656595 21833 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:57.657254 21833 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:57.658931 26401 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:57.661238 26339 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:57.662124 26396 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:06:57.663208 21833 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:57.664120 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.665766 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2085) took 1716 ms. Trace:
I20260709 13:06:57.677790 21833 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:06:57.678129 21833 pending_rounds.cc:85] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 11
I20260709 13:06:57.678421 21833 pending_rounds.cc:107] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:06:57.678687 21833 raft_consensus.cc:2889] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.679922 21982 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:06:57.666106 21830 rpcz_store.cc:276] 0709 13:06:55.949492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.036657 (+ 87165us) service_pool.cc:224] Handling call
0709 13:06:56.037011 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.334957 (+1297946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.665547 (+330590us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540011d354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:57.665712 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2982692736}
I20260709 13:06:57.684419 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:06:57.690593 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:57.718298 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:57.719226 21900 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:06:57.734704 21900 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:06:57.737267 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.738101 21830 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:57.739388 21826 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:06:57.739890 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:57.722448 26334 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:57.718562 26271 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.742134 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:57.690738 26336 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.721905 26113 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:06:57.735214 26000 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 13:06:57.741758 26074 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.746057 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:57.686993 26351 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.746526 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.745548 21900 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:57.751082 26399 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 13:06:57.751904 26402 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:06:57.751600 26000 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.756181 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2184) took 1035 ms. Trace:
W20260709 13:06:57.745922 26400 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:06:57.776024 26000 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:57.746589 26381 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:57.746109 26398 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:57.747941 26376 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
W20260709 13:06:57.759857 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.762800 26123 consensus_meta.cc:287] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.001s
W20260709 13:06:57.762917 25897 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
W20260709 13:06:57.779295 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.777595 21975 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:57.782950 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:57.763885 26334 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:57.772990 21974 rpcz_store.cc:276] 0709 13:06:56.720701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.726034 (+  5333us) service_pool.cc:224] Handling call
0709 13:06:57.756000 (+1029966us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400165154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:57.756121 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440835968}
I20260709 13:06:57.789595 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2171) took 1921 ms. Trace:
I20260709 13:06:57.791013 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.791952 21974 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:06:57.770833 26074 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.785451 21832 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:06:57.786958 21900 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
W20260709 13:06:57.773098 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.790934 21902 rpcz_store.cc:276] 0709 13:06:55.868434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.868559 (+   125us) service_pool.cc:224] Handling call
0709 13:06:55.868849 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.874742 (+  5893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.874785 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.875213 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.631834 (+1756621us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b1800402d00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:06:57.688043 (+ 56209us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:57.688080 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.688148 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.780504 (+ 92356us) raft_consensus.cc:1685] finished
0709 13:06:57.780531 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.789530 (+  8999us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21195,"raft.queue_time_us":6314,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7784,"spinlock_wait_cycles":47792512,"thread_start_us":55926,"threads_started":1,"wal-append.queue_time_us":1879698}
I20260709 13:06:57.720635 26262 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.793556 21825 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:06:57.789527 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.780046 26398 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.767731 26271 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:06:57.801328 26146 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.808372 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66858.7us
I20260709 13:06:57.790220 26381 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:57.816665 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:57.817445 21834 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.819393 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:06:57.820078 21826 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:57.784725 26123 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.806612 26398 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:57.823889 21826 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:57.827402 26074 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.828370 26343 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.816718 26146 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.831267 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:57.831846 21826 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:57.831883 26357 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:57.833375 26343 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:57.834020 26351 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:57.841862 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.842680 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.843222 26269 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:57.846235 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2244) took 1002 ms. Trace:
I20260709 13:06:57.846756 21829 rpcz_store.cc:276] 0709 13:06:56.844214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.844348 (+   134us) service_pool.cc:224] Handling call
0709 13:06:56.879062 (+ 34714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.020060 (+140998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.020100 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.020142 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:57.020193 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.845941 (+825748us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54002882d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:57.845996 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.846130 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323722624}
I20260709 13:06:57.848959 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 500) took 1710 ms. Trace:
I20260709 13:06:57.849457 21907 rpcz_store.cc:276] 0709 13:06:56.139028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.139453 (+   425us) service_pool.cc:224] Handling call
0709 13:06:56.139682 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.540384 (+400702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.265332 (+724948us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b5400149ea0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef55dc0 00007fb75efe1a02 00007fb75efdddd6 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:06:57.848671 (+583339us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b540020bcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:57.848880 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710731392}
I20260709 13:06:57.841899 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:57.801923 26081 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:57.864491 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:57.866938 22546 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:06:57.868000 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:57.891470 26074 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.627683 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:58.426123 26270 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.834s	user 0.007s	sys 0.000s
I20260709 13:06:58.656821 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.667658 26378 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.403017 21907 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:57.903515 26269 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:58.150489 26381 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:06:58.688768 26081 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.689481 26081 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:58.688865 26381 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.691152 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.692132 21907 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 7.
I20260709 13:06:58.151329 26417 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.037264 21826 raft_consensus.cc:2410] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:57.865409 26376 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.842s
I20260709 13:06:58.610841 21904 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 13. Ops: []
I20260709 13:06:57.908289 25876 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.445753 26123 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:57.891575 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:06:58.713402 22552 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:58.327392 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:58.612198 26257 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.969s	user 0.005s	sys 0.007s
I20260709 13:06:58.403506 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.614929 26333 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.873065 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:57.865615 26334 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:57.893119 21833 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:06:58.390885 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:57.926327 21834 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:58.668632 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 596) took 1392 ms. Trace:
W20260709 13:06:57.883915 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 113498us
W20260709 13:06:58.131495 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.150871 22547 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:06:57.921248 22550 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:58.304874 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:57.869470 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:06:58.674722 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.675859 21829 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:58.676393 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:58.677554 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:06:58.724277 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 46822us
I20260709 13:06:58.724514 21902 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:58.677646 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:58.725301 21829 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:58.677848 26168 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.723990 22553 rpcz_store.cc:276] 0709 13:06:57.229331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.230440 (+  1109us) service_pool.cc:224] Handling call
0709 13:06:58.621908 (+1391468us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54004c4354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:58.622064 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867683584}
I20260709 13:06:58.678551 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:06:58.609625 21900 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:58.732609 21828 raft_consensus.cc:2368] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13.
I20260709 13:06:58.663877 26074 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.687706 26422 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:58.687871 21901 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:06:58.061925 26002 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.699618 26269 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:57.928229 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.707870 21907 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:06:58.711513 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.750627 25767 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.751068 21908 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:58.751427 26239 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:58.753226 26074 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.684566 26271 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.689973 26081 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.684243 26270 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.739346 22548 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:06:58.734463 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:58.743837 21827 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:58.744204 21900 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:06:58.753161 26339 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:58.697571 26378 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:58.739050 26333 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:58.731230 21829 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.766863 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:58.767032 21829 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:58.767429 21907 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:58.712272 26417 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:58.773684 26336 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.776947 21907 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:06:58.777977 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.774139 26239 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:58.784047 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.785190 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.733023 26257 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.786264 21827 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:06:58.796545 21905 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:58.760659 26168 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:58.762840 26316 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.748142 26422 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.813314 21980 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:06:58.814231 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2185) took 2093 ms. Trace:
I20260709 13:06:58.810961 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.814620 21980 rpcz_store.cc:276] 0709 13:06:56.720993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.721142 (+   149us) service_pool.cc:224] Handling call
0709 13:06:58.811954 (+2090812us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:06:58.812173 (+   219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.813904 (+  1731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.814143 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11928832}
I20260709 13:06:58.817878 26333 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.818599 26333 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:58.819084 26333 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:06:58.819284 26417 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:58.820148 26333 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:58.821025 26257 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.757793 26002 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:58.783839 26239 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.825305 26270 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.827011 26239 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.827558 26239 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:58.828074 26239 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.828735 26251 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:58.761126 26271 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.827057 26316 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:58.831682 26271 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.832881 25876 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.833554 26316 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.834297 26269 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.834841 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:58.836238 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.836526 26422 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.837581 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.840308 26002 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:58.813436 26168 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.844206 26168 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.845204 21907 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:06:58.846414 21901 raft_consensus.cc:2410] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:58.849179 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 592) took 1749 ms. Trace:
I20260709 13:06:58.849673 22549 rpcz_store.cc:276] 0709 13:06:57.097862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.099101 (+  1239us) service_pool.cc:224] Handling call
0709 13:06:57.099455 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.496787 (+397332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.845947 (+1349160us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54004920d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:06:58.847539 (+  1592us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911948544}
W20260709 13:06:58.852375 22554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.016s	sys 0.019s
W20260709 13:06:58.852746 22554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.016s	sys 0.019s
I20260709 13:06:58.787063 26336 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.802652 26342 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:58.803393 26081 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.767409 26416 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.751085 25767 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:58.853650 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:58.855481 22552 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:06:58.868767 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 634) took 1015 ms. Trace:
I20260709 13:06:58.869807 22552 rpcz_store.cc:276] 0709 13:06:57.853619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.854003 (+   384us) service_pool.cc:224] Handling call
0709 13:06:58.868691 (+1014688us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:58.880316 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet ff74442193fb468c966c8842f014e361: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:06:58.860164 26342 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:58.854194 26239 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:58.854106 26422 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:06:58.916109 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 190756us
W20260709 13:06:58.883473 26398 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.013s	user 0.011s	sys 0.000s
W20260709 13:06:58.855894 26411 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.032s	sys 0.024s
I20260709 13:06:58.937342 21829 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:06:58.938002 21829 pending_rounds.cc:85] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 6
W20260709 13:06:58.921571 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.906278 26262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.051s	sys 0.063s
I20260709 13:06:58.938390 21829 pending_rounds.cc:107] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:06:58.940990 21829 raft_consensus.cc:2889] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:58.800536 21902 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
W20260709 13:06:58.919639 26357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.004s	sys 0.030s
I20260709 13:06:58.945185 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:58.945852 21901 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:58.947651 21799 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.537s (SENT) [suppressed 4 similar messages]
I20260709 13:06:58.884879 26423 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:06:58.927968 26239 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.863529 26416 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:58.940361 26411 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.033s	sys 0.024s
W20260709 13:06:58.942710 26262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.052s	sys 0.063s
W20260709 13:06:58.942495 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 208119us
W20260709 13:06:58.945443 26357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.004s	sys 0.030s
I20260709 13:06:58.944052 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:58.962107 22552 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:58.963093 22549 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:58.963052 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:58.963711 21902 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:58.982337 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 373350us
I20260709 13:06:58.950361 26426 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.983974 21904 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:58.927642 26398 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.955184 26378 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:58.991793 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 367444us
I20260709 13:06:58.987392 26262 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.001183 21901 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:06:59.003000 21906 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:06:59.002418 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:59.009276 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:59.009882 21977 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:06:59.006440 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:59.016501 26381 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:59.017434 26432 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:59.017261 26381 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:59.017992 26432 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.999630 26417 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.959159 26239 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:59.025097 26432 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.025627 26432 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.025645 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 598) took 1173 ms. Trace:
I20260709 13:06:59.026786 22554 rpcz_store.cc:276] 0709 13:06:57.852799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.852964 (+   165us) service_pool.cc:224] Handling call
0709 13:06:57.853485 (+   521us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:57.870145 (+ 16660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.870207 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:57.892654 (+ 22447us) log.cc:844] Serialized 52 byte log entry
0709 13:06:58.853159 (+960505us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:58.853212 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.853292 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.025406 (+172114us) raft_consensus.cc:1685] finished
0709 13:06:59.025427 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.025579 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":257,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":16333,"thread_start_us":791306,"threads_started":1,"wal-append.queue_time_us":1002665}
I20260709 13:06:59.035740 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:06:59.026115 26432 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:59.038614 25876 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.039256 26432 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.039074 25876 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:59.041342 25876 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.041801 26381 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.045485 26074 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.046087 26074 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:59.001209 26435 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:06:59.059742 26336 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.060315 26336 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.060789 26336 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:59.063385 26269 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.066916 26074 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.063887 26269 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:58.990271 26426 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:59.004673 26262 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:06:59.088131 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 140495us
I20260709 13:06:59.099996 21902 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8.
I20260709 13:06:59.101227 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:59.103124 21902 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:06:59.083377 26131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.115s	user 0.030s	sys 0.020s
I20260709 13:06:59.084506 25767 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.031836 26417 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:59.107620 21901 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:59.119078 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.254099 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:06:59.202819 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 210242us
W20260709 13:06:59.112776 26273 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.470s	user 0.017s	sys 0.036s
I20260709 13:06:59.278738 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:59.279199 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:06:59.282819 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:59.284389 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:06:59.286845 21902 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
W20260709 13:06:59.274449 26131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.302s	user 0.031s	sys 0.020s
I20260709 13:06:59.289932 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:06:59.286741 26273 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.652s	user 0.018s	sys 0.036s
I20260709 13:06:59.202710 26336 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:59.280345 26428 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:59.296378 26334 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:59.350805 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 72174.5us
I20260709 13:06:59.309808 26168 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.386931 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:06:59.393028 21903 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:06:59.393584 21903 pending_rounds.cc:85] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 6
I20260709 13:06:59.393872 21903 pending_rounds.cc:107] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:06:59.394219 21903 raft_consensus.cc:2889] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.399953 21901 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:06:59.336826 26273 consensus_queue.cc:1243] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:59.551985 21903 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:06:59.553663 21903 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:59.589946 26416 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:59.365474 26437 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:59.591987 26437 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:59.594558 26419 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.572s	user 0.001s	sys 0.000s
I20260709 13:06:59.598881 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:06:59.598863 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 212142us
W20260709 13:06:59.601668 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.602274 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.602698 21798 connection.cc:256] RPC call timeout handler was delayed by -1.541284932999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 13:06:59.603525 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.604929 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.605341 21798 connection.cc:256] RPC call timeout handler was delayed by -1.3716478329999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:06:59.605384 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.606338 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.364704 26378 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:59.612689 21902 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:59.364919 26037 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:59.369912 26398 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:59.631088 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 351180us
I20260709 13:06:59.637799 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:06:59.662304 26437 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.489574 26168 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:59.424243 26334 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:59.666658 26262 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.701650 26334 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.641606 26037 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:59.704281 26037 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.704882 26168 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:06:59.705432 26442 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:59.670465 26455 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:59.671541 26426 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.675230 26446 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.665217 26452 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:59.354462 26336 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.256s
I20260709 13:06:59.631759 26444 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:59.699219 26269 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.694384 26366 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:59.720417 26366 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:06:59.721711 26366 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:59.722945 26366 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:59.722610 26444 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:59.725361 26444 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:06:59.699956 26239 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:59.368049 26428 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:59.728024 26428 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:06:59.669587 26251 consensus_meta.cc:287] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.001s
I20260709 13:06:59.640933 26335 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:59.730338 21830 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
W20260709 13:06:59.731201 26409 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 2.087s	user 0.008s	sys 0.035s
I20260709 13:06:59.712801 26455 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:59.732391 26455 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:59.732497 21830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 2255) took 1951 ms (client timeout 2182 ms). Trace:
W20260709 13:06:59.732906 21830 rpcz_store.cc:269] 0709 13:06:57.780967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.789285 (+  8318us) service_pool.cc:224] Handling call
0709 13:06:59.732342 (+1943057us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54000e92d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:06:59.732441 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4443228032}
I20260709 13:06:59.578750 26397 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:06:59.638047 26378 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:59.735709 26378 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:06:59.736323 26432 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.736783 26432 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:59.716991 26446 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:06:59.742764 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 105061us
I20260709 13:06:59.747140 26453 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:59.747830 26453 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:06:59.715786 25977 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:59.738587 26452 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:59.758651 21948 connection.cc:256] RPC call timeout handler was delayed by -1.1468615569999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:06:59.758390 26450 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:06:59.729776 26335 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:06:59.717551 26426 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:06:59.759938 21909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.003s	sys 0.007s
W20260709 13:06:59.760049 21948 connection.cc:256] RPC call timeout handler was delayed by -1.1428387590000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:07:00.409586 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:00.418139 21900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.008s	sys 0.011s
W20260709 13:07:00.414250 21908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.009s	sys 0.016s
I20260709 13:06:59.793622 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:00.434566 21908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.010s	sys 0.016s
W20260709 13:07:00.428306 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 667090us
I20260709 13:07:00.311867 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2195) took 1540 ms. Trace:
W20260709 13:07:00.145388 21946 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.011s
W20260709 13:07:00.413686 21902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.006s	sys 0.014s
W20260709 13:07:00.434155 21900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.008s	sys 0.011s
W20260709 13:07:00.437742 21946 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.011s	sys 0.015s
W20260709 13:07:00.438205 21948 connection.cc:256] RPC call timeout handler was delayed by -1.0825387590000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:07:00.285621 21901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.001s	sys 0.009s
W20260709 13:07:00.438877 21901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.004s	sys 0.009s
W20260709 13:07:00.438088 21902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.006s	sys 0.015s
I20260709 13:07:00.439522 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2197) took 1665 ms. Trace:
I20260709 13:07:00.437309 21903 rpcz_store.cc:276] 0709 13:06:58.771226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.589433 (+818207us) service_pool.cc:224] Handling call
0709 13:06:59.603368 (+ 13935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.603558 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:59.634067 (+ 30509us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.877697 (+243630us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.201822 (+324125us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.311377 (+109555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.311455 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:00.311532 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.311624 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.311793 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":260462,"prepare.queue_time_us":83168,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":127,"raft.queue_time_us":389555,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":324,"thread_start_us":242725,"threads_started":1}
I20260709 13:07:00.439869 21901 rpcz_store.cc:276] 0709 13:06:58.773997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.737416 (+963419us) service_pool.cc:224] Handling call
0709 13:06:59.737731 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.737935 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.737961 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.738462 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.439222 (+700760us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:00.439260 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.439331 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.439368 (+    37us) raft_consensus.cc:1685] finished
0709 13:07:00.439379 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.439477 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":700412,"threads_started":1,"wal-append.queue_time_us":687103}
W20260709 13:07:00.441073 21909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.011s	sys 0.023s
I20260709 13:06:59.739007 26460 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.450878 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2196) took 1677 ms. Trace:
W20260709 13:07:00.368901 26366 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.003s
I20260709 13:06:59.759724 26336 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:06:59.948458 26468 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:07:00.372200 25977 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.001s
W20260709 13:07:00.155290 26342 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.246s	user 0.008s	sys 0.002s
I20260709 13:06:59.759085 26239 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:59.759438 26251 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.358328 26432 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:00.493465 26432 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:00.494100 26432 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.496603 26432 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:00.496830 26289 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:00.497217 26432 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:00.497397 26289 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.346659 26378 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.758982 26417 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:00.358728 26473 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:06:59.801561 26471 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.949191 26463 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.361485 26446 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:06:59.776106 26384 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.454919 21908 rpcz_store.cc:276] 0709 13:06:58.773766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.727474 (+953708us) service_pool.cc:224] Handling call
0709 13:06:59.727751 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.728086 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:59.728377 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.450430 (+722053us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.450501 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:00.450580 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.450665 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.450811 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":18352,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"thread_start_us":706530,"threads_started":1}
I20260709 13:07:00.425274 26476 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:06:59.758801 26466 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:00.444882 26453 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:00.476164 26477 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:00.520917 26476 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.490622 26342 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.523530 26476 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:00.524159 26342 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:00.501828 26251 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.526391 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2189) took 1754 ms. Trace:
I20260709 13:07:00.526893 21902 rpcz_store.cc:276] 0709 13:06:58.772161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.621427 (+849266us) service_pool.cc:224] Handling call
0709 13:06:59.621841 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:59.632312 (+ 10471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.632341 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:59.694143 (+ 61802us) log.cc:844] Serialized 52 byte log entry
0709 13:07:00.439509 (+745366us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:00.439548 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.439607 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.526116 (+ 86509us) raft_consensus.cc:1685] finished
0709 13:07:00.526140 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.526325 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10035,"raft.queue_time_us":10324,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":38482,"thread_start_us":696296,"threads_started":1,"wal-append.queue_time_us":786539}
I20260709 13:07:00.529060 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:00.484956 26335 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:00.487027 26427 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:00.320140 26428 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:06:59.759135 26452 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.461344 26336 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:00.157370 26455 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.466895 26460 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.446672 26426 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.508697 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:00.544394 22553 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:00.467487 26366 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:00.446777 26450 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.488165 25977 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.514969 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:00.491222 26239 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:00.503496 26257 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.519781 22551 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:00.520326 26466 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:00.531747 21902 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:00.577071 21902 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:00.504864 26289 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:00.512633 26081 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:00.534693 26453 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.536055 26427 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.506042 26378 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.510610 26473 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.538236 26467 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.576062 21874 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:00.510493 26471 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.577931 21902 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.598315 21902 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.530441 26384 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.542095 26428 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.517212 26463 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.571720 26366 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.586956 25992 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:00.546522 26460 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.582278 26257 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:00.629402 21832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2079) took 4679 ms (client timeout 1998 ms). Trace:
I20260709 13:07:00.587066 26081 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:00.629838 21832 rpcz_store.cc:269] 0709 13:06:55.946074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.971753 (+ 25679us) service_pool.cc:224] Handling call
0709 13:07:00.625530 (+4653777us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54001d6ad4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:00.625695 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4069264768}
W20260709 13:07:00.630000 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 836378us
I20260709 13:07:00.631031 21902 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:00.594143 26453 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.682796 21902 pending_rounds.cc:85] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 5
I20260709 13:07:00.690491 21902 pending_rounds.cc:107] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:00.690897 21902 raft_consensus.cc:2889] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:00.691823 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2209) took 1879 ms. Trace:
I20260709 13:07:00.692308 21902 rpcz_store.cc:276] 0709 13:06:58.812619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.531316 (+1718697us) service_pool.cc:224] Handling call
0709 13:07:00.531619 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.691513 (+159894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.691752 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:00.682742 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 174733us
I20260709 13:07:00.695536 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:00.610113 26435 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:00.700114 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:00.700956 21825 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:00.702654 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:00.703401 21902 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:07:00.597968 26467 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.715243 21902 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:00.715448 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2180) took 2029 ms. Trace:
I20260709 13:07:00.715890 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2210) took 1899 ms. Trace:
I20260709 13:07:00.716270 21902 rpcz_store.cc:276] 0709 13:06:58.816087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.714603 (+1898516us) service_pool.cc:224] Handling call
0709 13:07:00.714929 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.715656 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.715839 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.598941 26336 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.697346 26453 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:00.730377 21902 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:00.727322 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:00.732240 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2211) took 1915 ms. Trace:
I20260709 13:07:00.715809 21909 rpcz_store.cc:276] 0709 13:06:58.686080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.686222 (+   142us) service_pool.cc:224] Handling call
0709 13:06:58.686584 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.686840 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:59.113911 (+427071us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.715002 (+1601091us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.715054 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:00.715111 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.715177 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.715392 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26784,"prepare.queue_time_us":600606,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":18938,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":5678,"thread_start_us":2017406,"threads_started":3,"wal-append.queue_time_us":1245148}
I20260709 13:07:00.732599 21902 rpcz_store.cc:276] 0709 13:06:58.816406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.717429 (+1901023us) service_pool.cc:224] Handling call
0709 13:07:00.717770 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.731604 (+ 13834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.732190 (+   586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.734969 21834 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:07:00.738463 21909 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:00.739297 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2212) took 1890 ms. Trace:
I20260709 13:07:00.739718 21909 rpcz_store.cc:276] 0709 13:06:58.848882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.733395 (+1884513us) service_pool.cc:224] Handling call
0709 13:07:00.737776 (+  4381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.739101 (+  1325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.739253 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:00.741271 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 304732us
I20260709 13:07:00.707716 26251 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:00.744820 21902 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:00.607049 26239 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.626462 25992 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.718340 26168 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:00.759101 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:00.759770 22551 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:07:00.760797 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:00.761483 21977 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.762744 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:00.763739 26168 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:00.759075 26446 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:07:00.721431 26435 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.772675 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:00.868393 22547 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:00.774891 26336 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:00.842730 26452 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:00.843139 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:00.843361 26426 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:00.843613 26395 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 3.366s	user 0.032s	sys 0.038s
I20260709 13:07:00.844367 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:00.844367 26418 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.993s	user 0.008s	sys 0.021s
I20260709 13:07:00.845014 26428 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:00.845992 26427 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:00.767047 21980 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 9: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:00.710242 26466 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:00.850087 21977 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:00.846297 26455 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:00.873075 26481 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.160s	user 0.000s	sys 0.004s
I20260709 13:07:00.873411 26496 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.875963 22551 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
W20260709 13:07:00.880466 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 170616us
I20260709 13:07:00.881474 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:00.883944 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:00.883944 21978 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:00.887306 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.846025 26378 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:00.887663 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:00.970700 21975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2186) took 4244 ms (client timeout 3186 ms). Trace:
I20260709 13:07:00.973014 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:00.867520 26068 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.867684 26477 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.888235 21983 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:00.973651 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:00.973846 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.977977 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:00.978317 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.978480 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:00.976878 21975 rpcz_store.cc:269] 0709 13:06:56.726203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.726308 (+   105us) service_pool.cc:224] Handling call
0709 13:06:57.663987 (+937679us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:07:00.970433 (+3306446us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54003f9654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:00.970574 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271518336}
I20260709 13:07:00.979100 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:00.971278 21974 raft_consensus.cc:2410] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:07:00.978704 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.979646 21983 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:00.979912 21977 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:00.977119 21981 raft_consensus.cc:2410] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:00.986595 21978 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:00.988346 21978 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:00.865384 26251 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:01.094343 21975 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:07:00.896870 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 299816us
I20260709 13:07:00.976598 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:00.966611 26388 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 3.498s	user 0.013s	sys 0.040s
I20260709 13:07:01.107182 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:00.977311 26339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.181s	user 0.008s	sys 0.022s
I20260709 13:07:01.114849 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.123471 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:01.124207 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.127364 21977 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.123878 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:01.128171 21975 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:01.127065 21981 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:00.965520 25992 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.129601 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:00.968864 26463 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:00.966840 26081 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:01.133237 21976 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:00.917060 26426 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.947891 26452 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.965946 26471 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:00.977592 26450 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:01.130376 26339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.342s	user 0.009s	sys 0.022s
I20260709 13:07:01.154513 26339 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:01.155654 26339 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:01.153770 26452 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.161082 26452 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.152804 26426 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:01.164016 26426 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:01.170352 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2254) took 3389 ms. Trace:
I20260709 13:07:01.170758 21831 rpcz_store.cc:276] 0709 13:06:57.780695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.781121 (+   426us) service_pool.cc:224] Handling call
0709 13:06:57.781468 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.781851 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.781890 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.782442 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.951176 (+168734us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:57.951237 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.951338 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.778214 (+2826876us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:01.148901 (+370687us) raft_consensus.cc:1685] finished
0709 13:07:01.148930 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.170270 (+ 21340us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2720,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4403,"spinlock_wait_cycles":3330944,"thread_start_us":140547,"threads_started":1,"wal-append.queue_time_us":986170}
W20260709 13:07:01.180990 26420 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 2.286s	user 0.004s	sys 0.023s
W20260709 13:07:01.183398 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2190) took 2413 ms (client timeout 2814 ms). Trace:
W20260709 13:07:01.183956 21905 rpcz_store.cc:269] 0709 13:06:58.769984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.784927 (+ 14943us) service_pool.cc:224] Handling call
0709 13:07:01.183112 (+2398185us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5400308754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:01.183301 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5910400}
I20260709 13:07:01.184821 26146 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.190210 21977 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:01.192384 21975 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:01.193208 21976 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
W20260709 13:07:01.193907 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.195032 26503 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:01.206702 21983 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:01.114466 26486 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:01.260623 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47695.1us
I20260709 13:07:01.133405 26366 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:01.267252 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 59955.9us
I20260709 13:07:01.111176 26251 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:01.148769 25992 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.124514 26428 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:07:01.093276 26496 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.187192 26384 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:01.111512 26068 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:01.328378 26493 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.456s	user 0.000s	sys 0.000s
I20260709 13:07:01.271060 26460 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:01.355161 21978 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:01.347065 26487 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:01.329124 26483 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.462s	user 0.001s	sys 0.000s
I20260709 13:07:01.356340 26487 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.357761 26495 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.358294 26495 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.359436 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 548) took 3707 ms. Trace:
I20260709 13:07:01.359913 21979 rpcz_store.cc:276] 0709 13:06:57.652161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.665629 (+ 13468us) service_pool.cc:224] Handling call
0709 13:06:57.665905 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.675106 (+  9201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.675133 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.331058 (+2655925us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b2c00111818. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:07:00.346577 (+ 15519us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.609609 (+263032us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:00.609659 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.609748 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.359039 (+749291us) raft_consensus.cc:1685] finished
0709 13:07:01.359066 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.359340 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6497,"spinlock_wait_cycles":19686144,"thread_start_us":244494,"threads_started":1,"wal-append.queue_time_us":376972}
I20260709 13:07:01.350224 26498 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.266425 26481 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:07:01.376422 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.333850 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.364753 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2108) took 3675 ms. Trace:
I20260709 13:07:01.378242 21982 rpcz_store.cc:276] 0709 13:06:57.689403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.689613 (+   210us) service_pool.cc:224] Handling call
0709 13:06:57.691880 (+  2267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.718890 (+ 27010us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:57.741699 (+ 22809us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.742832 (+  1133us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.662953 (+1920121us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b180038aca0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef1522 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:01.304470 (+1641517us) spinlock_profiling.cc:243] Waited 965 us on lock 0x7b180038aca0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75eb94d70 00007fb75eb88293 00007fb75eb7dcea 00007fb75eb7e23a 00007fb75efe8a2a 00007fb75eff80bf 00007fb75eff8038
0709 13:07:01.364255 (+ 59785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:01.364331 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:01.364408 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.364504 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.364676 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89546,"prepare.queue_time_us":32205,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":62023,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":1285,"spinlock_wait_cycles":43453952}
I20260709 13:07:01.273007 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.103719 26477 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:01.363448 26498 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:01.388413 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.397178 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:01.498530 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 402937us
W20260709 13:07:01.498795 21901 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.018s	sys 0.030s
I20260709 13:07:01.395555 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:01.294998 26499 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
W20260709 13:07:01.514423 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.527244 26450 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:01.528004 26450 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.517500 26332 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:01.533516 26068 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.349040 26497 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:01.514871 21901 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.021s	sys 0.032s
W20260709 13:07:01.396394 26432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.018s	sys 0.029s
I20260709 13:07:01.544790 26450 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.353947 26496 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.354018 26428 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:01.547003 26428 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.549117 26428 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.555694 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:01.558070 21981 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:01.562609 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.512502 26251 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:01.564193 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.533957 26332 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.567406 26332 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.568437 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.570839 21975 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
W20260709 13:07:01.569680 21907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2193) took 2798 ms (client timeout 1691 ms). Trace:
W20260709 13:07:01.571463 21907 rpcz_store.cc:269] 0709 13:06:58.770784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.783827 (+ 13043us) service_pool.cc:224] Handling call
0709 13:07:01.569463 (+2785636us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b540020a8d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:01.569592 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139140864}
I20260709 13:07:01.573381 21975 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:01.574055 22554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.019s	sys 0.018s
I20260709 13:07:01.574337 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.394541 26487 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.414710 26263 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:01.575184 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.383148 25992 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.581612 21981 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:07:01.589668 22554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.020s	sys 0.019s
I20260709 13:07:01.577765 21975 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:01.599294 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:01.590378 21875 connection.cc:256] RPC call timeout handler was delayed by -1.0143888830000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 13:07:01.591560 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.583019 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.600062 21975 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:01.602433 21976 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:01.578789 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:01.605670 26451 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.939s	user 0.013s	sys 0.010s
I20260709 13:07:01.610244 21834 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:01.602787 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.581481 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:01.615587 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.386281 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:01.617518 21906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2174) took 3290 ms (client timeout 1660 ms). Trace:
I20260709 13:07:01.618381 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:01.618002 21906 rpcz_store.cc:269] 0709 13:06:58.327124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.390528 (+ 63404us) service_pool.cc:224] Handling call
0709 13:07:01.617347 (+3226819us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54002e77d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:01.617451 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643975040}
W20260709 13:07:01.619515 21799 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.008s	sys 0.007s
W20260709 13:07:01.619908 21799 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.008s	sys 0.007s
W20260709 13:07:01.620165 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 754185us
W20260709 13:07:01.620987 21799 connection.cc:256] RPC call timeout handler was delayed by -1.1992451060000349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28140000000000004s for a response
I20260709 13:07:01.601316 21907 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
W20260709 13:07:01.570230 26432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.023s	sys 0.029s
I20260709 13:07:01.615693 21903 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:01.640561 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.625764 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.641546 21906 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:01.641741 21907 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:07:01.645450 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.646957 21906 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:07:01.649153 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.654440 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:01.655468 21825 raft_consensus.cc:2410] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:07:01.656947 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.657810 21833 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:07:01.617041 26470 raft_consensus.cc:2764] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:07:01.671885 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.667882 21825 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:01.669379 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.674310 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.674417 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.675145 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.675712 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.676740 21825 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:01.624814 26251 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:01.639339 26068 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.679518 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.682265 21826 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:07:01.687933 21826 pending_rounds.cc:85] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 11
I20260709 13:07:01.688232 21826 pending_rounds.cc:107] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:07:01.688525 21826 raft_consensus.cc:2889] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:01.686615 21907 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:01.689088 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.690461 21828 raft_consensus.cc:2410] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:07:01.691346 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.691995 21827 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:07:01.694119 21827 pending_rounds.cc:85] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 10
I20260709 13:07:01.694406 21827 pending_rounds.cc:107] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:07:01.694653 21827 raft_consensus.cc:2889] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:01.574591 26497 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:01.693742 21906 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:01.697098 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.702402 21833 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:01.704074 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.704340 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.617406 26263 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:01.706051 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.706951 21827 raft_consensus.cc:2410] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:07:01.708186 26448 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 2.039s	user 0.004s	sys 0.021s
I20260709 13:07:01.699442 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.708905 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 640) took 1210 ms. Trace:
I20260709 13:07:01.708467 26263 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:01.709437 22554 rpcz_store.cc:276] 0709 13:07:00.498496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.499496 (+  1000us) service_pool.cc:224] Handling call
0709 13:07:00.499855 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.734900 (+235045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.734948 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.735530 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.598389 (+862859us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:01.598425 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.598520 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.708696 (+110176us) raft_consensus.cc:1685] finished
0709 13:07:01.708717 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.708851 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24712,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":1097051,"threads_started":2,"wal-append.queue_time_us":970169}
I20260709 13:07:01.704965 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:01.717563 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.718914 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.720551 21828 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:07:01.722424 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:01.722569 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:01.723660 21906 raft_consensus.cc:2376] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11. Re-sending same reply.
I20260709 13:07:01.724330 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.721408 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.732733 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.733496 21975 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:01.734598 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.735126 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.735709 21976 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:01.737706 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.738610 21828 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 8.
I20260709 13:07:01.739992 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.740767 21907 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:01.695955 26068 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:01.743537 26477 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:01.744566 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.744867 26068 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:01.741829 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:01.745440 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2206) took 2945 ms. Trace:
I20260709 13:07:01.742256 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.745802 26513 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:01.746634 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.747088 22520 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.742903 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.747991 26441 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:01.748286 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.748616 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.748914 21909 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:01.745831 21827 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:01.749702 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.745329 21902 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:01.748371 26441 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.692739 26251 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.742977 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.747212 21906 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:01.750942 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.760264 21905 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 8: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:01.760491 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.761188 21906 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:01.761889 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.754628 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:01.756596 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.766645 21975 raft_consensus.cc:2376] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13. Re-sending same reply.
I20260709 13:07:01.745798 21908 rpcz_store.cc:276] 0709 13:06:58.800125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.513051 (+1712926us) service_pool.cc:224] Handling call
0709 13:07:00.536537 (+ 23486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.149957 (+613420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.149999 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:01.150059 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:01.150123 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.745232 (+595109us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540034b554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:01.745275 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.745389 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":445870,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":386312960,"thread_start_us":444931,"threads_started":1}
I20260709 13:07:01.755296 21909 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:01.767555 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:01.757936 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 324088us
I20260709 13:07:01.759310 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:01.768626 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:01.768721 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:01.769099 21949 connection.cc:256] RPC call timeout handler was delayed by -2.0720312589999139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 13:07:01.755872 26490 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:01.755730 26441 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:01.768538 21979 raft_consensus.cc:2376] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10. Re-sending same reply.
I20260709 13:07:01.770117 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.820444 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.821146 21906 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:01.821923 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:01.829249 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 73830.1us
I20260709 13:07:01.794536 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:01.838435 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 43995.6us
I20260709 13:07:01.840091 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.769193 21975 raft_consensus.cc:2376] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13. Re-sending same reply.
W20260709 13:07:01.769752 21949 connection.cc:256] RPC call timeout handler was delayed by -1.9298011550000638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
I20260709 13:07:01.769958 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:01.842664 21949 connection.cc:256] RPC call timeout handler was delayed by -1.8335044990000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 13:07:01.843137 21949 connection.cc:256] RPC call timeout handler was delayed by -1.6946680580000475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 13:07:01.836812 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:01.844202 21903 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:01.844626 21981 raft_consensus.cc:2376] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14. Re-sending same reply.
I20260709 13:07:01.847313 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.850056 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.851308 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.740226 26498 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.849795 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:01.852085 21905 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:07:01.853482 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.856611 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.858212 21949 leader_election.cc:400] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13.
I20260709 13:07:01.859162 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:01.860821 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:01.861156 21874 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.761861 26513 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:01.865774 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.836890 26366 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:01.771234 26340 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:01.848842 26512 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:01.878790 26512 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:01.878466 26340 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:01.879276 26512 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:01.880956 26340 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.770764 26485 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:07:01.882457 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.882694 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:01.883234 26428 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:01.883536 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.883976 22555 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:01.884315 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.885725 26251 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.885885 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:01.886435 26503 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:01.886543 22548 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:07:01.886871 26503 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.887293 26503 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.887596 26497 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:01.887677 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:01.888200 26497 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:01.888654 26497 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:01.888914 26435 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:01.889424 26497 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:01.892764 22549 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:01.893364 26366 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.893801 26366 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.871896 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.895473 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.895659 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.896284 21902 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:07:01.896334 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:01.896759 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.884562 26428 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:01.897593 26428 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.897982 26428 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:01.865089 26092 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.836515 26263 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:01.867573 26123 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:01.876768 26131 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:01.866459 26470 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:07:01.882653 26485 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:01.890532 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:01.891592 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:01.890415 22551 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:01.874123 25992 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:01.900045 22519 connection.cc:256] RPC call timeout handler was delayed by -1.0990658259999009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 13:07:01.881798 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:01.870652 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.919894 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:01.901522 21905 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:01.886035 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.920542 21907 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:01.920941 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.921556 21908 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:01.762038 26477 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:07:01.925030 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.897126 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.761145 26068 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:07:01.923463 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.878482 26336 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:01.899477 26263 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:01.927309 21908 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:01.906104 26378 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.943955 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.945042 21908 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:01.870787 26498 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:01.868357 26332 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:07:01.928512 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.926350 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.924758 26123 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:01.920045 26266 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:07:01.943400 26263 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:01.936673 26336 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.931823 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.931768 26506 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:01.921197 26485 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:01.929509 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.934298 26330 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:01.853829 26509 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:07:01.869222 26513 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:01.917682 26131 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.853487 26486 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:07:01.945603 21907 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:01.946017 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:01.949306 26157 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:01.966183 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.966289 21905 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:01.919739 26435 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:01.924235 26340 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:01.951102 21902 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:01.946440 26397 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:02.022717 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 56653.9us
I20260709 13:07:02.031466 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:01.962574 26514 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:02.023253 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:01.950222 26498 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:02.008267 26391 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 4.541s	user 0.034s	sys 0.036s
I20260709 13:07:01.962100 26378 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.025463 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:02.037956 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:02.040221 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.059684 21905 raft_consensus.cc:2410] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:07:02.059924 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.069216 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:02.025784 26092 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:01.971757 26131 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:02.051569 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.053843 26498 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:01.970549 26513 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.970773 26339 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:01.954277 26123 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.056283 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:01.957020 26336 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:02.053969 26266 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:01.962072 26512 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:01.972520 21908 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:07:02.090385 21907 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:07:02.091825 22553 raft_consensus.cc:2410] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:07:02.081394 26092 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.058120 26397 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:02.010569 26239 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:02.098451 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.956684 26263 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.004652 26441 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.101431 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.101989 21981 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:02.055318 26366 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.130360 21907 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:02.097463 26339 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:02.024634 26485 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:02.161621 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.162922 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2190) took 3390 ms. Trace:
I20260709 13:07:02.103962 26266 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.164191 21900 rpcz_store.cc:276] 0709 13:06:58.772397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.674887 (+902490us) service_pool.cc:224] Handling call
0709 13:06:59.675203 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.675428 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:59.675695 (+   267us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.740900 (+1065205us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.884367 (+143467us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.757748 (+873381us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b18002db920. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:07:02.107877 (+350129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.107940 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:02.108019 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.108115 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.162860 (+ 54745us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12434,"prepare.queue_time_us":3744,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":4268,"raft.queue_time_us":751947,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":4734,"spinlock_wait_cycles":18814848,"thread_start_us":1537795,"threads_started":4,"wal-append.queue_time_us":941636}
W20260709 13:07:02.130609 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 371838us
I20260709 13:07:02.169389 21906 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:02.169253 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.129710 26092 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.166594 26428 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.177261 26428 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.178350 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2184) took 3464 ms. Trace:
I20260709 13:07:02.178738 21904 rpcz_store.cc:276] 0709 13:06:58.713524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.713906 (+   382us) service_pool.cc:224] Handling call
0709 13:06:58.714187 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.985477 (+271290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.178113 (+3192636us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54002e72d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:02.178297 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619914624}
I20260709 13:07:02.174454 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.182515 22554 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:07:02.173799 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 403898us
I20260709 13:07:02.183892 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:02.184233 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.164925 26339 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:02.169417 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:02.168296 26266 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:02.188862 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.194779 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:02.175105 26263 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.197875 22520 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:02.189814 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 258140us
I20260709 13:07:02.186774 26466 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:02.187960 26485 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:02.213492 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 128371us
I20260709 13:07:02.197731 26528 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.202600 26490 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:02.229847 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:02.208681 26446 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:02.208776 26466 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:02.268980 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.270448 26444 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:02.271840 26444 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:02.271881 26533 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:02.272382 26444 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:02.272477 26533 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:02.272855 26444 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.273425 26533 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:02.274701 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 44664.3us
I20260709 13:07:02.275694 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:02.275622 26330 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:02.276541 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.276901 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.274866 26533 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.278862 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:02.279975 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.279085 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.283915 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:02.285255 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.286425 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.278040 26330 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:02.285480 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.231884 26528 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.268014 26446 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.278388 26466 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:02.307504 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.310158 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.281329 26435 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:02.298447 26528 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.279179 26514 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:02.288679 26432 raft_consensus.cc:2764] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:07:02.290386 26504 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:02.278542 26527 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:02.337153 26527 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.323488 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.292202 26477 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:02.291152 26490 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.337601 26527 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.334235 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.336457 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.338794 26490 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.291818 26330 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:02.293768 26251 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:02.209551 26397 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.320022 26446 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.337244 26504 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:02.323302 26536 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:02.361234 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:02.351250 26522 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
I20260709 13:07:02.361064 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:02.368985 26524 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:07:02.360423 26378 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.370575 26514 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.351469 26330 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:02.360311 26521 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:07:02.359340 26504 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.315415 26534 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:07:02.360749 26366 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:02.379362 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 93944.2us
I20260709 13:07:02.385855 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.359067 26512 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.316105 26531 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:07:02.333042 26503 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.470599 26268 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:02.471009 26092 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.471976 26503 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:02.402602 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.404408 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:02.473619 26092 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:02.474594 21975 raft_consensus.cc:2368] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:07:02.474754 26444 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.408528 26336 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.416158 21830 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:07:02.476691 21830 pending_rounds.cc:85] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 8
I20260709 13:07:02.476962 21830 pending_rounds.cc:107] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:07:02.477185 21830 raft_consensus.cc:2889] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.427727 26266 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.479612 26266 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:02.417953 26131 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:02.480305 26529 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:07:02.425784 26466 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.481745 26131 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:02.482628 21979 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:02.421619 26528 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.483481 21977 raft_consensus.cc:2368] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:02.482389 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.470634 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:02.437187 26490 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:02.441612 26495 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:02.442648 26441 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:02.442761 26532 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:07:02.501425 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:02.447527 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:02.450100 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2271) took 2014 ms. Trace:
W20260709 13:07:02.461401 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 66355.2us
I20260709 13:07:02.480218 26168 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.503367 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.435806 26435 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:02.507244 21909 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:02.502138 21903 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:02.477988 26336 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:02.513727 22555 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:02.502897 21829 rpcz_store.cc:276] 0709 13:07:00.435281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.435756 (+   475us) service_pool.cc:224] Handling call
0709 13:07:00.456199 (+ 20443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.572157 (+115958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.572202 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.572259 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:00.572312 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.449904 (+1877592us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540009d154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:02.449946 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.450047 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266142976}
I20260709 13:07:02.512207 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:02.518906 21975 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:02.482368 26466 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:02.525357 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 238978us
I20260709 13:07:02.529170 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:02.529876 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 253440us
I20260709 13:07:02.531445 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:02.530700 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.532013 21983 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:02.533332 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:02.535799 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:02.507222 26435 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:02.516456 26092 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:02.555177 21873 leader_election.cc:400] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:07:02.560655 21873 leader_election.cc:403] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.568387 21983 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:02.520395 26490 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.559501 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:02.584894 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47953.3us
W20260709 13:07:02.628409 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.569746 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:02.668946 21900 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:07:02.667305 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 109218us
W20260709 13:07:02.674420 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 143788us
I20260709 13:07:02.672084 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:02.554688 26466 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:02.676460 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 117060us
I20260709 13:07:02.680917 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.669092 21983 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.537818 26473 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.574752 26490 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.537968 26268 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 13:07:02.684716 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:02.692847 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.695547 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:02.697794 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:02.671519 26550 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.683530 26336 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:02.680564 26466 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:02.700363 21983 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:02.555501 26536 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:07:02.679687 26531 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:07:02.685209 26266 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:02.704538 26558 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.162s	user 0.000s	sys 0.004s
I20260709 13:07:02.704589 22547 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:02.702826 26336 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:02.687386 26239 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:02.688128 26490 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.707743 21983 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:02.841195 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:02.700649 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:02.703297 26550 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:02.738781 26263 consensus_meta.cc:287] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.010s
I20260709 13:07:02.700487 26251 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:02.765105 26339 consensus_meta.cc:287] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.000s
I20260709 13:07:02.848562 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.849645 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2117) took 1726 ms. Trace:
I20260709 13:07:02.850024 21980 rpcz_store.cc:276] 0709 13:07:01.122813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.122917 (+   104us) service_pool.cc:224] Handling call
0709 13:07:02.848357 (+1725440us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:07:02.849576 (+  1219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13091072}
I20260709 13:07:02.705727 26432 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:02.766898 26498 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.005s
I20260709 13:07:02.706521 26257 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.698809 26092 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:02.756242 26444 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:02.747597 26477 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.698748 26366 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:02.743911 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2115) took 1807 ms. Trace:
W20260709 13:07:02.763003 26513 consensus_meta.cc:287] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.002s
W20260709 13:07:02.743059 26489 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.871s	user 0.006s	sys 0.018s
I20260709 13:07:02.761251 26330 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.757050 26504 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:02.744009 26549 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:02.698618 26473 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:02.705622 26466 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.832587 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:02.825953 26467 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:02.855402 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2269) took 2447 ms. Trace:
I20260709 13:07:02.844410 26239 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.840358 26336 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:02.877516 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.702591 26435 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.878743 21978 rpcz_store.cc:276] 0709 13:07:00.936928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.989069 (+ 52141us) service_pool.cc:224] Handling call
0709 13:07:00.989341 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.355640 (+366299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.743709 (+1388069us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54003a52d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:02.743859 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840450944}
I20260709 13:07:02.844660 26251 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.846159 26550 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:02.873306 26485 consensus_meta.cc:287] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.001s
I20260709 13:07:02.853777 26432 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:02.824301 26527 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.893297 21982 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:02.905751 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 63859.5us
I20260709 13:07:02.893428 21830 rpcz_store.cc:276] 0709 13:07:00.408148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.408311 (+   163us) service_pool.cc:224] Handling call
0709 13:07:00.408681 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.477789 (+2069108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.855191 (+377402us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b540017fcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:02.855350 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4615973760}
I20260709 13:07:02.859040 26339 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.907217 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:02.907838 21830 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.899811 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2129) took 1484 ms. Trace:
I20260709 13:07:02.896257 21980 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:02.897884 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.902557 26251 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:02.892053 26473 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:02.909497 26536 consensus_queue.cc:1175] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0157b4f0725d4f92a53938c921db9efc" responder_term: 14 status { last_received { term: 13 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:02.900790 26239 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.884554 26513 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:02.906354 26553 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:07:02.881388 26477 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.909938 26435 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.911099 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:02.916649 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.899369 26366 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:02.918365 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.931579 26366 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:02.931644 26477 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:02.932090 26366 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.932464 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.933667 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.934374 26513 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:02.935491 26504 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:02.937047 26339 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:02.938671 26527 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.940845 26366 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.941679 26514 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.944628 26531 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.944726 26366 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.945127 26531 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:02.901721 25978 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:02.908095 26432 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:02.931157 26239 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.871704 26498 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:02.932812 26330 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:02.922255 26473 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:02.957659 26498 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:02.949669 26531 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.966951 26550 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:02.968532 26550 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:02.970083 26531 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:02.999667 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 298842us
I20260709 13:07:03.002481 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:03.004513 21798 connection.cc:256] RPC call timeout handler was delayed by -1.2377300370000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28140000000000004s for a response
I20260709 13:07:03.004547 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:03.006582 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:03.009310 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:03.010958 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 338114us
I20260709 13:07:03.012497 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:03.014230 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:03.014796 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet edb7f62b920e42349d56d878295176b2: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:02.913491 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2202) took 4129 ms. Trace:
W20260709 13:07:03.020196 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 112434us
I20260709 13:07:03.020341 21901 rpcz_store.cc:276] 0709 13:06:58.784473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.494766 (+1710293us) service_pool.cc:224] Handling call
0709 13:07:00.495110 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.495489 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:00.495750 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.544085 (+1048335us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.544546 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.544704 (+   158us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:01.761371 (+216667us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.761628 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.761703 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.742539 (+980836us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:02.913308 (+170769us) raft_consensus.cc:1685] finished
0709 13:07:02.913327 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.913441 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7618,"prepare.queue_time_us":522223,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":458399,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":73821,"spinlock_wait_cycles":8514432,"thread_start_us":1264218,"threads_started":3,"wal-append.queue_time_us":286305}
I20260709 13:07:03.024816 21903 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:03.025943 21982 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:02.908527 21974 rpcz_store.cc:276] 0709 13:07:01.415162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.415734 (+   572us) service_pool.cc:224] Handling call
0709 13:07:02.176975 (+761241us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:07:02.177153 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.177348 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:02.177643 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.317680 (+140037us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.474401 (+156721us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b18004abf00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:02.852051 (+377650us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b18004abf00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:07:02.899312 (+ 47261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:02.899362 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:02.899408 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.899468 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.899584 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28334,"prepare.queue_time_us":4391,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":76,"raft.queue_time_us":49079,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":16879,"spinlock_wait_cycles":52293888,"thread_start_us":158055,"threads_started":2,"wal-append.queue_time_us":171714}
I20260709 13:07:03.028290 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.029387 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.029747 21982 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:03.043689 21830 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:07:03.043974 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:02.930055 21980 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.033253 21974 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 12: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:02.934448 21976 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 13: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:03.045851 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:03.023649 21902 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:02.945853 22546 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:03.046195 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:03.047278 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:03.047501 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.131011 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.131809 21830 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.048631 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:03.134521 21982 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:03.048928 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:03.136061 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:03.136934 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 88300us
I20260709 13:07:03.138746 21982 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:03.139962 26506 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:03.054878 26239 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:03.055017 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:03.056715 26081 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:03.061457 26168 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:03.063802 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:03.064606 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:03.070823 26257 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:03.072579 26263 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:03.073971 26330 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:03.082695 26366 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:03.102007 26446 consensus_meta.cc:287] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.737s	user 0.006s	sys 0.007s
I20260709 13:07:03.081563 26269 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:07:03.106097 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.111543 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.113095 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.117398 26068 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:03.174687 26550 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:07:03.178751 26336 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.180168 26527 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:03.180987 26527 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.181386 26527 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:03.182252 26239 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.182837 26239 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.175729 26477 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:03.185004 26446 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.185700 26477 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:03.186555 26550 consensus_queue.cc:1243] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:03.187879 26477 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.173873 26506 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:03.190901 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.191501 26506 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:03.201947 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.192232 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.203526 26545 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:03.204119 26545 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.196090 26531 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.204576 26545 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.191898 21974 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.207108 26251 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.208299 21834 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:07:03.209615 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.209731 26251 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.175166 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.203414 26168 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:03.213757 21831 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:07:03.214421 26168 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:03.214991 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.215062 26432 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.195956 26068 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:03.216517 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.217347 21831 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.217123 26068 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.198240 26485 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:03.210301 26257 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:03.220439 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 157038us
I20260709 13:07:03.221467 26257 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.224491 21980 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:03.197813 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 155628us
I20260709 13:07:03.195632 21828 raft_consensus.cc:2376] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12. Re-sending same reply.
I20260709 13:07:03.188959 26446 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.196873 26081 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:03.236447 26081 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:03.236884 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2153) took 1203 ms. Trace:
I20260709 13:07:03.237735 26081 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.239656 26081 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:03.240855 21981 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:03.185616 26466 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.258582 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:03.260169 26513 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:03.260921 26513 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:03.237444 21979 rpcz_store.cc:276] 0709 13:07:02.032913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.035656 (+  2743us) service_pool.cc:224] Handling call
0709 13:07:03.236390 (+1200734us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540001e5d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:03.236688 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969728768}
I20260709 13:07:03.278616 21974 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:03.286409 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 715) took 1404 ms. Trace:
I20260709 13:07:03.286999 22553 rpcz_store.cc:276] 0709 13:07:01.882047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.890310 (+  8263us) service_pool.cc:224] Handling call
0709 13:07:03.285853 (+1395543us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002508d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:03.286144 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398083968}
W20260709 13:07:03.287468 22521 connection.cc:256] RPC call timeout handler was delayed by -1.7913090010000587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 13:07:03.288046 22521 connection.cc:256] RPC call timeout handler was delayed by -1.7371794240000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 13:07:03.288480 22521 connection.cc:256] RPC call timeout handler was delayed by -1.6500090010000577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 13:07:03.290576 26068 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.291348 26513 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:03.293946 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.294409 26538 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:03.296054 22554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 709) took 1415 ms (client timeout 1886 ms). Trace:
I20260709 13:07:03.296074 26538 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:03.296723 26538 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:03.296662 22554 rpcz_store.cc:269] 0709 13:07:01.880074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.882476 (+  2402us) service_pool.cc:224] Handling call
0709 13:07:03.295626 (+1413150us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400638154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:03.295867 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687511424}
I20260709 13:07:03.298998 26538 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.300849 26538 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.292083 21983 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:03.306610 26490 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:03.309085 26490 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:03.283551 26336 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.315794 26466 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.316536 21826 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:03.320019 21829 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:03.323745 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:03.324555 21832 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:03.325587 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.326329 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.327942 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:03.288920 22521 connection.cc:256] RPC call timeout handler was delayed by -1.3363503840000703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 13:07:03.329933 22521 connection.cc:256] RPC call timeout handler was delayed by -1.0484761490000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.34990000000000004s for a response
I20260709 13:07:03.321728 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.332990 21830 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:03.217602 26432 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.334702 21832 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:03.351876 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 74369.3us
I20260709 13:07:03.350750 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.338855 26366 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:03.371975 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.372905 21830 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.364173 26332 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:03.374773 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 369363us
I20260709 13:07:03.334249 26527 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.354797 21828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:03.386385 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:03.386746 21828 raft_consensus.cc:606] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:03.388262 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.389004 21828 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.374555 26366 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.407210 21981 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.395520 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:03.416945 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45051.6us
I20260709 13:07:03.377290 26332 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:03.375854 26239 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:03.462936 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 71315.3us
I20260709 13:07:03.448073 21831 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.469956 21834 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:03.466085 26514 consensus_meta.cc:287] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.010s
I20260709 13:07:03.476320 26556 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:03.476842 26556 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:03.391829 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:03.473879 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.473467 21829 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:03.482571 26441 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:03.483093 26441 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:03.483553 26441 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.483855 21832 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:03.486294 26564 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:03.486733 26564 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:03.474116 26332 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.488507 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.489290 21976 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:03.490741 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.492072 26509 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.492723 26509 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.499400 21828 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:03.503912 26467 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:03.504395 26467 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:03.504781 26467 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:03.505273 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.497339 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:03.507107 21829 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:03.508976 26490 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:03.511502 26527 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.512427 21826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:03.513118 21826 raft_consensus.cc:606] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:03.513746 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 534) took 1308 ms. Trace:
I20260709 13:07:03.514850 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:03.515647 26580 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 13:07:03.516345 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.517550 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.518347 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:03.519888 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.520332 26081 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.521934 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.522476 26487 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.522650 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:03.523067 26487 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.514146 21909 rpcz_store.cc:276] 0709 13:07:02.205431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.509224 (+303793us) service_pool.cc:224] Handling call
0709 13:07:02.509519 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.513792 (+  4273us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:02.523802 (+ 10010us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.858895 (+335093us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b180043e7c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:07:02.958035 (+ 99140us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b180043e7c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1
0709 13:07:03.472202 (+514167us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.508387 (+ 36185us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.508637 (+   250us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:03.508672 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.508771 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.513381 (+  4610us) raft_consensus.cc:1685] finished
0709 13:07:03.513400 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.513539 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157789,"prepare.queue_time_us":10519,"raft.queue_time_us":199218,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":5130,"spinlock_wait_cycles":92218368,"thread_start_us":370262,"threads_started":2,"wal-append.queue_time_us":403899}
I20260709 13:07:03.523514 26473 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.524329 26081 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.525292 26487 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.526157 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.526432 26081 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.527606 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:03.530999 21908 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:03.530871 26556 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.531376 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:03.531733 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.532109 26556 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.532183 26490 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:03.532352 21909 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.532866 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2168) took 1013 ms. Trace:
I20260709 13:07:03.533270 21979 rpcz_store.cc:276] 0709 13:07:02.519840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.295963 (+776123us) service_pool.cc:224] Handling call
0709 13:07:03.296426 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.296907 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.296941 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.297727 (+   786us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.372794 (+ 75067us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:03.379872 (+  7078us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.380097 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.390919 (+ 10822us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.527055 (+136136us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b1800378460. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:03.532570 (+  5515us) raft_consensus.cc:1685] finished
0709 13:07:03.532673 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.532797 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8485,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":9688,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":15652,"spinlock_wait_cycles":14559488,"thread_start_us":74563,"threads_started":1,"wal-append.queue_time_us":124341}
W20260709 13:07:03.534749 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53502us
I20260709 13:07:03.535068 26490 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:03.535422 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.535903 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:03.536846 26450 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:03.537204 26490 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:03.537585 26450 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:03.538188 26450 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:03.530999 21829 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:07:03.539392 21798 connection.cc:256] RPC call timeout handler was delayed by -1.1039295629999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3186s for a response
I20260709 13:07:03.539224 26450 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:03.542738 26578 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:03.543342 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.544348 21975 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:03.543526 21829 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:03.545825 26509 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.546689 21829 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:03.546772 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.506734 26514 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:07:03.545379 21909 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:03.548492 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.549247 21907 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.550308 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 724) took 1034 ms. Trace:
I20260709 13:07:03.550724 22546 rpcz_store.cc:276] 0709 13:07:02.516254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.516453 (+   199us) service_pool.cc:224] Handling call
0709 13:07:02.945600 (+429147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.126845 (+181245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.549954 (+423109us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400673750. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:03.550107 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939571072}
I20260709 13:07:03.509037 26333 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:03.553188 26333 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:03.553671 26239 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.554303 26333 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:03.555852 26333 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.563652 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:03.544744 21798 connection.cc:256] RPC call timeout handler was delayed by -2.5115757450000729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
I20260709 13:07:03.566434 21980 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:07:03.567667 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2170) took 1043 ms. Trace:
I20260709 13:07:03.525924 26473 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.570291 21830 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:07:03.568042 21975 rpcz_store.cc:276] 0709 13:07:02.520416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.535167 (+ 14751us) service_pool.cc:224] Handling call
0709 13:07:03.543053 (+1007886us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:07:03.564080 (+ 21027us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2690816}
I20260709 13:07:03.572535 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.573613 26381 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.574074 26528 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.574211 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:03.575178 26582 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:03.575662 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.576560 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.577899 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.591039 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.591650 26464 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.592248 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2160) took 1553 ms. Trace:
I20260709 13:07:03.592634 21977 rpcz_store.cc:276] 0709 13:07:02.038690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.174225 (+135535us) service_pool.cc:224] Handling call
0709 13:07:03.584214 (+1409989us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54003f9154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:03.592045 (+  7831us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691545472}
I20260709 13:07:03.593660 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.594280 26381 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.596827 21909 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.570417 26239 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.494925 26545 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:03.598737 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.603042 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.603479 21798 connection.cc:256] RPC call timeout handler was delayed by -2.401775745000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 13:07:03.603847 21798 connection.cc:256] RPC call timeout handler was delayed by -2.3936757449999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:07:03.604086 21798 connection.cc:256] RPC call timeout handler was delayed by -2.2361757450000823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 13:07:03.604297 21798 connection.cc:256] RPC call timeout handler was delayed by -2.1533757450000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 13:07:03.604918 26528 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:03.605166 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:03.607419 21798 connection.cc:256] RPC call timeout handler was delayed by -2.1047757449999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2296s for a response
I20260709 13:07:03.597530 26490 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:03.610590 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.612895 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:03.615258 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 249745us
I20260709 13:07:03.615447 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.578552 26564 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.621601 22552 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:07:03.630703 26575 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:07:03.612530 26381 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.633095 22554 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:03.627305 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:03.635303 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 99527.1us
I20260709 13:07:03.638859 21983 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:03.641466 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:03.613555 26490 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:03.647938 21798 connection.cc:256] RPC call timeout handler was delayed by -1.4287405400000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:07:03.649878 21798 connection.cc:256] RPC call timeout handler was delayed by -1.4062405399999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 13:07:03.650508 21798 connection.cc:256] RPC call timeout handler was delayed by -1.4017405400001053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:07:03.651059 21798 connection.cc:256] RPC call timeout handler was delayed by -1.3504405400000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 13:07:03.651420 21798 connection.cc:256] RPC call timeout handler was delayed by -1.3270405400000982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:07:03.651736 21798 connection.cc:256] RPC call timeout handler was delayed by -1.3198405400000865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
I20260709 13:07:03.647017 21908 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.653370 21980 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:03.654824 21977 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:03.654881 26528 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:03.652381 26441 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:03.661151 21907 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
W20260709 13:07:03.652010 21798 connection.cc:256] RPC call timeout handler was delayed by -1.2838405400000283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
W20260709 13:07:03.662405 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.669543 21798 connection.cc:256] RPC call timeout handler was delayed by -1.1857405400000971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
I20260709 13:07:03.664959 21909 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:03.637310 26477 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.670084 21798 connection.cc:256] RPC call timeout handler was delayed by -1.1191405400001031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260709 13:07:03.671650 21901 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.674952 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:03.679410 21798 connection.cc:256] RPC call timeout handler was delayed by -1.1092405400000871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 13:07:03.679963 21798 connection.cc:256] RPC call timeout handler was delayed by -1.0930405400000609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:07:03.680300 21798 connection.cc:256] RPC call timeout handler was delayed by -1.0786405400000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:07:03.680756 21798 connection.cc:256] RPC call timeout handler was delayed by -1.0102405400000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 13:07:03.653825 26490 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.619527 26239 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.690584 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:03.693727 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55335.8us
I20260709 13:07:03.696290 26433 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:07:03.696307 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.698962 21983 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:03.701377 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.704439 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.704733 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.711706 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.712446 21830 raft_consensus.cc:2368] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:03.708834 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.713485 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.714193 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.714483 21830 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.714651 21977 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:03.711313 21831 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:03.716341 21977 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:03.717007 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.709208 26157 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:03.717777 21831 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:03.718343 25978 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:03.718492 26157 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.718915 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.719292 25978 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:03.719691 25978 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:03.719889 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.720573 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.721413 21830 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.722071 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.722141 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.714865 21832 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.723097 21830 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.723322 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:03.723834 21906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 2224) took 1877 ms (client timeout 2152 ms). Trace:
I20260709 13:07:03.724058 21828 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
W20260709 13:07:03.724238 21906 rpcz_store.cc:269] 0709 13:07:01.845896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.853237 (+  7341us) service_pool.cc:224] Handling call
0709 13:07:03.723484 (+1870247us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54002387d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:03.723667 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701348608}
I20260709 13:07:03.720646 21827 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.712746 22552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 651) took 1338 ms. Trace:
I20260709 13:07:03.725517 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.728407 21906 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.722115 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:03.729420 21907 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:07:03.730406 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:03.730669 21902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2222) took 1818 ms (client timeout 2180 ms). Trace:
I20260709 13:07:03.730979 21907 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:03.731124 21902 rpcz_store.cc:269] 0709 13:07:01.912164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.022940 (+110776us) service_pool.cc:224] Handling call
0709 13:07:03.730449 (+1707509us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400076f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:03.730617 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241097984}
I20260709 13:07:03.731706 26441 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.732262 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.727238 22552 rpcz_store.cc:276] 0709 13:07:02.374497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.374878 (+   381us) service_pool.cc:224] Handling call
0709 13:07:03.302331 (+927453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.622197 (+319866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.711758 (+ 89561us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54002508d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:03.712493 (+   735us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54002508d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:03.712659 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842092672}
I20260709 13:07:03.732551 26441 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:03.737059 26157 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.737360 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.738179 21900 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:03.742319 26378 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:03.742761 26378 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:03.743666 26378 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:03.745211 21902 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:07:03.745023 26378 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:03.745699 21903 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.746112 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.753052 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:03.754850 26584 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.244s	user 0.004s	sys 0.000s
I20260709 13:07:03.755378 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:03.756381 26581 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:07:03.757074 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:03.762068 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 6e964a7ca2a54491a72482e75917bd10: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:03.763293 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.764170 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.702853 26477 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.767303 21833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:03.769129 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.697520 26433 consensus_queue.cc:1243] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:03.775437 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:03.774813 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:03.682490 26332 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:03.780818 26503 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:03.780936 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:03.675940 26527 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:07:03.782665 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.783262 21831 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:03.783772 21826 raft_consensus.cc:2410] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:07:03.708454 21875 leader_election.cc:336] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.565s (SENT)
I20260709 13:07:03.796633 21829 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.781278 21873 leader_election.cc:400] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:03.804736 21873 leader_election.cc:403] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.807415 21907 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:03.801838 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.809531 21902 raft_consensus.cc:2368] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13.
I20260709 13:07:03.811189 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.822537 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.720631 25978 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.786401 26564 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.827241 21979 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:03.831493 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.832202 21979 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.833566 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.836957 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.838061 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.839135 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.885058 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.888437 21900 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:03.890489 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:03.891563 21909 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:03.892572 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.893311 21902 raft_consensus.cc:2376] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 8. Re-sending same reply.
I20260709 13:07:03.828343 26503 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:03.895131 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.895972 21826 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:07:03.897658 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.895233 25978 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.888188 21905 raft_consensus.cc:2376] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14. Re-sending same reply.
I20260709 13:07:03.902218 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.904152 21980 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:07:03.903978 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 147033us
W20260709 13:07:03.907505 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 126375us
I20260709 13:07:03.907029 21903 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:03.910480 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:03.911514 21908 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:03.912446 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.913086 21983 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 8.
I20260709 13:07:03.922312 21979 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
W20260709 13:07:03.923552 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 215145us
I20260709 13:07:03.924274 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:03.930666 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:03.930964 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.933075 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.933261 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.934552 21902 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 10: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.930508 26257 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:03.940830 26332 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:03.941421 21978 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:03.942260 26536 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.942884 26536 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:03.944741 26536 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:03.946297 26574 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
W20260709 13:07:03.950848 26590 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:07:03.951812 26503 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:03.952955 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.953922 21902 raft_consensus.cc:2368] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11.
I20260709 13:07:03.915732 26464 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:03.954962 26477 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.955891 26464 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.956562 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.957593 21908 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.917181 26467 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:03.932027 26545 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:03.959228 21974 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:03.959997 21908 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:03.960171 26467 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:03.960618 26513 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:03.961956 21979 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:03.962949 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.963035 26473 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:03.963619 26473 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:03.965395 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:03.942158 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:03.967597 21900 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:03.968104 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:03.969753 21904 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:03.954938 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.970748 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:03.971069 21829 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:03.971123 21902 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.971802 21903 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:03.972961 21904 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:03.974895 21826 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:03.968899 21875 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.622s (SENT) [suppressed 65 similar messages]
I20260709 13:07:03.980746 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.980628 21832 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:03.986258 21833 raft_consensus.cc:606] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:03.986611 21833 raft_consensus.cc:614] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:03.989465 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.989687 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.955928 26239 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:03.992064 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.993136 21826 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:03.996532 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:03.997174 21983 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 10: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:03.994906 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2299) took 1232 ms. Trace:
W20260709 13:07:04.001613 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.002071 21907 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:07:04.008308 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.010063 21906 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:04.011045 21900 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:07:04.010852 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:04.011410 21906 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:04.013742 21826 raft_consensus.cc:2368] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:07:03.994315 26545 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:04.019205 21902 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
W20260709 13:07:04.019318 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 93621us
W20260709 13:07:04.021688 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.021337 21902 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:04.025599 21907 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:03.982843 26473 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:03.994103 26257 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:04.032400 26366 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.524s	user 0.013s	sys 0.008s
I20260709 13:07:03.998539 21825 rpcz_store.cc:276] 0709 13:07:02.759602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.759732 (+   130us) service_pool.cc:224] Handling call
0709 13:07:03.629334 (+869602us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b5800010598. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:07:03.629598 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.629900 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:03.633833 (+  3933us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.991713 (+357880us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.991770 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.991825 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.991889 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.992001 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1550,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":3669,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":13940096,"thread_start_us":310915,"threads_started":1}
W20260709 13:07:04.038905 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.042572 22519 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:04.045707 21902 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:07:04.023403 26545 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:04.047742 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 193676us
W20260709 13:07:04.052367 21981 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.001s
I20260709 13:07:04.052884 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.046147 21902 pending_rounds.cc:85] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 7
I20260709 13:07:04.056428 21981 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:04.054563 21901 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:04.057626 21908 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:04.059288 21975 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:04.008774 26477 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:07:04.066913 26473 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.075001 21981 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:04.056083 21902 pending_rounds.cc:107] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:07:04.077984 21902 raft_consensus.cc:2889] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.058264 26545 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:04.059654 26381 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:04.092343 22552 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:04.094341 21980 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:04.099051 21826 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:04.099782 22554 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:04.045370 26257 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.096170 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:04.045941 26366 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.096017 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:04.102141 21875 leader_election.cc:336] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.946s (SENT)
I20260709 13:07:04.105726 21981 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:04.106911 22546 raft_consensus.cc:2410] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:07:04.093858 26593 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.283s	user 0.002s	sys 0.000s
I20260709 13:07:04.112236 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.117825 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.118683 21825 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:04.119664 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.123178 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.126626 21826 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
W20260709 13:07:04.138370 26556 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.606s	user 0.013s	sys 0.000s
I20260709 13:07:04.139704 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.140625 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.141211 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.141884 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.158392 21981 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:04.142675 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.143760 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.145354 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:04.157600 21827 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:04.142755 21825 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:04.146382 26257 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:04.162993 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.163833 21832 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:04.165462 21832 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:04.166790 21834 raft_consensus.cc:2368] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10.
I20260709 13:07:04.168843 21829 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:04.170236 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.171031 21976 raft_consensus.cc:2410] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:07:04.178551 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:04.178889 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 573748us
I20260709 13:07:04.180894 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.182243 21828 raft_consensus.cc:2368] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13.
I20260709 13:07:04.182355 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:04.203866 21826 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:04.171411 26464 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:04.172827 26597 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:04.168566 26490 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.212272 26490 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:04.212990 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:04.214111 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:04.216521 26477 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:04.217308 26477 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:04.217684 26528 consensus_meta.cc:287] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.002s
I20260709 13:07:04.215233 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:04.222354 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:04.224746 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.231082 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48090us
I20260709 13:07:04.213872 26441 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:04.251880 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 164883us
I20260709 13:07:04.238627 26528 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:04.263077 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.263320 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:04.266312 22553 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:04.267539 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:04.270076 26564 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:04.279420 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 99410.6us
W20260709 13:07:04.280422 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.294512 26503 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:07:04.303357 26503 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:04.303849 26503 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:04.305061 26503 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.295135 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.306967 21827 raft_consensus.cc:2376] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13. Re-sending same reply.
I20260709 13:07:04.307323 26503 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:04.307793 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.308384 21827 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:04.308260 26545 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.309245 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.309909 21827 raft_consensus.cc:2393] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:04.296079 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:04.311106 26545 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:04.296257 21832 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:04.312726 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.313578 21832 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
W20260709 13:07:04.290113 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.296411 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.315435 21828 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:04.296715 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:04.317387 21902 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:04.296149 21831 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:07:04.297827 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.319591 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.320305 21834 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:04.321030 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.321852 21834 raft_consensus.cc:2410] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:04.309353 22554 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:04.318092 21831 pending_rounds.cc:85] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 6
I20260709 13:07:04.298519 26513 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:07:04.322964 21831 pending_rounds.cc:107] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:07:04.323297 21831 raft_consensus.cc:2889] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.323508 26513 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:04.324044 26513 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:04.324398 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.325019 21831 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:04.265699 26378 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:04.326033 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.298563 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.326763 21831 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:04.327024 21829 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:04.327564 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.328375 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.328651 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.298899 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.331097 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.329768 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.333616 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:04.334595 21829 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:04.294962 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.336089 21826 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:04.297070 21825 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:07:04.316591 21977 raft_consensus.cc:2410] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:04.337064 21825 pending_rounds.cc:85] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 7
I20260709 13:07:04.337731 21825 pending_rounds.cc:107] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:07:04.338020 21825 raft_consensus.cc:2889] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.301342 22553 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.300661 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:04.339900 21904 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:04.298053 26574 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:07:04.302348 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.343779 22552 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:07:04.342401 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.347810 21830 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:04.325228 26513 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:04.358795 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 111361us
W20260709 13:07:04.357718 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 55428.2us
I20260709 13:07:04.360160 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.361430 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.361745 26564 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:04.362201 21830 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:04.362363 26564 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.362645 26513 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.363622 26564 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.361543 26441 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:04.361199 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.371333 26333 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:04.376866 26441 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:04.377995 26441 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.379624 21728 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.380967 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.381608 21829 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:04.381522 21728 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 8 to 13, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 13 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:04.383047 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.384868 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:04.387104 21829 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:04.387456 21829 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.388804 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.395521 26473 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:04.396137 26157 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:04.396252 26473 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.396623 26157 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:04.398980 21905 raft_consensus.cc:2368] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15.
I20260709 13:07:04.391193 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.399081 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2171) took 1361 ms. Trace:
I20260709 13:07:04.399513 21975 rpcz_store.cc:276] 0709 13:07:03.037676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.633445 (+595769us) service_pool.cc:224] Handling call
0709 13:07:04.059045 (+425600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.061688 (+  2643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.398901 (+337213us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54002265d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:04.399027 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956449664}
I20260709 13:07:04.406598 21830 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:04.406998 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.407133 21830 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.397560 26157 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.410763 21825 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:04.411487 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:04.386544 26333 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:04.398757 26068 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:04.416738 26157 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.397603 26473 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.418100 26477 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:04.408131 21830 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.413085 26574 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:04.424078 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.426303 21830 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.428960 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.430212 21825 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:04.435273 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.440999 22552 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:07:04.441143 26612 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:04.441618 22552 pending_rounds.cc:85] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 11
I20260709 13:07:04.442471 22552 pending_rounds.cc:107] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:07:04.442873 22552 raft_consensus.cc:2889] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.449465 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.431738 21829 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.439363 21825 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:04.429723 26513 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:04.441991 26612 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.466817 21829 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:04.468560 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.470860 21825 raft_consensus.cc:2368] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:04.457834 26068 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.461161 26477 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.466168 26513 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:04.475051 26477 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.475180 26513 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.476766 26513 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.466419 26611 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:04.478699 26611 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.479606 26611 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:04.493657 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.495072 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.492125 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.496802 21830 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:07:04.497351 21830 pending_rounds.cc:85] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 6
I20260709 13:07:04.497786 21830 pending_rounds.cc:107] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:07:04.498034 21830 raft_consensus.cc:2889] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.499490 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.498982 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.486708 26574 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:07:04.503324 26574 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:04.503062 26612 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.503688 26574 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:04.504563 26574 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.505728 26574 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:04.511080 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.512575 26609 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:04.513252 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:04.513677 26609 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:04.514046 26609 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.514881 26609 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.516360 26564 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:04.517109 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.517769 26609 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.518451 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:04.519459 21827 raft_consensus.cc:2368] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:07:04.520470 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.472730 26503 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:07:04.483562 26333 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.531076 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:04.533033 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 566) took 1787 ms. Trace:
I20260709 13:07:04.517884 21834 raft_consensus.cc:2376] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15. Re-sending same reply.
I20260709 13:07:04.535741 21829 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:04.533473 21978 rpcz_store.cc:276] 0709 13:07:02.745270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.628046 (+882776us) service_pool.cc:224] Handling call
0709 13:07:03.628383 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.941802 (+313419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.532732 (+590930us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540001efd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:04.532961 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485454208}
I20260709 13:07:04.496374 26378 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:04.539924 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.543936 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:04.528502 26473 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:04.542402 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:04.547888 22546 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:04.557163 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.557065 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:04.546655 26564 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:04.545746 26366 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:04.561226 21830 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:04.566407 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:04.567763 26239 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:07:04.574870 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:04.566313 26611 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:04.573701 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 555) took 1831 ms. Trace:
I20260709 13:07:04.573807 26131 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:04.567586 26477 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:04.577245 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.576211 21974 rpcz_store.cc:276] 0709 13:07:02.742085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.339348 (+597263us) service_pool.cc:224] Handling call
0709 13:07:03.466763 (+127415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.959691 (+492928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.572814 (+613123us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400225bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:04.572980 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131985280}
I20260709 13:07:04.578131 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2206) took 1089 ms. Trace:
I20260709 13:07:04.576907 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2173) took 1538 ms. Trace:
I20260709 13:07:04.576274 26131 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:04.580297 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 892219us
I20260709 13:07:04.579185 21982 rpcz_store.cc:276] 0709 13:07:03.038507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.658909 (+620402us) service_pool.cc:224] Handling call
0709 13:07:03.659389 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.659738 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:03.660160 (+   422us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.804844 (+144684us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.576440 (+771596us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b1800392920. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:07:04.576578 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.576641 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:04.576683 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.576759 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.576856 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9904,"prepare.queue_time_us":5167,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":6800,"raft.queue_time_us":784591,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":12970,"spinlock_wait_cycles":30437120,"thread_start_us":125929,"threads_started":1,"wal-append.queue_time_us":290534}
I20260709 13:07:04.580821 26131 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:04.581794 26506 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:04.582150 26131 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:04.582445 26506 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:04.583379 26506 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.584828 26268 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:04.585840 26268 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:04.578614 21976 rpcz_store.cc:276] 0709 13:07:03.488374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.517294 (+ 28920us) service_pool.cc:224] Handling call
0709 13:07:04.576845 (+1059551us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54003f9b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:04.578072 (+  1227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496103808}
W20260709 13:07:04.586359 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 681284us
W20260709 13:07:04.578270 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.567615 26473 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.593062 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:04.590700 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34370 (request call id 55) took 1004 ms. Trace:
I20260709 13:07:04.596273 21830 raft_consensus.cc:2410] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:04.594980 21833 rpcz_store.cc:276] 0709 13:07:03.575054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.767004 (+191950us) service_pool.cc:224] Handling call
0709 13:07:04.578802 (+811798us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54001d83d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd8853 00007fb763fa660a 00007fb75d52c7d4 00007fb75d52c762 00007fb75d52c691 00007fb75d52c60c 00007fb75d52b8c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:04.578899 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450466176}
I20260709 13:07:04.573760 26366 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:04.604844 26366 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.608439 26366 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:04.608309 26092 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:04.593756 26548 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:07:04.619252 26618 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.637001 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53024.1us
W20260709 13:07:04.637850 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.643224 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.604923 26611 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.575807 26068 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.606564 26467 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:04.606387 26536 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:04.635932 26613 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:04.677053 26433 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.647119 26618 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.711115 26444 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:04.712078 26444 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:04.711400 26610 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:07:04.705267 26613 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:04.707757 26473 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.716158 26433 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.783574 26444 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.815502 26433 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:04.817389 26366 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:04.823132 26617 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:07:04.725927 26611 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:04.822122 26615 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:07:04.821358 26618 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:04.824755 26613 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:04.841693 26366 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.072639 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.075718 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:06.081214 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.082758 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:06.085330 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:06.086930 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 1.44633e+06us
I20260709 13:07:06.087327 26622 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:06.090911 26622 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:06.092063 26622 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.093040 26613 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.093454 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2178) took 2790 ms. Trace:
I20260709 13:07:06.093703 26622 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.093870 21979 rpcz_store.cc:276] 0709 13:07:03.303114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.993979 (+690865us) service_pool.cc:224] Handling call
0709 13:07:04.009306 (+ 15327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.616219 (+606913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.616265 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.648217 (+ 31952us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.091672 (+1443455us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:06.091711 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.091773 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.093224 (+  1451us) raft_consensus.cc:1685] finished
0709 13:07:06.093244 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.093381 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":585427,"raft.queue_time_us":603059,"spinlock_wait_cycles":29316864,"thread_start_us":7743,"threads_started":1,"wal-append.queue_time_us":7664}
I20260709 13:07:06.099233 26631 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:06.100986 26632 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:06.101917 26631 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:06.102700 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.103026 26631 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:06.109570 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.112356 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.115180 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2179) took 2811 ms. Trace:
I20260709 13:07:06.115614 21983 rpcz_store.cc:276] 0709 13:07:03.303660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.999533 (+695873us) service_pool.cc:224] Handling call
0709 13:07:04.015072 (+ 15539us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:04.609287 (+594215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.609316 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:04.609953 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 13:07:04.632176 (+ 22223us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:04.632241 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.632325 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.114926 (+1482601us) raft_consensus.cc:1685] finished
0709 13:07:06.114950 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.115118 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":589658,"raft.queue_time_us":593051,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12660,"spinlock_wait_cycles":1515264,"thread_start_us":21795,"threads_started":1,"wal-append.queue_time_us":117451,"wal-append.run_cpu_time_us":2486,"wal-append.run_wall_time_us":1085965}
W20260709 13:07:06.112357 21875 leader_election.cc:336] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.655s (SENT)
I20260709 13:07:06.120604 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:06.121740 21875 leader_election.cc:336] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.713s (SENT)
W20260709 13:07:06.122494 21875 connection.cc:256] RPC call timeout handler was delayed by -1.3665533630000937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 13:07:06.122836 21875 connection.cc:256] RPC call timeout handler was delayed by -1.3264907170000697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 13:07:06.123119 21875 connection.cc:256] RPC call timeout handler was delayed by -1.3126410500000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:07:06.123872 21875 leader_election.cc:336] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 2.808s (SENT)
I20260709 13:07:06.124351 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:06.125385 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.125908 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.126601 21875 connection.cc:256] RPC call timeout handler was delayed by -1.0784669749999694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 13:07:06.127117 21875 connection.cc:256] RPC call timeout handler was delayed by -1.0280669750000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:07:06.129175 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.132686 26635 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.133369 26635 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.135842 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:06.139109 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.142700 26635 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:06.143512 26635 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:06.142069 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.145486 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:06.146724 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.149870 26635 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:06.150725 26635 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.151327 26635 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:06.162142 21825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.531s	user 0.020s	sys 0.040s
W20260709 13:07:06.162792 21825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.539s	user 0.022s	sys 0.040s
W20260709 13:07:06.149909 26619 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.357s	user 0.004s	sys 0.036s
I20260709 13:07:06.175351 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 573) took 1550 ms. Trace:
I20260709 13:07:06.175983 21832 rpcz_store.cc:276] 0709 13:07:04.625172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.625572 (+   400us) service_pool.cc:224] Handling call
0709 13:07:04.625916 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.636057 (+ 10141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.636093 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.174850 (+1538757us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:06.174972 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.175084 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.175275 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.180486 26631 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:06.182320 26633 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:06.182982 26631 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:06.184108 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 571) took 1590 ms. Trace:
I20260709 13:07:06.183924 26633 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:06.184508 21825 rpcz_store.cc:276] 0709 13:07:04.593457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.603127 (+  9670us) service_pool.cc:224] Handling call
0709 13:07:04.603439 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.163212 (+1559773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.163246 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.163771 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.176687 (+ 12916us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:06.180130 (+  3443us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.180324 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.183797 (+  3473us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.183851 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:06.183865 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.184004 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5812,"prepare.queue_time_us":2937,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":24310,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6215,"thread_start_us":1555255,"threads_started":3,"wal-append.queue_time_us":11436}
I20260709 13:07:06.188016 26636 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:06.188517 26636 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:06.189126 26631 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:06.189627 26636 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.189777 26631 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:06.187974 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.192523 26631 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.196197 26631 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.191403 26636 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.198830 26477 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:06.202519 26157 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.203013 26157 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.206336 26514 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.206794 26514 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.208904 26514 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.209421 26514 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.216293 26531 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:06.217113 26531 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.219370 26503 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.219933 26503 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.220860 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:06.221593 26636 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.222128 26636 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.222036 26503 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.223488 26503 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:06.223778 26441 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:06.224370 26636 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.224291 26441 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.225167 26503 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.225539 26503 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:06.225656 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.225941 26503 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.226576 21825 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:06.228016 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.230618 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.231432 21827 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
I20260709 13:07:06.233367 26441 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.235144 26441 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.235657 26441 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.236195 26503 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.238806 26157 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.240006 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 570) took 1646 ms. Trace:
I20260709 13:07:06.240515 26157 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:06.210105 26514 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:06.240988 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:06.242197 26514 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:06.242595 26157 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:06.243022 26157 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.243171 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:06.244398 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.245877 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.240412 21834 rpcz_store.cc:276] 0709 13:07:04.593206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.593525 (+   319us) service_pool.cc:224] Handling call
0709 13:07:04.608318 (+ 14793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.616577 (+  8259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.616620 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.635381 (+ 18761us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.239657 (+1604276us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:06.239711 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.239783 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.239826 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:06.239838 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.239951 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7824,"raft.queue_time_us":22597,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":11618,"thread_start_us":11254,"threads_started":1,"wal-append.queue_time_us":5326}
I20260709 13:07:06.247044 26513 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:06.248199 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.248919 21832 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:06.251210 26531 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.251904 26531 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.253155 26531 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.252653 26514 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:06.255358 26514 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:06.255874 26514 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.255991 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:06.237962 26441 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.254588 26640 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:06.261339 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.261397 26513 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:06.262879 26513 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.243474 26157 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.263358 26636 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.263973 26636 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.257292 26641 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:06.261437 26531 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.267300 26477 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.267441 26514 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.267899 26477 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.239097 26503 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.269574 26514 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.270108 26477 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.271602 26636 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.263391 26513 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:06.278393 26513 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:06.271790 21873 connection.cc:256] RPC call timeout handler was delayed by -1.2579950690000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:07:06.273101 26330 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:06.281936 26642 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.282218 26330 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:06.282518 26642 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.282403 26514 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.283135 26330 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.283589 26514 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.284922 26642 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.284976 26330 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:06.285456 26642 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.285523 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.285833 26514 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.282927 26574 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.286561 26574 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.288437 26641 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.288918 26641 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.285976 26642 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.291200 26641 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.291679 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:06.291764 26531 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.292325 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 664) took 2023 ms. Trace:
I20260709 13:07:06.292403 26531 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.292325 26514 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:06.292738 22546 rpcz_store.cc:276] 0709 13:07:04.269090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.269287 (+   197us) service_pool.cc:224] Handling call
0709 13:07:04.273233 (+  3946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.548716 (+275483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.292097 (+1743381us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54002af3d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:06.292266 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631123200}
I20260709 13:07:06.294708 26503 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:06.292382 26574 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.295215 26642 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.295583 26531 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.316277 26631 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.316790 26631 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.296507 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:06.306758 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.318442 26631 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:06.318698 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.318737 26642 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.308956 26513 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.313870 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.319713 21830 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:06.320138 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.320951 26514 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:06.321334 21875 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.322358 26514 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.322551 26513 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.323899 26513 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:06.324764 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:06.326540 26642 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:06.326922 26642 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:06.327292 26642 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.328086 26503 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:06.340898 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:06.334591 26503 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:06.342818 26642 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.345458 26514 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:06.346093 26514 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:06.346513 26514 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.351027 26503 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.371414 26642 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.334098 26643 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:06.352139 26157 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.375648 26157 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.354446 26441 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.378645 26441 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.380949 26441 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.381582 26643 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.383685 26643 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.356389 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:06.389889 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.803s	user 0.021s	sys 0.025s
W20260709 13:07:06.390275 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.803s	user 0.022s	sys 0.025s
I20260709 13:07:06.390106 22553 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 9.
W20260709 13:07:06.390684 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 1.80351e+06us
I20260709 13:07:06.391450 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:06.357313 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:06.392926 22548 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:06.358803 26513 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:06.359678 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:06.360836 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:06.361013 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:06.394647 22551 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:06.362726 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:06.395560 22550 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
W20260709 13:07:06.364706 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.396183 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:06.396394 21874 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.397634 26513 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:06.398072 26513 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.398612 26513 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.365628 26514 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.367619 26536 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:06.354902 22546 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:06.442945 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:06.443300 21833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edb7f62b920e42349d56d878295176b2"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:06.444013 21833 raft_consensus.cc:606] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:06.411926 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.409583 26514 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.445029 26157 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.445531 26157 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.447746 26157 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.414347 25978 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:06.448211 26444 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.448303 25978 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:06.449326 25978 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.450898 25978 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:06.402696 26503 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.424222 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 669) took 1864 ms. Trace:
I20260709 13:07:06.452253 22554 rpcz_store.cc:276] 0709 13:07:04.559637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.559856 (+   219us) service_pool.cc:224] Handling call
0709 13:07:04.560211 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.563176 (+  2965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.563224 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.564837 (+  1613us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.603552 (+ 38715us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:04.603590 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.603650 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.149587 (+1545937us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b240033b4c8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf3009d 00007fb75eb6210e 00007fb75eb7988c 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221
0709 13:07:06.423935 (+274348us) raft_consensus.cc:1685] finished
0709 13:07:06.423956 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.424161 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4242,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1099,"spinlock_wait_cycles":21592320,"thread_start_us":33206,"threads_started":1,"wal-append.queue_time_us":147282}
I20260709 13:07:06.434064 26068 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:06.435770 26643 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.454409 26068 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.437498 21825 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:06.439277 26548 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.455622 26548 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.456835 26068 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:06.415261 21829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.805s	user 0.015s	sys 0.019s
W20260709 13:07:06.408402 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.441782 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.443583 26536 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.460563 26548 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:06.453610 26513 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.436473 26635 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:06.461813 26635 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.462296 26536 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.454473 26643 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.463994 26635 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.464636 26643 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.387900 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.465549 21833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
W20260709 13:07:06.465698 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 77907.1us
I20260709 13:07:06.466213 21833 raft_consensus.cc:606] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:06.466642 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.467401 26381 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:06.459312 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.467754 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:06.468098 26381 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:06.468370 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.468883 21875 leader_election.cc:400] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:06.468850 26381 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.469497 26381 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.469887 26381 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.470333 26503 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:06.470438 26514 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.470785 26503 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:06.470992 26514 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.471257 26503 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.471454 26514 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.472515 26574 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:06.473924 26574 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:06.474184 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.475080 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:06.475423 26641 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.475751 22554 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:06.475833 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:06.476748 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.478681 26642 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.479758 26642 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.461251 26157 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:06.480492 26157 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.480978 26157 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:06.460458 21829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.850s	user 0.015s	sys 0.020s
I20260709 13:07:06.489559 26467 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:06.491719 22519 connection.cc:256] RPC call timeout handler was delayed by -1.7155403770000248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 13:07:06.503021 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.485601 26381 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.489997 26467 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:06.492118 26642 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.517514 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:06.513401 26381 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.515102 26467 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.518316 22554 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.519522 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:06.521062 22550 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.515872 26513 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.508522 26503 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.527874 26640 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:06.531541 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:06.540591 22554 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:06.541913 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.542776 21832 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:06.544219 21833 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 9: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:06.543932 26640 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:06.546280 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:06.546154 26640 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.545410 21728 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 6 to 12, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 12 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:06.549280 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.550217 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.550433 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.554703 26513 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:06.551151 21830 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:06.555259 26513 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:06.553678 26640 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:06.557497 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 87379.7us
I20260709 13:07:06.559265 21875 leader_election.cc:400] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:07:06.559520 21875 leader_election.cc:403] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:06.562282 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 170740us
W20260709 13:07:06.564827 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.565377 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.567778 26503 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.568511 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.568966 26433 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:06.569096 21834 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:06.571084 21830 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:07:06.571429 21830 pending_rounds.cc:85] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 9
I20260709 13:07:06.571645 21830 pending_rounds.cc:107] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:07:06.571870 21830 raft_consensus.cc:2889] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:06.573254 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 481580us
I20260709 13:07:06.576578 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:06.577891 21831 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:06.579057 26266 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.579274 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:06.579465 21833 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:06.579530 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:06.579834 26332 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.580202 21979 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.580482 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.580291 26332 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.581197 21826 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:06.581465 21827 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:06.582139 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:06.582244 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.579666 26330 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.582736 21828 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.580250 26123 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.582306 26444 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.583537 26444 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.587662 21979 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:06.593020 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:06.598613 22554 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:06.596196 21728 catalog_manager.cc:5697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.569582 26433 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.603332 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.604841 22550 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:06.606720 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:06.606963 26444 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:06.607162 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:06.602021 26635 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:06.607550 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:06.608063 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:06.608201 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:06.608426 21904 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:06.608777 21909 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:06.608845 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.598317 26641 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:07:06.609272 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:06.609501 21833 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:06.556154 26513 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.610751 21908 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:06.611253 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.611711 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:06.611868 21982 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:06.612319 22546 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:06.553963 26157 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.607807 21903 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:06.609885 21902 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:06.616930 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.620728 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.632855 21834 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:06.609898 21983 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:06.614224 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:06.550745 26514 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.637988 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:06.634518 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.632895 21728 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:06.639797 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 74568.5us
I20260709 13:07:06.588325 26467 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.615144 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:06.639803 21976 raft_consensus.cc:2376] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14. Re-sending same reply.
I20260709 13:07:06.612737 26123 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.644968 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.643581 21979 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.644207 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.646665 21833 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:06.648128 21900 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:06.602556 26366 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:06.649166 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:06.582966 26330 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.658109 26433 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.658699 26330 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:06.579545 26266 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.660511 26266 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.648090 26332 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.643088 26643 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.662742 26643 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.663082 26643 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.638526 26068 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.652889 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.674202 21981 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:06.674075 21825 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:07:06.653281 21730 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33528 (request call id 223) took 48180 ms (client timeout 15000 ms). Trace:
I20260709 13:07:06.665124 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:06.653607 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:06.675822 21974 raft_consensus.cc:2410] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:07:06.653896 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.676750 21978 raft_consensus.cc:2410] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:06.654520 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.655258 26157 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.655213 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.656366 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 569) took 2063 ms. Trace:
I20260709 13:07:06.665872 21982 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:06.677706 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.633097 26620 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:06.656488 26622 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.639199 26506 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.695420 21949 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.694952 21728 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.648114 26444 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.665984 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.649904 26531 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:06.715672 26531 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.716094 26531 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.716234 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:06.717353 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.717857 21977 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:06.671275 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.641010 26378 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.722674 26378 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.724731 26378 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:06.725266 26444 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.680104 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.677744 21979 raft_consensus.cc:2410] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:07:06.729146 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:06.730602 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.732352 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:06.733070 21905 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:06.733285 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:06.677501 21829 rpcz_store.cc:276] 0709 13:07:04.592921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.593028 (+   107us) service_pool.cc:224] Handling call
0709 13:07:04.593312 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.488409 (+1895097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.488449 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.488975 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.510886 (+ 21911us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:06.521003 (+ 10117us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.521275 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.521368 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.553043 (+ 31675us) spinlock_profiling.cc:243] Waited 877 us on lock 0x7b1800031ba0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:06.656090 (+103047us) raft_consensus.cc:1685] finished
0709 13:07:06.656182 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.656310 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13255,"prepare.queue_time_us":9952,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":18911,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":12040,"spinlock_wait_cycles":2016512,"thread_start_us":1899083,"threads_started":2,"wal-append.queue_time_us":74858}
I20260709 13:07:06.734108 21904 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:06.696743 26620 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.735582 26632 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:07:06.737452 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.738103 21978 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:06.731293 21979 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:06.738683 26620 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:06.738979 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.681488 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:06.666724 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.697441 26450 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:07:06.694988 26068 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.700827 26330 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.754747 26444 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.702422 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:06.782312 26330 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:06.701264 26332 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:06.782671 26450 consensus_queue.cc:1243] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:06.783212 26444 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:06.704152 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.787549 26444 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:06.787962 21981 raft_consensus.cc:2410] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:07:06.788345 26444 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.788853 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.789408 21981 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:06.789505 26444 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:06.706231 22576 debug-util.cc:398] Leaking SignalData structure 0x7b0800250660 after lost signal to thread 20697
I20260709 13:07:06.706419 26333 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:06.790668 26333 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:06.791038 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080031f900 after lost signal to thread 21766
W20260709 13:07:06.792383 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9c20 after lost signal to thread 21858
W20260709 13:07:06.792651 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3220 after lost signal to thread 21859
W20260709 13:07:06.793692 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0400 after lost signal to thread 21933
I20260709 13:07:06.707240 21909 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:06.707521 26603 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:07:06.674937 21730 rpcz_store.cc:269] 0709 13:06:18.482840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.489125 (+  6285us) service_pool.cc:224] Handling call
0709 13:06:20.425026 (+1935901us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b540037bed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef48090 00007fb75efe6f3a 00007fb764d9d1cc 00007fb764e9b37e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc 00007fb76335b392 00007fb75d31948c 00007fb75d3188c6
0709 13:07:06.653019 (+46227993us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:57.545134 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:57.545721 (+   587us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:57.545779 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:06:57.545795 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:57.546261 (+   466us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:57.546323 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:57.546351 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:57.621930 (+ 75579us) tablet.cc:701] Row locks acquired
0709 13:06:57.635005 (+ 13075us) write_op.cc:260] PREPARE: finished
0709 13:06:57.685835 (+ 50830us) write_op.cc:270] Start()
0709 13:06:57.722153 (+ 36318us) write_op.cc:276] Timestamp: P: 1783602417651675 usec, L: 0
0709 13:06:57.722203 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:06:57.764678 (+ 42475us) log.cc:844] Serialized 929 byte log entry
0709 13:06:59.019967 (+1255289us) op_driver.cc:464] REPLICATION: finished
0709 13:06:59.671167 (+651200us) write_op.cc:301] APPLY: starting
0709 13:06:59.671285 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:00.444671 (+773386us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:00.485466 (+ 40795us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:00.512212 (+ 26746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:00.586079 (+ 73867us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:07:00.596074 (+  9995us) write_op.cc:312] APPLY: finished
0709 13:07:00.629879 (+ 33805us) log.cc:844] Serialized 33 byte log entry
0709 13:07:00.948195 (+318316us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:00.976107 (+ 27912us) write_op.cc:454] Released schema lock
0709 13:07:01.106812 (+130705us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:01.260182 (+153370us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:01.267950 (+  7768us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1996865,"reported_tablets":51,"spinlock_wait_cycles":222546688,"child_traces":[["op",{"apply.queue_time_us":642055,"apply.run_cpu_time_us":36371,"apply.run_wall_time_us":1480805,"cfile_cache_hit":6,"cfile_cache_hit_bytes":6261,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":1,"lbm_read_time_us":25086,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":6,"num_ops":2,"prepare.queue_time_us":228781,"prepare.run_cpu_time_us":3901,"prepare.run_wall_time_us":219870,"replication_time_us":1274071,"thread_start_us":571810,"threads_started":3,"wal-append.queue_time_us":713812,"wal-append.run_cpu_time_us":1548,"wal-append.run_wall_time_us":1127149}]]}
I20260709 13:07:06.706076 26656 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:06.796259 26656 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:06.796851 26643 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.797442 26656 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.710441 21902 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:06.607846 26635 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.800001 21981 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:06.698262 26622 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.714789 26506 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.715093 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.670986 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.718204 26239 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:06.647836 26123 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.722056 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.804519 21834 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:06.730794 21903 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:06.739502 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.809508 21979 raft_consensus.cc:2376] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13. Re-sending same reply.
I20260709 13:07:06.735328 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:06.693970 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49833.1us
I20260709 13:07:06.734898 21901 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:07:06.736340 21983 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:06.747278 21874 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.689525 21828 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:06.697795 26441 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.741539 21978 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
W20260709 13:07:06.830572 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 95331.4us
I20260709 13:07:06.781412 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.675325 26366 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.782459 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:06.783141 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 134705us
I20260709 13:07:06.703203 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:06.783773 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 106130us
I20260709 13:07:06.832490 22546 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:06.832764 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 129637us
I20260709 13:07:06.703496 26514 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.784061 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:06.782802 26330 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.718245 26266 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:07:06.837766 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.785073 26068 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:06.785239 21831 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
W20260709 13:07:06.786068 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 226713us
I20260709 13:07:06.842948 21825 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:07:06.782791 21908 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:06.790990 26333 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:06.707019 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:06.845345 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 138397us
I20260709 13:07:06.845813 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:06.846110 21978 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:07:06.795488 26603 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:06.708220 21728 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.648097 26268 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.800539 21981 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:06.802028 22576 debug-util.cc:398] Leaking SignalData structure 0x7b0800193be0 after lost signal to thread 22007
I20260709 13:07:06.849550 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:06.850363 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080033c5e0 after lost signal to thread 22579
W20260709 13:07:06.850692 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080004c540 after lost signal to thread 22580
W20260709 13:07:06.815631 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 68462.7us
I20260709 13:07:06.810853 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.777182 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:06.834429 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.835597 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:06.836025 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.837359 21977 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:06.839058 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.840257 21979 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:06.840695 21974 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:06.846511 22519 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.846544 21980 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:06.846587 21978 pending_rounds.cc:85] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 7
I20260709 13:07:06.849059 21975 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:06.854497 22551 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.855130 21978 pending_rounds.cc:107] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:07:06.855515 21978 raft_consensus.cc:2889] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.848713 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.831569 26157 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:06.856935 21833 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:06.847582 26473 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:07:06.866880 26433 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.867192 21948 leader_election.cc:400] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13.
I20260709 13:07:06.867522 21948 leader_election.cc:403] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:06.857185 21834 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 14 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:06.844233 26332 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:06.854010 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:06.859529 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:06.868067 26621 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13.
I20260709 13:07:06.859982 21976 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:06.842733 26620 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:06.869181 26620 consensus_queue.cc:1243] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:06.869390 26633 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.869786 26633 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.870095 26633 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.870510 26591 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:06.870910 26591 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:06.871280 26591 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.873018 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.851181 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.875379 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:06.876621 22546 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:06.860423 21978 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:06.842499 26450 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:07:06.860657 21981 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.861052 26239 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:06.861573 26123 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:06.895061 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 84277.7us
I20260709 13:07:06.895714 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.896265 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.867987 26332 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.868880 21976 pending_rounds.cc:85] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 5
I20260709 13:07:06.899345 21976 pending_rounds.cc:107] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:06.899650 21976 raft_consensus.cc:2889] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.868642 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:06.860038 25978 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.882409 26613 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.903271 26592 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:06.879335 26378 raft_consensus.cc:2764] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:07:06.837610 26631 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:06.884466 26622 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.880200 26268 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.915095 26435 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:07:06.916494 26123 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.916844 26268 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.917026 26123 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:06.917387 26506 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:06.917694 21982 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:06.904047 26332 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:06.917928 26123 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.885978 26366 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.887604 26513 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.930809 26641 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:06.931311 26641 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:06.932066 26641 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.932878 26591 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.881853 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:06.881282 26333 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.885624 21728 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.873296 26068 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:06.885051 26531 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.890318 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.908200 21981 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.908694 25978 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.909785 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:06.942065 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.942524 21833 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:06.848662 26603 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:06.911473 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65014.8us
I20260709 13:07:06.944831 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:07:06.895138 26658 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.076s	user 0.003s	sys 0.009s
W20260709 13:07:06.913977 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 80592.9us
I20260709 13:07:06.899154 26632 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:06.830288 26642 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.897804 26620 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:06.903374 26157 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:06.913486 26631 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.955891 26631 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.912689 26441 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.956524 26513 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.957062 26441 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.957497 26441 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.958424 26620 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:06.959385 26620 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.961916 26332 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.962707 26157 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.963805 26332 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:06.940465 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50225.7us
I20260709 13:07:06.940637 21728 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.943480 22551 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:06.967885 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.966224 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:06.945492 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 70937.1us
I20260709 13:07:06.946444 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:06.876374 26556 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:06.912636 26655 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.946513 26092 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:07:06.979346 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.950264 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 81731.7us
I20260709 13:07:06.943028 25978 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.945824 26506 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.955226 26333 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.971740 21981 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
W20260709 13:07:06.981145 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 83813.3us
I20260709 13:07:06.993659 21981 pending_rounds.cc:85] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 8
I20260709 13:07:06.952078 26643 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:06.942489 26330 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:06.948014 26592 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:06.979664 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.983348 26656 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:06.993923 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:06.994148 21981 pending_rounds.cc:107] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:07:06.995460 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:06.964996 26441 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:06.978564 21728 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 9 to 12, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 12 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.965927 26574 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:06.979095 26655 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:06.990190 26092 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:06.978889 26556 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:07.033629 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.013275 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 66902.8us
I20260709 13:07:07.001077 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:07.002895 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:07.042234 21981 raft_consensus.cc:2889] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.042759 21834 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:07.042970 21828 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
W20260709 13:07:07.014976 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 133210us
I20260709 13:07:07.005807 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:07.021373 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.005962 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:07.044157 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.044096 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 48707us
W20260709 13:07:07.045078 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.018328 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.003245 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:07.048048 21833 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:07:06.990438 26123 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:06.991920 26513 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:06.993738 26506 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.055914 21798 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:07.058145 21728 catalog_manager.cc:5697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 8 to 10, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 10 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.060551 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:07.062016 21903 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:07.061758 21728 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.055138 26123 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:07.063620 26123 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.997689 26239 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:07.065270 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:07.068895 22549 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:07.065933 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:07.069406 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.069768 21902 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:07.066004 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:07.062480 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:07.067020 21901 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:07.069375 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:07.071449 21900 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:07.004559 26642 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:07.074096 21728 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 7 to 12, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 12 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:07:07.105481 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 160702us
I20260709 13:07:07.069850 26513 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:07.107514 26654 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:07:07.108546 26092 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.056916 26620 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:06.998677 26366 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:07:07.110817 26556 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.111521 26441 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:07.013554 26635 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:07.049307 26655 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.054802 26068 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:07.060572 26506 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.017511 26633 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.059518 26574 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:07.132412 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:07.187016 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54722.9us
I20260709 13:07:07.187757 22549 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:07.188733 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:07.132479 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 70074.9us
W20260709 13:07:07.110416 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 104539us
I20260709 13:07:07.111954 26591 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:07.006230 26662 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 13:07:07.156932 26635 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:07.161904 21983 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:07.123374 26450 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:07.162532 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49636.5us
I20260709 13:07:07.163084 26592 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.170676 26556 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:07.014813 26603 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.115422 26664 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:07.147163 26620 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.447810 26664 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.448465 26664 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.151413 26622 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:07.450399 26622 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.450881 26622 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:07.173476 26330 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:07.155380 26068 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:07.454687 26068 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.174707 21900 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
W20260709 13:07:07.175544 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 181683us
I20260709 13:07:07.189699 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:07.409859 26677 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:07.406903 21948 leader_election.cc:400] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11.
W20260709 13:07:07.459151 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52442.8us
W20260709 13:07:07.460011 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.459977 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:07.460489 26635 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.464808 26635 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.466928 26635 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:07.253095 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.475402 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.194926 26531 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:07.214959 26591 raft_consensus.cc:2764] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:07:07.249356 26513 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:07.319701 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 277200us
W20260709 13:07:07.340926 26668 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:07:07.407685 26613 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:07.412495 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:07.415808 26670 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.441249 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:07.414922 26656 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:07.414690 25978 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:07.422488 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 217361us
I20260709 13:07:07.485395 26435 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:07.488911 26635 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:07.490968 26635 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:07.424299 21834 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:07.491523 26656 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.492087 26656 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.491847 26635 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.486203 26330 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:07.493372 26330 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.493746 26330 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:07.435113 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.495221 22549 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:07.495563 25978 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:07.496021 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.496114 25978 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.496760 25978 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.427883 26633 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:07.447889 26620 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:07.173008 26092 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:07.481521 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 291875us
I20260709 13:07:07.469931 26603 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.482947 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:07.411792 26506 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:07.430724 26661 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.475s	user 0.005s	sys 0.006s
I20260709 13:07:07.484812 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:07.508124 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:07.508414 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:07.509192 21983 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:07:07.502137 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.487085 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 74746us
I20260709 13:07:07.502699 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:07.510658 21829 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.503123 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:07.427582 26631 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.509301 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:07.511453 21978 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.502696 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:07.506549 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:07.512712 21832 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.513731 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:07.515818 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 74656.3us
I20260709 13:07:07.516510 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:07.521778 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:07.523484 21798 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:07.526686 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.521883 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:07.528527 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:07.531050 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.514935 26633 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:07.531838 26633 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.532171 26633 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.534476 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:07.534152 26330 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.505991 26157 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.535135 26662 raft_consensus.cc:2764] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:07:07.535907 26366 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:07.536275 26366 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:07.536512 26366 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.538429 26131 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:07.539088 26643 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:07.539479 26643 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.539819 26643 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:07.540160 26239 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:07.542413 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:07.542973 21905 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.545140 26366 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.535056 21904 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:07:07.538486 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 55639.7us
W20260709 13:07:07.515736 26641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.011s	sys 0.030s
I20260709 13:07:07.553864 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:07.554112 21831 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 13:07:07.535049 21981 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:07.550774 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.552520 21978 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:07.568166 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:07.568806 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:07.559124 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:07.557621 21832 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:07.568245 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:07.558413 21905 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:07.571988 21829 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:07.512676 26613 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:07.520092 26444 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:07.586799 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 2705e36077094db8a03a8b3e606284be: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:07.587046 21826 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:07.593344 21902 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:07.596848 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:07.597210 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:07.597944 21828 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.555024 26381 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:07.510102 26591 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
W20260709 13:07:07.573688 26641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.012s	sys 0.030s
I20260709 13:07:07.598899 21827 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:07.560360 26672 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:07.498615 26670 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.549530 26674 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:07.508147 26068 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:07.611135 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 80905.7us
I20260709 13:07:07.554018 26654 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:07:07.593309 26640 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:07.625038 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.501405 26574 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.625769 21981 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:07.609150 26381 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.629143 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:07.630343 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 101872us
W20260709 13:07:07.634819 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.635042 21828 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:07.607192 26613 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:07.669669 21833 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:07.681193 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:07.667347 26653 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:07.661496 26381 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:07.615114 26662 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:07:07.638816 26640 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:07.670063 26641 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.694751 21904 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:07.683542 26123 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.002s
W20260709 13:07:07.696798 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.679840 26621 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:07.669737 26366 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:07.716141 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 61560.3us
I20260709 13:07:07.705076 26640 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.726979 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:07.727854 21904 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:07.669737 26655 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.687454 26622 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.719396 26444 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:07.736177 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:07.717806 26123 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:07.746541 26680 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:07:07.734865 26631 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:07.754577 26620 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.756685 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:07.717254 26641 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.759195 26068 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:07.759095 26643 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.735128 26506 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:07.805284 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 48680us
I20260709 13:07:07.805812 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:07.804492 26655 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:07.758127 26366 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:07.743693 25978 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:07.816424 21906 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:07.821540 26693 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:07.822398 21906 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:07.824301 21906 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:07.825925 21906 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:07.809059 26473 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:07.826793 26688 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:07:07.827486 21906 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:07.828616 21900 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:07.829236 21906 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:07.808970 26632 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:07:07.829895 26381 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.833659 26381 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:07.834939 26695 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:07.836156 26633 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:07.802594 26068 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:07:07.805320 26613 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:07:07.808454 26635 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:07:07.842420 26574 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.810160 26444 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:07.859038 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 52745.7us
I20260709 13:07:07.860031 21948 leader_election.cc:400] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15.
I20260709 13:07:07.860652 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:07.861460 21978 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:07.861639 21983 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:07.863396 21980 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:07.864190 21983 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:07.864656 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:07.820408 26631 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:07:07.813776 26689 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:07.852177 25978 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.873522 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 294840us
I20260709 13:07:07.875316 21978 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:07.876528 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:07.883925 21983 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:07.877887 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:07.878080 26641 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:07.881027 26157 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:07.883190 21975 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:07.888024 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 83980.7us
I20260709 13:07:07.877568 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:07.886005 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:07.889120 21905 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.859862 26620 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:07.891271 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:07.922629 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.938977 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:07.940317 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:07.941195 21902 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.944679 21828 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:07:07.893193 26643 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:07.948994 26698 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:07:07.950456 26622 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:07.954409 26123 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:07.955324 26670 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:07.955529 26697 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:07.956046 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:07.957286 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:07.974591 21900 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.976400 21905 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:07.976950 21826 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 17. Ops: []
I20260709 13:07:07.960276 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:07.858549 26574 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:07.962881 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:07.957600 26068 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.992396 21833 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:07:07.971817 26656 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:07.983397 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.968452 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:07.987638 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:07.974622 21976 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:07:07.999287 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:07.959177 26664 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.004s
I20260709 13:07:08.000376 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:07.958720 26641 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:07.888322 25978 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.006078 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:08.007228 21949 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:08.003088 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:08.007043 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.008821 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:08.023897 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.013006 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:08.024694 21826 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.026249 21900 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:08.027691 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:08.028928 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:08.029716 21830 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:08.030794 21902 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:08.031212 21829 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:08.044966 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:08.045522 21873 leader_election.cc:336] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.558s (SENT)
I20260709 13:07:08.047395 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:08.005132 26643 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.004809 26622 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:08.047385 21904 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
W20260709 13:07:08.049448 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50216.5us
I20260709 13:07:08.097707 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.003875 26068 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.005329 26664 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:08.011214 26591 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.147s
W20260709 13:07:08.477331 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.049674 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:08.382486 21909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.007s
W20260709 13:07:08.479736 21909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.000s	sys 0.010s
W20260709 13:07:08.120210 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.350276 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 322623us
I20260709 13:07:08.027829 26531 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.445935 21826 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:08.489369 21826 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:07:08.353096 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 327361us
I20260709 13:07:08.157290 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.157788 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.491142 21830 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:08.116914 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 178454us
I20260709 13:07:08.491621 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.028003 26332 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:08.031834 26603 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:08.297688 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.493010 21832 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.048324 26450 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.410288 26701 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.522s	user 0.001s	sys 0.000s
I20260709 13:07:08.032123 26506 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:08.513510 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:08.517472 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.517952 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.103037 26631 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:08.441989 26670 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:08.446301 26705 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.101851 26514 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:08.444178 25978 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:08.538687 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.156699 26708 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:08.304661 26633 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:08.543118 22547 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:08.046469 26592 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.496s
I20260709 13:07:08.547315 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:08.044768 26467 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.473s
I20260709 13:07:08.028275 26641 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.048460 26632 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.472s
I20260709 13:07:08.556136 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:08.569427 21977 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:08.557381 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 60393.2us
I20260709 13:07:08.046280 26131 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.492s
I20260709 13:07:08.511080 26692 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.119558 26643 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:08.543423 26672 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.579639 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.587082 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.559877 26330 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:08.539578 26450 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.539832 26332 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:08.556861 26631 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:08.561472 26531 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.565749 26670 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:08.571280 21832 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:08.559424 26705 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.603120 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:08.632364 21828 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:08.593415 26131 consensus_queue.cc:1243] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:08.563153 26717 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:07:08.560702 26708 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:08.676174 26622 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.680995 26622 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:08.683462 26622 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:08.587316 26672 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:08.688378 26674 consensus_meta.cc:287] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.051s	user 0.016s	sys 0.001s
I20260709 13:07:08.688920 26674 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.689846 21825 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:08.690474 26711 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:07:08.691689 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2283) took 1133 ms. Trace:
I20260709 13:07:08.692051 21901 rpcz_store.cc:276] 0709 13:07:07.558282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.558474 (+   192us) service_pool.cc:224] Handling call
0709 13:07:07.593698 (+ 35224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.666397 (+ 72699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.666427 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.864466 (+198039us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b2c00010828. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:07:07.864841 (+   375us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.978276 (+113435us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:07.978329 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.978420 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.691399 (+712979us) raft_consensus.cc:1685] finished
0709 13:07:08.691417 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.691610 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9060,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5674,"spinlock_wait_cycles":5877632,"thread_start_us":185299,"threads_started":2,"wal-append.queue_time_us":690051}
I20260709 13:07:08.701629 21977 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:08.704007 26654 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:08.704875 26654 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:08.705546 26654 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:08.707612 26672 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:08.709719 26708 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:08.712589 26691 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:08.712977 26691 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:08.713790 26691 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.715242 26691 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.719324 26068 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:08.720090 26332 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.723681 26705 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:08.724416 26631 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:08.727391 21948 connection.cc:256] RPC call timeout handler was delayed by -4.0963289139999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31880000000000003s for a response
I20260709 13:07:08.728101 26123 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:08.647210 26330 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:08.728790 26674 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:08.728693 26123 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.729290 26330 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:08.588124 26715 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:07:08.648767 26656 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:08.728367 26473 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.902s	user 0.014s	sys 0.009s
I20260709 13:07:08.738740 26266 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.760643 21832 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:08.761121 21832 pending_rounds.cc:85] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 4
I20260709 13:07:08.761384 21832 pending_rounds.cc:107] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:08.761652 21832 raft_consensus.cc:2889] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.587388 26692 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.739696 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:08.631078 26531 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:08.764660 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.765280 21830 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:08.763986 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 266904us
I20260709 13:07:08.729427 26674 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.756320 26381 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:08.767853 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.759064 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:08.758412 26473 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:08.762717 26640 consensus_meta.cc:287] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.030s	user 0.010s	sys 0.007s
I20260709 13:07:08.744433 26330 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.787020 21978 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:08.779357 21831 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:08.797489 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.798053 21832 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:08.774972 26655 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:07:08.772449 26622 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:08.777083 26381 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:08.802697 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 63163.1us
I20260709 13:07:08.768941 26656 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:08.800495 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:08.793655 26131 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.864683 21830 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:08.760149 26266 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:08.854266 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.869580 21831 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:08.776594 26664 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:08.874446 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:08.873935 26131 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:08.877656 26706 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.033s	user 0.006s	sys 0.015s
I20260709 13:07:08.879418 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 583) took 1321 ms. Trace:
I20260709 13:07:08.879829 21825 rpcz_store.cc:276] 0709 13:07:07.557674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.557823 (+   149us) service_pool.cc:224] Handling call
0709 13:07:07.561129 (+  3306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.690263 (+1129134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.879177 (+188914us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002729d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:08.879359 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2595296512}
I20260709 13:07:08.881485 21825 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:07:08.883555 26723 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:08.864586 26330 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:08.886864 26643 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:08.889881 26712 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.394s	user 0.003s	sys 0.000s
I20260709 13:07:08.890424 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2271) took 1009 ms. Trace:
I20260709 13:07:08.898228 21831 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:08.891821 26692 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:08.793844 26640 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.893101 26531 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:08.881843 21833 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:08.768584 26670 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:08.895825 26266 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:08.867766 21873 leader_election.cc:336] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.973s (SENT)
W20260709 13:07:08.908139 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 341004us
I20260709 13:07:08.916110 26592 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.891464 26381 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:08.924906 21832 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:08.899389 21981 rpcz_store.cc:276] 0709 13:07:07.880715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.880865 (+   150us) service_pool.cc:224] Handling call
0709 13:07:07.881175 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.051331 (+170156us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:08.442712 (+391381us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.712835 (+270123us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.713188 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.713311 (+   123us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.713829 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.713986 (+   157us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:08.714029 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.715345 (+  1316us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003f9154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:08.715489 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.890223 (+174734us) raft_consensus.cc:1685] finished
0709 13:07:08.890242 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.890371 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":497711,"prepare.queue_time_us":391928,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":109018,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":20489,"spinlock_wait_cycles":378204928,"thread_start_us":167917,"threads_started":1,"wal-append.queue_time_us":321504}
I20260709 13:07:08.918020 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:08.895659 21977 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:08.943573 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:08.927865 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 289202us
W20260709 13:07:08.931933 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 485938us
I20260709 13:07:08.933348 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:08.936200 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:08.849898 21978 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:08.948470 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:08.949822 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:08.950537 21977 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:08.953691 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:08.957777 21977 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:08.961045 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:08.965787 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:08.969856 21977 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:08.971689 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:08.972837 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.925882 26641 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:08.982129 21832 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:08.989675 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 56427.5us
W20260709 13:07:08.982903 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 208316us
I20260709 13:07:08.988787 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:08.984932 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:08.994613 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 46705.4us
I20260709 13:07:08.994835 21981 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: [10.6-13.7]
W20260709 13:07:08.983484 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 115822us
I20260709 13:07:08.925922 26378 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:08.987473 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:08.928422 25978 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:07:08.999948 21873 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.985s (SENT)
I20260709 13:07:09.001266 22520 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:08.948031 26266 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:09.029155 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:09.027355 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:09.068408 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.068925 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:09.068431 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:08.982062 26726 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:08.982371 26622 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:08.985410 26513 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.947781 26592 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:09.068933 21873 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.618s (SENT) [suppressed 29 similar messages]
I20260709 13:07:08.975694 26692 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:07:09.107156 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:08.985140 26717 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:07:09.007232 26381 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.110025 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:08.949241 26531 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 13:07:09.110716 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 120240us
I20260709 13:07:09.029359 26157 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:09.032778 26643 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.998903 26732 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 13:07:08.993845 26506 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:09.126142 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57258.9us
I20260709 13:07:09.129103 21977 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:09.130568 22550 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:09.131052 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:09.107741 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 110637us
W20260709 13:07:09.131943 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 62778.1us
I20260709 13:07:09.134572 22546 raft_consensus.cc:2368] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14.
W20260709 13:07:09.129653 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 128504us
I20260709 13:07:09.032234 26435 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:09.137187 26720 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:09.137581 26717 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:09.107900 26641 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:09.140837 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2200) took 1201 ms. Trace:
I20260709 13:07:09.072577 22552 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:09.111292 26728 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:09.153878 22549 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:09.120795 26656 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:09.155978 21834 rpcz_store.cc:276] 0709 13:07:07.939868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.939982 (+   114us) service_pool.cc:224] Handling call
0709 13:07:07.940266 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.990452 (+ 50186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.990481 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.004542 (+ 14061us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.447295 (+442753us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.007104 (+559809us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.140493 (+133389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.140578 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.140622 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:09.140635 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.140768 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":255360,"prepare.queue_time_us":422883,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":170421,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":1534,"spinlock_wait_cycles":4396416,"thread_start_us":784534,"threads_started":2,"wal-append.queue_time_us":605209}
I20260709 13:07:09.139081 26622 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:09.199839 22551 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:09.183974 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.202546 22552 raft_consensus.cc:2410] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:09.188202 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.215860 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.147442 26674 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.130752 26513 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.216636 22554 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:09.168680 26435 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:09.129968 26726 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.135836 26715 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:07:09.156647 26631 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:09.240645 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 92003.8us
I20260709 13:07:09.249781 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:09.244148 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 44540.7us
I20260709 13:07:09.210335 26123 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:09.249053 26719 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:09.254387 26631 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.254906 26744 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:07:09.222579 26717 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.188146 26157 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:09.263055 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:09.255309 26738 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:09.281872 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.181771 26728 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.256220 26640 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.284824 26266 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:09.329887 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:09.278936 26531 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:07:09.332297 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2281) took 1820 ms. Trace:
I20260709 13:07:09.332964 22548 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:09.333990 21909 rpcz_store.cc:276] 0709 13:07:07.511629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.511738 (+   109us) service_pool.cc:224] Handling call
0709 13:07:07.549908 (+ 38170us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:07.561397 (+ 11489us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:07.847696 (+286299us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.865361 (+1017665us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.866927 (+  1566us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:08.867627 (+   700us) log.cc:844] Serialized 52 byte log entry
0709 13:07:08.871344 (+  3717us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:08.871617 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.873042 (+  1425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.873121 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.331939 (+458818us) raft_consensus.cc:1685] finished
0709 13:07:09.331958 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.332121 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3083,"prepare.queue_time_us":958164,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":109,"raft.queue_time_us":80662,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":44904,"thread_start_us":1256541,"threads_started":4,"wal-append.queue_time_us":769532}
W20260709 13:07:09.338964 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 61201.1us
W20260709 13:07:09.343070 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.285247 26157 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.310880 26727 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:09.345570 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.349882 26733 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.181s
W20260709 13:07:09.350338 26752 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 13:07:09.286031 26717 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.284426 26656 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.391449 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:09.392184 22549 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:09.385016 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:09.285411 26506 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:09.388964 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 98891.8us
I20260709 13:07:09.395666 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:09.332104 26732 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:09.320911 26622 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.379159 26764 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:09.386752 26592 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.389987 26727 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:09.327199 26435 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.396765 26670 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:09.411266 26748 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
I20260709 13:07:09.411535 26754 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:09.411947 26762 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:09.419914 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2214) took 1318 ms. Trace:
I20260709 13:07:09.420641 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:09.420665 26742 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.165s	user 0.001s	sys 0.001s
I20260709 13:07:09.422341 26776 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:09.423502 26631 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:09.393818 26640 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:09.430630 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.397562 26732 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:09.402491 26764 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:09.440884 26717 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.441213 26643 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:09.442619 26574 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:09.443888 26691 consensus_meta.cc:287] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 13:07:09.444185 26513 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.444053 26450 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:09.436393 26762 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:09.390983 26738 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:07:09.454154 21983 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:09.454439 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.463177 26762 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.464356 21974 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:09.464498 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.464650 26762 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:09.465032 21983 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:09.465260 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.434837 21827 rpcz_store.cc:276] 0709 13:07:08.101655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.101826 (+   171us) service_pool.cc:224] Handling call
0709 13:07:08.445207 (+343381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.579441 (+134234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:08.579475 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.586581 (+  7106us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.958330 (+371749us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:08.958406 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.958548 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.419723 (+461175us) raft_consensus.cc:1685] finished
0709 13:07:09.419738 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.419862 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122199,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98,"thread_start_us":470332,"threads_started":2,"wal-append.queue_time_us":774946}
I20260709 13:07:09.436506 26754 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.466528 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:09.428848 26670 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:09.472087 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.474151 26758 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:09.474292 26574 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:09.475049 26691 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:09.474947 26758 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.475630 26691 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.476454 26726 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.476902 26735 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:09.477192 26758 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.477792 26691 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.406265 26266 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.437163 26776 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:09.476967 26726 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.475982 26769 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.480018 26513 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:09.482016 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.480748 26131 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:09.486606 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.493796 21974 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.466401 26717 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:09.500487 22550 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:09.502827 21902 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:09.506135 21983 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:09.506944 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.507437 21983 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:09.508062 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.508476 21983 raft_consensus.cc:2376] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17. Re-sending same reply.
I20260709 13:07:09.509069 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.509503 21983 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:09.482532 26735 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.472507 26754 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:09.513602 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:09.513796 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:09.515544 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.486338 26640 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:09.519294 21975 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:09.517128 26776 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:09.538851 26757 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:07:09.540107 26750 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.540647 26750 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.543398 26750 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.545714 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2277) took 1032 ms. Trace:
I20260709 13:07:09.562824 21982 rpcz_store.cc:276] 0709 13:07:08.513437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.513548 (+   111us) service_pool.cc:224] Handling call
0709 13:07:08.513887 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.802854 (+288967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.802897 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.909876 (+106979us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.117472 (+207596us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:09.151799 (+ 34327us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.155958 (+  4159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.156052 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.545516 (+389464us) raft_consensus.cc:1685] finished
0709 13:07:09.545536 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.545662 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58536,"prepare.queue_time_us":38747,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":17886,"raft.queue_time_us":137820,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":22131,"thread_start_us":412060,"threads_started":2,"wal-append.queue_time_us":601533}
I20260709 13:07:09.564379 22554 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:09.564793 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.565955 21982 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:09.566350 26662 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:09.566737 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.481204 26732 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.567508 26732 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:09.569569 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 430649us
I20260709 13:07:09.518302 26735 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.546046 26670 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.510676 26778 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:07:09.550145 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.497282 26513 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:09.558727 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 570204us
I20260709 13:07:09.514505 26717 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.566828 26662 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:09.548874 26157 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.497789 26726 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.577915 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:09.615836 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:09.570996 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:09.576423 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 624) took 2020 ms. Trace:
I20260709 13:07:09.630684 21832 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 13:07:09.579397 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:09.576915 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:09.570106 21974 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:09.636771 21827 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:09.628672 21975 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:09.637121 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.637708 21974 raft_consensus.cc:2376] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14. Re-sending same reply.
I20260709 13:07:09.579843 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.632021 21977 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:09.635568 22547 rpcz_store.cc:276] 0709 13:07:07.556251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.556385 (+   134us) service_pool.cc:224] Handling call
0709 13:07:07.556730 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.561880 (+1005150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.576222 (+1014342us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54002debd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:09.576363 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207122304}
I20260709 13:07:09.630785 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:09.497643 26769 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.640524 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:09.640697 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.632975 21831 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:09.606413 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:09.644310 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 73372.8us
I20260709 13:07:09.649521 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:09.650532 21948 leader_election.cc:400] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14.
I20260709 13:07:09.651005 21948 leader_election.cc:403] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:09.644415 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:09.651736 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.651978 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:09.652395 21975 raft_consensus.cc:2376] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16. Re-sending same reply.
I20260709 13:07:09.651101 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.654454 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.627097 26450 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:09.654692 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:09.657366 21830 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:07:09.648260 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.658983 22550 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:09.666929 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.671571 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.574996 26729 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:09.572046 26092 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:09.684388 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 78081.2us
I20260709 13:07:09.641526 26654 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.676308 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.671068 26450 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.712275 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.713070 21974 raft_consensus.cc:2376] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17. Re-sending same reply.
I20260709 13:07:09.714468 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:09.716534 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:09.717902 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:09.572640 26239 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:07:09.623026 26722 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:09.574011 26746 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.714124 21975 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:09.631748 26381 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:07:09.719764 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.666056 26733 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:09.656371 26635 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:09.732865 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.720394 21903 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:09.733462 22550 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:09.733898 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:09.734092 21975 raft_consensus.cc:2376] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14. Re-sending same reply.
I20260709 13:07:09.671612 26692 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:09.665040 26674 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:09.729600 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.677078 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:09.731017 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 9206e3439eb54425a3de6b25e0d8b36a: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:09.732349 21901 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: [10.9-13.10]
I20260709 13:07:09.655579 26123 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.655668 26506 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:09.723654 21829 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:09.734889 21832 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:09.735422 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.682722 26729 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:09.723613 26718 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:09.572853 26721 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.151s
I20260709 13:07:09.733165 26722 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.743754 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.733475 26635 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:09.744206 26760 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:09.723876 26131 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.744712 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.745064 26450 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:09.746434 26691 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:09.813272 26473 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:09.813642 26691 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:09.746676 26381 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:09.747041 26330 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.748082 26743 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:09.748127 26620 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.748759 26737 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:09.727471 26750 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:07:09.751086 26513 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.730875 26733 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:09.757227 21903 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:09.824721 26766 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:09.825142 26733 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.825569 26592 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:09.761355 26662 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.724086 26693 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:09.766500 26777 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:09.768285 26717 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.770192 26726 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.771070 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:09.775959 26713 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.183s	user 0.004s	sys 0.000s
I20260709 13:07:09.779850 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:09.804800 26506 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.714962 26643 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:09.778059 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.785841 26754 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.787942 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.686506 26092 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:09.790894 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:09.802686 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:09.531059 26764 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.817004 26131 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.815196 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.800122 26692 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:09.688040 26640 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.726758 26654 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.801657 26674 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:09.809041 26635 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:09.816351 26641 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.005s
I20260709 13:07:09.732165 26746 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:09.570453 26656 consensus_queue.cc:1175] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 12 status { last_received { term: 11 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:09.818614 26381 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:09.808758 26531 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:07:09.833181 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53416.4us
W20260709 13:07:09.781443 26756 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.301s	user 0.001s	sys 0.001s
I20260709 13:07:09.861110 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:09.862905 26654 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.863343 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:09.864776 26746 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.835291 21983 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 9.
I20260709 13:07:09.865141 21833 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:09.789497 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2353) took 1036 ms. Trace:
I20260709 13:07:09.838018 26691 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.812111 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:09.866712 26758 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:09.867002 21832 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:09.867122 26758 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:09.867487 26758 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:09.867959 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:09.868507 21832 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:09.840430 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49617us
I20260709 13:07:09.843003 22548 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:09.844128 26754 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.870646 26655 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:09.871080 26726 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:09.871728 26726 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.874377 26722 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:09.874632 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.848830 26777 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:09.866430 21826 rpcz_store.cc:276] 0709 13:07:08.753579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.753717 (+   138us) service_pool.cc:224] Handling call
0709 13:07:08.754068 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.797164 (+ 43096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.797194 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.797253 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:08.797299 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.789283 (+991984us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b5400337a54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:09.789323 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.789439 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98621312}
I20260709 13:07:09.876699 26092 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.877811 26092 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:09.849740 26715 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:09.831532 26693 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.835875 26717 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:09.823855 26743 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.827111 26620 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.877063 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:09.907287 21826 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:09.874395 26692 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.858434 26641 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:09.822990 26330 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.846715 26131 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:09.888809 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2272) took 2006 ms. Trace:
W20260709 13:07:09.922322 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.922742 21832 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:09.921751 21979 rpcz_store.cc:276] 0709 13:07:07.882120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.882260 (+   140us) service_pool.cc:224] Handling call
0709 13:07:07.882542 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.882855 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.882880 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.883271 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.023452 (+140181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:08.116201 (+ 92749us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.122068 (+  5867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.122863 (+   795us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.775163 (+1652300us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:09.883388 (+108225us) raft_consensus.cc:1685] finished
0709 13:07:09.888563 (+  5175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.888739 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196289,"prepare.queue_time_us":164549,"prepare.run_cpu_time_us":12037,"prepare.run_wall_time_us":174171,"raft.queue_time_us":4308,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":140397,"spinlock_wait_cycles":3070720,"thread_start_us":130066,"threads_started":1,"wal-append.queue_time_us":695639}
I20260709 13:07:09.892403 26726 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.844532 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:09.890429 21828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:09.926839 21828 raft_consensus.cc:606] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:09.927284 21828 raft_consensus.cc:614] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:09.928061 26674 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.929842 26743 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:09.930533 26786 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:07:09.931115 21974 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:07:09.931478 26693 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:09.932449 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.932998 21974 raft_consensus.cc:2376] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16. Re-sending same reply.
I20260709 13:07:09.933820 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:09.935318 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.936112 26620 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:09.936458 26758 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.887905 26717 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.942749 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.943711 21974 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:09.944793 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.882627 26366 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:07:09.946820 26758 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.950270 21829 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 13: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:07:09.953539 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.955322 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.955482 26717 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:09.957327 26739 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:09.957700 26739 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:09.957814 26641 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:09.958580 26739 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.958858 26641 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:09.959604 26739 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:09.954066 22551 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:09.959899 26769 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:09.959004 26506 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:09.961309 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.963146 26330 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:09.963795 22553 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:09.965648 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.966260 21979 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
W20260709 13:07:09.966123 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.967821 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.971477 21905 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:09.979002 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:09.981143 21834 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:09.982898 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:09.983966 21906 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:07:09.989203 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 343513us
I20260709 13:07:09.991032 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:09.992187 26641 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:09.949752 26729 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:09.993757 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:09.994897 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:09.995246 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.995453 21906 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:09.996405 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:09.996698 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:09.997471 21979 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:09.997854 21826 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:10.000133 26762 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:10.000804 26762 consensus_queue.cc:1243] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:09.997028 21906 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:10.002043 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.002708 21906 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:07:10.003587 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.005254 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.005810 21906 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:10.008358 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.009593 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.009934 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.010313 21974 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.013382 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.013640 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.014209 21909 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:10.014309 21906 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:10.018399 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.015385 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.019271 21907 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 8.
I20260709 13:07:10.019482 21909 raft_consensus.cc:2410] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:10.021083 26744 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:10.030151 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.030836 21979 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:10.031983 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.032295 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.032733 21979 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:10.058411 21909 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:10.061200 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.069859 21974 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:10.071023 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 592) took 1040 ms. Trace:
I20260709 13:07:10.042074 26643 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:10.072429 21974 rpcz_store.cc:276] 0709 13:07:09.030910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.009335 (+978425us) service_pool.cc:224] Handling call
0709 13:07:10.070614 (+ 61279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.022027 26641 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:07:10.079820 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.083868 21974 raft_consensus.cc:2410] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:07:10.073253 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.084879 21979 raft_consensus.cc:2410] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:07:10.080736 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.086855 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.091559 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.092339 21974 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:10.093343 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.094254 21974 raft_consensus.cc:2368] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13.
I20260709 13:07:10.096417 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.096872 21904 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:10.097470 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.098392 21909 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:10.102734 21974 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:10.103664 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2195) took 1207 ms. Trace:
I20260709 13:07:10.104173 21974 rpcz_store.cc:276] 0709 13:07:08.895896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.101577 (+1205681us) service_pool.cc:224] Handling call
0709 13:07:10.102399 (+   822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.103393 (+   994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.103602 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.105999 21974 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:10.106659 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2196) took 1210 ms. Trace:
I20260709 13:07:10.109257 21974 rpcz_store.cc:276] 0709 13:07:08.896139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.105312 (+1209173us) service_pool.cc:224] Handling call
0709 13:07:10.105621 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.106394 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.106601 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.094455 26744 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:10.111726 26744 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.113205 21909 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:10.114333 21909 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:10.112178 21974 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:10.095002 26641 consensus_queue.cc:1243] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:07:10.088763 26777 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:10.118285 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.129124 21909 raft_consensus.cc:2410] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:10.081907 26642 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:07:10.133965 26731 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:10.148804 26731 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:10.149580 26731 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.150787 26731 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:10.152343 26746 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.152844 26746 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.117811 21974 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:10.125151 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:10.156638 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.156873 21974 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:10.157615 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.125427 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.130131 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.159394 21832 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:10.123260 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.130949 26735 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.137676 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2273) took 1625 ms. Trace:
I20260709 13:07:10.163723 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.139622 26717 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.140429 26643 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.141276 26764 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.142768 26664 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:10.144761 26728 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.145789 26631 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:10.150832 26794 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.136372 26123 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14.
I20260709 13:07:10.162293 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.163151 21980 rpcz_store.cc:276] 0709 13:07:08.512317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.512454 (+   137us) service_pool.cc:224] Handling call
0709 13:07:08.512840 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.540044 (+ 27204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.540086 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.540646 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.854532 (+1313886us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b1800411ee0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:07:10.030375 (+175843us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:10.030413 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.030476 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.137381 (+106905us) raft_consensus.cc:1685] finished
0709 13:07:10.137402 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.137617 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43133,"raft.queue_time_us":50264,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":11245,"spinlock_wait_cycles":28678400,"thread_start_us":175660,"threads_started":1,"wal-append.queue_time_us":1496102}
I20260709 13:07:10.167117 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.168740 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:10.171470 21828 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:10.177248 26664 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:10.190567 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.177672 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.178894 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.191165 21977 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:10.129357 26613 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:10.194895 22547 raft_consensus.cc:2368] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14.
I20260709 13:07:10.170148 26603 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:10.195225 22546 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:10.200445 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.202306 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.145920 26635 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.229529 26722 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.233417 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.229656 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.212932 21977 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:07:10.198494 26603 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:10.200870 26613 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.166847 26777 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.238750 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.191303 26631 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:10.237650 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:10.242811 26733 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.243844 21977 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:10.244006 21826 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:10.242635 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.196103 26641 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:10.248278 26635 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.249028 26613 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.207511 26332 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.251433 26729 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:10.249691 26664 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.253545 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.255326 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:10.257516 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:10.264511 22549 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:10.268651 21982 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:10.281821 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.282684 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.287106 21834 raft_consensus.cc:2376] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11. Re-sending same reply.
I20260709 13:07:10.288967 21909 raft_consensus.cc:2410] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:07:10.291321 21977 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:07:10.294209 21909 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:10.277611 26670 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.305591 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.307842 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.277734 26123 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:10.310249 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:10.310913 21909 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:10.195567 26794 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.311811 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.314473 21905 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:07:10.281054 26592 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:07:10.284286 26633 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:10.320214 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.309070 21900 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:10.313009 26123 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.326373 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.328728 21825 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:10.322992 21977 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:10.329703 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.331060 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:10.331745 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.265827 26722 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.332070 21905 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:10.335486 21830 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:10.336524 21905 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:10.337662 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:10.333658 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.338209 21828 raft_consensus.cc:2376] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10. Re-sending same reply.
I20260709 13:07:10.340047 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:10.340858 21825 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.332661 26664 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.371174 21825 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:10.372347 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.346325 21901 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:10.374732 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:10.375617 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.375509 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.348709 26777 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.377580 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:10.351181 26733 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:10.377936 26123 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:10.378309 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.371044 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:10.350765 26381 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.351845 26717 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.322010 26631 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.352474 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.382882 21904 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:10.357769 21834 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:10.328444 26633 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.392673 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 741) took 1047 ms. Trace:
I20260709 13:07:10.393105 22548 rpcz_store.cc:276] 0709 13:07:09.345170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.345297 (+   127us) service_pool.cc:224] Handling call
0709 13:07:10.392487 (+1047190us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400638154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:10.392614 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130582400}
I20260709 13:07:10.289058 26332 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.395190 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.395591 26332 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:10.397271 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.365293 22555 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:10.382019 26239 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:07:10.402808 21977 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:07:10.361765 26603 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:10.376910 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet a6e402ca5ed540e5a1c44b9a1dafcf78: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:10.377374 21828 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:10.350471 26735 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.379500 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:10.342578 26759 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.994s	user 0.003s	sys 0.002s
I20260709 13:07:10.412039 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.412616 21829 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:10.379621 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:10.380903 21978 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2276) took 1867 ms (client timeout 1595 ms). Trace:
I20260709 13:07:10.381037 21905 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:10.381464 21981 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:10.385890 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.397188 26123 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:10.365406 21831 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:10.404569 26693 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:10.408447 21900 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:10.420459 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:10.409651 26806 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:07:10.410490 26811 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:07:10.410782 26745 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:10.426254 26745 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:10.426661 26239 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.419458 26613 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:10.427053 26745 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.427878 26613 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:10.428128 26745 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:10.428349 26613 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.429062 26633 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.422482 26731 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:10.413825 21978 rpcz_store.cc:269] 0709 13:07:08.513186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.513298 (+   112us) service_pool.cc:224] Handling call
0709 13:07:10.380695 (+1867397us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540005b4d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:10.380835 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621159808}
I20260709 13:07:10.430697 26621 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:10.431449 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.432011 21978 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:10.432286 26794 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.416214 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:10.439667 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:10.439994 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.440311 26635 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:10.440418 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:10.440864 26635 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.441262 26635 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:10.409349 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.442759 21977 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:10.445577 26805 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:10.445858 26804 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.446043 26805 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.446359 26804 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:10.446558 26805 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.446810 26804 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.450708 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2212) took 1113 ms. Trace:
I20260709 13:07:10.450995 21980 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:10.452013 21979 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 14. Ops: []
I20260709 13:07:10.411517 26381 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.452844 22554 raft_consensus.cc:2410] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:07:10.442350 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:10.455920 26662 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:10.456423 26662 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.457191 26613 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.465472 26631 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.465975 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:10.466576 22547 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:10.466706 21799 leader_election.cc:400] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14.
I20260709 13:07:10.467057 21799 leader_election.cc:403] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:10.467684 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.411247 21901 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:10.432222 26123 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:10.432837 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.440595 21983 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:10.472115 21978 raft_consensus.cc:2376] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12. Re-sending same reply.
I20260709 13:07:10.472615 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.472863 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.473162 21977 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:10.473515 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.473655 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.405239 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.435225 26722 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:10.436534 21833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:10.437071 22551 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:07:10.483721 22551 pending_rounds.cc:85] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 9
I20260709 13:07:10.483978 22551 pending_rounds.cc:107] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:07:10.484308 22551 raft_consensus.cc:2889] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.437463 26746 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:10.457144 26635 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.459522 26670 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:10.483739 21833 raft_consensus.cc:606] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:10.485390 26670 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:10.485572 21833 raft_consensus.cc:614] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:10.485749 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.486454 21975 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:10.486575 26635 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.486390 26670 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.487825 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.460018 26662 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.421240 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.463409 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:10.512367 22549 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:10.463912 26715 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:10.464596 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.451041 21982 rpcz_store.cc:276] 0709 13:07:09.337122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.654211 (+317089us) service_pool.cc:224] Handling call
0709 13:07:10.450552 (+796341us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54002d4454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:10.450659 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254565760}
I20260709 13:07:10.514106 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.514617 21982 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:10.516613 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 95408.7us
I20260709 13:07:10.517316 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.518213 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.473982 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.473878 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.477658 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:10.479032 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.519987 21978 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:10.520516 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.427096 26239 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:10.484066 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 78953.1us
W20260709 13:07:10.521674 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 44093.8us
I20260709 13:07:10.522131 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:10.438047 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2274) took 1925 ms. Trace:
I20260709 13:07:10.523811 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:10.490325 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:10.488420 21975 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.500810 26724 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:10.501401 21826 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:10.489012 26794 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:10.502988 21833 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:10.503530 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.504441 21828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2705e36077094db8a03a8b3e606284be"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:10.504776 26805 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.487834 26654 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:10.420511 26693 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.510521 26735 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:10.510737 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:10.523948 21976 rpcz_store.cc:276] 0709 13:07:08.512621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.512734 (+   113us) service_pool.cc:224] Handling call
0709 13:07:08.556320 (+ 43586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.803561 (+247241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.803788 (+   227us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.837923 (+ 34135us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.148031 (+310108us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:09.148111 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.148226 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.132642 (+984416us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b480021c258. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:07:10.194620 (+ 61978us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:10.437846 (+243226us) raft_consensus.cc:1685] finished
0709 13:07:10.437866 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.437998 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11507,"raft.queue_time_us":74784,"raft.run_cpu_time_us":3258,"raft.run_wall_time_us":1494564,"spinlock_wait_cycles":69605376,"thread_start_us":452314,"threads_started":2,"wal-append.queue_time_us":407657}
I20260709 13:07:10.470785 26776 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.511566 21907 raft_consensus.cc:2410] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:10.520766 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.523425 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:10.531162 21828 raft_consensus.cc:606] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:10.483354 26633 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14.
I20260709 13:07:10.509503 26613 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.518710 26123 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:10.529044 26467 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:10.529137 26689 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:10.540839 26662 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:10.540994 26762 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:10.545138 26805 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:10.545472 26635 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.547055 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.539091 21982 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:10.594030 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.563681 26735 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:10.572342 26621 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:10.558691 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.518951 26715 consensus_queue.cc:1243] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:10.532791 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:10.573138 21975 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:10.541320 26794 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:10.580307 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2192) took 1685 ms. Trace:
W20260709 13:07:10.636875 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 78250.4us
I20260709 13:07:10.636579 21981 rpcz_store.cc:276] 0709 13:07:08.895171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.995973 (+100802us) service_pool.cc:224] Handling call
0709 13:07:10.381294 (+1385321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.414514 (+ 33220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.580049 (+165535us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540005b4d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:10.580238 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3185309568}
W20260709 13:07:10.637617 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 104904us
I20260709 13:07:10.638307 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.638703 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.639145 21981 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:10.639436 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.640053 21978 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:10.640177 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.581915 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2231) took 1085 ms. Trace:
W20260709 13:07:10.583648 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.587066 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 745) took 1011 ms. Trace:
I20260709 13:07:10.548404 26654 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:10.563784 26693 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:10.591229 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.594686 21982 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:10.557590 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:10.597069 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.597090 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.646692 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 89182.7us
I20260709 13:07:10.571046 26724 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:10.576354 26689 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.648165 21982 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:10.574683 26729 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:10.580265 26662 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.635545 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.636463 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:10.641211 21980 rpcz_store.cc:276] 0709 13:07:09.496736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.187889 (+691153us) service_pool.cc:224] Handling call
0709 13:07:10.450671 (+262782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.451535 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.581686 (+130151us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54002d4450. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:10.581845 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575719296}
I20260709 13:07:10.641652 22554 rpcz_store.cc:276] 0709 13:07:09.575717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.579579 (+  3862us) service_pool.cc:224] Handling call
0709 13:07:10.586809 (+1007230us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54006801d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:10.586982 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1871649536}
I20260709 13:07:10.635257 26778 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.650147 26621 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.642808 26794 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:10.648483 26633 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:10.657023 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.663611 21978 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:10.676838 26689 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.667595 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.727998 21900 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:07:10.668442 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.729362 21905 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:10.669273 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.670235 21828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:10.670718 26762 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:10.670984 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.602726 26735 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.670759 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.732945 21909 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:10.733760 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.683437 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 596) took 1200 ms. Trace:
I20260709 13:07:10.682752 26662 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.686467 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.754441 21975 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.594861 26804 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.646001 26123 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:10.655839 22580 heartbeater.cc:646] Failed to heartbeat to 127.20.53.190:38207 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.53.190:38207 timed out after 15.000s (SENT)
I20260709 13:07:10.687947 26467 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:07:10.699450 26724 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.685515 26733 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:07:10.700511 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:10.701524 26824 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:10.765825 21975 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:10.682662 26613 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.777751 26467 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:10.778193 26467 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:10.706516 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:10.707953 26656 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:10.707762 26092 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:10.710502 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:10.710906 26239 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:10.755501 26633 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:10.713294 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2194) took 1817 ms. Trace:
I20260709 13:07:10.824863 21979 rpcz_store.cc:276] 0709 13:07:08.895659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.099907 (+1204248us) service_pool.cc:224] Handling call
0709 13:07:10.451855 (+351948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.452381 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.713117 (+260736us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54002d4450. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:10.713241 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769954560}
I20260709 13:07:10.715801 21978 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:10.807659 21905 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:10.665503 21902 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:10.827060 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.827032 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.828158 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.828327 21905 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.717134 22549 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:10.716794 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:10.718135 21832 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:10.724546 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:10.725831 22552 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:10.649436 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:10.722307 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:10.832600 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 110431us
I20260709 13:07:10.734364 21974 rpcz_store.cc:276] 0709 13:07:09.482624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.157492 (+674868us) service_pool.cc:224] Handling call
0709 13:07:10.170325 (+ 12833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.170506 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:10.289001 (+118495us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.683038 (+394037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:10.683100 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:10.683170 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.683249 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.683376 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8742,"prepare.queue_time_us":168240,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":1155,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":6522,"thread_start_us":511047,"threads_started":2}
I20260709 13:07:10.739890 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.835510 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:10.836139 21909 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:10.741338 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:10.741878 26728 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:10.696738 26778 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.750869 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:10.751019 26332 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:10.754926 22546 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:07:10.845249 22546 pending_rounds.cc:85] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 10
I20260709 13:07:10.845585 22546 pending_rounds.cc:107] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:10.845898 22546 raft_consensus.cc:2889] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.755981 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.768137 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:10.702764 26817 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:10.684314 26670 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:07:10.795806 21799 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:10.711792 26603 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:10.857810 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 116528us
I20260709 13:07:10.866003 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:07:10.876922 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.779011 26467 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:10.882242 22555 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:10.828711 21902 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:10.829458 22547 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:10.718533 26621 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.834012 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:10.845033 26332 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:10.858932 21904 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:10.859438 21979 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:07:10.862106 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66405.6us
I20260709 13:07:10.894858 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:10.799724 26656 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.896384 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:10.896664 22547 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:10.897884 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.870378 21974 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:07:10.842911 26642 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:10.852550 26239 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.823714 22551 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:07:10.883733 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:10.920217 22551 pending_rounds.cc:85] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 11
W20260709 13:07:10.885664 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51740.2us
I20260709 13:07:10.920511 22551 pending_rounds.cc:107] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:07:10.920782 22551 raft_consensus.cc:2889] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.921022 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:10.851971 26123 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:10.902179 22550 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:10.957913 21902 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:10.961074 21909 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:10.962838 26721 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:10.962611 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 63915us
I20260709 13:07:10.965114 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:10.966482 26721 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:10.967008 26721 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.967485 26721 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:10.972086 21904 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:10.915308 21905 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:10.687631 26729 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:10.801662 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.879613 26473 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:10.923691 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.884730 26641 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:10.899837 26467 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.894351 26726 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:10.892477 26728 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:11.000517 21874 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:11.001945 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.919651 26808 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:10.954341 26777 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.954137 26631 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:11.004803 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:10.976418 26642 raft_consensus.cc:2764] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:07:10.981092 26764 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.980721 26473 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:10.998873 26762 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.998281 26640 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:10.974876 26123 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.028690 26123 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:11.030745 26769 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:11.031251 26769 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:11.033425 26691 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:11.055096 26473 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:11.059841 26822 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:11.086930 26729 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:10.972000 26239 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.016747 26631 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.955593 26633 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.133841 21976 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:07:11.137486 21976 pending_rounds.cc:85] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 5
I20260709 13:07:11.137823 21976 pending_rounds.cc:107] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:07:11.138123 21976 raft_consensus.cc:2889] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.141084 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:11.094022 26804 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:11.155751 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:11.156519 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:11.015857 26777 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.149930 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:11.133600 26631 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:11.131919 26808 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.178434 21832 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:11.160429 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:11.116127 26764 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.120617 26762 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:11.188727 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 539344us
I20260709 13:07:11.191471 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:11.190183 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:11.195508 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:11.191671 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:11.153494 26722 raft_consensus.cc:2764] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:07:11.178944 26635 consensus_meta.cc:287] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.000s
I20260709 13:07:11.021445 26332 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.202205 26791 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:11.204289 26635 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:11.205781 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:11.206274 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.207525 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:11.209025 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:11.210197 26825 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:07:11.210325 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:11.211206 21905 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:07:11.177588 26804 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:11.164778 26735 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:11.211316 26800 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:07:11.226411 26794 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.002s
W20260709 13:07:11.250973 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.251092 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:11.183498 26808 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.219918 26803 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:11.269061 21982 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:11.199302 26670 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:07:11.219132 26722 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 13:07:11.232194 26693 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.003s
I20260709 13:07:11.227030 26621 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:11.262568 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:11.221438 26635 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:11.309427 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:11.320504 26777 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:11.321874 26827 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 13:07:11.324911 26776 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.754s	user 0.006s	sys 0.002s
I20260709 13:07:11.325708 21906 raft_consensus.cc:2410] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:07:11.326602 26735 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:11.326773 26764 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:11.327617 26239 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:11.328433 26808 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:11.331705 26662 consensus_meta.cc:287] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.000s
I20260709 13:07:11.332139 26662 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:11.334661 26745 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.001s
I20260709 13:07:11.227562 26689 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:11.335047 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 72559us
I20260709 13:07:11.335544 26621 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:11.336176 26621 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:11.336849 26689 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:11.290283 26794 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:11.338666 26613 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
I20260709 13:07:11.339107 26613 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:11.309355 26693 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:11.340778 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.341679 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:11.342327 21828 raft_consensus.cc:606] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:11.358258 21828 raft_consensus.cc:614] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:11.341974 26693 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:11.344647 26816 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.798s	user 0.005s	sys 0.000s
I20260709 13:07:11.351981 26473 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.355475 26721 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.362701 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 631) took 1084 ms. Trace:
I20260709 13:07:11.346552 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:11.363147 26473 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:11.363508 26721 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:11.363173 22553 rpcz_store.cc:276] 0709 13:07:10.278551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.279047 (+   496us) service_pool.cc:224] Handling call
0709 13:07:10.279401 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.282790 (+  3389us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:10.282818 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.306649 (+ 23831us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.408892 (+102243us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:10.411920 (+  3028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.411993 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.344018 (+932025us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:11.362242 (+ 18224us) raft_consensus.cc:1685] finished
0709 13:07:11.362269 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.362615 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1219,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":415,"spinlock_wait_cycles":99793792,"thread_start_us":80675,"threads_started":1,"wal-append.queue_time_us":232201}
I20260709 13:07:11.345872 22552 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:11.312220 26834 raft_consensus.cc:2764] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:07:11.377187 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:11.376611 26662 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:11.502532 26670 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.508749 26670 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.511363 26670 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:07:11.352813 26731 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 13:07:11.355829 26092 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
I20260709 13:07:11.354516 26631 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:11.534528 21977 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.008s	sys 0.013s
W20260709 13:07:11.534960 21977 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.008s	sys 0.013s
W20260709 13:07:11.535826 21900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.000s	sys 0.025s
W20260709 13:07:11.536286 21900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.000s	sys 0.026s
W20260709 13:07:11.550374 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.016s	sys 0.018s
W20260709 13:07:11.550707 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.016s	sys 0.018s
W20260709 13:07:11.551220 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 667534us
W20260709 13:07:11.551628 21902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.004s	sys 0.018s
W20260709 13:07:11.551977 21902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.004s	sys 0.018s
I20260709 13:07:11.518195 26834 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 13:07:11.578265 21873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.006s	sys 0.023s
W20260709 13:07:11.578676 21873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.006s	sys 0.023s
W20260709 13:07:11.580359 21874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.038s	sys 0.045s
W20260709 13:07:11.580845 21874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.038s	sys 0.045s
W20260709 13:07:11.585695 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 585214us
W20260709 13:07:11.599797 21981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.017s	sys 0.009s
W20260709 13:07:11.599910 22550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.021s	sys 0.076s
I20260709 13:07:11.573485 26693 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.574671 26794 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:11.600270 21981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.018s	sys 0.009s
W20260709 13:07:11.600435 22550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.022s	sys 0.076s
I20260709 13:07:11.534699 26731 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:07:11.608683 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2291) took 1207 ms. Trace:
W20260709 13:07:11.609205 21975 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.020s	sys 0.045s
W20260709 13:07:11.609790 21975 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.020s	sys 0.045s
I20260709 13:07:11.610859 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2300) took 1170 ms. Trace:
I20260709 13:07:11.609135 21981 rpcz_store.cc:276] 0709 13:07:10.400753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.652271 (+251518us) service_pool.cc:224] Handling call
0709 13:07:10.652508 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.652694 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:10.652900 (+   206us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.608230 (+955330us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:11.608299 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:11.608360 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.608445 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.608588 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3210,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":477132,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":57,"thread_start_us":954715,"threads_started":2,"wal-append.queue_time_us":475296}
W20260709 13:07:11.612140 22518 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.006s	sys 0.015s
W20260709 13:07:11.612453 22518 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.015s
W20260709 13:07:11.607923 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 686952us
W20260709 13:07:11.613121 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.613658 21873 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:11.630723 26721 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:11.631421 26721 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:11.635004 26831 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:11.633895 26721 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:11.640266 26721 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.640865 26721 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.643451 26721 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:11.611339 21975 rpcz_store.cc:276] 0709 13:07:10.440649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.772309 (+331660us) service_pool.cc:224] Handling call
0709 13:07:10.772732 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.773276 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:10.839553 (+ 66277us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.074548 (+234995us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b18003f2ce0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:07:11.610453 (+535905us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:11.610520 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:11.610591 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.610672 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.610802 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16398,"prepare.queue_time_us":66049,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":5938,"raft.queue_time_us":472130,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":13092608,"thread_start_us":535746,"threads_started":1}
I20260709 13:07:11.646298 26721 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.605019 26654 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.648128 26654 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:11.651010 26836 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:11.651993 26836 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:11.653283 26836 raft_consensus.cc:2764] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:07:11.606570 26693 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.603097 26670 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.663208 26728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.006s	sys 0.029s
W20260709 13:07:11.665621 26728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.006s	sys 0.030s
I20260709 13:07:11.658084 26670 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:11.667896 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.668605 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2318) took 1007 ms. Trace:
W20260709 13:07:11.669636 26821 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.777s	user 0.000s	sys 0.003s
I20260709 13:07:11.669791 26670 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:11.664266 26833 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:11.671347 26833 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:11.672762 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34370 (request call id 61) took 1027 ms. Trace:
I20260709 13:07:11.672438 26833 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.673228 21828 rpcz_store.cc:276] 0709 13:07:10.645162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.645289 (+   127us) service_pool.cc:224] Handling call
0709 13:07:11.672565 (+1027276us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b540011e754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd8853 00007fb763fa660a 00007fb75d52c7d4 00007fb75d52c762 00007fb75d52c691 00007fb75d52c60c 00007fb75d52b8c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:11.672697 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405389568}
I20260709 13:07:11.674525 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2295) took 1706 ms. Trace:
I20260709 13:07:11.674986 21903 rpcz_store.cc:276] 0709 13:07:09.967994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.968134 (+   140us) service_pool.cc:224] Handling call
0709 13:07:09.968503 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.968943 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.968983 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.989295 (+ 20312us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.466352 (+477057us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b18000f0f40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:07:10.675246 (+208894us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:10.675287 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.675344 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.669041 (+993697us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:11.674279 (+  5238us) raft_consensus.cc:1685] finished
0709 13:07:11.674306 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.674459 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10909,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1739,"spinlock_wait_cycles":103195648,"thread_start_us":208407,"threads_started":1,"wal-append.queue_time_us":810807}
I20260709 13:07:11.669090 21900 rpcz_store.cc:276] 0709 13:07:10.661650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.853157 (+191507us) service_pool.cc:224] Handling call
0709 13:07:10.853558 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.860156 (+  6598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.860213 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.860803 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.536814 (+676011us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:11.536881 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.536983 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.668318 (+131335us) raft_consensus.cc:1685] finished
0709 13:07:11.668350 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.668531 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6458,"raft.queue_time_us":7925,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":675617,"threads_started":1,"wal-append.queue_time_us":805885}
I20260709 13:07:11.646955 26721 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:11.681149 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 489728us
I20260709 13:07:11.684446 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:11.679893 21980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.004s	sys 0.020s
I20260709 13:07:11.656702 26693 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:11.663455 26837 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:11.679411 26762 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:11.657488 26631 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:11.666060 26728 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:11.674057 26833 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:11.686604 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 464777us
W20260709 13:07:11.690389 21908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.006s	sys 0.038s
W20260709 13:07:11.690389 21980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.005s	sys 0.021s
I20260709 13:07:11.654145 26836 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:07:11.715018 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 313412us
I20260709 13:07:11.721872 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:11.722865 21908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.007s	sys 0.039s
I20260709 13:07:11.722697 22550 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.684923 26621 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:11.691077 26674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.022s	sys 0.022s
I20260709 13:07:11.710856 21828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:11.693742 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:11.734891 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:11.736657 21828 raft_consensus.cc:606] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:11.737238 21828 raft_consensus.cc:614] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:11.737514 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:11.728442 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2297) took 1323 ms. Trace:
W20260709 13:07:11.685247 26641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.007s	sys 0.016s
I20260709 13:07:11.775081 22546 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:11.738780 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:11.778715 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.778975 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:11.724195 26692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.000s	sys 0.018s
I20260709 13:07:11.693356 26837 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:11.773963 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:11.776993 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:11.777290 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:11.738323 26674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.022s	sys 0.022s
W20260709 13:07:11.704577 26744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.015s
I20260709 13:07:11.779559 21975 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:11.734298 26804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.005s	sys 0.013s
W20260709 13:07:11.776460 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.773519 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:11.739420 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:11.734534 26746 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.010s	sys 0.015s
I20260709 13:07:11.697669 26834 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:11.784933 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:11.812160 22546 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:11.775673 21980 rpcz_store.cc:276] 0709 13:07:10.405108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.694862 (+289754us) service_pool.cc:224] Handling call
0709 13:07:10.701756 (+  6894us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:10.711363 (+  9607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.711411 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:10.712226 (+   815us) log.cc:844] Serialized 52 byte log entry
0709 13:07:11.128434 (+416208us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:11.135043 (+  6609us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.135397 (+   354us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.727761 (+592364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.728126 (+   365us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.728188 (+    62us) raft_consensus.cc:1685] finished
0709 13:07:11.728208 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.728375 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12402,"prepare.queue_time_us":55385,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":66,"raft.queue_time_us":410764,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":224,"thread_start_us":1007884,"threads_started":2,"wal-append.queue_time_us":813531}
I20260709 13:07:11.788090 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:11.813458 22551 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.720140 26803 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:11.794931 22550 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:11.795504 21979 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:11.794447 26744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.013s	sys 0.022s
I20260709 13:07:11.798460 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:11.798696 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:11.800396 26835 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:11.826593 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:11.827222 21980 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:11.800961 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:11.803483 26621 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:11.739133 26794 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:11.770321 26722 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.798465 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:11.809732 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:11.835006 21830 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
W20260709 13:07:11.784569 26692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.003s	sys 0.023s
I20260709 13:07:11.795503 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:11.817005 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2303) took 1375 ms. Trace:
I20260709 13:07:11.840925 21977 rpcz_store.cc:276] 0709 13:07:10.441405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.794939 (+353534us) service_pool.cc:224] Handling call
0709 13:07:10.846222 (+ 51283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.846475 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:11.535518 (+689043us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.813716 (+278198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:11.813834 (+   118us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:11.813961 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.814028 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.816487 (+  2459us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36032,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":933284,"threads_started":2}
I20260709 13:07:11.817179 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:11.842715 22550 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:11.811980 26834 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:11.786265 26613 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:11.829748 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:11.830592 22551 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:11.828310 21974 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:11.795142 26804 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:11.812065 26746 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.010s	sys 0.015s
I20260709 13:07:11.841575 26835 consensus_queue.cc:1243] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:11.841435 26722 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.839004 26656 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:11.853892 26803 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.845465 26769 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.830834 26721 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:11.877278 21979 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:11.883431 21975 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:11.886225 22546 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:11.867906 22552 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:11.869127 26804 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.842308 26794 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.852957 26837 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.863931 26834 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:11.840862 26859 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:07:11.900216 21825 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:11.861740 26728 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.899507 26656 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.876011 26613 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:11.907090 26769 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:11.906492 26859 consensus_queue.cc:1243] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:07:11.923401 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 74267us
I20260709 13:07:11.923969 21827 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:07:11.926077 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:11.917881 26837 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:11.916958 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 178865us
I20260709 13:07:11.916149 26656 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:11.944563 26729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.004s	sys 0.008s
W20260709 13:07:11.948518 26729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.004s	sys 0.009s
I20260709 13:07:11.949831 26733 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.928759 26846 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:11.931257 26746 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:11.952417 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:11.959614 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:11.960779 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:11.981257 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:11.954948 26846 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:11.993952 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 220067us
I20260709 13:07:11.994385 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:11.992781 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:11.991881 26854 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:11.989600 26721 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:12.000784 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:11.989820 26744 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:12.020509 21949 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:11.997874 26859 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:11.957557 26733 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:11.998457 26846 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.005131 26854 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.017192 26721 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.004300 26856 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:11.990200 26746 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.043196 22552 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:12.026784 26722 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:12.075769 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.067232 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 46779.3us
W20260709 13:07:12.076346 26848 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:07:12.033843 26854 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.072896 26836 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:12.078419 26836 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.078833 26836 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:12.079584 26733 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:12.072990 26613 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.037582 26794 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.037245 26721 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:12.081231 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 80550.1us
I20260709 13:07:12.108060 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:12.110396 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:12.111317 22550 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:12.102041 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:12.119197 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:12.124209 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:12.080999 26850 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:07:12.126122 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44294.1us
I20260709 13:07:12.111831 26722 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:12.135447 21831 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:07:12.140206 21831 pending_rounds.cc:85] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 10
I20260709 13:07:12.140478 21831 pending_rounds.cc:107] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:07:12.140727 21831 raft_consensus.cc:2889] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.133647 26744 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:12.126406 26859 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:12.129125 26613 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:12.154867 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:12.157123 21830 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:12.133392 26867 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:12.131928 26868 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:07:12.182747 26803 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:12.157390 26883 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:12.226400 26722 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:12.177345 26865 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:07:12.175849 26880 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:12.162957 26613 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:12.258275 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 102973us
I20260709 13:07:12.189783 26656 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:12.266836 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.185603 26881 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:12.250504 26878 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:12.192201 26883 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:12.228883 26722 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:12.268440 26816 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:07:12.258632 26731 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:12.188282 26803 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.258888 26849 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:12.291111 21909 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:12.282338 26883 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.272797 26729 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:07:12.258667 26834 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.183516 26744 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.290469 26731 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:12.272789 26880 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.317621 26854 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:12.322607 26869 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:07:12.323328 26882 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:12.327384 26613 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:12.328253 26833 consensus_meta.cc:287] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
W20260709 13:07:12.329705 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 74762.6us
I20260709 13:07:12.303531 26861 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.334501 21948 leader_election.cc:336] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.525s (SENT)
I20260709 13:07:12.303977 26893 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:12.336020 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:12.338385 21948 leader_election.cc:336] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.533s (SENT)
I20260709 13:07:12.340001 21982 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:12.282608 26881 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.308916 26746 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:12.332214 26654 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.002s
I20260709 13:07:12.282750 26859 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:12.340479 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 97535.6us
W20260709 13:07:12.336407 26872 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:07:12.347083 21904 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:12.297076 26849 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.333870 26856 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:12.353345 26123 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:12.339915 26837 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:12.369009 26890 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:12.353976 26731 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.376390 26731 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:12.383059 26879 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:07:12.384536 26854 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.340607 26893 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.388979 26893 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:12.427531 26881 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:12.429486 26834 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:12.435027 26834 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.435565 26880 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:12.435629 26834 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.437973 26849 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:12.439839 26834 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:12.340885 26861 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:12.445883 26887 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:07:12.446848 26861 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.447898 26803 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:12.448601 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:12.449280 22552 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:12.449340 26332 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.450424 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:12.451381 26861 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:12.451778 26861 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.452158 26861 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:12.364123 26123 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:12.456517 26123 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.457739 26123 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.465687 26092 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.350389 26836 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.487116 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:12.391943 26846 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.480656 26721 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.493758 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:07:12.510008 21948 leader_election.cc:336] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.733s (SENT)
I20260709 13:07:12.510751 21729 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 6 to 10, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 10 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:12.512382 21729 catalog_manager.cc:5697] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 8 to 9, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 9 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:07:12.514078 21948 leader_election.cc:336] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.787s (SENT)
I20260709 13:07:12.514614 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:12.515405 26123 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:12.510250 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:12.518265 26880 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:12.518743 26880 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.518950 26778 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:12.519106 26880 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.519268 26836 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.521176 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2311) took 1861 ms. Trace:
I20260709 13:07:12.491278 26803 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:12.477877 26092 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.521685 21907 rpcz_store.cc:276] 0709 13:07:10.659566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.675160 (+ 15594us) service_pool.cc:224] Handling call
0709 13:07:10.688635 (+ 13475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.688824 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:10.758213 (+ 69389us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.196618 (+438405us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.879752 (+683134us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b1800413f80. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef1522 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:12.518106 (+638354us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b1800413f80. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:07:12.520743 (+  2637us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.520828 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:12.520891 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.520980 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.521122 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24501,"prepare.queue_time_us":72497,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":1363207,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8067,"spinlock_wait_cycles":46440320,"thread_start_us":402985,"threads_started":1,"wal-append.queue_time_us":774834}
I20260709 13:07:12.521970 26836 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.527246 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 974016us
W20260709 13:07:12.527947 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 941413us
I20260709 13:07:12.528594 26803 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.529022 26803 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.529568 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.492182 26856 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.513849 26883 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:12.588554 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 60087.8us
W20260709 13:07:12.567710 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.569492 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 44548.8us
W20260709 13:07:12.589072 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 975441us
W20260709 13:07:12.536053 21906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 2270) took 2506 ms (client timeout 1969 ms). Trace:
I20260709 13:07:12.551863 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:12.590766 21906 rpcz_store.cc:269] 0709 13:07:10.029733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.032030 (+  2297us) service_pool.cc:224] Handling call
0709 13:07:12.535764 (+2503734us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002e86d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:12.535951 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2969293696}
I20260709 13:07:12.567991 21901 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:07:12.591526 21901 pending_rounds.cc:85] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 7
I20260709 13:07:12.591848 21901 pending_rounds.cc:107] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:07:12.592118 21901 raft_consensus.cc:2889] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.591533 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.576239 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:12.537631 26721 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.530407 26846 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:12.579103 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:12.602430 22547 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:12.603163 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:12.603258 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:12.599176 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.529960 26776 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.063s
W20260709 13:07:12.520764 26769 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.000s
W20260709 13:07:12.594946 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 65472.9us
W20260709 13:07:12.535296 26830 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.264s	user 0.002s	sys 0.008s
I20260709 13:07:12.594816 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:12.575325 26633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.286s	user 0.033s	sys 0.061s
W20260709 13:07:12.618223 26874 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:07:12.603876 22546 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:07:12.599225 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.610245 26642 raft_consensus.cc:2764] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:12.598902 26842 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:12.620815 26842 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:12.621135 26842 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:12.621892 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.626266 26643 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:12.626016 26842 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.626731 26643 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.628006 26842 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:12.628723 26643 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:12.600894 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:12.605474 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:12.605921 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.540179 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2310) took 1881 ms. Trace:
I20260709 13:07:12.601936 26745 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:12.535913 26092 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.598450 26778 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:07:12.605101 26381 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:07:12.602002 26654 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:12.635579 26861 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.646409 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 581) took 1914 ms. Trace:
I20260709 13:07:12.646791 21909 rpcz_store.cc:276] 0709 13:07:10.732338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.961950 (+229612us) service_pool.cc:224] Handling call
0709 13:07:10.962274 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.293427 (+1331153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.646205 (+352778us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54002e6dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:12.646356 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3055407488}
I20260709 13:07:12.647221 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 746) took 1948 ms. Trace:
I20260709 13:07:12.647598 22554 rpcz_store.cc:276] 0709 13:07:10.698487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.698657 (+   170us) service_pool.cc:224] Handling call
0709 13:07:10.698989 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.699357 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.699383 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.699816 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.900681 (+200865us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:10.900731 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.900824 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.534654 (+1633830us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:12.646970 (+112316us) raft_consensus.cc:1685] finished
0709 13:07:12.646990 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.647161 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1363,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"spinlock_wait_cycles":151768448,"thread_start_us":200227,"threads_started":1,"wal-append.queue_time_us":550797}
I20260709 13:07:12.611155 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:12.648870 26861 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.598443 26836 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.655778 26836 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:12.652494 26844 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:12.616652 21902 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:07:12.619611 26633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.330s	user 0.033s	sys 0.075s
I20260709 13:07:12.629578 22551 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:12.658560 21832 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:12.659909 21825 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:12.662318 26842 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:12.662510 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:12.661949 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:12.666706 26778 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:12.666792 26381 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:12.667151 26778 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:12.667249 26381 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:12.668061 26381 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.669171 26381 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.669550 26642 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:12.670425 26851 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:12.671566 26883 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.670444 26877 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:12.672472 21909 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:07:12.672580 26880 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.673925 21903 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:07:12.674315 21903 pending_rounds.cc:85] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 6
I20260709 13:07:12.674517 21903 pending_rounds.cc:107] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:07:12.674670 26880 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.549710 26803 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.675284 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.675670 21827 pending_rounds.cc:85] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 10
I20260709 13:07:12.675971 21827 pending_rounds.cc:107] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:07:12.676239 21827 raft_consensus.cc:2889] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.676503 26803 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:12.630517 26733 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:12.677062 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.677284 26733 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.677654 21909 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.630101 21908 rpcz_store.cc:276] 0709 13:07:10.659235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.681121 (+ 21886us) service_pool.cc:224] Handling call
0709 13:07:10.685848 (+  4727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.686097 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:10.686454 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.539749 (+1853295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.539818 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:12.539885 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.539968 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.540110 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":861782,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":806907,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":1048694,"threads_started":1,"wal-append.queue_time_us":1223673}
I20260709 13:07:12.639103 26621 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:12.678617 26621 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:12.679471 26621 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.677739 26733 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:12.680440 26621 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:12.600250 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:12.678040 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.668061 26778 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.682915 21906 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:12.683374 26778 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:12.688700 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 582) took 1956 ms. Trace:
I20260709 13:07:12.577144 26728 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.651818 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45946.9us
I20260709 13:07:12.694515 21873 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.598373 26729 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:12.674736 21903 raft_consensus.cc:2889] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.612273 26721 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:12.686267 21828 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:12.686815 21831 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:12.648442 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:12.704177 22546 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:12.704418 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:12.696311 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 96149.8us
I20260709 13:07:12.705416 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:12.689147 21904 rpcz_store.cc:276] 0709 13:07:10.732593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.973134 (+240541us) service_pool.cc:224] Handling call
0709 13:07:11.004579 (+ 31445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.347396 (+1342817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.688442 (+341046us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002f62d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:12.688634 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3086757760}
I20260709 13:07:12.706429 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:12.707727 22519 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.713119 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.713893 21981 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:12.717073 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.723848 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.723632 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.712363 21982 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:07:12.735008 21975 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:12.735489 21981 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:12.708146 21909 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 9.
I20260709 13:07:12.709679 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:12.709810 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.723253 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.740972 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:12.741281 21834 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:12.741925 21825 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:12.742458 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.742741 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.743274 21903 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:07:12.744155 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:12.744835 21830 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:12.744696 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.747290 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.748157 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.750921 22550 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:12.752554 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:12.752779 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:12.753197 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.753727 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:12.753932 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.754930 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:12.756348 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.756688 21829 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:12.756901 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:12.757493 21832 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
W20260709 13:07:12.758567 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.756903 21979 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:12.756701 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.762902 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:12.748935 21978 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:07:12.763123 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.763449 21976 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.764068 21873 leader_election.cc:400] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13.
I20260709 13:07:12.764374 21873 leader_election.cc:403] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.764776 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:12.768061 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.768608 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.769143 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.769469 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:12.770182 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.770764 21900 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:12.771029 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.770968 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.772249 21908 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:12.774060 21977 pending_rounds.cc:85] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 4
I20260709 13:07:12.770480 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.774381 21977 pending_rounds.cc:107] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:07:12.774675 21977 raft_consensus.cc:2889] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.740932 26729 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.790730 21908 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:12.775835 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.773766 26893 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:12.773916 26654 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13.
I20260709 13:07:12.773625 26851 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:12.798013 26851 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:12.798446 26851 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:12.800997 26654 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:12.801668 26654 consensus_queue.cc:1243] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:12.802680 26777 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:12.803045 26777 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:12.803881 26777 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.804944 26777 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.746018 26642 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:12.779189 26908 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:07:12.740724 26728 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.779517 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.806584 21833 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:12.779732 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.807260 21974 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:12.770766 26776 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:12.781198 21829 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.759752 26715 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:12.808291 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2316) took 1827 ms. Trace:
I20260709 13:07:12.808648 21902 rpcz_store.cc:276] 0709 13:07:10.980752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.579349 (+598597us) service_pool.cc:224] Handling call
0709 13:07:11.579707 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.656593 (+1076886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.808095 (+151502us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002e77d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:12.808240 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2371331840}
I20260709 13:07:12.809710 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.772112 26884 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:12.810770 26729 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.783005 26769 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:12.810989 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.811547 26769 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:12.811932 26769 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:12.812690 26769 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.813762 26769 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:12.787565 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:12.814249 26851 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:12.752564 26842 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.815141 26842 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.816221 21904 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:12.817061 26842 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:12.750057 26764 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:12.817880 26764 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:12.818297 26764 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:12.818534 26846 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:12.820103 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:12.820581 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:12.804960 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:12.822875 21832 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:12.823282 21909 raft_consensus.cc:2410] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:07:12.824618 21900 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:12.792140 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.792685 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.775678 21903 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:12.766021 26844 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:12.794821 26840 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:12.794952 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:12.833351 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 45844.2us
I20260709 13:07:12.834570 21832 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:12.835873 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:12.836571 21982 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:07:12.836691 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 44083.4us
I20260709 13:07:12.762372 26726 raft_consensus.cc:2764] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:07:12.753144 26745 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.789299 26641 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:12.826258 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.856122 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.856892 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.825482 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.857482 21908 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:12.857894 21900 raft_consensus.cc:2376] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15. Re-sending same reply.
I20260709 13:07:12.857532 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:12.858770 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.859370 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:12.859776 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.860144 21978 raft_consensus.cc:2376] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15. Re-sending same reply.
I20260709 13:07:12.860671 21900 raft_consensus.cc:2410] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:07:12.859781 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:12.861388 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:12.829697 21976 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10.
I20260709 13:07:12.809962 22546 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:12.831188 21981 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:07:12.839354 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:12.832526 21906 raft_consensus.cc:2376] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13. Re-sending same reply.
I20260709 13:07:12.849396 21826 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:12.863927 26664 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:12.864394 26664 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.850008 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2306) took 1872 ms. Trace:
I20260709 13:07:12.864646 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.864769 26664 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.864876 21901 rpcz_store.cc:276] 0709 13:07:10.977534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.217765 (+240231us) service_pool.cc:224] Handling call
0709 13:07:12.537783 (+1320018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.598570 (+ 60787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.849825 (+251255us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002e86d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:12.849958 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3035082112}
I20260709 13:07:12.865473 26861 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:12.865723 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.866288 21906 raft_consensus.cc:2376] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14. Re-sending same reply.
I20260709 13:07:12.866098 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:12.866850 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.866242 26861 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:12.867316 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.867561 26861 consensus_queue.cc:1243] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:12.868629 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.869879 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.871438 26896 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:12.873164 26846 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:12.861353 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:12.871196 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:12.881922 21949 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:12.886960 26896 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:12.887706 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:12.858968 22550 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:12.889674 26868 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:12.861418 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.880046 26847 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:07:12.889727 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:12.887254 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:12.892134 26092 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:12.892419 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:12.891054 21900 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:12.893422 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:12.894157 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.894356 26692 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:12.895642 26692 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:12.896066 26863 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:12.896936 26692 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.879959 26835 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:07:12.886718 26846 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:12.881292 26861 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:07:12.906783 26664 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.906971 26847 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:12.908324 21903 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:12.897576 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:12.908588 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 105278us
W20260709 13:07:12.909382 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet ff74442193fb468c966c8842f014e361: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:12.935103 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:12.910043 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51967.8us
I20260709 13:07:12.810010 26715 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.914269 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.917268 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:12.823640 26851 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:12.920465 22550 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:07:12.843223 26893 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:12.832654 26721 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:12.848873 26381 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:12.923624 22546 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:12.923951 21900 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:12.857287 26776 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.856009 26642 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.010632 22554 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:12.856627 26640 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.823485 26654 consensus_queue.cc:1175] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "479255846c5141b584b16aa253f587c7" responder_term: 14 status { last_received { term: 13 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:12.927925 21874 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:12.929443 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 104361us
I20260709 13:07:13.012128 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:13.013190 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.918996 26733 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.943058 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:13.022364 21975 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.941700 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.039371 21903 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:12.918738 26837 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:07:13.045487 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.942246 26715 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.931541 26846 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:12.985193 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:12.949038 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:13.004690 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 107160us
I20260709 13:07:12.912851 26844 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:07:12.926415 26884 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:12.908458 26745 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.016111 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:13.016500 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:12.919425 26861 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:12.933918 26847 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:12.975198 26721 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.008249 26381 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:13.048105 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.049013 21983 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:07:13.060314 21983 pending_rounds.cc:85] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 11
I20260709 13:07:13.060660 21983 pending_rounds.cc:107] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:07:13.060993 21983 raft_consensus.cc:2889] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.062330 21909 raft_consensus.cc:2393] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:13.052356 21978 raft_consensus.cc:2368] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18.
I20260709 13:07:13.053395 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:13.065603 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.066428 21908 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:07:13.071590 21902 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:13.072970 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.053864 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:13.055261 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 114793us
I20260709 13:07:13.055855 21975 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
W20260709 13:07:13.057277 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 129402us
I20260709 13:07:13.052515 21904 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:13.075527 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:13.076282 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:13.076910 21909 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:13.016155 26776 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.022156 26642 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:13.083323 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.053037 26861 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.041482 26640 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.102308 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.059155 26842 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:13.097470 26835 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.059363 26884 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:13.067917 26381 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:13.123907 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.126345 21901 raft_consensus.cc:2410] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:13.094036 26846 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.135761 21909 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:13.143246 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:13.107396 26912 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:07:13.099905 26641 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:13.063712 26726 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:07:13.106645 26861 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:13.161378 21906 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:13.168202 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.214684 21909 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:13.124526 26844 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:07:13.166735 26842 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:13.205328 26641 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.129483 26835 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.228497 26641 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.226558 26884 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.232002 26835 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:13.232230 26728 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:13.233186 26915 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:13.234238 21908 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:07:13.235577 21908 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:13.216431 26664 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.129616 26847 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.237131 26840 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:13.256017 26840 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:13.241299 26913 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:07:13.263008 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 350088us
I20260709 13:07:13.224534 26842 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.263904 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:13.279521 26745 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.279531 26835 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:13.280216 26642 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.280841 26835 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.281292 26835 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:13.282578 21904 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:13.254415 26733 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:13.272666 26847 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.273015 26896 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:13.301759 21905 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.009s	sys 0.021s
I20260709 13:07:13.289405 26692 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:13.302088 21905 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.009s	sys 0.021s
I20260709 13:07:13.300668 26776 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.303449 26692 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.308036 26640 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.328526 26692 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:13.332329 26778 consensus_meta.cc:287] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.640s	user 0.015s	sys 0.000s
W20260709 13:07:13.348515 26764 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.004s
I20260709 13:07:13.344066 26868 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:13.284065 26835 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.356426 26835 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.256889 26840 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.358835 26840 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.358659 26715 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.361166 26715 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:07:13.429910 21907 raft_consensus.cc:2410] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:07:13.551278 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.459743 22552 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:13.506201 26778 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.507088 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.361572 26764 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.519106 26858 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:13.520016 26928 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.520975 26803 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:13.522367 26835 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:13.523870 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.363927 26842 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:13.419057 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 484000us
I20260709 13:07:13.527000 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:13.367570 26861 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.527743 26837 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.364711 26729 consensus_meta.cc:287] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
W20260709 13:07:13.414484 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 402161us
I20260709 13:07:13.533898 21902 raft_consensus.cc:1217] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.6->[13.7-16.9]   Dedup: 13.7->[14.8-16.9]
I20260709 13:07:13.535478 21908 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:13.538940 26867 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:13.439514 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 161714us
I20260709 13:07:13.561769 26835 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.554282 26858 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:13.567698 26835 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:13.567617 26837 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.560863 21902 pending_rounds.cc:85] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 7
I20260709 13:07:13.555164 26803 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:13.569938 26778 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.578768 26928 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.571502 21902 pending_rounds.cc:107] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:07:13.580917 26803 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.585402 21900 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.581689 21902 raft_consensus.cc:2889] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.587931 26641 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:13.569082 26858 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.588266 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:13.589182 26621 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:07:13.595052 26764 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.595748 26621 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:13.593745 26778 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:13.596451 26621 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:13.590322 26835 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.612412 26861 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:13.612959 26764 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:13.613862 26764 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:13.616156 26909 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.605s	user 0.004s	sys 0.000s
I20260709 13:07:13.619343 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:13.619519 26715 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:13.621301 26715 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:13.624033 26837 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:13.624469 22554 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:13.634554 26715 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:13.635303 26715 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:13.637135 26715 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.638748 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2315) took 2658 ms. Trace:
I20260709 13:07:13.647423 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:13.639214 21905 rpcz_store.cc:276] 0709 13:07:10.980488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.268686 (+288198us) service_pool.cc:224] Handling call
0709 13:07:11.311497 (+ 42811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.522370 (+1210873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.522400 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.528943 (+  6543us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.701951 (+173008us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:13.303578 (+601627us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.303848 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.303927 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.614850 (+310923us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:13.638266 (+ 23416us) raft_consensus.cc:1685] finished
0709 13:07:13.638356 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.638556 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1210461,"prepare.queue_time_us":645424,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":888,"raft.queue_time_us":1210973,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":8140,"spinlock_wait_cycles":47630208,"thread_start_us":733486,"threads_started":2,"wal-append.queue_time_us":391902}
I20260709 13:07:13.631012 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:13.634024 26928 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:13.660511 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.662267 26729 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:13.664323 26381 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.012s
I20260709 13:07:13.663848 26621 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.655349 22519 leader_election.cc:400] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18.
I20260709 13:07:13.668753 22519 leader_election.cc:403] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.661976 22551 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:13.667966 21832 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:13.675894 26721 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.676873 26721 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.678220 26643 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:13.678920 26859 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.679816 26859 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:13.689639 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 87753.9us
I20260709 13:07:13.670979 26715 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.693334 26836 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:13.696060 26877 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:13.696659 26877 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:13.697054 26877 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.699970 22546 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:13.700984 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.693890 26836 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:13.704393 26729 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.705124 26851 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:13.685472 26643 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:13.705073 26836 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.705749 26851 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:13.706940 26643 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.707119 26851 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:13.710047 26940 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:07:13.657985 26835 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.737634 26778 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.737841 26930 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.738554 26930 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.739542 26835 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:13.740557 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 54254.9us
I20260709 13:07:13.741263 26930 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:13.741681 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.713785 26936 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
W20260709 13:07:13.713430 26939 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:07:13.714905 26867 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:13.742590 26867 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.743494 26721 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:13.711537 26621 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.719234 26851 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:13.720070 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65108.4us
I20260709 13:07:13.518232 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:13.723891 26868 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.723352 21729 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 5 to 7, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 7 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:13.754499 26868 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:13.726063 26938 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:07:13.755803 21729 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:13.756767 26868 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:13.725124 26893 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:13.725975 21728 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 127) took 18687 ms (client timeout 15000 ms). Trace:
I20260709 13:07:13.760247 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:13.727216 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:13.714823 26859 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.728554 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:13.758469 21728 rpcz_store.cc:269] 0709 13:06:55.038021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.038320 (+   299us) service_pool.cc:224] Handling call
0709 13:07:13.725706 (+18687386us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:07.631254 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:07.810368 (+179114us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:07.815087 (+  4719us) write_op.cc:435] Acquired schema lock
0709 13:07:07.817735 (+  2648us) tablet.cc:662] Decoding operations
0709 13:07:07.878860 (+ 61125us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:07.878972 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:07.878999 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:07:07.880079 (+  1080us) tablet.cc:701] Row locks acquired
0709 13:07:07.880159 (+    80us) write_op.cc:260] PREPARE: finished
0709 13:07:07.880317 (+   158us) write_op.cc:270] Start()
0709 13:07:07.880452 (+   135us) write_op.cc:276] Timestamp: P: 1783602427880256 usec, L: 0
0709 13:07:07.880472 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:07.881148 (+   676us) log.cc:844] Serialized 5129 byte log entry
0709 13:07:08.868924 (+987776us) op_driver.cc:464] REPLICATION: finished
0709 13:07:09.346218 (+477294us) write_op.cc:301] APPLY: starting
0709 13:07:09.378990 (+ 32772us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:09.561400 (+182410us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:09.561513 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:10.247727 (+686214us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b18001ace60. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75ed1d129 00007fb75ed1faf7 00007fb75ed20fb0 00007fb762a351bb 00007fb762a7c5d4 00007fb7629288da 00007fb76292b3cb 00007fb76292afd3 00007fb762a29e34
0709 13:07:10.486781 (+239054us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:10.487127 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:07:10.487184 (+    57us) write_op.cc:312] APPLY: finished
0709 13:07:10.487554 (+   370us) log.cc:844] Serialized 121 byte log entry
0709 13:07:10.598515 (+110961us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:10.598711 (+   196us) write_op.cc:454] Released schema lock
0709 13:07:10.598807 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:10.642875 (+ 44068us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:10.642915 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2995186,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":405158,"apply.run_cpu_time_us":47647,"apply.run_wall_time_us":1307186,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58389,"num_ops":13,"prepare.queue_time_us":39938,"prepare.run_cpu_time_us":107949,"prepare.run_wall_time_us":861018,"raft.queue_time_us":322953,"raft.run_cpu_time_us":13530,"raft.run_wall_time_us":352611,"replication_time_us":915041,"spinlock_wait_cycles":39982976,"thread_start_us":676218,"threads_started":5,"wal-append.queue_time_us":672851,"wal-append.run_cpu_time_us":29522,"wal-append.run_wall_time_us":2214715}]]}
I20260709 13:07:13.762542 21978 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.763032 22548 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:13.729178 22546 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:13.730427 26916 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.609s	user 0.000s	sys 0.003s
I20260709 13:07:13.730368 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:13.715574 26836 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.731452 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:13.767341 22554 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:13.732046 22550 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:13.741436 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:13.726336 26837 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:13.769373 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2334) took 1055 ms. Trace:
I20260709 13:07:13.769248 26837 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.769742 21977 rpcz_store.cc:276] 0709 13:07:12.713461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.744229 (+ 30768us) service_pool.cc:224] Handling call
0709 13:07:12.773862 (+ 29633us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:12.791284 (+ 17422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.791313 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:12.931305 (+139992us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b180038a160. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a
0709 13:07:13.323916 (+392611us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b2c00111818. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:07:13.328813 (+  4897us) log.cc:844] Serialized 52 byte log entry
0709 13:07:13.538277 (+209464us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:13.538373 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.539405 (+  1032us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.712532 (+173127us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:13.769018 (+ 56486us) raft_consensus.cc:1685] finished
0709 13:07:13.769037 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.769219 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26869,"raft.queue_time_us":16130,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":107507456,"thread_start_us":196784,"threads_started":1,"wal-append.queue_time_us":226046}
I20260709 13:07:13.726953 21832 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:13.738500 26778 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.731204 26844 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:13.758035 21729 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:13.684785 26381 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.779098 26844 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:13.779605 26844 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:13.779973 26381 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.780392 26778 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:13.780661 26844 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.775017 26837 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:13.794652 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:13.794860 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:13.795771 21982 raft_consensus.cc:2376] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 10. Re-sending same reply.
I20260709 13:07:13.796043 21978 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:13.798758 22550 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.805274 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:13.806046 21909 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.807174 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:13.807833 21978 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.810320 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.787827 21729 catalog_manager.cc:5697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 6 to 9, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 9 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:13.810973 21907 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:13.811190 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.811482 21729 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 9 to 10, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 10 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:13.831684 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:13.843850 26844 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.846449 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:13.848196 21729 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:13.849888 21901 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:07:13.850270 21901 pending_rounds.cc:85] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 12
I20260709 13:07:13.850526 21901 pending_rounds.cc:107] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:07:13.850749 21901 raft_consensus.cc:2889] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.850863 21729 catalog_manager.cc:5697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 6 to 10, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 10 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:13.852550 21729 catalog_manager.cc:5697] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 2 to 8, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 8 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:13.854307 26942 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:07:13.854242 21729 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:07:13.856184 21948 leader_election.cc:336] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.912s (SENT)
I20260709 13:07:13.856575 21729 catalog_manager.cc:5697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 5 to 7, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 7 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:13.857820 26837 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:13.858428 26837 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.859449 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:13.860100 21979 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:13.860263 21983 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:07:13.860558 26837 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:13.861502 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.861769 26837 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.862699 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:13.862876 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.863122 21975 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:13.910018 21982 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.910687 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.910848 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.911469 21975 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:13.864900 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.864998 21729 catalog_manager.cc:5697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 5 to 6, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 6 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:13.866250 21981 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:13.866745 26764 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:13.868166 21974 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:13.874419 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.911492 21983 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:13.876714 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:13.878417 21979 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
W20260709 13:07:13.882790 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 94413us
I20260709 13:07:13.883358 26721 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:13.889169 21904 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:13.889636 21906 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:13.892104 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.778194 26867 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.919155 21907 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
W20260709 13:07:13.892627 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 61303.9us
I20260709 13:07:13.920397 26867 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:13.892876 26923 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:13.893281 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:13.924268 21905 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:13.794631 26803 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:13.894394 26692 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.540s	user 0.016s	sys 0.002s
I20260709 13:07:13.895627 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:13.929291 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.897142 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:13.898550 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:13.900758 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:13.901532 26840 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:13.933830 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2339) took 1054 ms. Trace:
I20260709 13:07:13.916690 21900 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:13.927328 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:13.894555 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:13.936054 21982 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:13.897996 26877 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:13.938493 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61933.1us
I20260709 13:07:13.828414 26858 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.942510 26837 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:13.949415 26837 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:13.952575 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.953395 21901 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:13.954437 21979 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:13.955997 26877 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:13.956075 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:13.956740 21827 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:13.957129 21977 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:13.957659 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:13.958475 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.959146 21981 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:13.959977 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.960626 21976 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:13.961304 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.962136 21974 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:13.963778 21978 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
W20260709 13:07:13.966560 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 65980.6us
I20260709 13:07:13.962431 22550 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:13.934245 21902 rpcz_store.cc:276] 0709 13:07:12.882784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.528794 (+646010us) service_pool.cc:224] Handling call
0709 13:07:13.529375 (+   581us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:13.621159 (+ 91784us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:13.621566 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.656626 (+ 35060us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:13.673693 (+ 17067us) log.cc:844] Serialized 52 byte log entry
0709 13:07:13.673890 (+   197us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:13.673937 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.674024 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.933567 (+259543us) raft_consensus.cc:1685] finished
0709 13:07:13.933589 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.933766 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6904,"prepare.queue_time_us":6884,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":19010,"raft.queue_time_us":11398,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":2509,"thread_start_us":34565,"threads_started":1,"wal-append.queue_time_us":308764}
I20260709 13:07:13.973407 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:13.977095 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:13.977952 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:13.971695 26729 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:13.968210 26893 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18.
I20260709 13:07:13.970885 26851 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:13.985023 21908 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:07:13.969334 26867 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:13.941998 26692 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:13.981696 21827 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:13.978040 26861 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:13.985407 21908 pending_rounds.cc:85] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 10
I20260709 13:07:13.989421 21908 pending_rounds.cc:107] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:13.989816 21908 raft_consensus.cc:2889] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.999027 26858 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:14.001552 26778 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:14.002473 26840 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:14.002956 26840 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:13.992532 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:14.007730 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 84709.1us
I20260709 13:07:13.983050 26837 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:13.985250 26851 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:14.010059 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47559.4us
I20260709 13:07:13.986287 26867 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.989548 26729 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:14.025817 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.011106 26877 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:14.004158 26840 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.012782 26851 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:14.014541 26715 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:14.017536 26867 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:14.050976 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.057624 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.054615 22520 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.057186 26715 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.059983 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.027489 26923 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.031548 26877 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:14.032021 26778 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:14.072870 26893 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:14.055997 26861 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:14.070279 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 58849.8us
I20260709 13:07:14.079303 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:14.080243 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.063573 26715 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:14.086040 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.103847 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.099912 22553 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
W20260709 13:07:14.119298 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.119460 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.081211 26877 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:14.114241 26861 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.132329 26858 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:14.132934 26858 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:14.133345 26858 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:14.137598 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.126209 26764 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.138273 26861 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:14.128206 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 70204.7us
I20260709 13:07:14.138757 26884 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:14.118703 26840 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:14.123912 26803 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.147290 21909 raft_consensus.cc:2410] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:07:14.128562 26859 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.153426 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 376603us
I20260709 13:07:14.117765 26923 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.155841 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.162673 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2324) took 1308 ms. Trace:
I20260709 13:07:14.163069 21903 rpcz_store.cc:276] 0709 13:07:12.853997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.290347 (+436350us) service_pool.cc:224] Handling call
0709 13:07:13.291509 (+  1162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.291929 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:13.291972 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.292449 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.697704 (+405255us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b180048d480. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:07:14.006758 (+309054us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:14.014017 (+  7259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.028155 (+ 14138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.162235 (+134080us) raft_consensus.cc:1685] finished
0709 13:07:14.162255 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.162509 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2446,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":3326720,"thread_start_us":273250,"threads_started":1,"wal-append.queue_time_us":864187}
W20260709 13:07:14.165882 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.170770 21799 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 2.084s (SENT) [suppressed 31 similar messages]
I20260709 13:07:14.170393 26859 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.172686 26859 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:14.173998 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.176503 26928 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.177266 26928 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.181530 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:14.183665 21905 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:14.179991 26844 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.187268 26844 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.189517 26844 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.193670 26692 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.197337 26877 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:14.198282 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 180860us
I20260709 13:07:14.201134 26928 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.204432 26930 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:14.204843 26930 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:14.205811 26930 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.208456 26930 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:14.153676 26764 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.212220 26764 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.212853 26764 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.213442 26764 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.149883 26729 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.216413 26928 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.216996 26928 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.218340 26923 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.219169 26928 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.219017 26923 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:14.142688 26778 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.222139 26778 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:14.226790 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.158480 26835 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:14.232165 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:14.235908 26861 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.239820 26835 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:14.240420 26835 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:14.240724 26861 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.232941 26859 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:14.246031 26643 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:14.261718 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.262032 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.262681 22554 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:07:14.261787 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:14.263669 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 122045us
W20260709 13:07:14.269198 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 109514us
I20260709 13:07:14.276414 21905 raft_consensus.cc:2410] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:07:14.255821 26859 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.284281 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.286128 21828 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:14.289929 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.249830 26835 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.289746 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.273006 26893 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:14.294126 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 95160.2us
I20260709 13:07:14.294866 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:14.300180 26764 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.297981 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.291206 26884 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:14.309419 26778 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.311012 26954 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:07:14.311282 26778 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.312789 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.314073 26836 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:14.315794 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.316579 26643 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:14.318511 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.319139 26643 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:14.327754 21828 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:14.331669 26836 raft_consensus.cc:2764] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:14.332208 26867 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.332913 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.333701 21827 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.335572 26778 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:14.337240 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.337828 26715 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.324433 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:14.340893 26715 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.342294 26721 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:14.347043 26877 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.343964 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.348724 21979 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:14.345500 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:14.350942 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.351500 21905 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:14.351847 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:14.352368 21908 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:14.352954 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.346149 26859 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:14.309046 26764 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:14.320013 26884 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.296006 26893 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.382517 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.383344 21830 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:07:14.378624 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 62927.5us
I20260709 13:07:14.385895 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.386816 26923 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.387238 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.387377 26923 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.388332 26836 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:14.388738 26836 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.389091 26836 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.389536 26923 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.390502 26861 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:14.391260 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49126.2us
I20260709 13:07:14.371855 21831 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
W20260709 13:07:14.400229 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47369.4us
W20260709 13:07:14.392691 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 76399.8us
I20260709 13:07:14.302006 26851 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.413748 21827 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:14.355273 26928 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.424839 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:14.427795 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:14.430589 26733 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.431298 26733 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.437335 26778 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.437834 26778 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.451472 26928 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.455092 26851 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:14.455899 26861 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.456430 26861 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.459649 26846 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.459735 26847 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:14.460269 26846 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.460484 26847 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:14.462533 26863 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.462960 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.463244 26863 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.463994 26778 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:14.460533 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:14.467003 22553 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:14.476097 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51357.4us
W20260709 13:07:14.478282 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 135830us
I20260709 13:07:14.433748 26733 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.466025 26863 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.483985 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.429693 26867 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.488148 21908 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:14.490525 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.490603 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:14.428853 26955 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:14.493645 22554 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:14.495067 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.493713 26955 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.475605 26764 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:14.479332 26715 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:14.492586 26861 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.449971 26858 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.505529 22553 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:14.506691 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.508908 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:14.512099 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 121075us
I20260709 13:07:14.515463 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.498474 26778 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:14.516505 26778 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.516791 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.516934 26778 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.517422 21909 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:14.461869 26847 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.523499 26858 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.526994 26962 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:14.529378 26953 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:14.502876 26715 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.530490 26715 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.535765 26764 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.536595 21948 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.533766 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.515692 26851 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:14.501600 26846 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.499677 26955 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.530010 26953 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:14.547325 26958 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:14.547608 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:14.547784 26959 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:07:14.547876 26958 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.548435 26958 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.548581 21903 raft_consensus.cc:2410] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 19 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:07:14.546205 26621 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.549943 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.551339 26923 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:14.552223 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.553377 26953 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.549706 26621 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.556021 26621 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.558346 26863 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:14.559228 26863 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:14.562567 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.562983 26778 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.565085 26851 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:14.566112 26851 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.568526 21830 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:14.568663 26840 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.569432 26840 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.570062 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:14.513837 26928 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.584686 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.586724 26835 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:14.587213 26835 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.587538 26835 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:14.589752 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:14.590982 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.592308 22554 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:14.592310 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.594712 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:14.595402 22554 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:14.595808 26863 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.596500 26863 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.596747 26847 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:14.599651 26840 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.600690 26955 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.602263 26930 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:14.603212 26930 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:14.603554 26930 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:14.604331 26930 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.605348 26930 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:14.606369 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 60499.2us
I20260709 13:07:14.607213 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:14.609083 26963 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:14.609611 26963 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:14.606489 26840 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:14.610646 26963 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.611295 26840 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.611032 26836 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.611711 26840 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:14.613469 26836 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:14.614456 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44474.5us
I20260709 13:07:14.601843 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.615869 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.620182 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.620684 21978 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:14.618829 26844 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.630038 26621 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:14.630628 26621 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:14.632097 26381 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:14.630718 21974 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:14.634672 21974 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:14.622819 26836 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:14.631732 26621 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.643517 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.644166 21976 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:14.644119 21978 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:14.644953 26955 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.647292 26715 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.626015 26958 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.649343 26715 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.642082 26778 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:14.650861 26958 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.637804 26844 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.652320 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:14.657454 21909 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.656602 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.652846 21979 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:07:14.662428 26867 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:14.663555 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.664238 26861 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:14.664324 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.664721 26861 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:14.664969 21902 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:07:14.665851 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.665637 26861 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.666533 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.658126 21974 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:14.667140 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:14.667915 21906 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.653191 26836 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:14.668051 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.668776 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.669255 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.670428 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.670540 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:14.671018 21905 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:14.671152 21904 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.671324 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.672267 26836 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.665860 26844 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:14.667248 21908 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:14.670569 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:14.675060 21907 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.669353 21900 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:14.666576 21902 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:14.681902 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.685154 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.670023 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:14.686611 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.658445 21979 pending_rounds.cc:85] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 10
I20260709 13:07:14.687040 21901 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:14.687630 21979 pending_rounds.cc:107] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:14.685914 21977 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:14.688982 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.687620 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.691450 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:14.691908 21903 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.693082 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.693964 21979 raft_consensus.cc:2889] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.694808 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.695894 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:14.697811 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.698410 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:14.698871 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:14.702818 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.703830 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:14.704748 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:14.706460 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.707486 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.708144 21977 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:07:14.708384 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.708760 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.667186 26861 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.695293 21981 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:14.710945 21906 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:14.711195 21909 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:14.715066 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.717799 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.718313 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.719939 21901 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:14.719345 21974 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:14.726255 26863 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.726343 26868 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:14.727697 21976 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:14.728910 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.729490 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:14.730122 21978 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.713477 26847 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:14.731133 21904 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:14.735790 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.736423 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:14.727945 26837 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:14.737118 26961 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:14.737555 26837 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.724854 26692 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.737993 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.738497 26692 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.739742 26961 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:14.740489 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:14.737118 21905 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.742341 21907 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:14.744330 21979 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:14.752859 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.759260 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.760907 26867 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.761349 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.761474 26867 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.763737 26867 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.763995 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:14.764580 22553 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:14.766314 26863 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:14.766717 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 165003us
I20260709 13:07:14.767069 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:14.767746 22554 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:14.768074 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.768327 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:14.769307 21873 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.738013 26837 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:14.770959 26778 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:14.771462 26778 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:14.771907 26930 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:14.772421 26930 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:14.772359 26778 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.773388 26930 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.775141 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.763768 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.778367 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.775297 26803 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:14.786099 21830 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:14.784821 21979 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:14.740690 26692 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:14.789165 21799 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.802127 22553 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:14.775943 26621 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:14.807305 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.804545 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.766744 26863 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.815725 21907 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:14.817503 21905 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:14.786842 26958 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:14.785904 26733 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:14.819941 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:14.821990 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 52841.9us
I20260709 13:07:14.786299 26928 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:14.795547 26867 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:14.819666 26381 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:14.814289 26863 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.814088 26621 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:14.828495 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53436.1us
I20260709 13:07:14.803582 26643 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:14.827636 26847 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:14.831655 26974 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:07:14.845542 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.833719 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.833942 21978 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:14.846261 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.839143 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:14.842018 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 58991.1us
I20260709 13:07:14.827898 26962 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:14.824852 26733 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:14.831931 26958 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:14.844976 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.858489 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.828018 26928 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.842895 26621 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.867491 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.872336 21830 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:14.822968 26764 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:14.868757 21831 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:14.880517 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.846783 26847 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.887217 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:14.905563 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:14.860013 26733 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:14.894963 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.887863 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.856633 26851 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:14.885269 26968 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.254s	user 0.001s	sys 0.002s
I20260709 13:07:14.871069 26928 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.870265 26982 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:14.860527 26643 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:14.900738 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.886720 26692 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:14.886466 26868 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:14.915251 26981 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:14.914992 26863 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.923293 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:14.929723 26846 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.951978 21831 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:14.952181 26846 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.951964 26975 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:14.954676 26975 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.955027 26975 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:14.955941 21900 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:07:14.956431 21900 pending_rounds.cc:85] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 11
I20260709 13:07:14.956763 21900 pending_rounds.cc:107] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:07:14.957100 21900 raft_consensus.cc:2889] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.957547 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:14.958958 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 76392.4us
I20260709 13:07:14.959370 26840 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.956602 26958 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:14.962873 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:14.965939 26846 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:14.968060 21982 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:14.968564 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:14.967976 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:14.918294 26851 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.969812 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:14.959875 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:14.928095 21825 raft_consensus.cc:2393] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:14.912529 26837 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:14.907187 26893 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:07:14.986690 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 86036.2us
I20260709 13:07:14.986718 21983 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:15.017560 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:14.990948 21828 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:07:14.991780 26837 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:14.971807 26692 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:14.998456 26721 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:15.007807 26733 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.011930 26863 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:15.013073 21900 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:14.908378 26835 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:15.027211 26984 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.073s	user 0.000s	sys 0.003s
I20260709 13:07:14.971571 26986 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:14.973093 26851 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.987778 26953 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:14.986678 26840 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:15.054584 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.054875 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.055992 21831 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 13 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:15.040024 26381 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:15.040704 26989 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:15.032877 26954 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:07:15.043915 26733 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:15.043807 26621 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.068678 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.070029 26621 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:15.039799 26986 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:15.070626 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.045760 26692 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.036517 26987 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:15.047060 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.037082 26729 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:07:15.050833 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.051515 26835 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:15.021929 26955 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:07:15.053594 21980 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
W20260709 13:07:15.054204 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.090761 26928 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.093698 26928 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:14.957188 26643 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.063627 26863 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:15.068032 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.070776 26986 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:15.062414 26953 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:15.069948 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:15.051641 26978 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:15.080693 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.110872 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:15.111428 22554 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:15.081019 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.081234 26847 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:15.082381 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 64888.1us
I20260709 13:07:15.082907 26982 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:15.085484 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.086352 21834 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:15.086958 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.088474 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.059254 21903 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
W20260709 13:07:15.101794 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 196292us
I20260709 13:07:15.071449 26844 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.106806 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.097663 26721 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:15.120808 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:15.124217 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 82126.9us
I20260709 13:07:15.125231 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.104337 26863 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.128171 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:15.128304 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:15.103000 26987 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:15.134977 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.117527 26840 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:15.135643 21826 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:15.135227 26863 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:15.140241 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.140295 21829 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:15.096494 26846 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:15.140183 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.137051 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.154750 21833 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:15.154654 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:15.159739 26778 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:15.163805 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:15.165555 26930 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:15.165942 26930 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.135744 26958 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:15.073130 26975 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.166318 26930 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:15.177839 22547 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:15.177839 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:15.136811 26982 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:15.119246 26803 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:15.138446 26993 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:15.123421 26844 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.183275 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:15.177855 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47704.9us
I20260709 13:07:15.136632 26961 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:07:15.186615 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58528.1us
I20260709 13:07:15.184744 21982 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:15.185185 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:15.185472 21833 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:15.136718 26877 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:07:15.139954 26840 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.174973 26928 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.138361 26859 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:15.182256 26958 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:15.194588 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:15.194867 26987 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.194361 26991 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:15.211916 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:15.217334 26621 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:15.203645 26991 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:15.186501 26953 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.221140 26991 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:15.222663 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:15.198360 26988 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:07:15.228935 21982 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:15.242578 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:15.175256 26381 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.202097 26962 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:15.244445 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 43618.8us
W20260709 13:07:15.254114 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59620.5us
I20260709 13:07:15.255991 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:15.257014 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45138.7us
W20260709 13:07:15.259099 26992 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:15.257802 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:15.268287 26837 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:15.269133 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.269011 26837 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.199065 26928 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.271663 26928 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:15.271869 26837 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:15.272423 26982 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.208905 26643 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:07:15.277726 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 55159.6us
I20260709 13:07:15.281754 22554 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:15.193684 26993 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.295436 21833 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:15.311429 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.320804 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:15.286019 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 89274.4us
I20260709 13:07:15.333367 26847 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:15.334350 26997 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:07:15.332232 22550 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:15.259542 26962 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.332811 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:15.355710 22546 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:15.259491 26840 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:15.359110 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 128730us
W20260709 13:07:15.336670 26867 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.001s
I20260709 13:07:15.288312 26928 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:15.357234 26884 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:15.363749 26990 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:07:15.363999 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:15.386708 21982 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:15.364519 21825 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:15.386091 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 128389us
I20260709 13:07:15.365407 26975 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:15.367388 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:15.355649 26962 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:15.339355 26958 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.387765 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:15.381291 21826 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:15.389837 21975 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:15.382149 22546 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:15.285624 26858 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:15.388818 21978 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:15.390643 21974 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:15.376683 26953 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.383080 26867 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:15.408653 21978 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:15.409956 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:15.409821 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 303669us
I20260709 13:07:15.389406 26928 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:15.391247 26961 raft_consensus.cc:2764] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:07:15.412675 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.295841 26991 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:15.413228 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 51240.1us
I20260709 13:07:15.414332 22546 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:15.387419 26840 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:15.415987 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:15.416869 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:15.420215 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:15.421203 21980 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:15.421833 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:07:15.420866 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 164685us
I20260709 13:07:15.405185 26858 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:15.423128 21902 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 9.
I20260709 13:07:15.423329 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:15.423158 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:15.424682 21901 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:15.424785 21905 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:15.385838 26884 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.426015 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:15.426290 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:15.426719 21908 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:15.427191 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:15.426054 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:15.426676 21902 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:15.428048 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:15.431792 22550 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:15.427273 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:15.420008 26998 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:15.429034 26844 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:15.504266 26844 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:15.504896 26844 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:15.506613 26999 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:07:15.498783 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 76190.3us
I20260709 13:07:15.508221 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:15.500643 26868 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:07:15.509445 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:15.509150 26858 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:15.510349 27001 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:07:15.511682 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:15.513275 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:15.518981 21903 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:15.527810 21906 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:15.529997 26868 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:15.530321 27014 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:15.530457 26868 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:15.530676 26987 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:15.531235 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 104599us
I20260709 13:07:15.531579 26987 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:15.531673 26868 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.532634 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:15.533077 26868 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:15.532719 26987 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.534435 21905 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:15.411681 26953 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:15.530395 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 103196us
W20260709 13:07:15.537693 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.542681 21901 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:15.515336 26867 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:15.512647 26991 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:15.551366 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:15.566938 21908 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:07:15.528863 26928 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:15.594667 22546 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:15.528083 26877 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:07:15.591667 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 59095.4us
I20260709 13:07:15.592206 21983 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:15.535008 26975 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:15.591307 27013 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:15.612130 26994 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.350s	user 0.003s	sys 0.000s
I20260709 13:07:15.618927 22550 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:15.620014 26953 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:15.621753 26844 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:15.622457 27009 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:07:15.623512 27006 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.624123 27006 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.627040 27012 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:15.635492 26884 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:15.647411 27000 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:07:15.650588 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:15.551172 26867 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:15.586781 26847 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:15.645931 26961 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:15.682910 21909 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:15.656975 26867 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:15.657660 26884 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.704797 21977 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:15.588568 26863 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.660898 26975 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:15.664252 26961 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:15.656729 26986 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.725099 27012 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:15.729346 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:15.730327 26928 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:15.730405 21873 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:15.730782 26928 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:15.731169 26928 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:15.726034 27012 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.732966 26844 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:15.731177 26381 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:15.734573 26381 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.734968 26381 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:15.689025 26847 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:15.758757 26851 consensus_meta.cc:287] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.000s
I20260709 13:07:15.758610 26381 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.759914 26928 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.761186 26993 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:15.764714 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 105290us
I20260709 13:07:15.766489 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:15.768060 26963 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:15.768713 26803 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:15.811427 21979 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:15.769178 26961 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.774084 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:15.774581 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:15.784355 26986 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:15.785742 26844 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.788754 26975 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:15.791347 26930 consensus_meta.cc:287] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
I20260709 13:07:15.815588 21983 raft_consensus.cc:2368] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15.
I20260709 13:07:15.791147 26962 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.716884 27006 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:15.716496 26840 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:15.804922 26963 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:15.860304 21825 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:15.817229 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:15.714102 26884 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:15.813200 21980 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
W20260709 13:07:15.815608 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 415127us
I20260709 13:07:15.801141 26863 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:15.800486 26851 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.811229 26803 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:15.860977 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:15.852388 26778 consensus_meta.cc:287] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.002s
I20260709 13:07:15.871510 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:15.863996 21825 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:15.872308 21832 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:15.815743 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 303269us
I20260709 13:07:15.880244 26963 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.881371 26778 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:15.883244 26847 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:15.857048 27019 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:07:15.885501 27019 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:15.887192 26928 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:15.886912 26803 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.820290 26930 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.887982 26803 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:15.889264 26930 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:15.890259 21976 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:15.891392 21907 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:15.896260 21976 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:15.816788 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 303541us
I20260709 13:07:15.822715 26844 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.897615 21980 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:07:15.899964 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:15.874902 21825 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:15.902029 21975 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:15.901063 21825 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:15.909888 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 48980.8us
I20260709 13:07:15.911002 21983 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:15.904043 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:15.912979 21980 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:15.865207 26836 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:15.927280 21976 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:07:15.859416 26998 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:07:15.934752 21902 consensus_meta.cc:287] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.001s
I20260709 13:07:15.874336 26954 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:07:15.941552 21902 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:15.897364 27028 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:15.951395 21902 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:15.955998 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:15.956658 21900 raft_consensus.cc:2410] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:15.955989 21874 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:15.962265 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 87392.1us
I20260709 13:07:15.963951 22519 leader_election.cc:400] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15.
I20260709 13:07:15.965204 22519 leader_election.cc:403] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:15.967605 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:15.969372 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:15.971175 27020 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:07:15.972602 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.976495 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:15.939978 26930 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:15.980458 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:15.986698 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:15.987425 22546 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:15.988193 21904 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:07:15.991703 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:15.992344 21900 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:15.953474 27028 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:15.992367 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:15.993261 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:15.979375 26963 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:15.977882 26778 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:16.000260 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:16.001654 21906 raft_consensus.cc:2368] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15.
I20260709 13:07:16.000869 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:15.984570 26958 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:16.002733 22553 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:16.003091 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.004793 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:16.007022 21903 raft_consensus.cc:2368] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16.
I20260709 13:07:15.981482 26381 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:15.992610 27013 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.011577 27027 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:16.010270 27012 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:07:16.012310 27026 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:16.012753 27023 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:16.014920 21905 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:16.030915 21974 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:16.031538 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.018080 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:16.021080 22546 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:15.979259 26928 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:16.023828 21906 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:15.947293 26840 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.039537 22547 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:07:16.036932 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.996668 27028 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:16.039239 22553 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:15.982627 26859 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:07:16.045524 27030 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:16.046247 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet a6e402ca5ed540e5a1c44b9a1dafcf78: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:16.046056 27030 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.047015 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:16.048103 27030 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:15.902637 26721 consensus_queue.cc:1175] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d76b2c4699e43fba10eeb81a91e4913" responder_term: 14 status { last_received { term: 14 index: 7 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:16.051460 26858 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:16.051836 26858 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.052563 26858 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.053462 26858 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:16.056211 26961 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:16.057232 21905 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:16.058387 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:16.059044 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:16.038022 26729 raft_consensus.cc:2764] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:07:16.038331 27027 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:16.060956 21900 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: [10.9-14.10]
I20260709 13:07:16.061002 27027 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.062216 21900 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:16.094774 21907 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:16.025051 26930 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:16.099782 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2373) took 1015 ms. Trace:
I20260709 13:07:16.109164 21977 rpcz_store.cc:276] 0709 13:07:15.084508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.085975 (+  1467us) service_pool.cc:224] Handling call
0709 13:07:15.086263 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.707061 (+620798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.099557 (+392496us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54002c7254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:16.099721 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1389102848}
W20260709 13:07:16.099884 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 68423.6us
I20260709 13:07:16.101591 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:16.063745 21900 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: [9.5-13.6]
I20260709 13:07:16.111107 21906 raft_consensus.cc:2368] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16.
I20260709 13:07:16.111716 21875 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.107923 27023 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:16.117617 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:16.124310 21900 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:16.098729 26981 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:16.125375 21906 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:07:16.131634 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.132511 21826 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:16.108002 26836 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.134603 26836 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.136689 26836 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:16.131665 21829 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:07:16.137657 27039 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:07:16.137734 21829 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.039978 26962 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:16.128064 21900 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:16.131778 27005 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.139519 22546 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:16.130853 21906 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:16.091871 26884 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:16.031306 27013 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.124161 26868 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:16.145815 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.151621 21903 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:16.125780 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 131918us
I20260709 13:07:16.153285 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:16.153606 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:16.149721 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:16.142204 21831 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:16.140991 21829 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.156385 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.158989 22550 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:16.159627 22551 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:16.172574 21831 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.160035 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:16.161665 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.164748 21981 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:16.162149 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:16.155172 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:16.180316 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:16.180781 21982 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:16.180583 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:16.179734 21974 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:16.181478 21799 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:16.181856 21983 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:16.182394 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:16.183035 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.145393 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:16.183234 21901 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.131151 26975 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:16.180946 21829 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:16.164681 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53060.1us
I20260709 13:07:16.180303 22548 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:16.193578 21976 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:16.188372 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:16.197906 21977 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:16.152405 26988 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.203400 21983 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:16.146770 26844 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:16.204977 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.156700 27013 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:16.154579 26930 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.208526 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.208547 21901 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:16.159159 26851 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:16.216105 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:16.197244 26987 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:16.186038 26928 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:16.189355 27019 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:16.146008 27030 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:07:16.279598 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.146130 26859 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:07:16.223295 21903 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 11.
I20260709 13:07:16.153870 26867 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.162647 26868 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.292065 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.206254 21831 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.278525 21825 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:07:16.286562 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 81663.5us
I20260709 13:07:16.303211 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.213223 26837 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:16.226687 21901 pending_rounds.cc:85] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 6
I20260709 13:07:16.224476 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.314047 21903 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:07:16.315804 21901 pending_rounds.cc:107] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:07:16.309798 21982 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:16.316399 21901 raft_consensus.cc:2889] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.189216 26877 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:07:16.320916 21831 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:16.322932 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.326318 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.220923 27012 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:07:16.202770 26986 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:07:16.164286 27005 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.331053 21903 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:16.331537 21830 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:16.191517 27014 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:07:16.276600 26844 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:16.283320 26987 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.351819 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.334930 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.374625 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.376897 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.378144 21830 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:16.369415 21825 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:16.381390 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.214982 26988 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.315496 26837 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:16.384801 21828 raft_consensus.cc:2368] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12.
I20260709 13:07:16.329834 26836 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:16.327981 26989 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.221239 27041 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.152s
I20260709 13:07:16.371605 26987 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.371894 27012 consensus_queue.cc:1243] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:16.224864 26930 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.392452 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.446110 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.313989 26643 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:07:16.366281 26928 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:16.394819 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.451314 21834 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:07:16.397594 21832 consensus_meta.cc:287] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.000s
I20260709 13:07:16.451929 21832 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:16.217139 26847 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.154s
I20260709 13:07:16.403499 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:16.407289 26867 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:16.375888 27019 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:16.375758 26733 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:16.407886 26836 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:16.410516 21829 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:16.386070 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:16.451776 27041 consensus_queue.cc:1243] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:16.387795 26837 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:16.447125 21980 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:16.449400 21830 raft_consensus.cc:2368] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12.
W20260709 13:07:16.427013 27003 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:16.423897 26989 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:16.427554 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 124441us
I20260709 13:07:16.450448 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:16.450213 26803 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.562s	user 0.002s	sys 0.009s
I20260709 13:07:16.457273 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.393504 26998 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:07:16.427541 26962 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:16.473578 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.474568 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:16.481711 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.481942 21903 raft_consensus.cc:2410] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 13:07:16.481938 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 108757us
I20260709 13:07:16.380111 26844 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.479892 21832 raft_consensus.cc:2368] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15.
I20260709 13:07:16.476701 21831 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:16.484872 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.485180 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.485767 21832 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.490376 26836 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.490823 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.492033 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.492574 21833 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:16.489688 26958 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15.
I20260709 13:07:16.494131 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.495491 21830 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:16.495784 21830 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.496502 21830 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.497610 21830 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.498847 26858 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:16.499259 26858 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.499608 26928 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.500016 26858 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.500476 26844 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:16.493674 21833 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:16.504901 21832 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 13 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:16.523741 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:16.523890 22549 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
W20260709 13:07:16.516870 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.525892 21828 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:16.506769 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:16.502143 21903 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:07:16.528132 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.528612 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.535424 21903 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:07:16.537616 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57301.2us
I20260709 13:07:16.538301 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.539924 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.540887 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:16.541031 22552 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:07:16.542667 22550 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:07:16.544696 21831 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:16.545166 21831 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.501044 26733 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:16.549304 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65084.6us
W20260709 13:07:16.549960 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.552949 21903 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:16.554399 22547 raft_consensus.cc:2393] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:07:16.556770 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.557757 21799 leader_election.cc:400] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15.
I20260709 13:07:16.558629 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:16.559695 21828 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:16.559788 21827 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:16.560611 21827 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.560073 21831 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.561885 21828 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.562981 22521 leader_election.cc:400] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15.
I20260709 13:07:16.537374 26958 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:16.541706 26858 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:16.590982 21830 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:16.592662 21799 leader_election.cc:400] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16.
I20260709 13:07:16.592998 21799 leader_election.cc:403] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:07:16.592690 21830 pending_rounds.cc:85] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 9
I20260709 13:07:16.546370 26621 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:16.594957 21831 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.589932 21832 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:16.593910 21830 pending_rounds.cc:107] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:16.599120 21830 raft_consensus.cc:2889] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.590590 21827 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.594697 21828 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.611209 21977 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:16.612253 21834 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:16.614037 21833 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:16.619283 21828 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:16.620353 21827 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:16.570322 26868 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:16.591308 26958 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:16.629336 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 74080.7us
I20260709 13:07:16.651046 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:16.599983 27030 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16.
I20260709 13:07:16.599884 27012 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:16.623730 27053 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:07:16.659179 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 65496.7us
I20260709 13:07:16.664276 21831 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:07:16.664640 21831 pending_rounds.cc:85] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 11
I20260709 13:07:16.664945 21831 pending_rounds.cc:107] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:07:16.614393 26621 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:16.597749 26963 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:07:16.666586 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:16.652714 26958 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:16.665019 26867 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:16.691684 21828 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:07:16.694406 21828 pending_rounds.cc:85] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 12
I20260709 13:07:16.694738 21828 pending_rounds.cc:107] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:07:16.695055 21828 raft_consensus.cc:2889] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.656571 26988 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:16.583415 27063 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:07:16.665189 21831 raft_consensus.cc:2889] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:16.698441 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44626us
I20260709 13:07:16.699196 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:16.700475 21827 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:16.702524 21799 leader_election.cc:400] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16.
I20260709 13:07:16.703119 21799 leader_election.cc:403] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:16.657037 26868 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:07:16.661046 26998 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:16.687119 27069 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:16.696707 26963 consensus_queue.cc:1243] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:16.729872 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:16.730604 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.699649 26961 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:16.731989 27075 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:16.732105 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:16.708375 27049 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:07:16.687165 26643 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:07:16.733610 26989 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:16.734229 27070 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:16.707445 26930 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:16.773247 26930 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:16.773977 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:16.738641 27069 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.775600 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:16.776013 26986 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.776384 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:16.776607 26986 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.739806 21900 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:16.742317 22555 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:07:16.778460 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:16.779253 21900 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:16.779470 22547 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:16.779709 27066 raft_consensus.cc:2764] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:07:16.735971 26859 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:16.742949 27072 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16.
W20260709 13:07:16.743309 27056 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:07:16.728473 27068 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:16.746008 26993 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:16.746682 27076 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:16.746724 26621 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:16.727041 27055 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:07:16.761220 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:16.767577 26975 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:16.768162 21904 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:16.701297 27019 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:16.770634 21874 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:16.773784 26930 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.694949 26733 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.781831 21909 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:07:16.782212 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.786782 27027 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:16.783730 26859 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.784145 26868 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:16.784911 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 82567.6us
I20260709 13:07:16.780696 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:16.787153 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:16.789088 21982 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:16.789583 21983 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:16.790086 21976 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:16.758634 26837 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.795768 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.821671 21828 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:16.796376 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.796427 21834 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:16.797415 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.822940 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.780686 26989 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:16.798238 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:16.803768 26986 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:16.790143 27075 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:16.815619 27023 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:16.815936 27026 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.817309 21875 leader_election.cc:400] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12.
I20260709 13:07:16.792217 26643 consensus_queue.cc:1243] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:16.794646 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:16.845716 21827 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:16.763957 26836 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:16.823303 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.784088 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.855779 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.819288 27014 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:16.824579 27058 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:16.824914 26877 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:16.868798 26877 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.869818 26877 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.871037 26877 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:16.871348 26837 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:16.871958 26837 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:16.821063 26975 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.791576 26993 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:16.836459 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 55404.7us
I20260709 13:07:16.832568 26958 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:16.837245 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 46725.5us
I20260709 13:07:16.886104 26837 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:16.886137 26867 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:16.887704 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:16.840368 21903 raft_consensus.cc:1217] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Deduplicated request from leader. Original: 11.11->[12.12-12.12]   Dedup: 12.12->[]
I20260709 13:07:16.889109 21903 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:07:16.888854 26867 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.888923 26837 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:16.784343 27066 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:07:16.890493 27066 consensus_queue.cc:1243] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:16.841291 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:16.892968 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51788.2us
I20260709 13:07:16.893712 26928 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:16.819273 22551 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:16.843032 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:16.786250 26893 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:07:16.858767 26621 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:16.895255 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 52322us
I20260709 13:07:16.896179 26621 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:16.896620 26621 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:16.861443 26643 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.847484 26989 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:16.900962 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 66789.4us
I20260709 13:07:16.834859 26868 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:16.868006 27067 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:16.789441 21825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:16.894030 21875 leader_election.cc:400] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12.
I20260709 13:07:16.897476 26621 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:16.902755 21825 raft_consensus.cc:606] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:16.903191 21825 raft_consensus.cc:614] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:16.903283 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:16.904119 26928 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:16.904601 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:16.820415 27028 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 13:07:16.906145 21825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2705e36077094db8a03a8b3e606284be"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:16.906791 21825 raft_consensus.cc:606] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:16.880582 27075 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.847131 27027 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:16.839882 27063 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:16.906438 27028 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.916873 26721 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:16.909372 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:16.862972 27014 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.910902 22552 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:16.855531 26836 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.914701 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:16.921336 22546 raft_consensus.cc:2368] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16.
I20260709 13:07:16.802552 27076 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.928987 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:16.919361 27066 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:16.855082 27026 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.944758 27026 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:16.945374 27026 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:16.945757 27026 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.931999 26844 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:16.898424 26643 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.938524 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:16.940312 27030 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:16.946137 27026 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:16.946573 26844 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.955945 26844 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.948442 26643 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:16.950349 27063 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:16.958792 27063 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.959789 27063 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:16.962002 27052 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:07:16.951851 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:16.963387 26858 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:16.952010 26961 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:07:16.963551 21829 raft_consensus.cc:2410] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:16.950549 27030 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:16.927464 27014 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.929318 26836 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.877081 27058 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.919226 26837 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:16.908614 26859 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.923058 26867 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:07:16.922621 26986 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:07:16.927330 27023 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:07:16.988654 21980 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:16.908627 27027 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.934485 27013 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:16.981770 26963 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:07:16.983862 26989 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:16.995673 27028 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:17.002108 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.003014 21826 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:17.003463 26962 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:17.003883 26962 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:17.006875 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:17.013550 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:17.014541 26858 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:17.014858 26953 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:17.015480 26953 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.015601 27059 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:17.014701 27074 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:17.016515 26381 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:17.017452 27059 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:17.017452 27074 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:17.014622 27075 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.018203 26381 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:17.018739 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2389) took 1111 ms. Trace:
I20260709 13:07:17.015924 26953 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:17.026242 21981 rpcz_store.cc:276] 0709 13:07:15.907721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.066765 (+159044us) service_pool.cc:224] Handling call
0709 13:07:16.164573 (+ 97808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.180000 (+ 15427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.018547 (+838547us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b540005a5d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:17.018677 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103795072}
I20260709 13:07:17.025409 21826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:17.036882 21826 raft_consensus.cc:606] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:17.037407 21826 raft_consensus.cc:614] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:17.004858 26962 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.073177 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2375) took 1032 ms. Trace:
I20260709 13:07:17.016480 27066 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:17.073539 21907 rpcz_store.cc:276] 0709 13:07:16.040265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.047882 (+  7617us) service_pool.cc:224] Handling call
0709 13:07:16.048174 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.107492 (+ 59318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.072918 (+965426us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b54002e63d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:17.073112 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59495808}
I20260709 13:07:17.080056 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:17.080600 21907 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:17.048310 27028 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.081956 27069 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:17.088968 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:17.089701 21909 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:17.087260 21908 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:17.036731 27059 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:07:17.094636 27092 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:07:17.094884 26987 consensus_meta.cc:287] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 13:07:17.095258 26987 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.073983 27013 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.083595 27090 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:17.073764 26986 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:17.114578 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 186372us
I20260709 13:07:17.115041 21977 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:17.118496 21826 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:07:17.118877 21826 pending_rounds.cc:85] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 6
I20260709 13:07:17.119092 21826 pending_rounds.cc:107] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:17.119283 21826 raft_consensus.cc:2889] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.072798 26877 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:07:17.123549 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.123492 21832 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:17.124573 21831 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:17.127828 26975 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:17.128779 26778 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:17.129171 26778 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:17.130615 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.131464 21828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "865ede4842b04242930bf2619bb09d16"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:17.132018 21828 raft_consensus.cc:606] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:17.132328 21828 raft_consensus.cc:614] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:17.135229 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.137975 21907 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:17.138590 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:17.140705 21909 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:17.141602 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.107908 27028 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.142379 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2387) took 1241 ms. Trace:
I20260709 13:07:17.080384 27030 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.117293 27013 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.122591 26986 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.141718 27009 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:17.119941 26836 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.144801 26987 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.141021 26381 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 13:07:17.160159 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.160565 21974 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:17.160195 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:17.161482 21831 raft_consensus.cc:606] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:17.161803 21831 raft_consensus.cc:614] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:17.160621 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.152994 27009 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.148108 26858 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:07:17.172581 27028 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:17.174257 27013 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:17.176599 27026 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.178124 27076 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.179857 26844 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.179970 26778 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.180553 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.182089 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.182673 21830 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:17.156142 27058 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.187291 26962 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:17.187532 26986 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:17.189365 26836 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.164593 27009 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:17.193444 21830 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:17.194387 27026 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:17.197247 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.197881 21831 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.198732 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:17.199092 26844 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:17.200410 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:17.200902 26953 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.203159 26953 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.205303 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.193382 27014 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.205860 21830 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:17.210970 26778 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:17.211326 27093 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.138s	user 0.003s	sys 0.000s
I20260709 13:07:17.215445 27005 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.216605 26844 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.217085 26844 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:17.219321 27100 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
I20260709 13:07:17.211170 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.227077 21830 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:17.232106 26844 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:17.233052 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.235960 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.236485 27059 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:17.221007 27030 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:17.240134 22550 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:17.242920 26844 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:17.245066 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:17.247083 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:17.249392 21831 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:17.251343 27028 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.251718 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:17.251848 27028 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.252394 27041 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:17.252873 27041 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:17.254743 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:17.250816 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.252451 21900 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:17.257249 22551 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:17.258294 26998 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.261731 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.264603 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:17.265306 21978 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.269966 21976 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:17.271278 21830 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:17.274287 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.274901 21833 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:17.253898 26986 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:07:17.277745 21976 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:17.274652 26863 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.283753 21977 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:17.273805 27005 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.282737 26863 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.287173 27005 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.288475 26863 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.289112 27005 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:17.253912 27028 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:17.292702 27057 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:17.293248 27057 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:17.253705 27041 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.273764 26847 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.299113 26847 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.143357 21975 rpcz_store.cc:276] 0709 13:07:15.897237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.950390 (+ 53153us) service_pool.cc:224] Handling call
0709 13:07:15.971174 (+ 20784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.971377 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:16.964679 (+993302us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b18003f2c20. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf
0709 13:07:16.964835 (+   156us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.137997 (+173162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.138054 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.138103 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.138200 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.138304 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59254,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":5766,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3648,"spinlock_wait_cycles":13039872,"thread_start_us":297995,"threads_started":2}
I20260709 13:07:17.301141 26847 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.301710 27019 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:17.302246 27019 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:17.290299 21799 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2705e36077094db8a03a8b3e606284be. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:17.303145 27019 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.304548 27019 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:17.295485 27057 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.284915 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.307417 21981 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:17.273324 27014 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:17.258760 26998 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.305922 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:17.296929 27041 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.312062 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.312176 21978 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:17.312928 21831 raft_consensus.cc:2368] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19.
I20260709 13:07:17.313933 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2377) took 1259 ms. Trace:
I20260709 13:07:17.314685 26729 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:17.316365 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.315896 26993 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.317337 26993 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.319723 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2381) took 1263 ms. Trace:
I20260709 13:07:17.320055 21904 rpcz_store.cc:276] 0709 13:07:16.056088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.059996 (+  3908us) service_pool.cc:224] Handling call
0709 13:07:16.768000 (+708004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.805289 (+ 37289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.319564 (+514275us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b5400077450. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:17.319675 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627597184}
I20260709 13:07:17.321780 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:17.314414 21902 rpcz_store.cc:276] 0709 13:07:16.054956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.058243 (+  3287us) service_pool.cc:224] Handling call
0709 13:07:16.058522 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.099766 (+ 41244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.099795 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.114333 (+ 14538us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.536252 (+421919us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:16.582395 (+ 46143us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.772091 (+189696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.772162 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.296769 (+524607us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b180043d980. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:17.305400 (+  8631us) raft_consensus.cc:1685] finished
0709 13:07:17.313722 (+  8322us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.313851 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232893,"prepare.queue_time_us":53793,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":229641,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":16128,"spinlock_wait_cycles":9537408,"thread_start_us":421537,"threads_started":1,"wal-append.queue_time_us":539877}
I20260709 13:07:17.325366 21902 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:17.327433 21908 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:17.328603 21908 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:07:17.329900 26953 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:17.331059 21826 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:17.331171 26953 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:17.334534 26953 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:17.334692 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.335387 26953 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.336604 26953 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:17.337896 26868 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:17.332599 21903 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:17.339641 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.339991 21975 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:17.335397 21977 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:17.345817 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:17.346386 27028 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:17.346937 27028 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.348431 27072 raft_consensus.cc:2764] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:07:17.349103 27028 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:17.353921 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2295) took 1136 ms. Trace:
I20260709 13:07:17.354353 21829 rpcz_store.cc:276] 0709 13:07:16.231168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.484093 (+252925us) service_pool.cc:224] Handling call
0709 13:07:17.353735 (+869642us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540011e254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:17.353863 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008503168}
I20260709 13:07:17.356709 21798 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:17.359125 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.359781 21829 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:17.362558 21908 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:17.363215 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.363909 21829 raft_consensus.cc:2376] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19. Re-sending same reply.
I20260709 13:07:17.364862 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.366058 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.367874 21829 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:17.373845 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.363423 27064 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.675s	user 0.004s	sys 0.000s
I20260709 13:07:17.340261 26778 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.415081 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.379844 26954 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:17.387938 21829 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:17.378715 26962 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:17.390106 26859 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:17.396907 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 782) took 1227 ms. Trace:
I20260709 13:07:17.468883 22549 rpcz_store.cc:276] 0709 13:07:16.169394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.226464 (+ 57070us) service_pool.cc:224] Handling call
0709 13:07:17.396728 (+1170264us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b5400463f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:17.396832 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89425280}
I20260709 13:07:17.400159 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.472560 22549 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:17.449424 26778 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:17.473623 27098 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.367s	user 0.001s	sys 0.001s
I20260709 13:07:17.402395 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2390) took 1267 ms. Trace:
I20260709 13:07:17.474246 26962 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:17.474712 26962 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:17.475353 26778 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:17.475834 26778 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:17.393939 22521 leader_election.cc:400] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19.
I20260709 13:07:17.475699 26962 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.476305 26778 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:17.476619 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 82842.1us
I20260709 13:07:17.406360 26989 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:17.478716 26930 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:17.464898 27009 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.407162 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:17.479825 21979 pending_rounds.cc:85] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 11
I20260709 13:07:17.406255 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:17.479962 22546 raft_consensus.cc:2410] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:07:17.476862 26962 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.407846 26840 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:17.480682 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 74539.4us
I20260709 13:07:17.480921 27009 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:17.410063 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.409788 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:17.411222 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.482437 21981 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:17.482682 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.483357 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.483781 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.484454 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:17.484820 21904 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:17.411942 26958 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:17.412468 21976 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:17.480803 26989 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:17.413759 26998 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:17.486299 22552 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:17.414119 21980 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:17.488984 21979 pending_rounds.cc:107] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:07:17.489293 21979 raft_consensus.cc:2889] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.492080 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:17.410481 27040 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.354s	user 0.004s	sys 0.000s
I20260709 13:07:17.459262 21983 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:07:17.493343 21983 pending_rounds.cc:85] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 7
I20260709 13:07:17.493662 21983 pending_rounds.cc:107] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:07:17.493942 21983 raft_consensus.cc:2889] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.462075 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.464260 21825 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:17.494771 21831 raft_consensus.cc:2376] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15. Re-sending same reply.
I20260709 13:07:17.462761 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:17.465787 21833 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:17.473536 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.401448 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.474097 21901 rpcz_store.cc:276] 0709 13:07:16.134926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.226061 (+ 91135us) service_pool.cc:224] Handling call
0709 13:07:16.226461 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.363159 (+136698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.363194 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.370370 (+  7176us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.484866 (+114496us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:16.537283 (+ 52417us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.771865 (+234582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.771931 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.363151 (+591220us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b24001cd768. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf3009d 00007fb75eb6210e 00007fb75eb7988c 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221
0709 13:07:17.402083 (+ 38932us) raft_consensus.cc:1685] finished
0709 13:07:17.402208 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.402338 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234306,"prepare.queue_time_us":54903,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5286,"raft.queue_time_us":234496,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":15761792,"thread_start_us":63863,"threads_started":1,"wal-append.queue_time_us":210182}
I20260709 13:07:17.413605 21978 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:17.496592 21834 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
W20260709 13:07:17.455318 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.376005 27028 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:17.487068 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.501461 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.498996 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.466538 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.504432 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.506034 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.506148 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.508665 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.509418 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.502926 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:17.503701 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.503712 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.509657 21830 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:17.507169 21905 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:17.516389 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:17.516575 21976 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:17.515201 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.519039 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:17.500305 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:17.519795 22546 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:17.521085 21905 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:17.521922 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.523119 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.524070 21827 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:17.518805 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:17.526304 21974 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:17.528640 21977 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:17.502698 27076 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:17.540037 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.501770 27028 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.540676 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:17.546820 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.549551 27028 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.549826 26930 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:17.525821 26989 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:17.552592 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.560523 21831 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 17 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 5.
I20260709 13:07:17.553777 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:17.562510 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:17.564029 21827 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:17.565274 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:17.566076 21827 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:17.567235 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:17.555675 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:17.525800 26993 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:17.534673 27009 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:17.573916 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:17.542546 27063 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:17.593379 21874 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:17.549220 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:17.546259 27076 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.595685 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:17.596037 27076 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:17.575556 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:17.544934 26859 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:17.571465 26858 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:17.599970 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.578029 21827 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:17.578994 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:17.549867 27073 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.572962 26803 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:17.550298 27041 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:07:17.550570 26930 consensus_queue.cc:1243] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:17.568572 27078 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.636502 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.617242 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:17.636950 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 58071.2us
I20260709 13:07:17.637499 21908 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:17.608145 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.609956 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.556257 27019 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:07:17.592932 27063 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.558424 27030 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:07:17.556519 26963 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:07:17.590281 26955 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:17.616936 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.589411 26989 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:17.599936 26993 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:17.596903 27099 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:17.568192 26986 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:07:17.642995 21948 leader_election.cc:400] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16.
I20260709 13:07:17.642930 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:17.595701 27014 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:17.648032 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:17.651625 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:17.635802 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:17.667407 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.677515 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:17.614064 27060 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:17.698876 21948 leader_election.cc:403] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:07:17.699993 21907 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:17.702791 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 80952.7us
I20260709 13:07:17.708669 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:17.713251 21828 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:07:17.647352 27009 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:17.612588 26859 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.655269 27063 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:17.719511 21904 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:17.741217 21904 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:17.705242 21974 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:17.714025 21832 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:07:17.726856 27060 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:17.727092 21908 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:17.727407 21827 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:17.647771 27078 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:17.736224 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 140221us
I20260709 13:07:17.742635 21832 pending_rounds.cc:85] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 10
I20260709 13:07:17.696481 26955 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:17.697572 27014 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:17.716482 27061 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:17.712217 26961 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:17.721552 27030 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:17.635514 27073 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.675438 26778 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:17.719264 27009 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:17.741021 26836 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:17.810051 21832 pending_rounds.cc:107] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:07:17.729164 26953 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:17.707732 27052 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:07:17.808936 26851 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.833261 21977 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:17.834841 21832 raft_consensus.cc:2889] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.827593 27014 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:17.837535 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 261622us
W20260709 13:07:17.879114 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 69050.2us
W20260709 13:07:17.879575 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.876101 21907 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 10.
I20260709 13:07:17.834193 27009 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:17.828920 27080 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.183s
I20260709 13:07:17.845219 27071 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:17.921147 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:17.921602 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:17.868373 26988 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:17.831295 26961 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:17.932148 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.878677 27052 consensus_queue.cc:1243] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:17.874055 27058 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16.
W20260709 13:07:17.951968 27112 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:17.953378 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:17.953938 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2389) took 1058 ms. Trace:
I20260709 13:07:17.954481 21900 rpcz_store.cc:276] 0709 13:07:16.895336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.267295 (+371959us) service_pool.cc:224] Handling call
0709 13:07:17.267673 (+   378us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:17.276698 (+  9025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.276737 (+    39us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:17.309273 (+ 32536us) log.cc:844] Serialized 78 byte log entry
0709 13:07:17.553096 (+243823us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:17.553134 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.553198 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.953629 (+400431us) raft_consensus.cc:1685] finished
0709 13:07:17.953659 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.953861 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9514,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":1812,"thread_start_us":213241,"threads_started":1,"wal-append.queue_time_us":382169}
I20260709 13:07:17.960769 26955 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.966949 27128 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.967731 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52670.1us
I20260709 13:07:17.967677 27128 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.949862 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:17.835750 27030 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.981803 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:17.925551 27120 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
I20260709 13:07:17.890057 26858 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:17.988430 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:17.989212 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 353472us
I20260709 13:07:17.830570 26993 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.845501 26953 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.877038 26851 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:17.945304 27099 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:17.990741 27116 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.283s	user 0.000s	sys 0.004s
I20260709 13:07:17.981122 26930 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:17.985041 27118 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.068s	user 0.003s	sys 0.001s
I20260709 13:07:17.915532 27072 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:07:17.999079 27066 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:17.987059 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 244565us
I20260709 13:07:17.833997 26989 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:17.973308 26988 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:18.039852 27114 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:07:17.997184 27026 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:18.050509 27099 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.054356 26851 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.058456 26778 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:18.059320 27128 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:18.060313 26859 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.019510 27005 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:07:18.066390 26840 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:18.010670 26975 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:07:17.918797 27060 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.090835 27066 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:18.095217 27026 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.178591 27023 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.311465 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 323089us
W20260709 13:07:18.308061 21797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.018s	sys 0.042s
W20260709 13:07:18.318519 21797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.018s	sys 0.042s
I20260709 13:07:18.331739 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.345139 22550 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:18.221841 27026 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.344470 26930 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:07:18.426294 26988 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.306720 26953 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.415222 27066 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:18.432076 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 71491us
I20260709 13:07:18.430198 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:18.494655 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2395) took 1229 ms. Trace:
W20260709 13:07:18.496462 21905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.028s	sys 0.028s
W20260709 13:07:18.496794 21905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.028s	sys 0.028s
I20260709 13:07:18.495216 21982 rpcz_store.cc:276] 0709 13:07:17.265595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.265718 (+   123us) service_pool.cc:224] Handling call
0709 13:07:17.282893 (+ 17175us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.304155 (+ 21262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.304185 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.304709 (+   524us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.522232 (+217523us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.522272 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.522406 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.494379 (+971973us) raft_consensus.cc:1685] finished
0709 13:07:18.494407 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.494580 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1821,"raft.queue_time_us":22298,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3912,"thread_start_us":217119,"threads_started":1,"wal-append.queue_time_us":363152}
W20260709 13:07:18.503324 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 415370us
I20260709 13:07:18.428092 27078 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:18.481352 26851 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.346964 27073 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:18.555361 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.346314 26858 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.504272 26953 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:18.498641 26692 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:07:18.606866 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:18.608314 27093 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.019s	user 0.000s	sys 0.008s
I20260709 13:07:18.610730 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2324) took 1064 ms. Trace:
I20260709 13:07:18.615377 21830 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:18.615397 21977 rpcz_store.cc:276] 0709 13:07:17.546054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.548967 (+  2913us) service_pool.cc:224] Handling call
0709 13:07:18.610523 (+1061556us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540001ead4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:18.610644 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549831424}
W20260709 13:07:18.597632 26955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.031s	sys 0.045s
I20260709 13:07:18.347630 27023 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:18.626196 27076 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.030s	user 0.008s	sys 0.002s
W20260709 13:07:18.626879 27131 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.575s	user 0.002s	sys 0.000s
I20260709 13:07:18.626744 27076 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.582949 27078 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:18.628005 27078 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.628535 26692 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:18.628928 26692 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:18.629550 27076 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:18.629992 27078 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:18.587407 27030 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:18.624125 27063 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.002s
I20260709 13:07:18.621353 27144 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.631894 27063 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.579733 26993 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.629695 26692 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.636749 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2472) took 1285 ms. Trace:
I20260709 13:07:18.624089 26930 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:18.604044 26954 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.637885 21833 rpcz_store.cc:276] 0709 13:07:17.350965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.919674 (+568709us) service_pool.cc:224] Handling call
0709 13:07:17.981484 (+ 61810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.999915 (+ 18431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.999960 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.000014 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:18.000064 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.636459 (+636395us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b540017f2d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:18.636524 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.636678 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41738624}
W20260709 13:07:18.634462 26955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.031s	sys 0.046s
I20260709 13:07:18.589437 26851 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.601871 26953 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.662592 26692 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:18.667145 27148 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.683427 27099 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:18.691743 26986 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:18.655978 26954 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.703418 27099 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:18.631270 27144 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.696523 27148 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.704823 27063 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.708904 26851 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:18.698812 27028 consensus_meta.cc:287] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.149s	user 0.012s	sys 0.000s
I20260709 13:07:18.642551 26993 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.655355 26930 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:18.720899 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 216567us
I20260709 13:07:18.721680 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:18.722877 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:18.724262 27135 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:18.725919 26953 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.726241 26954 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:18.724910 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:18.727582 27135 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:18.728976 27023 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.729496 27023 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.724649 26868 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:18.729910 27023 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.731525 27148 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:18.732656 27122 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.683s	user 0.008s	sys 0.001s
I20260709 13:07:18.733749 27023 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:18.713851 27099 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.734344 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2314) took 1258 ms. Trace:
I20260709 13:07:18.734716 21978 rpcz_store.cc:276] 0709 13:07:17.475809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.497347 (+ 21538us) service_pool.cc:224] Handling call
0709 13:07:17.497614 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.502839 (+  5225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.502867 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.515627 (+ 12760us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.835985 (+320358us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.836026 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.836095 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.732134 (+896039us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:18.734038 (+  1904us) raft_consensus.cc:1685] finished
0709 13:07:18.734058 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.734278 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":1911,"spinlock_wait_cycles":43668736,"thread_start_us":267006,"threads_started":1,"wal-append.queue_time_us":458530}
I20260709 13:07:18.736413 27099 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.736830 27135 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:18.737234 27132 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:07:18.731431 27130 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.422s	user 0.000s	sys 0.008s
I20260709 13:07:18.738698 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:18.744481 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:18.746691 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2403) took 1675 ms. Trace:
I20260709 13:07:18.747229 21902 rpcz_store.cc:276] 0709 13:07:17.071485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.326938 (+255453us) service_pool.cc:224] Handling call
0709 13:07:17.327268 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.343454 (+ 16186us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:17.343475 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.359745 (+ 16270us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.900661 (+540916us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.900700 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.900771 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.736691 (+835920us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:18.738564 (+  1873us) raft_consensus.cc:1685] finished
0709 13:07:18.738582 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.746624 (+  8042us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24595,"raft.queue_time_us":16283,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5110,"spinlock_wait_cycles":8396672,"thread_start_us":425074,"threads_started":1,"wal-append.queue_time_us":956222}
I20260709 13:07:18.745916 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:18.733940 27144 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.724505 26851 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:18.760579 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:18.719677 27028 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.746716 27135 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:18.747025 26868 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:18.763527 26851 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.767347 27155 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:18.763594 26993 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.768781 26851 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:18.770133 27014 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.864s	user 0.009s	sys 0.003s
I20260709 13:07:18.770582 27014 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.772701 27014 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:18.773334 21909 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:18.774529 26851 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:18.775076 26851 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.777321 27014 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:18.777844 27014 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.780761 27155 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:18.781212 27155 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.781555 27155 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:18.782850 27151 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:18.786554 26868 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:18.789044 26851 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.789600 26868 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:18.790424 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:18.791054 26930 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:18.791288 27014 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.792737 26851 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:18.802577 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:18.804056 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:18.805351 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.807976 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:18.779167 27149 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:18.809286 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.811167 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2392) took 1214 ms. Trace:
I20260709 13:07:18.814116 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.814791 21976 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:18.815557 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.816316 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.817929 21902 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:18.818990 21828 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:18.816748 21976 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:18.826596 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.826864 21982 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:18.827212 21975 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:18.827939 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.830500 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.831758 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 755) took 1300 ms. Trace:
I20260709 13:07:18.832113 22546 rpcz_store.cc:276] 0709 13:07:17.531664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.531847 (+   183us) service_pool.cc:224] Handling call
0709 13:07:17.551227 (+ 19380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.568430 (+ 17203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.568479 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.595285 (+ 26806us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.869830 (+274545us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.869874 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.869941 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.730900 (+860959us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:18.831434 (+100534us) raft_consensus.cc:1685] finished
0709 13:07:18.831453 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.831683 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4203,"raft.queue_time_us":17114,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11665,"spinlock_wait_cycles":26505600,"thread_start_us":222044,"threads_started":1,"wal-append.queue_time_us":477620}
W20260709 13:07:18.833734 27009 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.907s	user 0.011s	sys 0.000s
I20260709 13:07:18.834136 27009 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.835666 27155 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.813714 21905 rpcz_store.cc:276] 0709 13:07:17.597001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.598265 (+  1264us) service_pool.cc:224] Handling call
0709 13:07:17.598606 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.903360 (+304754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.903671 (+   311us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.904485 (+   814us) log.cc:844] Serialized 52 byte log entry
0709 13:07:18.497131 (+592646us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.690751 (+193620us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.690990 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.691088 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.810972 (+119884us) raft_consensus.cc:1685] finished
0709 13:07:18.810991 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.811116 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7214,"prepare.queue_time_us":194647,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":39400,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":29959,"thread_start_us":930221,"threads_started":3,"wal-append.queue_time_us":690857}
I20260709 13:07:18.806941 26868 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:18.838964 26868 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:18.843369 21976 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:18.913739 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:18.922855 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:18.916154 27026 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.924396 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.925166 21979 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:18.926952 21903 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:18.925056 27154 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:18.925993 27026 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.842797 27155 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:18.909494 27160 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:18.839823 26868 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.943771 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.877799 27135 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.812878 26851 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.947715 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:18.913427 27144 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:18.916502 26954 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:18.959597 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:18.955869 27123 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.909s	user 0.017s	sys 0.025s
W20260709 13:07:18.969424 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.947750 27160 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.971761 27160 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:18.950436 27135 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:18.956859 26844 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:18.974813 26844 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.974875 27135 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:18.975265 26844 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:18.957335 27009 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.981818 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:18.966779 27026 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:18.988783 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:18.960243 27078 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:18.989529 21982 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:18.978691 27163 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:18.986449 26840 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:18.995605 26840 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:18.996038 26840 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:18.986599 27028 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:18.992369 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.992054 26962 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:18.969241 26989 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:07:18.984251 27026 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.001529 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:19.007709 21976 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:19.007718 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.969074 26954 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:18.983937 27160 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:07:18.967247 27144 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.012207 21982 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:19.013254 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2315) took 1537 ms. Trace:
I20260709 13:07:19.000828 27163 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.013648 21981 rpcz_store.cc:276] 0709 13:07:17.476058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.500665 (+ 24607us) service_pool.cc:224] Handling call
0709 13:07:17.529954 (+ 29289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.548823 (+ 18869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.548869 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.549312 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.868324 (+319012us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.868369 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.868446 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.955011 (+1086565us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:19.007284 (+ 52273us) raft_consensus.cc:1685] finished
0709 13:07:19.007309 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.013190 (+  5881us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1571,"raft.queue_time_us":12973,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":14358,"spinlock_wait_cycles":38606720,"thread_start_us":253708,"threads_started":1,"wal-append.queue_time_us":474784}
I20260709 13:07:19.018410 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:19.004438 26851 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.002573 26962 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:19.008720 27026 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:19.029282 26962 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.030539 26962 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:19.032063 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 636) took 1048 ms. Trace:
I20260709 13:07:19.032425 21900 rpcz_store.cc:276] 0709 13:07:17.983705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.983946 (+   241us) service_pool.cc:224] Handling call
0709 13:07:17.984392 (+   446us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:18.203027 (+218635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.203063 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:18.205093 (+  2030us) log.cc:844] Serialized 78 byte log entry
0709 13:07:18.617246 (+412153us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:18.758987 (+141741us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.759514 (+   527us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.759727 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.030990 (+271263us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b1800346960. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419
0709 13:07:19.031775 (+   785us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54000fad54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:19.031821 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.031862 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:19.031873 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.032013 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1278,"prepare.queue_time_us":87388,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":2411,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":12350,"spinlock_wait_cycles":515406208,"thread_start_us":419895,"threads_started":2,"wal-append.queue_time_us":379748}
I20260709 13:07:19.036021 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:19.036479 21900 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:19.018209 27163 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:19.044557 27082 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:19.045284 27082 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.047853 27082 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.049736 21826 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:19.050612 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2316) took 1655 ms. Trace:
I20260709 13:07:19.050994 21826 rpcz_store.cc:276] 0709 13:07:17.395280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.049116 (+1653836us) service_pool.cc:224] Handling call
0709 13:07:19.049515 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.050262 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.050517 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.053572 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.054400 21901 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:19.055825 27144 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:19.063608 26954 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:19.064322 26954 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:19.066401 27137 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.646s	user 0.007s	sys 0.000s
I20260709 13:07:19.069788 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 752) took 1596 ms. Trace:
I20260709 13:07:19.070258 22549 rpcz_store.cc:276] 0709 13:07:17.473866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.505021 (+ 31155us) service_pool.cc:224] Handling call
0709 13:07:17.531719 (+ 26698us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.547916 (+ 16197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.547964 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.548527 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 13:07:18.004915 (+456388us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:18.004973 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.005067 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.065632 (+1060565us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:19.069425 (+  3793us) raft_consensus.cc:1685] finished
0709 13:07:19.069455 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.069717 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34502,"raft.queue_time_us":9527,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":8238,"spinlock_wait_cycles":21537664,"thread_start_us":405884,"threads_started":1,"wal-append.queue_time_us":629357}
I20260709 13:07:19.064913 26954 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.075519 26961 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:19.077665 27136 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.655s	user 0.000s	sys 0.006s
I20260709 13:07:19.082909 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 638) took 1093 ms. Trace:
I20260709 13:07:19.084867 26954 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:19.083402 21907 rpcz_store.cc:276] 0709 13:07:17.989252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.989902 (+   650us) service_pool.cc:224] Handling call
0709 13:07:17.990451 (+   549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.098052 (+107601us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:18.581435 (+483383us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.762127 (+180692us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.762415 (+   288us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:18.762461 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.082628 (+320167us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400078354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:19.082683 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.082840 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":564579,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":10037,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":246861056,"thread_start_us":548593,"threads_started":3,"wal-append.queue_time_us":180764}
I20260709 13:07:19.086606 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2400) took 1486 ms. Trace:
I20260709 13:07:19.088004 27160 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:19.088521 27160 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.091218 27160 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.026602 27066 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:19.087076 21906 rpcz_store.cc:276] 0709 13:07:17.600502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.652909 (+ 52407us) service_pool.cc:224] Handling call
0709 13:07:17.653250 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.654244 (+   994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.654286 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.673623 (+ 19337us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.066092 (+392469us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:18.066132 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.066238 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.076981 (+1010743us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:19.086239 (+  9258us) raft_consensus.cc:1685] finished
0709 13:07:19.086267 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.086538 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":513,"raft.queue_time_us":15232,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":21521,"spinlock_wait_cycles":138806016,"thread_start_us":262201,"threads_started":1,"wal-append.queue_time_us":705302}
I20260709 13:07:19.138060 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 647) took 1931 ms. Trace:
I20260709 13:07:19.098094 27026 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.139000 27082 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.139787 27082 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.142346 27082 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.138473 21829 rpcz_store.cc:276] 0709 13:07:17.206245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.701519 (+495274us) service_pool.cc:224] Handling call
0709 13:07:17.727014 (+ 25495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.867646 (+140632us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:17.900276 (+ 32630us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.095209 (+1194933us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b1800050440. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb762eb258f 00007fb75bef1571 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd
0709 13:07:19.112372 (+ 17163us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.112797 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.112963 (+   166us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:19.113002 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.113071 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.137745 (+ 24674us) raft_consensus.cc:1685] finished
0709 13:07:19.137861 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.137982 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":950244,"prepare.queue_time_us":32329,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":937647,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":9633,"spinlock_wait_cycles":6291328,"thread_start_us":405477,"threads_started":1,"wal-append.queue_time_us":718561}
I20260709 13:07:19.143023 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:19.144693 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2490) took 1742 ms. Trace:
I20260709 13:07:19.145247 21829 rpcz_store.cc:276] 0709 13:07:17.401570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.143581 (+1742011us) service_pool.cc:224] Handling call
0709 13:07:19.143855 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.144012 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.144038 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.144076 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:19.144112 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.144165 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.144255 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.146831 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:19.147413 27069 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:19.148041 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:19.147914 27069 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.149068 27129 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.149546 27129 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.151635 27129 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:19.151861 27135 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:19.152590 27135 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.153648 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.154771 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.154863 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:19.155622 27155 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:19.155827 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.156133 27155 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.157322 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:19.158941 21979 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:19.160118 21979 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:19.160907 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:19.163403 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.104301 21827 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:19.161876 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.164852 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2483) took 1765 ms. Trace:
W20260709 13:07:19.143153 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 1.17451e+06us
I20260709 13:07:19.157944 21975 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:19.165899 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:19.157975 21983 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:19.155891 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.149896 27069 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:19.152113 27129 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.168174 21978 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:19.169129 21982 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:07:19.100541 27168 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:07:19.169154 21976 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:19.112947 27030 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.195883 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:19.196187 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.198035 21906 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:07:19.165330 21827 rpcz_store.cc:276] 0709 13:07:17.399515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.103594 (+1704079us) service_pool.cc:224] Handling call
0709 13:07:19.104000 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.164604 (+ 60604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.164804 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.199683 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.201189 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:19.105782 27121 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.123s	user 0.001s	sys 0.010s
I20260709 13:07:19.041514 26930 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:19.158015 27155 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:19.112689 27126 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.112887 27012 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.203572 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.215955 21979 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:19.220947 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:19.221653 21827 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:19.204759 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.210973 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.215322 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:19.193989 21905 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:19.224619 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.189333 27072 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:07:19.228652 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53803.8us
I20260709 13:07:19.228818 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.236452 21906 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 11.
I20260709 13:07:19.099987 26844 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.230542 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:19.110862 26975 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:07:19.232821 21900 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:19.195273 27066 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:19.208387 26764 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.214082 26803 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.265162 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.226544 27069 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:19.234194 27063 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:19.225627 27125 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.264863 21827 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:19.197278 27129 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.263473 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:19.258111 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.290232 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.274330 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2470) took 1924 ms. Trace:
I20260709 13:07:19.238680 27155 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:19.233803 26643 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.284647 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.285238 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.236100 27072 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.215569 27030 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.354766 21908 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:07:19.356230 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.356981 21906 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:19.292196 21828 rpcz_store.cc:276] 0709 13:07:17.350377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.714157 (+363780us) service_pool.cc:224] Handling call
0709 13:07:17.714467 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.819614 (+1105147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.274045 (+454431us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540040cc54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:19.274255 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2539678976}
I20260709 13:07:19.297250 21827 raft_consensus.cc:2410] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:19.346696 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.358433 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.252280 26847 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:19.280977 27127 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.239s	user 0.007s	sys 0.015s
I20260709 13:07:19.365947 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:19.367835 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2471) took 2017 ms. Trace:
I20260709 13:07:19.368335 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2316) took 1892 ms. Trace:
I20260709 13:07:19.376016 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:18.304708 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:19.376608 21975 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:19.226449 26930 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.382498 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.375936 21980 rpcz_store.cc:276] 0709 13:07:17.476334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.510694 (+ 34360us) service_pool.cc:224] Handling call
0709 13:07:17.510989 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.511452 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.511499 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.522791 (+ 11292us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.712083 (+189292us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:17.712120 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.712197 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.104961 (+1392764us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:19.297835 (+192874us) raft_consensus.cc:1685] finished
0709 13:07:19.297859 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.368276 (+ 70417us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9193,"raft.queue_time_us":4505,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":16652,"spinlock_wait_cycles":30441344,"thread_start_us":152646,"threads_started":1,"wal-append.queue_time_us":303270}
I20260709 13:07:19.377285 21832 rpcz_store.cc:276] 0709 13:07:17.350704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.911384 (+560680us) service_pool.cc:224] Handling call
0709 13:07:17.911775 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.032012 (+120237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.032044 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.032094 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:18.032144 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.367598 (+1335454us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001d83d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:19.367653 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.367777 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275937024}
I20260709 13:07:19.389050 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.271780 27063 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:19.238574 27012 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.390671 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:19.391811 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.395059 21906 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:19.263279 26877 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:07:19.267174 26961 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:07:19.396347 26998 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:19.407673 26998 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.409785 26998 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.411679 26930 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.400188 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:19.419170 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.400426 21829 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:19.401885 27147 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:19.420539 27147 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.402671 27133 raft_consensus.cc:2764] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:07:19.384232 27127 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.008s	sys 0.015s
I20260709 13:07:19.371796 26847 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.422813 26847 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:19.271417 27154 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:07:19.345937 26987 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:19.349176 27072 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:19.427127 21983 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:19.425324 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.271313 27128 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:07:19.271658 26858 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:07:19.271397 27078 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:07:19.256201 27140 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:07:19.283685 26803 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.243582 27126 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.419338 27066 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.372000 26954 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:07:19.431572 26962 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.482484 26962 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.485589 21832 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:19.486788 26803 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.452080 21827 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:19.447456 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:19.414000 27030 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:19.393384 27148 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:19.454945 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.491932 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.492652 21906 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:19.493582 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.273651 26764 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.349045 26643 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.405800 26840 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.498548 26840 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.498610 26643 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:19.461586 27171 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:19.468500 26858 consensus_queue.cc:1243] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:19.468911 26961 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:19.469790 27073 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.499478 21908 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:19.499727 27073 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.496850 26764 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.430200 27135 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:19.431950 26861 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.502250 21828 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:19.344772 27125 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.393790 27163 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.449960 26987 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:19.490883 27148 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:19.503032 26851 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.567009 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 375313us
W20260709 13:07:19.568953 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 304529us
W20260709 13:07:19.564348 21901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.024s	sys 0.034s
I20260709 13:07:19.504537 26962 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:19.566061 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 118685us
I20260709 13:07:19.573658 21875 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:19.513517 27144 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.565452 27139 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.143s	user 0.005s	sys 0.004s
I20260709 13:07:19.571780 21900 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:19.572919 21901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.024s	sys 0.034s
I20260709 13:07:19.499503 26961 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:19.518781 27147 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:19.576169 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:19.576750 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:19.553766 26930 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:19.584707 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 292793us
I20260709 13:07:19.568814 27014 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:19.563637 27041 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:07:19.575742 27026 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.554018 26861 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.610656 26989 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:19.603614 27174 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:19.572033 26851 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.626590 27009 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:19.649195 21979 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:19.652134 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 646) took 2446 ms. Trace:
I20260709 13:07:19.579363 27144 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:19.655258 21826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.000s
I20260709 13:07:19.652592 21834 rpcz_store.cc:276] 0709 13:07:17.205970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.590939 (+384969us) service_pool.cc:224] Handling call
0709 13:07:17.612091 (+ 21152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.867424 (+255333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.867459 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.870929 (+  3470us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.087601 (+216672us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:19.242925 (+1155324us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.253074 (+ 10149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.253174 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.267329 (+ 14155us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:19.651795 (+384466us) raft_consensus.cc:1685] finished
0709 13:07:19.651907 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.652066 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1157899,"prepare.queue_time_us":1183874,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":19115,"raft.queue_time_us":45412,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":28437,"spinlock_wait_cycles":148089984,"thread_start_us":372713,"threads_started":2,"wal-append.queue_time_us":510637}
I20260709 13:07:19.639575 26844 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.644148 27073 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.627866 26930 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.633921 27014 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:19.670225 21825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.008s
I20260709 13:07:19.671139 21906 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:19.669428 21798 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:19.674052 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:19.656816 21826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.009s	sys 0.001s
W20260709 13:07:19.670800 21825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.000s	sys 0.008s
W20260709 13:07:19.514997 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 342879us
I20260709 13:07:19.651371 27071 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:19.726491 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.649071 26989 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.728063 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:19.729137 22521 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.591s (SENT) [suppressed 14 similar messages]
I20260709 13:07:19.729511 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:19.636384 27148 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.737805 21980 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:07:19.743458 21980 pending_rounds.cc:85] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 9
I20260709 13:07:19.673553 26764 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:19.743758 21980 pending_rounds.cc:107] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:07:19.744263 21980 raft_consensus.cc:2889] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.740916 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:19.747346 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:19.843465 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 102666us
I20260709 13:07:19.650520 26961 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.725942 26877 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:19.847324 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:19.847533 21905 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:19.717007 27140 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:19.756130 27027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.043s	sys 0.067s
I20260709 13:07:19.853168 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.853657 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:19.722015 27009 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.858287 21906 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:19.859548 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:19.741782 26643 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.749264 27139 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:07:19.856065 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 126654us
I20260709 13:07:19.849879 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:19.720125 27073 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.742112 26858 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:19.651530 26987 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.873127 21980 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:19.870692 21975 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:19.843334 27026 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.880456 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:19.731920 27071 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:19.751442 26764 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:19.887992 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.855376 26975 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:19.865315 27124 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:19.873818 27148 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:19.878719 27066 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:19.899315 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 293026us
W20260709 13:07:19.895030 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 165917us
I20260709 13:07:19.909194 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:19.882402 27163 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.919763 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:19.880820 27126 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:19.891008 27069 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:19.921797 21906 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:07:19.921603 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.922752 21980 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
W20260709 13:07:19.933619 21947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.008s	sys 0.016s
W20260709 13:07:19.900772 27170 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:07:19.946404 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:19.944236 26877 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:19.954574 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:19.900331 26764 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.956909 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:19.944917 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:19.958511 22551 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:19.951422 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:19.954614 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.879618 27009 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.960566 21834 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:19.886462 26643 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.910256 27066 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:19.877012 27140 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.950999 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:19.943476 21947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.009s	sys 0.016s
I20260709 13:07:19.898041 26863 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:19.930956 26975 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:19.893570 27073 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.920594 27192 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.900470 27026 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:19.968760 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:19.972952 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2477) took 2620 ms. Trace:
I20260709 13:07:19.939337 27069 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:19.895545 26858 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:19.980751 21830 rpcz_store.cc:276] 0709 13:07:17.356426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.622220 (+1265794us) service_pool.cc:224] Handling call
0709 13:07:18.630540 (+  8320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.630781 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:19.658642 (+1027861us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.972578 (+313936us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.972650 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:19.972701 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.972773 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.972896 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":621496,"prepare.queue_time_us":739201,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"thread_start_us":696854,"threads_started":2}
W20260709 13:07:19.976812 27172 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:07:19.970348 27066 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:19.979676 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:19.982836 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 111710us
I20260709 13:07:19.961973 27144 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:19.969405 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:19.988579 22554 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:07:19.976074 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:19.965134 27200 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:19.983578 27176 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:07:20.001961 21834 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:20.015919 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:20.017055 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.017261 26643 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.017616 21834 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:20.002290 22554 pending_rounds.cc:85] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 13
I20260709 13:07:20.018340 22554 pending_rounds.cc:107] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 18.14
W20260709 13:07:20.018452 27182 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:20.018618 22554 raft_consensus.cc:2889] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:20.019419 27173 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:07:20.019950 27014 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:20.020349 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44353.9us
I20260709 13:07:20.021159 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.021484 27200 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:20.022935 27195 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:19.976691 27126 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.023432 27211 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.023804 27200 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.023488 27126 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.024323 27211 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:20.024030 26975 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.024410 27200 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:20.025538 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:19.986366 27069 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:20.000433 27177 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:07:20.022825 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.033212 27129 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.033468 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.034317 27128 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:20.034683 27128 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:20.034706 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.035084 26858 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.035892 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.035619 27128 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:20.036733 27128 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.036911 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:20.037360 26847 consensus_meta.cc:287] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.614s	user 0.004s	sys 0.005s
I20260709 13:07:20.004669 27125 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:19.988739 27197 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:20.025611 27126 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:20.038383 27180 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:07:20.038981 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2482) took 2639 ms. Trace:
I20260709 13:07:20.040247 26989 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:19.983764 27192 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.041101 27212 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:20.041577 27212 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:20.041921 27212 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:20.014063 26930 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.039785 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.033232 21975 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:20.044668 21975 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:20.045433 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:20.042290 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.001329 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 645) took 2788 ms. Trace:
W20260709 13:07:20.033365 27072 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.001s
I20260709 13:07:20.039343 21826 rpcz_store.cc:276] 0709 13:07:17.399230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.051757 (+1652527us) service_pool.cc:224] Handling call
0709 13:07:19.052052 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.141909 (+ 89857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.141939 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.142622 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.719263 (+576641us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.719317 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.719404 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.038785 (+319381us) raft_consensus.cc:1685] finished
0709 13:07:20.038805 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.038924 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89428,"raft.queue_time_us":89790,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":576245,"threads_started":1,"wal-append.queue_time_us":733431}
I20260709 13:07:19.990628 26859 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.064635 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.071482 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:20.076293 27137 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:20.077457 27073 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.063104 21975 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.082242 26930 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:20.082367 27192 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.082743 26930 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:20.082875 21975 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:20.083195 26930 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:19.981868 26877 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.063627 26847 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.087446 21980 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:20.059595 21831 rpcz_store.cc:276] 0709 13:07:17.205744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.584095 (+378351us) service_pool.cc:224] Handling call
0709 13:07:17.584525 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.599997 (+ 15472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.600026 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.600422 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.949592 (+349170us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:18.626328 (+676736us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:19.720798 (+1094470us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.977740 (+256942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.977814 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.977856 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:19.994353 (+ 16497us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.994539 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1230129,"prepare.queue_time_us":1293269,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":112039,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":23162,"spinlock_wait_cycles":54982912,"thread_start_us":1059892,"threads_started":4,"wal-append.queue_time_us":712336,"wal-append.run_cpu_time_us":2801,"wal-append.run_wall_time_us":1576545}
I20260709 13:07:20.088337 26847 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:20.088421 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.089051 21831 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:20.090034 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.090605 21831 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:20.091346 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.094935 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2415) took 1285 ms. Trace:
I20260709 13:07:20.095513 22551 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:20.095803 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2404) took 2494 ms. Trace:
I20260709 13:07:20.096138 21909 rpcz_store.cc:276] 0709 13:07:17.601707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.707861 (+106154us) service_pool.cc:224] Handling call
0709 13:07:17.716865 (+  9004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.773755 (+1056890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.095609 (+1321854us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400308254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:20.095753 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429166848}
I20260709 13:07:20.100593 27012 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.101617 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.095329 21904 rpcz_store.cc:276] 0709 13:07:18.809014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.114239 (+305225us) service_pool.cc:224] Handling call
0709 13:07:19.114573 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.114986 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.115025 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.115530 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.555802 (+440272us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:19.555859 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.555947 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.094721 (+538774us) raft_consensus.cc:1685] finished
0709 13:07:20.094741 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.094876 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1129,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":6926,"thread_start_us":335796,"threads_started":1,"wal-append.queue_time_us":466659}
W20260709 13:07:20.117365 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52792.9us
I20260709 13:07:20.127471 21831 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:20.101532 27066 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.141170 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:20.143240 21831 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:20.140316 27012 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:20.151897 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.154621 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.155592 21834 raft_consensus.cc:2410] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:20.102453 27129 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:20.158200 21975 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:20.158833 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.161720 21826 raft_consensus.cc:2410] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:20.169163 21831 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:20.170671 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 2502) took 1022 ms. Trace:
I20260709 13:07:20.171092 21826 rpcz_store.cc:276] 0709 13:07:19.148436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.073006 (+924570us) service_pool.cc:224] Handling call
0709 13:07:20.170618 (+ 97612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.184568 21834 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:20.063236 26989 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:07:20.150893 27156 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.188824 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2492) took 2690 ms. Trace:
I20260709 13:07:20.191354 21834 rpcz_store.cc:276] 0709 13:07:17.498215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.177846 (+2679631us) service_pool.cc:224] Handling call
0709 13:07:20.184110 (+  6264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.188563 (+  4453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.188767 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:20.186112 26988 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:07:20.070752 27072 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.150677 27012 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.204828 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2412) took 1400 ms. Trace:
I20260709 13:07:20.212975 21902 rpcz_store.cc:276] 0709 13:07:18.804700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.890630 (+ 85930us) service_pool.cc:224] Handling call
0709 13:07:18.932698 (+ 42068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.932954 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:18.941684 (+  8730us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.099382 (+1157698us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b180043e400. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:07:20.204404 (+105022us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.204456 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:20.204505 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.204579 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.204767 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5296,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":31,"raft.queue_time_us":78,"spinlock_wait_cycles":4418944,"thread_start_us":104425,"threads_started":1}
I20260709 13:07:20.158744 27126 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.191219 27041 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:20.179270 26859 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:20.191277 26877 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:20.194308 27214 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:20.232491 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.233192 21975 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:20.233022 21831 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:20.227017 21981 raft_consensus.cc:1217] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Deduplicated request from leader. Original: 14.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:07:20.233995 21981 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:20.235018 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.236214 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.237226 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:20.237367 27209 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:07:20.239382 27175 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.512s	user 0.002s	sys 0.000s
I20260709 13:07:20.241864 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2478) took 2880 ms. Trace:
I20260709 13:07:20.246657 21833 rpcz_store.cc:276] 0709 13:07:17.361746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.660452 (+1298706us) service_pool.cc:224] Handling call
0709 13:07:18.669574 (+  9122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.113541 (+443967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.113595 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.114109 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.515628 (+401519us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:19.515675 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.515755 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.238761 (+723006us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:20.241561 (+  2800us) raft_consensus.cc:1685] finished
0709 13:07:20.241582 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.241800 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":432218,"raft.queue_time_us":432638,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"spinlock_wait_cycles":7077632,"thread_start_us":401184,"threads_started":1,"wal-append.queue_time_us":546583}
I20260709 13:07:20.248502 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 790) took 1106 ms. Trace:
I20260709 13:07:20.243510 26764 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.248842 22549 rpcz_store.cc:276] 0709 13:07:19.142376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.162242 (+ 19866us) service_pool.cc:224] Handling call
0709 13:07:19.162539 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.162724 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:19.660125 (+497401us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.248053 (+587928us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b18003b6f80. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:07:20.248200 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.248245 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:20.248294 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.248360 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.248456 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3927,"prepare.queue_time_us":724028,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"spinlock_wait_cycles":3670272,"thread_start_us":688973,"threads_started":2,"wal-append.queue_time_us":335637}
I20260709 13:07:20.244704 26861 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:20.245935 27140 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.246042 21981 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:20.235054 27206 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:07:20.249717 22555 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:20.243613 27071 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.251780 21834 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:07:20.205367 27099 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:20.258337 27126 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.258548 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.259027 26930 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.255396 27214 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.260277 26953 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:20.261879 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.250715 27066 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.250758 26764 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:20.270895 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.269876 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2494) took 2738 ms. Trace:
I20260709 13:07:20.281610 21826 rpcz_store.cc:276] 0709 13:07:17.531832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.180139 (+2648307us) service_pool.cc:224] Handling call
0709 13:07:20.187377 (+  7238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.187595 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:20.193000 (+  5405us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.269553 (+ 76553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.269602 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:20.269651 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.269714 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.269813 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5646,"prepare.run_cpu_time_us":425,"prepare.run_wall_time_us":7219,"raft.queue_time_us":2881,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"thread_start_us":75892,"threads_started":1}
I20260709 13:07:20.194321 27156 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.286615 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.287971 21981 raft_consensus.cc:2410] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:20.227439 27041 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.289410 21982 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:20.289925 21826 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:07:20.301093 21826 pending_rounds.cc:85] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 9
I20260709 13:07:20.292944 27012 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.293568 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.294047 27179 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.251570 26877 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.296195 26930 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.297150 26961 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:20.297351 27212 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.297817 27214 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.321735 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.298564 27026 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.299054 27072 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.299497 21830 raft_consensus.cc:2410] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:20.299782 27069 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.301349 21826 pending_rounds.cc:107] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:07:20.302691 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.326326 21826 raft_consensus.cc:2889] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.306807 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:20.315177 26859 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:20.282534 27099 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.285709 26953 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.319540 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.322347 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.323638 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.327028 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2321) took 2773 ms. Trace:
I20260709 13:07:20.281068 27126 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.335234 21826 rpcz_store.cc:276] 0709 13:07:17.553968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.286015 (+2732047us) service_pool.cc:224] Handling call
0709 13:07:20.288933 (+  2918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.326810 (+ 37877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.326980 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:20.328238 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.336360 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.320128 27071 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:20.337960 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:20.341358 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.360134 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.360908 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.342149 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.343317 27041 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.345005 26877 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.353123 27069 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:20.353484 27072 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.10, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:20.354765 27128 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:20.355214 27212 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.364907 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.329676 27052 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:20.321034 27179 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.377729 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.378014 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.378333 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2414) took 1573 ms. Trace:
I20260709 13:07:20.378577 21902 raft_consensus.cc:2410] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:07:20.378705 21907 rpcz_store.cc:276] 0709 13:07:18.807857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.085673 (+277816us) service_pool.cc:224] Handling call
0709 13:07:19.086104 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:19.135534 (+ 49430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.135580 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:19.136263 (+   683us) log.cc:844] Serialized 52 byte log entry
0709 13:07:19.509815 (+373552us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.377808 (+867993us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.378003 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.378075 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.378114 (+    39us) raft_consensus.cc:1685] finished
0709 13:07:20.378126 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.378284 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":877002,"raft.queue_time_us":5676,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":26908,"thread_start_us":283305,"threads_started":1,"wal-append.queue_time_us":448270}
I20260709 13:07:20.369357 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.365986 27210 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.373416 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.369311 22548 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:20.370973 26986 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:20.381479 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.384228 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.382254 21902 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:20.385123 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.377527 27023 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.386478 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:20.387554 27194 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:07:20.376150 27052 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.388835 27052 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:20.389611 26986 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.380988 26840 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.391182 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 649) took 3176 ms. Trace:
I20260709 13:07:20.366212 27012 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:20.391536 21825 rpcz_store.cc:276] 0709 13:07:17.215166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.715568 (+500402us) service_pool.cc:224] Handling call
0709 13:07:17.715922 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.873917 (+157995us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:19.162144 (+1288227us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b18004a5ba0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf 00007fb75eff8038
0709 13:07:19.162414 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.719749 (+557335us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.742530 (+ 22781us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.742726 (+   196us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:19.743135 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.843301 (+100166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.843382 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.387056 (+543674us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:20.390974 (+  3918us) raft_consensus.cc:1685] finished
0709 13:07:20.390995 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.391119 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":313213,"prepare.queue_time_us":1313731,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":8743,"raft.queue_time_us":310902,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":53468,"spinlock_wait_cycles":35130112,"thread_start_us":556955,"threads_started":1,"wal-append.queue_time_us":1032413}
I20260709 13:07:20.394281 21909 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:20.395427 26859 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:20.395862 26859 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:20.396274 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2336) took 1107 ms. Trace:
I20260709 13:07:20.396740 21827 rpcz_store.cc:276] 0709 13:07:19.312550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.388813 (+ 76263us) service_pool.cc:224] Handling call
0709 13:07:20.396082 (+1007269us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b540011d354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:20.396207 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143355264}
I20260709 13:07:20.399423 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.403849 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.404536 21907 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 10.
I20260709 13:07:20.405956 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2419) took 1410 ms. Trace:
I20260709 13:07:20.415519 27179 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.416592 21907 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:20.410601 21903 rpcz_store.cc:276] 0709 13:07:18.995148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.140809 (+145661us) service_pool.cc:224] Handling call
0709 13:07:19.141095 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.141299 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:19.256139 (+114840us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.374967 (+1118828us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.405371 (+ 30404us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.405546 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.405611 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.405674 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.405770 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.405894 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":852415,"prepare.queue_time_us":1955135,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":7394,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":17881,"spinlock_wait_cycles":6490496,"thread_start_us":389267,"threads_started":1,"wal-append.queue_time_us":676028}
I20260709 13:07:20.376832 27072 consensus_queue.cc:1243] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:20.428411 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.420784 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.422659 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:20.396646 26859 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.431828 26859 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:20.432137 27126 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.433080 26851 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.433320 27156 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.424074 26953 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.409029 27174 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:20.424861 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.426133 26986 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.426338 21904 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 14. Ops: [12.9-12.9]
I20260709 13:07:20.426544 27128 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.427522 27019 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:20.427417 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.430696 21903 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:20.382054 27069 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:20.435205 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.437202 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.471481 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.472774 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.472882 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.440049 22554 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:20.441323 21907 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:20.466858 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.481525 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.483559 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:20.486754 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.486617 27069 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.487591 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:20.488466 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 51425.8us
I20260709 13:07:20.489018 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.493316 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.495218 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2495) took 2938 ms. Trace:
I20260709 13:07:20.495738 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.495654 21826 rpcz_store.cc:276] 0709 13:07:17.556548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.337500 (+2780952us) service_pool.cc:224] Handling call
0709 13:07:20.338501 (+  1001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.338687 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:20.342461 (+  3774us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.494925 (+152464us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.494970 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:20.495014 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.495074 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.495169 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4058,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":152123,"threads_started":1}
I20260709 13:07:20.497428 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.490227 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:20.481029 27216 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:07:20.482941 27071 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.503727 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.494575 27126 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.507364 27133 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:20.508807 27187 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:20.492336 26975 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:20.518159 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.519744 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.522228 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.494841 27072 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.500468 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.482448 27128 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.513797 27028 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:20.531563 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.482779 27019 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.527405 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.547552 27224 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:20.547997 27224 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:20.548441 27224 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:20.523300 27133 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:20.523201 26877 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.552716 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.496963 27188 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:20.563730 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.516845 27226 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:07:20.566565 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 193700us
I20260709 13:07:20.570884 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.570860 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.537917 26975 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:20.587935 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:20.546504 27225 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:20.559887 27200 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:20.567135 27133 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.524012 27071 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.595019 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.609230 21799 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.603453 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.571183 27226 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.600863 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:20.588456 27041 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:20.612043 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:20.610195 21903 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:20.622023 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:20.539000 27072 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.624114 27212 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.620573 26877 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:20.628556 26998 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:20.628919 27183 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.628940 26998 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:20.630545 26998 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.618709 27226 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:20.634531 27223 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.210s	user 0.003s	sys 0.000s
I20260709 13:07:20.631681 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.635722 21826 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:20.637586 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2318) took 3085 ms. Trace:
I20260709 13:07:20.637946 21834 rpcz_store.cc:276] 0709 13:07:17.552503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.194502 (+2641999us) service_pool.cc:224] Handling call
0709 13:07:20.197321 (+  2819us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.271858 (+ 74537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.637342 (+365484us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b5400287dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:20.637533 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124601728}
I20260709 13:07:20.639998 27226 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.641222 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2334) took 1352 ms. Trace:
I20260709 13:07:20.624404 27144 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.641587 21830 rpcz_store.cc:276] 0709 13:07:19.288471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.036715 (+748244us) service_pool.cc:224] Handling call
0709 13:07:20.641056 (+604341us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54002882d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:20.641170 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601943936}
I20260709 13:07:20.643453 27226 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:20.643939 27198 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.633s	user 0.001s	sys 0.001s
I20260709 13:07:20.644634 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:20.646853 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2423) took 1219 ms. Trace:
I20260709 13:07:20.648588 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2353) took 1357 ms. Trace:
I20260709 13:07:20.653666 27019 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.624027 26851 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:20.655202 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.595773 27225 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:20.659381 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:20.602077 27126 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.660167 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:20.680068 21976 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:20.687105 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:20.688732 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.692472 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:20.692953 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.682472 21905 rpcz_store.cc:276] 0709 13:07:19.427867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.428084 (+   217us) service_pool.cc:224] Handling call
0709 13:07:19.428401 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.866493 (+438092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.646570 (+780077us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540019ee54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:20.646783 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963384704}
I20260709 13:07:20.685132 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:20.655462 27233 ts_tablet_manager.cc:933] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:07:20.631709 26998 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:20.682526 21979 rpcz_store.cc:276] 0709 13:07:19.290786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.293220 (+  2434us) service_pool.cc:224] Handling call
0709 13:07:19.432071 (+138851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.649641 (+217570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.647532 (+997891us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400413f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:20.648365 (+   833us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b5400413f50. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:20.648522 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643100288}
I20260709 13:07:20.601235 27026 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.696487 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:20.703794 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:20.704588 21901 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:20.713551 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.716192 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:20.721400 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2491) took 3319 ms. Trace:
I20260709 13:07:20.721894 21829 rpcz_store.cc:276] 0709 13:07:17.401859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.146014 (+1744155us) service_pool.cc:224] Handling call
0709 13:07:19.146264 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.420178 (+273914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.721121 (+1300943us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540017e8d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:20.721333 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583850880}
I20260709 13:07:20.723371 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:20.725557 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2493) took 3206 ms. Trace:
I20260709 13:07:20.695139 27187 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:20.728786 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2412) took 1481 ms. Trace:
I20260709 13:07:20.684084 26851 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.686777 26930 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.730198 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.726032 21831 rpcz_store.cc:276] 0709 13:07:17.518872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.178523 (+2659651us) service_pool.cc:224] Handling call
0709 13:07:20.178855 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.233671 (+ 54816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.725308 (+491637us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b54001d7ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:20.725495 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117194112}
I20260709 13:07:20.739156 21904 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:20.739521 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:20.716117 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:20.733891 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.729136 21900 rpcz_store.cc:276] 0709 13:07:19.246980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.247108 (+   128us) service_pool.cc:224] Handling call
0709 13:07:19.247511 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.578189 (+330678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.728552 (+1150363us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b540034b554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:20.728721 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745321344}
I20260709 13:07:20.694674 26381 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.736594 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.764259 21980 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 10.
I20260709 13:07:20.770537 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.771358 21978 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:20.736688 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.697580 27225 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:20.728572 27187 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.784457 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:20.778812 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:20.785552 21978 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:20.742930 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.792816 21901 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:20.795012 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.795364 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.699934 27014 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:07:20.799508 27147 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:20.800051 27147 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.800786 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:20.801396 21834 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:20.801915 27147 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.802572 27147 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:20.803081 27147 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.805001 27147 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.806229 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2331) took 1519 ms. Trace:
I20260709 13:07:20.806604 21832 rpcz_store.cc:276] 0709 13:07:19.287161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.425073 (+137912us) service_pool.cc:224] Handling call
0709 13:07:20.806030 (+1380957us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b540009d654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:20.806135 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123595136}
I20260709 13:07:20.807492 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.807799 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.808673 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:20.809705 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:20.810354 26958 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:20.810762 26958 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.811090 26958 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:20.812417 27099 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:20.817755 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.819080 21830 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:20.823271 21825 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:20.825554 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.826354 21903 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:20.827327 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.828361 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:20.828972 21903 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:20.831801 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.832502 21830 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:20.832482 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.832866 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.833463 21900 raft_consensus.cc:2410] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:20.833463 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.838567 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:20.839491 21832 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 11: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:20.781904 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:20.850777 21980 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:20.850929 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:20.841960 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.852856 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:20.842154 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.843678 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2428) took 1108 ms. Trace:
I20260709 13:07:20.845098 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:20.686290 27060 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:07:20.857879 27082 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:20.858469 27082 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:20.855346 21906 rpcz_store.cc:276] 0709 13:07:19.735652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.940017 (+204365us) service_pool.cc:224] Handling call
0709 13:07:19.966012 (+ 25995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.966196 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:20.528005 (+561809us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.843383 (+315378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.843433 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:20.843472 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.843531 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.843630 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":426189,"prepare.queue_time_us":430399,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":1697,"thread_start_us":445804,"threads_started":2}
I20260709 13:07:20.859318 27082 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:20.842180 27069 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.860493 27082 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:20.861210 27222 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:07:20.864852 21980 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:20.865850 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:20.855309 21830 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:20.869460 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.870707 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.871565 21830 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:20.884209 21834 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:20.885190 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.885895 21834 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:20.886667 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:20.893007 21903 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:20.831542 27200 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:20.826879 26930 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:20.841717 27019 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:20.732963 26975 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.899483 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:20.907783 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.874092 27073 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:20.965081 21828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2329) took 1679 ms (client timeout 1828 ms). Trace:
W20260709 13:07:20.965603 21828 rpcz_store.cc:269] 0709 13:07:19.285894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.391536 (+105642us) service_pool.cc:224] Handling call
0709 13:07:20.963902 (+1572366us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000e97d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:20.965022 (+  1120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236013312}
W20260709 13:07:20.946509 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 95722.3us
I20260709 13:07:20.964411 21827 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:20.850086 21978 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:20.701483 27226 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:20.974534 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.897089 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:20.907631 26930 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:20.862569 27026 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
W20260709 13:07:20.943439 27181 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.937s	user 0.003s	sys 0.000s
I20260709 13:07:20.903183 27128 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:20.907646 27186 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:20.975497 27228 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:07:20.966683 27099 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:21.074124 21830 raft_consensus.cc:2410] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:20.964819 27069 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:21.078991 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2430) took 1353 ms. Trace:
I20260709 13:07:21.084028 26958 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:21.089442 27052 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.002s
I20260709 13:07:21.102654 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:21.142836 21900 raft_consensus.cc:2410] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 14 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:07:20.980597 27200 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:21.100514 27176 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:07:21.100307 27218 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:07:21.104148 26961 consensus_meta.cc:287] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.780s	user 0.006s	sys 0.006s
I20260709 13:07:21.099189 27014 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:20.740231 26851 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:20.907450 27019 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:21.113132 27153 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.012s	sys 0.062s
I20260709 13:07:21.113404 27072 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:21.138501 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 272730us
I20260709 13:07:21.140431 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:21.194499 21830 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:21.195678 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:21.196468 21830 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:21.135622 21983 rpcz_store.cc:276] 0709 13:07:19.725140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.725278 (+   138us) service_pool.cc:224] Handling call
0709 13:07:19.725610 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.743020 (+ 17410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.743053 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.509583 (+766530us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b2c00111818. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:07:20.510022 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.688248 (+178226us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.688283 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.688341 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.078678 (+390337us) raft_consensus.cc:1685] finished
0709 13:07:21.078702 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.078927 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2187,"raft.queue_time_us":17401,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":98537,"spinlock_wait_cycles":230184704,"thread_start_us":177863,"threads_started":1,"wal-append.queue_time_us":566759}
W20260709 13:07:21.152572 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.154150 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:21.159610 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:21.138499 27249 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.198241 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.199857 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.202073 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:21.202867 21983 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:21.203970 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:21.205193 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:21.208267 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54248.8us
W20260709 13:07:21.194149 27153 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.012s	sys 0.062s
I20260709 13:07:21.214054 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:21.194324 27019 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:21.207876 26961 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:07:21.215862 27072 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:21.195389 27187 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:21.228806 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:21.222141 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.047s	sys 0.038s
I20260709 13:07:21.144160 27069 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.153612 27052 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:21.229768 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.048s	sys 0.038s
W20260709 13:07:21.233103 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 521293us
I20260709 13:07:21.225268 27128 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.212865 26847 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:21.231475 27073 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.232450 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.208071 27188 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:21.235009 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:21.186048 27014 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:21.232299 27241 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:07:21.242008 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:21.144601 27099 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:21.227562 27072 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:21.236511 27073 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:21.248618 27236 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:07:21.243001 27041 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:07:21.249053 27245 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:07:21.249076 26958 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.242069 27188 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.210942 27249 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:21.250581 26998 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.003s
I20260709 13:07:21.138681 27186 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.252669 27073 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.255679 27072 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:21.249089 27256 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:21.273383 21983 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:21.270126 27188 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:21.284224 27238 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:07:21.267822 26961 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:21.275624 26998 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:21.318559 27133 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.694s	user 0.007s	sys 0.002s
W20260709 13:07:21.338964 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 104047us
I20260709 13:07:21.334798 27099 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.287514 26930 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.341132 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.350458 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:21.338701 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 130185us
I20260709 13:07:21.355185 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:21.342309 27224 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.792s	user 0.014s	sys 0.000s
I20260709 13:07:21.337883 26998 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.361008 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:21.365824 27014 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.371798 27052 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.360117 26861 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:21.380522 27073 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.382550 27247 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:21.320969 27233 tablet_copy_client.cc:323] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.129:39085
I20260709 13:07:21.388842 27186 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:21.392200 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:21.404523 27248 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:21.425199 27248 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.399394 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:21.399863 27258 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:21.400792 27264 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:21.417415 26861 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.419770 27071 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:21.343817 27133 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.444073 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 758) took 1535 ms. Trace:
I20260709 13:07:21.397058 27069 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:21.423250 27247 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:21.429672 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.435475 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:21.426144 26851 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.420694 27072 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.444643 22550 rpcz_store.cc:276] 0709 13:07:19.908506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.908632 (+   126us) service_pool.cc:224] Handling call
0709 13:07:19.908947 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.920719 (+ 11772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.920750 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.920807 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:19.920839 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.443769 (+1522930us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54004c4fd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:21.443839 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.444008 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23944448}
I20260709 13:07:21.451339 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:21.395218 26998 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.435297 27014 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.473807 22546 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:07:21.482587 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:21.435254 26381 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:21.475667 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2323) took 2208 ms. Trace:
I20260709 13:07:21.486310 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:21.488667 22549 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:21.485183 21828 rpcz_store.cc:276] 0709 13:07:19.267208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.966621 (+1699413us) service_pool.cc:224] Handling call
0709 13:07:20.967117 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.967364 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:21.290027 (+322663us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.475322 (+185295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.475406 (+    84us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:21.475453 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.475514 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.475616 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":402922,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"thread_start_us":393089,"threads_started":2}
I20260709 13:07:21.494534 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:21.491452 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:21.446346 26847 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:21.496577 21902 raft_consensus.cc:2368] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12.
I20260709 13:07:21.473490 26961 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.480235 26859 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.048s	user 0.012s	sys 0.001s
W20260709 13:07:21.502082 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 92160.7us
I20260709 13:07:21.493124 27160 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:21.396180 27224 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.473634 26930 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:21.505779 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:21.444303 26861 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:21.498454 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 245899us
I20260709 13:07:21.515967 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:21.492969 27191 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.517344 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:21.523938 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:21.524386 21828 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:21.528393 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:21.529114 26986 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:21.530825 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2499) took 2383 ms. Trace:
I20260709 13:07:21.531431 27009 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:21.496184 26381 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.547123 21828 pending_rounds.cc:85] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 10
I20260709 13:07:21.547425 21828 pending_rounds.cc:107] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:07:21.547672 21828 raft_consensus.cc:2889] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.548769 22555 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:21.533613 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 131710us
I20260709 13:07:21.537647 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:21.549477 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:21.550002 22546 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.550118 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:21.538865 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.497375 26993 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:07:21.493582 27014 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.544546 21826 raft_consensus.cc:2410] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:21.545182 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:21.544315 21832 rpcz_store.cc:276] 0709 13:07:19.147661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.944572 (+1796911us) service_pool.cc:224] Handling call
0709 13:07:21.060355 (+115783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.060735 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.060774 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.061321 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.252212 (+190891us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:21.478566 (+226354us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.479802 (+  1236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.479905 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.530549 (+ 50644us) raft_consensus.cc:1685] finished
0709 13:07:21.530581 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.530754 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":948,"prepare.queue_time_us":118563,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":46689,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":9605,"thread_start_us":384817,"threads_started":2,"wal-append.queue_time_us":375512}
I20260709 13:07:21.518268 27160 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:21.559521 27014 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.559641 27160 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:21.556214 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:21.560727 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2327) took 2275 ms. Trace:
I20260709 13:07:21.561223 21832 rpcz_store.cc:276] 0709 13:07:19.285343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.559751 (+2274408us) service_pool.cc:224] Handling call
0709 13:07:21.560101 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.560318 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.560368 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.560423 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:21.560476 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.560544 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.560661 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.558959 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:21.563129 21832 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:07:21.535971 27225 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.733s	user 0.006s	sys 0.004s
I20260709 13:07:21.563783 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.557117 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:21.563673 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2330) took 2276 ms. Trace:
I20260709 13:07:21.565410 21832 rpcz_store.cc:276] 0709 13:07:19.286853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.562201 (+2275348us) service_pool.cc:224] Handling call
0709 13:07:21.562520 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.563480 (+   960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.563629 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.565977 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:21.568122 27273 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:21.536460 27191 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:21.571154 27191 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.572360 26861 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:21.512425 26961 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.574357 26961 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:21.562988 27265 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:21.532948 26851 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:21.575420 26381 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:21.576009 21903 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:21.567596 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.576592 26847 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:21.571148 27082 consensus_meta.cc:287] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.000s
I20260709 13:07:21.578663 27280 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:21.578065 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:21.579967 27191 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.580631 27264 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:21.580912 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.581187 27264 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:21.581390 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2324) took 2313 ms. Trace:
I20260709 13:07:21.575131 27073 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.582122 27264 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.582741 27028 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:21.583180 27028 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:21.583334 27191 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:21.583628 27028 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:21.581764 21830 rpcz_store.cc:276] 0709 13:07:19.267507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.206638 (+1939131us) service_pool.cc:224] Handling call
0709 13:07:21.206991 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.216373 (+  9382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.216409 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.216884 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.336487 (+119603us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:21.536257 (+199770us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.538556 (+  2299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.538657 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.581176 (+ 42519us) raft_consensus.cc:1685] finished
0709 13:07:21.581197 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.581332 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17613,"prepare.queue_time_us":34481,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":25943,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":9120,"thread_start_us":292870,"threads_started":2,"wal-append.queue_time_us":267238}
I20260709 13:07:21.586409 21900 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.543455 27249 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:21.588584 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 97249.9us
I20260709 13:07:21.586422 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:21.548367 27268 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:21.556169 26986 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:21.596019 22546 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:21.613387 21830 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:21.623371 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.730969 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 50313.5us
I20260709 13:07:21.734866 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:21.742619 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 188375us
W20260709 13:07:21.743938 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 157575us
I20260709 13:07:21.744298 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2343) took 2343 ms. Trace:
I20260709 13:07:21.744831 21830 rpcz_store.cc:276] 0709 13:07:19.401083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.585451 (+2184368us) service_pool.cc:224] Handling call
0709 13:07:21.613141 (+ 27690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.743941 (+130800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.744222 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.746806 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.747668 21832 raft_consensus.cc:2410] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:21.750665 21830 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:21.556620 27248 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:21.756525 26859 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.757208 26859 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:21.759971 26859 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.759630 26986 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.586612 27052 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:21.773764 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 658) took 1818 ms. Trace:
I20260709 13:07:21.774796 21830 rpcz_store.cc:276] 0709 13:07:19.955777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.746034 (+1790257us) service_pool.cc:224] Handling call
0709 13:07:21.750403 (+  4369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.773411 (+ 23008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.773695 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.593042 27214 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:07:21.781850 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 224182us
I20260709 13:07:21.771145 26961 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:21.752297 27041 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:21.751955 27189 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:21.772174 27280 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:21.586444 27225 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.686111 27273 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:07:21.781795 27249 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.800487 27249 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.802670 27249 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:21.805615 27019 consensus_meta.cc:287] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.004s
I20260709 13:07:21.798245 26961 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:21.786919 27009 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:21.788548 27191 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:07:21.743470 27268 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.799233 27189 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.799101 27041 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.795650 21843 tablet_copy_service.cc:140] P 479255846c5141b584b16aa253f587c7: Received BeginTabletCopySession request for tablet 2705e36077094db8a03a8b3e606284be from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:52674)
I20260709 13:07:21.806145 27019 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.827723 21834 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:21.807407 27072 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:21.807475 27224 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:21.829632 27019 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.837997 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:21.842052 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:21.825835 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:21.843534 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:21.846133 21903 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:21.847610 21980 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:21.848757 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2497) took 3842 ms. Trace:
I20260709 13:07:21.849233 21827 rpcz_store.cc:276] 0709 13:07:18.006495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.397826 (+2391331us) service_pool.cc:224] Handling call
0709 13:07:20.964021 (+566195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.967800 (+  3779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.848504 (+880704us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54000e97d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:21.848685 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301314432}
I20260709 13:07:21.851716 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:21.854592 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:21.854743 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:21.855715 21980 raft_consensus.cc:2410] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:07:21.857124 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:21.857517 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2358) took 2117 ms. Trace:
I20260709 13:07:21.857975 21980 raft_consensus.cc:1217] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Deduplicated request from leader. Original: 14.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:07:21.859432 21980 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:21.858749 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2458) took 1416 ms. Trace:
I20260709 13:07:21.860376 21981 rpcz_store.cc:276] 0709 13:07:20.442790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.825593 (+1382803us) service_pool.cc:224] Handling call
0709 13:07:21.858696 (+ 33103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.857846 21982 rpcz_store.cc:276] 0709 13:07:19.740401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.848847 (+108446us) service_pool.cc:224] Handling call
0709 13:07:19.875809 (+ 26962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.300954 (+425145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.857318 (+1556364us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54003a43d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:21.857466 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950662400}
I20260709 13:07:21.862561 27174 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.863314 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:21.865432 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:21.867337 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.829646 27028 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.870196 21830 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:21.870457 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:21.872053 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:21.809162 27259 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:07:21.808511 27191 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:21.874394 21975 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:21.876260 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:21.886735 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:21.813179 27189 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.813117 27268 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:21.889151 21827 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:21.889714 21901 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:21.890080 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:21.891141 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 147755us
I20260709 13:07:21.890105 21874 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:21.815478 27041 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.814770 27225 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:21.895623 21980 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:21.858407 27014 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:21.903515 27099 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:21.900009 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:21.815795 21843 tablet_copy_service.cc:161] P 479255846c5141b584b16aa253f587c7: Beginning new tablet copy session on tablet 2705e36077094db8a03a8b3e606284be from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:52674: session id = 0157b4f0725d4f92a53938c921db9efc-2705e36077094db8a03a8b3e606284be
I20260709 13:07:21.807801 27009 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.821365 27160 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.818994 26998 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:21.877249 27282 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:21.897980 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2356) took 1475 ms. Trace:
I20260709 13:07:21.913460 21827 rpcz_store.cc:276] 0709 13:07:20.422472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.888412 (+1465940us) service_pool.cc:224] Handling call
0709 13:07:21.888777 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.897675 (+  8898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.897916 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:21.899924 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.873791 27283 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:21.911686 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:21.899144 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:21.944309 21980 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:21.856632 27127 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:07:21.887887 27191 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:21.900389 27026 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:21.939430 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:21.940078 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:21.807236 26961 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.913398 27282 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:21.896862 26993 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:21.906579 27014 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:21.940544 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:21.895045 26381 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:21.945014 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45938.2us
I20260709 13:07:21.899392 27153 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:07:21.896750 27012 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:07:21.899724 26861 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:21.946532 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:21.948158 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 382584us
I20260709 13:07:21.950730 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:21.951867 21826 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 12: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:21.907516 27063 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:21.952773 27268 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:21.973047 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2325) took 2705 ms. Trace:
I20260709 13:07:22.006742 22521 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.955865 27026 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:21.949150 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49332.7us
I20260709 13:07:21.938860 27041 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.952458 27099 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:22.007555 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 651) took 1315 ms. Trace:
I20260709 13:07:21.957751 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:22.011941 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:22.012080 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:22.038928 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 650) took 1346 ms. Trace:
W20260709 13:07:22.046618 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 88919.7us
I20260709 13:07:22.047470 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:22.047120 21902 rpcz_store.cc:276] 0709 13:07:20.692101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.692256 (+   155us) service_pool.cc:224] Handling call
0709 13:07:22.006715 (+1314459us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54002373d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:22.038846 (+ 32131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847593344}
I20260709 13:07:22.048026 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.048676 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:22.047374 22550 raft_consensus.cc:2410] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:07:22.005002 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2496) took 4000 ms. Trace:
I20260709 13:07:22.040424 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 665) took 2082 ms. Trace:
I20260709 13:07:22.049715 21825 rpcz_store.cc:276] 0709 13:07:18.004578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.393413 (+2388835us) service_pool.cc:224] Handling call
0709 13:07:20.822892 (+429479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.823715 (+   823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.004795 (+1181080us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540009d650. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:22.004944 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987042176}
I20260709 13:07:22.041333 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:21.955981 27282 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:22.044389 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.059181 27294 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:22.059682 27294 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:22.060261 26998 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:22.060475 27294 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:22.061318 27295 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:22.046108 21908 rpcz_store.cc:276] 0709 13:07:20.692433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.693171 (+   738us) service_pool.cc:224] Handling call
0709 13:07:20.716654 (+ 23483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.734933 (+ 18279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.734976 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.735030 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:20.735075 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.007286 (+1272211us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54002e63d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:22.007344 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.007489 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41506560}
I20260709 13:07:21.956319 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:21.981056 27227 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.386s	user 0.002s	sys 0.000s
I20260709 13:07:22.012470 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:21.958189 27014 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:22.051556 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:21.957360 26381 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.052111 27189 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:22.056407 21843 tablet_copy_source_session.cc:215] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:22.057555 27052 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:21.959466 27028 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:22.051951 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 670) took 1557 ms. Trace:
I20260709 13:07:22.003955 26987 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:22.080084 21825 rpcz_store.cc:276] 0709 13:07:20.494976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.051247 (+1556271us) service_pool.cc:224] Handling call
0709 13:07:22.051527 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.051682 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.051706 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:22.051744 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:22.051772 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.051820 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.051905 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.012161 21828 rpcz_store.cc:276] 0709 13:07:19.268458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.546609 (+2278151us) service_pool.cc:224] Handling call
0709 13:07:21.546933 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:21.567122 (+ 20189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.567171 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:21.567928 (+   757us) log.cc:844] Serialized 52 byte log entry
0709 13:07:21.849823 (+281895us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:21.849890 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.849979 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.972794 (+122815us) raft_consensus.cc:1685] finished
0709 13:07:21.972821 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.972980 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9057,"raft.queue_time_us":9962,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":98505,"threads_started":1,"wal-append.queue_time_us":325721}
I20260709 13:07:22.068513 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:22.062812 27099 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:21.939803 21827 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:22.085985 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 669) took 1649 ms. Trace:
I20260709 13:07:22.086551 21827 rpcz_store.cc:276] 0709 13:07:20.436753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.914487 (+1477734us) service_pool.cc:224] Handling call
0709 13:07:21.939473 (+ 24986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.085658 (+146185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.085917 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.005949 27073 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:22.081609 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:22.088934 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:21.967418 27273 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:22.091732 27273 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:22.092507 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55452.5us
I20260709 13:07:22.094157 21825 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:22.063678 26986 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.079033 26381 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:21.967192 27012 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 13:07:22.085279 27019 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:22.085759 26987 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:22.104554 27127 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:22.106614 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.107518 21902 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.108126 26861 consensus_queue.cc:1243] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:22.123092 27174 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:22.108937 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 97095.3us
I20260709 13:07:22.124778 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:22.125813 27268 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:22.109226 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 68017.4us
I20260709 13:07:22.126155 27268 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:22.126556 27268 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:22.126586 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.110337 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2508) took 1447 ms. Trace:
I20260709 13:07:22.127462 21829 rpcz_store.cc:276] 0709 13:07:20.662800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.109435 (+1446635us) service_pool.cc:224] Handling call
0709 13:07:22.109754 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.109946 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.109975 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:22.110025 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:22.110060 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.110132 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.110271 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.110949 27153 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:22.128894 21829 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:22.129431 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2361) took 1357 ms. Trace:
I20260709 13:07:22.123087 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2447) took 1394 ms. Trace:
I20260709 13:07:22.090804 27099 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:22.063277 27041 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.122541 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:21.982698 27191 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.131335 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2437) took 1284 ms. Trace:
I20260709 13:07:22.131812 21906 raft_consensus.cc:1217] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 14.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:07:22.137814 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.138183 21906 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:22.137387 21904 rpcz_store.cc:276] 0709 13:07:20.846918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.856725 (+  9807us) service_pool.cc:224] Handling call
0709 13:07:20.857028 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:20.874386 (+ 17358us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:21.072820 (+198434us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.127378 (+1054558us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.127538 (+   160us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:22.128041 (+   503us) log.cc:844] Serialized 52 byte log entry
0709 13:07:22.128164 (+   123us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:22.128193 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.128251 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.131122 (+  2871us) raft_consensus.cc:1685] finished
0709 13:07:22.131140 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.131282 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1037622,"prepare.queue_time_us":1077168,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":24827,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":13048,"thread_start_us":176664,"threads_started":1,"wal-append.queue_time_us":404445}
I20260709 13:07:22.140147 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:22.140741 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.141304 21904 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:22.142554 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:22.129726 21829 rpcz_store.cc:276] 0709 13:07:20.771657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.128333 (+1356676us) service_pool.cc:224] Handling call
0709 13:07:22.128614 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.129209 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.129383 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.130611 21905 rpcz_store.cc:276] 0709 13:07:20.728975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.730014 (+  1039us) service_pool.cc:224] Handling call
0709 13:07:20.730324 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.730537 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:20.782937 (+ 52400us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.111599 (+328662us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.832520 (+720921us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18000fab40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:22.122383 (+289863us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b18000fab40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf 00007fb75eff8038
0709 13:07:22.122617 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.122771 (+   154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:22.122815 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:22.122859 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.122921 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.123039 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":309010,"prepare.queue_time_us":85490,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":2379,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":1669,"spinlock_wait_cycles":17604224,"thread_start_us":325493,"threads_started":1,"wal-append.queue_time_us":438702}
I20260709 13:07:22.095427 27073 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.133479 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:22.096030 26953 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:07:22.134904 21827 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:22.135514 22548 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:22.133204 21949 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.142051 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:22.149838 21908 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:22.150198 21905 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:07:22.156090 21905 pending_rounds.cc:85] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 6
I20260709 13:07:22.156342 21905 pending_rounds.cc:107] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:07:22.156561 21905 raft_consensus.cc:2889] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.157569 21980 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:07:22.068243 27280 consensus_queue.cc:1175] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d76b2c4699e43fba10eeb81a91e4913" responder_term: 17 status { last_received { term: 17 index: 11 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:22.152102 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:22.158906 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.159425 27233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2705e36077094db8a03a8b3e606284be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:22.159997 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:22.161242 21909 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:22.130724 27127 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:22.162003 27127 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:22.163347 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 91497.9us
I20260709 13:07:22.133911 27099 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.163888 27291 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:22.166044 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2320) took 4612 ms. Trace:
I20260709 13:07:22.164232 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:22.170027 21833 rpcz_store.cc:276] 0709 13:07:17.553691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.248253 (+2694562us) service_pool.cc:224] Handling call
0709 13:07:20.248566 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.260488 (+ 11922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.260515 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:20.260936 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.441495 (+180559us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:20.441547 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.441635 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.980521 (+1538886us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:22.155187 (+174666us) raft_consensus.cc:1685] finished
0709 13:07:22.155215 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.165969 (+ 10754us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11598,"raft.queue_time_us":12576,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":10951936,"thread_start_us":180176,"threads_started":1,"wal-append.queue_time_us":272206}
I20260709 13:07:22.171916 21902 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 11.
I20260709 13:07:22.172912 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.174141 22551 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:07:22.174508 22551 pending_rounds.cc:85] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 11
I20260709 13:07:22.174721 22551 pending_rounds.cc:107] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:07:22.177937 22551 raft_consensus.cc:2889] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.150048 27248 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:22.184590 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.186226 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.163148 26961 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:22.189530 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.175037 27191 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:22.191179 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:22.193058 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.193881 26954 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:22.149914 26861 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:22.180509 26930 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:22.117704 27026 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.191179 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.197809 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.200641 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:22.202526 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.203920 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:22.170641 27153 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:22.165748 27247 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:22.205049 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.207515 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.209151 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.210108 21904 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:22.210932 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.213440 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.197050 27248 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.186089 26986 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:22.197463 26930 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:22.218276 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.221246 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.215660 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.211081 27012 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:22.232796 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.210304 27240 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:22.234447 21977 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:22.214052 26961 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:22.177785 26987 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:22.235327 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 131517us
I20260709 13:07:22.217459 27288 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:22.249874 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2459) took 1786 ms. Trace:
I20260709 13:07:22.272394 21977 rpcz_store.cc:276] 0709 13:07:20.463878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.234004 (+1770126us) service_pool.cc:224] Handling call
0709 13:07:22.234288 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.249562 (+ 15274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.249808 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.214567 27257 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:22.198444 27297 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:22.255466 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:22.257197 27282 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.258455 27041 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.261343 27127 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.235049 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:22.266863 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 67752us
I20260709 13:07:22.252540 27214 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:22.214815 27019 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:22.232606 26930 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:22.231986 27080 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:22.274398 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.231792 26998 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:22.306090 26998 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:22.306964 27242 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.189s	user 0.003s	sys 0.000s
I20260709 13:07:22.308475 26998 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.309121 26998 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:22.218927 27028 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:07:22.310456 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.272475 27012 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.287694 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52717.2us
I20260709 13:07:22.311201 27012 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.290645 22520 leader_election.cc:400] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12.
I20260709 13:07:22.313550 27012 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.313773 22520 leader_election.cc:403] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.314301 27052 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.314800 27052 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.316073 26953 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 11. Current term is 12.
I20260709 13:07:22.233551 26877 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:07:22.316864 27052 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.232457 27248 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.285249 26987 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:22.265156 27147 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:22.308341 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.274489 27300 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:22.323988 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:22.304447 27127 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.397826 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.289604 27257 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:22.401124 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:22.405362 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.299041 27019 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:22.314131 27012 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.408666 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 186221us
I20260709 13:07:22.316883 26953 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:07:22.413434 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:22.424646 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 155729us
W20260709 13:07:22.424646 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 159101us
I20260709 13:07:22.436057 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:22.410424 27073 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.437175 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:22.437196 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.409124 27019 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:22.447883 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.451299 21977 raft_consensus.cc:2410] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:22.412118 27127 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:07:22.424120 27265 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:22.461236 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.465551 27248 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:22.465612 27313 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:22.466671 27225 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:22.467758 27313 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:22.468528 27313 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:22.468780 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 674) took 1651 ms. Trace:
I20260709 13:07:22.469175 21833 rpcz_store.cc:276] 0709 13:07:20.817371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.171996 (+1354625us) service_pool.cc:224] Handling call
0709 13:07:22.183461 (+ 11465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.467414 (+283953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.467446 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:22.467485 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:22.467513 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.468570 (+  1057us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54001d79d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:22.468616 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.468728 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652649344}
I20260709 13:07:22.472573 27250 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:22.472961 27250 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:22.463896 27265 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.478997 27282 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.478761 27273 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.479976 27273 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:22.480799 27265 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:22.421916 27012 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:22.487459 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 74125.1us
I20260709 13:07:22.488476 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:22.490330 26381 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.491717 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.502961 21905 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:22.503957 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:22.493088 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.516579 27268 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.517503 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.517772 21980 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:22.518641 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.519205 21833 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:22.519946 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.473687 27250 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.521036 27250 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:22.524789 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.525359 21905 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:22.526196 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.526847 21905 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:22.527731 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.529502 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:22.530277 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.485672 27012 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.538509 21975 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:22.546141 21905 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:22.517611 27014 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:22.537972 27255 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.305s	user 0.006s	sys 0.000s
W20260709 13:07:22.530304 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 214306us
I20260709 13:07:22.517156 26961 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:22.558544 21909 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:22.524331 27314 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:22.562068 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:22.521998 27099 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.547205 26861 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:22.574761 21975 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
W20260709 13:07:22.574869 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 137739us
I20260709 13:07:22.573343 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:22.576714 21903 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:22.585067 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:22.582139 21833 raft_consensus.cc:2410] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:22.583560 22551 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:22.585160 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:22.587203 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 159463us
I20260709 13:07:22.537932 27288 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:07:22.581451 27212 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:22.601420 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2371) took 1057 ms. Trace:
I20260709 13:07:22.601935 21826 rpcz_store.cc:276] 0709 13:07:21.543866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.558725 (+ 14859us) service_pool.cc:224] Handling call
0709 13:07:22.601191 (+1042466us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400336b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:22.601356 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878613376}
I20260709 13:07:22.604020 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.607561 26381 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:22.595177 27212 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:22.610069 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:22.591548 27317 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.596947 26877 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:22.597049 27270 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:22.609697 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 78165.9us
I20260709 13:07:22.597054 26961 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:22.613314 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:22.669173 21976 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2461) took 2204 ms (client timeout 1679 ms). Trace:
W20260709 13:07:22.669641 21976 rpcz_store.cc:269] 0709 13:07:20.464539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.487368 (+ 22829us) service_pool.cc:224] Handling call
0709 13:07:22.668954 (+2181586us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002c7254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:22.669061 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441230720}
I20260709 13:07:22.670660 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:22.671025 27225 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.671687 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:22.671532 27225 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.673288 27019 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.674404 21826 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:22.679201 26993 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.000s
I20260709 13:07:22.679695 26993 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:22.685101 21900 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:22.686666 27133 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:22.687260 27283 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:22.687628 27283 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:22.688664 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.688437 27283 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.684545 27014 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:22.691001 27019 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.691649 27099 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.683156 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 774) took 1230 ms. Trace:
I20260709 13:07:22.680038 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 682) took 1548 ms. Trace:
I20260709 13:07:22.669183 27268 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:22.693506 21983 rpcz_store.cc:276] 0709 13:07:21.131218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.229324 (+ 98106us) service_pool.cc:224] Handling call
0709 13:07:21.229706 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.277462 (+ 47756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.679830 (+1402368us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b54003f9654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:22.679984 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99409792}
I20260709 13:07:22.694626 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:22.695211 21979 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:22.610337 27212 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:22.691835 27283 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:22.692512 22555 rpcz_store.cc:276] 0709 13:07:21.453077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.454402 (+  1325us) service_pool.cc:224] Handling call
0709 13:07:21.485541 (+ 31139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.549374 (+ 63833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.682963 (+1133589us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b5400191ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:22.683105 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144785792}
I20260709 13:07:22.619825 26877 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.706740 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:22.689818 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.612190 27282 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:22.711304 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:22.658660 26961 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:22.711647 27320 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:22.710498 27273 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.746933 26961 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:22.706521 26954 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:07:22.752691 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:22.716506 26877 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:22.690266 27270 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.743963 27191 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:07:22.719580 27282 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.764672 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.769438 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.773027 21829 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:22.774153 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:22.775308 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.776364 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.776919 21829 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:22.777681 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.780463 26930 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.781003 27270 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:22.781901 21829 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
W20260709 13:07:22.775470 27322 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:22.784426 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:22.783885 21977 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:22.783520 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.785828 21829 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:22.753645 27273 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.792284 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.802472 27264 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:22.802343 26877 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.803086 27264 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:22.803612 27264 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:22.804490 26877 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.811582 27250 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:22.812165 27250 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:22.812631 27250 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:22.819231 27128 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:22.819645 27128 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:22.820376 27128 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.821317 27128 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.825558 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:22.827092 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.836535 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.837600 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.838336 21829 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:22.792130 27191 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:22.844921 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:22.845372 21903 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.838269 27265 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:22.841941 26987 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:22.841702 27288 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:22.850975 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:22.851625 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:22.860281 21829 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:22.850495 26987 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:22.862738 26861 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:22.858561 27009 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.863353 26861 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.864737 27282 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.865329 26861 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:22.851167 27288 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:22.862825 26987 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:22.869901 21903 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:22.871568 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:22.873871 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:22.877332 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:22.878062 21983 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:22.876281 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:22.879120 26861 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:22.870573 27288 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.872170 27265 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:22.874586 27282 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.884788 21829 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:07:22.888168 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2364) took 2014 ms. Trace:
I20260709 13:07:22.888548 21829 rpcz_store.cc:276] 0709 13:07:20.874031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.875790 (+2001759us) service_pool.cc:224] Handling call
0709 13:07:22.884447 (+  8657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.887768 (+  3321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.888116 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.889103 27256 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:22.889499 27256 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:22.890252 27256 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.896479 27282 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.899075 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2447) took 1351 ms. Trace:
I20260709 13:07:22.899562 21901 rpcz_store.cc:276] 0709 13:07:21.547196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.855884 (+308688us) service_pool.cc:224] Handling call
0709 13:07:21.856211 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.898195 (+ 41984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.898804 (+1000609us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b5400308254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:22.899007 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76522240}
I20260709 13:07:22.901279 21901 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:22.903009 26987 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.903852 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 675) took 1136 ms. Trace:
I20260709 13:07:22.905814 27300 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:22.904537 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.905866 21826 rpcz_store.cc:276] 0709 13:07:21.768050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.903145 (+1135095us) service_pool.cc:224] Handling call
0709 13:07:22.903396 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.903564 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.903591 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:22.903627 (+    36us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:22.903663 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.903712 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.903794 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.905084 27288 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.897843 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2451) took 1834 ms. Trace:
I20260709 13:07:22.875011 27317 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:22.886338 27265 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:22.911147 21906 rpcz_store.cc:276] 0709 13:07:21.063156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.063409 (+   253us) service_pool.cc:224] Handling call
0709 13:07:22.131684 (+1068275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.138644 (+  6960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.897614 (+758970us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540034ab50. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:22.897774 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2427136768}
I20260709 13:07:22.915119 21826 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:22.915905 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 679) took 1045 ms. Trace:
I20260709 13:07:22.916481 21826 rpcz_store.cc:276] 0709 13:07:21.870033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.912820 (+1042787us) service_pool.cc:224] Handling call
0709 13:07:22.913060 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.915623 (+  2563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.915842 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.917902 21826 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:22.919826 21826 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:22.884155 26861 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.921851 21906 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:22.906332 27300 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:22.935523 21906 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:22.936758 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:22.914572 27265 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:22.914439 26930 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:22.932215 26861 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:22.943737 21906 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:22.940352 27300 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.944886 27233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60034 (request call id 673) took 2626 ms. Trace:
I20260709 13:07:22.914848 27317 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:22.914281 27311 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:07:22.947302 27052 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:22.947736 27128 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:22.949020 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2368) took 2431 ms. Trace:
I20260709 13:07:22.948849 26961 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.949535 27028 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:22.979239 21906 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:07:22.979691 21906 pending_rounds.cc:85] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 13
I20260709 13:07:22.979914 21906 pending_rounds.cc:107] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:07:22.980167 21906 raft_consensus.cc:2889] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:22.929109 27273 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:22.954696 21904 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:22.950138 27212 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.974980 21974 rpcz_store.cc:276] 0709 13:07:20.517700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.866235 (+348535us) service_pool.cc:224] Handling call
0709 13:07:22.674886 (+1808651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.705601 (+ 30715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.705629 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.706032 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.762017 (+ 55985us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:22.762056 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.762125 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.811865 (+ 49740us) raft_consensus.cc:1685] finished
0709 13:07:22.811898 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.948777 (+136879us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54002c7250. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:22.948964 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44359,"raft.queue_time_us":30636,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":8721,"spinlock_wait_cycles":4158718336,"thread_start_us":55637,"threads_started":1,"wal-append.queue_time_us":85515}
I20260709 13:07:22.929733 27331 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:07:22.934121 27240 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:22.974680 27052 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:22.979570 27028 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:22.986145 27300 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:22.985355 27311 consensus_queue.cc:1243] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:22.990520 27331 consensus_queue.cc:1243] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:22.974085 27250 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:22.999810 27240 consensus_queue.cc:1243] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:23.001362 26961 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:23.005394 27317 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:22.983438 27128 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:23.001519 27335 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:07:23.012868 21976 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:23.015053 27063 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:23.016451 27128 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:23.018433 27288 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:23.019378 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 649) took 2327 ms. Trace:
I20260709 13:07:23.019696 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2365) took 1928 ms. Trace:
I20260709 13:07:23.020205 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2506) took 2369 ms. Trace:
I20260709 13:07:23.020555 21827 rpcz_store.cc:276] 0709 13:07:20.650913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.087529 (+1436616us) service_pool.cc:224] Handling call
0709 13:07:22.087792 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.152810 (+ 65018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.019995 (+867185us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b540017f2d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:23.020146 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107838720}
I20260709 13:07:23.026521 27028 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.028157 27028 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.034987 27263 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:23.035758 27263 consensus_queue.cc:1243] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:23.035684 27052 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.010077 27317 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:07:23.037539 27282 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:23.038139 27014 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:23.038529 27014 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:23.039266 27250 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:23.039268 27014 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:23.043969 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.044358 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.044708 27183 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:23.046298 27273 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.019718 21907 rpcz_store.cc:276] 0709 13:07:20.691757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.691897 (+   140us) service_pool.cc:224] Handling call
0709 13:07:20.692237 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.818546 (+126309us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:20.818766 (+   220us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.114039 (+295273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.114102 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:21.114995 (+   893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.523742 (+1408747us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:23.019161 (+495419us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000fad54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:23.019212 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.019326 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1380,"prepare.queue_time_us":568,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":547,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":1419,"spinlock_wait_cycles":294057088,"thread_start_us":294366,"threads_started":1,"wal-append.queue_time_us":380868}
I20260709 13:07:23.046772 27324 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:23.047250 27324 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:23.046787 27273 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.048053 27324 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.049258 27324 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.049804 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:23.056250 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:23.064615 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:23.045617 27183 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:07:23.079571 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.084519 21907 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:23.020053 21829 rpcz_store.cc:276] 0709 13:07:21.091602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.889476 (+1797874us) service_pool.cc:224] Handling call
0709 13:07:22.889960 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.890304 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.890332 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.890750 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.939090 (+ 48340us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:22.972116 (+ 33026us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.972484 (+   368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.972663 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.019499 (+ 46836us) raft_consensus.cc:1685] finished
0709 13:07:23.019519 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.019632 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69918,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":8202,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":1509,"thread_start_us":69534,"threads_started":2,"wal-append.queue_time_us":101611}
W20260709 13:07:23.097751 21834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 2509) took 2399 ms (client timeout 3138 ms). Trace:
W20260709 13:07:23.098194 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48464.2us
I20260709 13:07:23.099004 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:23.100162 21829 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:23.098198 21834 rpcz_store.cc:269] 0709 13:07:20.663115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.886436 (+223321us) service_pool.cc:224] Handling call
0709 13:07:23.062643 (+2176207us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b540011e254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:23.062809 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2162214272}
I20260709 13:07:23.100365 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:23.101609 22555 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:23.107091 27212 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:23.107601 27186 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:23.108167 27186 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.111112 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2378) took 2404 ms. Trace:
I20260709 13:07:23.111413 27279 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:23.112336 27279 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:23.112896 27279 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:23.111629 21978 rpcz_store.cc:276] 0709 13:07:20.709699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.970534 (+260835us) service_pool.cc:224] Handling call
0709 13:07:20.970808 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.245429 (+274621us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:21.259099 (+ 13670us) log.cc:844] Serialized 14 byte log entry
0709 13:07:21.524525 (+265426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:21.524576 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:21.524633 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.062152 (+537519us) spinlock_profiling.cc:243] Waited 985 us on lock 0x7b1800411ee0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:23.110818 (+1048666us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54003fa054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:23.110880 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.111019 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20758,"prepare.queue_time_us":13698,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":27091,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":69,"spinlock_wait_cycles":633171456,"thread_start_us":244252,"threads_started":1,"wal-append.queue_time_us":341331,"wal-append.run_cpu_time_us":1481,"wal-append.run_wall_time_us":1065678}
I20260709 13:07:23.114606 27160 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:23.113689 27279 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.115917 27279 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.118647 27225 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:23.118930 27311 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:23.120167 27311 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:23.120541 27311 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:23.121536 27291 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:23.121402 27311 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.121889 27291 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:23.094590 27014 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:23.159559 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:23.156774 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:23.141882 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.138530 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:23.162101 21903 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:23.177186 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:23.178483 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:23.162500 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:22.970746 27233 rpcz_store.cc:276] 0709 13:07:20.318549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.320174 (+  1625us) service_pool.cc:224] Handling call
0709 13:07:20.707599 (+387425us) ts_tablet_manager.cc:934] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
0709 13:07:22.149746 (+1442147us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:22.521147 (+371401us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:22.521269 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:22.922303 (+401034us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:22.944354 (+ 22051us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:22.944717 (+   363us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:22.944776 (+    59us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":54933,"tablet-copy.queue_time_us":264163,"thread_start_us":318056,"threads_started":2}
I20260709 13:07:23.132907 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 666) took 2716 ms. Trace:
I20260709 13:07:23.145474 21906 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:23.180025 21830 rpcz_store.cc:276] 0709 13:07:20.416979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.781102 (+1364123us) service_pool.cc:224] Handling call
0709 13:07:21.793042 (+ 11940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.870699 (+ 77657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.132702 (+1262003us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b54002729d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:23.132840 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176990592}
I20260709 13:07:23.181046 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:23.164475 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:23.147596 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:23.165413 27224 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:23.166188 27225 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:23.167690 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.184459 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 671) took 2689 ms. Trace:
I20260709 13:07:23.167500 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:23.184892 21825 rpcz_store.cc:276] 0709 13:07:20.495218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.081076 (+1585858us) service_pool.cc:224] Handling call
0709 13:07:22.081360 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.094653 (+ 13293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.184192 (+1089539us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5400030054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:23.184390 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28722432}
I20260709 13:07:23.186486 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2457) took 1176 ms. Trace:
I20260709 13:07:23.186818 21902 rpcz_store.cc:276] 0709 13:07:22.010341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.080791 (+ 70450us) service_pool.cc:224] Handling call
0709 13:07:23.186335 (+1105544us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54002378d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:23.186438 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43581312}
I20260709 13:07:23.187790 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:23.124620 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:23.157884 27160 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:07:23.169719 27071 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:23.170500 27082 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:23.171267 26958 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:23.197742 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:23.171794 26861 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.174371 27187 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:23.271298 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.182435 21901 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:23.193310 21902 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:23.194507 21908 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:07:23.135030 27226 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:23.197448 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:23.198663 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:23.199633 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:23.291582 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:23.292336 21981 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:23.293519 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:23.294237 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:23.295840 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:23.296550 21825 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.133497 26987 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:23.133405 27128 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:23.259473 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:23.189451 27306 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.126s
I20260709 13:07:23.260385 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2522) took 1069 ms. Trace:
I20260709 13:07:23.207815 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:23.200696 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:23.267560 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:23.201061 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:23.193085 27071 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:23.133603 27212 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:23.225399 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:23.331707 21830 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:23.278110 21901 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:23.133162 27257 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:23.291606 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2453) took 1082 ms. Trace:
I20260709 13:07:23.333180 21908 rpcz_store.cc:276] 0709 13:07:22.209147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.232129 (+ 22982us) service_pool.cc:224] Handling call
0709 13:07:23.186509 (+954380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:23.274069 (+ 87560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.291406 (+ 17337us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54002378d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:23.291554 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190716160}
I20260709 13:07:23.134687 27273 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:23.302336 21902 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:23.338042 21902 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:07:23.306828 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:23.297732 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:23.192813 26993 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.193033 27270 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.309465 21904 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:23.290035 27226 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:23.194356 27201 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:22.049767 21832 rpcz_store.cc:276] 0709 13:07:19.957549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.755524 (+1797975us) service_pool.cc:224] Handling call
0709 13:07:21.786558 (+ 31034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.786894 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.786921 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.787321 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 13:07:21.950742 (+163421us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:21.959588 (+  8846us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.039860 (+ 80272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.039947 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.040004 (+    57us) raft_consensus.cc:1685] finished
0709 13:07:22.040196 (+   192us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.040353 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70340,"prepare.queue_time_us":11790,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":83696,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":7741,"thread_start_us":132268,"threads_started":1,"wal-append.queue_time_us":148448}
I20260709 13:07:23.313679 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 2526) took 1102 ms. Trace:
I20260709 13:07:23.122613 26954 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.140s
I20260709 13:07:23.195648 27189 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.120s
W20260709 13:07:23.260704 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 68492.2us
I20260709 13:07:23.319587 21906 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:23.183997 27224 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:23.214293 27311 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.193480 27082 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:23.325479 21975 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:23.200146 26958 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:23.340231 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:23.340950 21905 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:23.342417 21908 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:23.270627 27187 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:23.310340 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:23.365939 21833 rpcz_store.cc:276] 0709 13:07:22.210866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.519725 (+308859us) service_pool.cc:224] Handling call
0709 13:07:23.300887 (+781162us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b54002882d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:23.313623 (+ 12736us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141330176}
I20260709 13:07:23.392541 21903 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 11: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:23.393081 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:23.393985 21833 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.321987 21826 rpcz_store.cc:276] 0709 13:07:22.191001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.922883 (+731882us) service_pool.cc:224] Handling call
0709 13:07:22.923111 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.923256 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:23.009541 (+ 86285us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.259932 (+250391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.260005 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:23.260068 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.260168 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.260317 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92332,"prepare.queue_time_us":73270,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1127,"raft.queue_time_us":94133,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10037,"spinlock_wait_cycles":1952128,"thread_start_us":228645,"threads_started":2}
I20260709 13:07:23.395509 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:23.381075 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 189647us
I20260709 13:07:23.382519 21825 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:23.397707 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:23.377111 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.364099 27291 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:23.399281 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.403707 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:23.404507 21826 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
W20260709 13:07:23.405354 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 65201.6us
I20260709 13:07:23.404717 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:23.348658 27264 consensus_meta.cc:287] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.007s
I20260709 13:07:23.352712 27233 tablet_copy_client.cc:806] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:23.427472 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:23.365440 27226 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:23.407642 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:23.411422 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:23.332535 27128 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.436542 21833 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:23.437762 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:23.438617 21833 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.348013 26987 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.418440 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:23.420022 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:23.430394 21978 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:23.341528 27012 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:23.440874 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:23.443085 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:23.345286 27212 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.386987 27201 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:23.471992 21833 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:23.501158 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:23.363467 27270 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.477046 21831 raft_consensus.cc:2410] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:23.477451 21832 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:23.431186 27247 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:23.444605 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:23.486424 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 45011us
I20260709 13:07:23.440699 27291 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:23.346084 27257 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.487829 27233 tablet_copy_client.cc:670] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:23.412806 26877 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:23.502513 21833 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.525370 21833 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:23.440606 27153 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:23.504148 21825 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 20: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:23.496428 27082 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.440233 26851 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:07:23.495379 21830 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:23.439373 27264 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.467151 27069 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:23.519840 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:23.499050 27240 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:07:23.526084 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:23.506479 27191 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.660s	user 0.006s	sys 0.005s
I20260709 13:07:23.555187 21833 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:23.520063 27247 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:23.431053 27071 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.506029 27012 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.539805 27212 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:23.541213 27128 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:23.544600 21825 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:23.563932 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2531) took 1290 ms. Trace:
I20260709 13:07:23.564270 21825 rpcz_store.cc:276] 0709 13:07:22.273441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.543941 (+1270500us) service_pool.cc:224] Handling call
0709 13:07:23.544229 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.563683 (+ 19454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.563881 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.565675 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 681) took 1252 ms. Trace:
I20260709 13:07:23.507462 27126 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.534476 27201 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.559557 22546 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:23.565996 21825 rpcz_store.cc:276] 0709 13:07:22.313269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.564984 (+1251715us) service_pool.cc:224] Handling call
0709 13:07:23.565238 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.565388 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.565418 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.565454 (+    36us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:23.565488 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.565538 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.565623 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:23.569926 21825 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:23.571164 21825 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:23.522928 27331 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:23.566670 27147 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:07:23.566879 27126 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:23.572975 27347 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:23.583935 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2530) took 1332 ms. Trace:
I20260709 13:07:23.584467 27183 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:23.585127 27183 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:23.502970 27187 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.584321 21834 rpcz_store.cc:276] 0709 13:07:22.251273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.101318 (+850045us) service_pool.cc:224] Handling call
0709 13:07:23.101707 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:23.102118 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.102155 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:23.108892 (+  6737us) log.cc:844] Serialized 52 byte log entry
0709 13:07:23.289314 (+180422us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:23.341242 (+ 51928us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.342276 (+  1034us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.562797 (+220521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.562898 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.583704 (+ 20806us) raft_consensus.cc:1685] finished
0709 13:07:23.583727 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.583877 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1408,"prepare.queue_time_us":40844,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":10728,"raft.queue_time_us":708,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":2493,"thread_start_us":394145,"threads_started":2,"wal-append.queue_time_us":358388}
I20260709 13:07:23.586567 27187 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.586186 27183 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.587365 27183 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:23.588393 21834 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:07:23.588999 21834 pending_rounds.cc:85] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 8
I20260709 13:07:23.589354 21834 pending_rounds.cc:107] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:07:23.573912 27186 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:23.580405 27012 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:23.590834 27270 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:23.591648 21825 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:23.547577 27279 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:23.589687 21834 raft_consensus.cc:2889] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.554301 27082 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.593158 21825 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:23.596552 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.557240 26987 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:23.560817 27069 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.712667 21825 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:23.559938 27191 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.709904 21834 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:23.545718 26877 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.714313 21834 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:23.714121 21825 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:23.564250 26861 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:23.707908 27052 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:23.594781 27263 consensus_queue.cc:1175] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 14 status { last_received { term: 14 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 14 index: 8 } }
I20260709 13:07:23.749585 21909 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:23.545293 27153 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.709297 26987 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:23.737928 27013 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:23.755077 27013 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.756996 27013 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:23.763165 27156 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:23.763576 27156 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:23.763751 26993 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.764473 27156 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.765827 26877 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:23.745235 27348 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:07:23.767483 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.773036 27306 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:07:23.776782 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.777163 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.708220 27279 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.784430 27279 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:23.787559 27028 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.000s
I20260709 13:07:23.788589 27264 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:23.790643 27226 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.797798 22552 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:23.765878 27156 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:23.801100 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 245310us
I20260709 13:07:23.803253 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:23.805150 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.815100 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.815547 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.819778 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:23.823146 22555 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:23.816481 27279 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.809782 27187 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:07:23.852156 27187 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:23.852602 27187 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:23.813436 27264 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:07:23.855908 27264 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:23.856309 27264 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:23.857247 27264 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.857860 27224 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:23.778684 27247 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.816527 26987 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.873955 26958 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:23.875728 27346 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:07:23.876626 27257 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:23.877074 27288 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:23.875583 26958 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:23.878000 27288 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:23.878216 27153 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:23.879635 27265 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.909s	user 0.005s	sys 0.011s
I20260709 13:07:23.879132 27288 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.880263 27288 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:23.880039 27265 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.880417 27256 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:23.885825 27342 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.494s	user 0.000s	sys 0.007s
I20260709 13:07:23.853662 27187 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.888738 27187 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:23.888753 27224 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.892519 27264 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:23.895219 27014 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.000s
I20260709 13:07:23.882048 27265 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:23.899600 26987 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.903587 27279 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.904147 27126 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:23.905984 27226 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:23.948295 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.954603 21728 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 13 to 15, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 15 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.959177 21826 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
W20260709 13:07:23.961922 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.970969 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2523) took 1774 ms. Trace:
I20260709 13:07:23.988860 21983 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:23.994146 21979 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:23.997097 21728 catalog_manager.cc:5697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 10 to 18, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 18 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.002745 27156 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.003616 27156 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.003984 27279 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:24.005121 27279 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:23.996057 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:24.006541 26381 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:24.001201 21728 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 7 to 14, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 14 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.009557 27156 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.009748 26877 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:24.010450 27263 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.010776 27012 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.010397 26381 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.011441 27263 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.011571 27012 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.013728 26381 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.010433 26877 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:24.016357 26877 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.017773 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:24.018805 21974 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:24.021795 27279 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:24.025557 27356 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.026612 26961 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.026578 27356 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.027523 26961 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.028874 21979 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:24.029623 27356 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.030589 27367 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:24.031765 27201 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.031446 27367 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.032516 27201 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.035059 27247 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:24.036279 27279 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.036628 21977 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:24.037318 27279 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.041378 21974 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:24.014075 27012 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.014075 27263 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:24.056191 27367 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.068041 26961 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:24.040589 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 555547us
I20260709 13:07:24.067117 27279 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:24.074326 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.975754 21827 rpcz_store.cc:276] 0709 13:07:22.196389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.021494 (+825105us) service_pool.cc:224] Handling call
0709 13:07:23.021807 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.022131 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.022160 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.052293 (+ 30133us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.390084 (+337791us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:23.429418 (+ 39334us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.969356 (+539938us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b1800399880. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:07:23.969860 (+   504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.970021 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.970103 (+    82us) raft_consensus.cc:1685] finished
0709 13:07:23.970411 (+   308us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.970711 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9227,"prepare.queue_time_us":41094,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":597063,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":257,"spinlock_wait_cycles":6361344,"thread_start_us":337434,"threads_started":1,"wal-append.queue_time_us":519145}
I20260709 13:07:24.107383 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:24.107617 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:24.111430 27019 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:24.112600 27201 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:24.114439 26381 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:24.114319 27156 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:24.115068 26381 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.115569 26993 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:24.119004 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:24.119345 21974 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:24.117027 26930 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:24.124485 26930 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:24.125895 26930 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.127774 26930 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:24.115608 26381 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:24.133154 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2373) took 1865 ms. Trace:
I20260709 13:07:24.133670 21829 rpcz_store.cc:276] 0709 13:07:22.267647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.104157 (+836510us) service_pool.cc:224] Handling call
0709 13:07:23.301050 (+196893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.543877 (+242827us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:23.543921 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.543980 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:23.544034 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.544118 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.132723 (+588605us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54002882d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:24.132952 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":547768,"raft.queue_time_us":131199,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":13655,"spinlock_wait_cycles":452011904,"thread_start_us":242328,"threads_started":1}
I20260709 13:07:24.136340 21829 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 13:07:24.153802 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.154588 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47474.5us
I20260709 13:07:24.155817 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:24.158597 27369 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:24.159075 27369 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.159442 27369 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:24.169318 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 668) took 1580 ms. Trace:
I20260709 13:07:24.169888 21909 rpcz_store.cc:276] 0709 13:07:22.588363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.908480 (+320117us) service_pool.cc:224] Handling call
0709 13:07:22.908813 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.750894 (+842081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.168668 (+417774us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54002f62d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:24.169035 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933216640}
I20260709 13:07:24.171159 21980 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:07:24.172231 27187 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:24.172667 27187 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:24.173614 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:24.174360 27247 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.175246 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:24.176191 21832 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:07:24.177135 26993 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.177623 21831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2352) took 3756 ms (client timeout 1799 ms). Trace:
I20260709 13:07:24.178009 26993 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.175062 27247 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.182487 21828 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:24.183928 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2505) took 3533 ms. Trace:
I20260709 13:07:24.184530 27247 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:24.180676 26993 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.186120 27019 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:24.184283 21828 rpcz_store.cc:276] 0709 13:07:20.650580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.081851 (+1431271us) service_pool.cc:224] Handling call
0709 13:07:24.181721 (+2099870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.182941 (+  1220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.183683 (+   742us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b540008af50. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:24.183850 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4828380416}
I20260709 13:07:24.186733 27019 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:24.187157 27019 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:24.187633 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:24.189029 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:24.189363 26381 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.191461 27071 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.194432 21828 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:24.194919 27226 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:24.195732 27226 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.199151 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.199748 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:24.201354 26961 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:24.199151 27368 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:07:24.178237 21831 rpcz_store.cc:269] 0709 13:07:20.421323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.740583 (+319260us) service_pool.cc:224] Handling call
0709 13:07:24.177140 (+3436557us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b540008af54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:24.177371 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6186710912}
I20260709 13:07:24.205150 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:24.206271 27226 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:24.206732 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:24.207432 27224 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.207377 21831 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:24.208245 27224 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.209347 21831 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:24.209059 21728 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 12 to 13, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 13 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:24.213583 27264 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:24.174078 27187 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:24.210592 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.215128 27263 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:24.215691 27263 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:24.215034 21728 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 12 to 15, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 15 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:24.207185 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.217356 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.216988 27263 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.186178 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:24.220623 21826 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:24.221529 27014 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.222126 27014 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.223500 27156 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.224373 27014 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.224184 27156 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.225071 27014 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:24.226727 27013 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.226977 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.227434 27013 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.186533 26987 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:24.229825 26987 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.230859 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.231813 21907 raft_consensus.cc:2393] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 12: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:24.232239 26987 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.232599 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:24.235532 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.238451 27365 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.229920 27013 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:24.238659 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.225909 27014 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.244599 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:24.245169 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.239140 27156 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.180588 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:24.217649 21728 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.240360 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:24.247154 27365 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.241964 21908 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:24.243230 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.248739 21900 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:24.248262 21728 catalog_manager.cc:5697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 5 to 10, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 10 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:24.249899 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.242600 21903 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:24.254763 27226 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:24.255780 27263 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:24.262784 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.263571 21903 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:24.266240 21905 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:24.266602 21729 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 221) took 44993 ms (client timeout 15000 ms). Trace:
I20260709 13:07:24.267539 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.265254 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.266631 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.271034 27365 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.271972 27014 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.271780 26851 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:24.272969 26930 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:24.273447 26930 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:24.273865 26851 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:24.274258 27365 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.281678 27156 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:24.282545 26851 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:24.282356 27365 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.283061 26851 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:24.284236 26851 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.272804 27014 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:24.285820 26851 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:24.276556 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.273702 21728 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 8 to 15, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 15 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.278602 27019 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.294119 21728 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.280387 27369 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:24.267038 21729 rpcz_store.cc:269] 0709 13:06:39.273407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.273594 (+   187us) service_pool.cc:224] Handling call
0709 13:07:24.266353 (+44992759us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:14.427980 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:14.643938 (+215958us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:14.643992 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:07:14.644009 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:14.645176 (+  1167us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:14.645296 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:14.645323 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:07:14.646709 (+  1386us) tablet.cc:701] Row locks acquired
0709 13:07:14.646770 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:07:14.646969 (+   199us) write_op.cc:270] Start()
0709 13:07:14.647122 (+   153us) write_op.cc:276] Timestamp: P: 1783602434646896 usec, L: 0
0709 13:07:14.647161 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:07:14.709896 (+ 62735us) log.cc:844] Serialized 5193 byte log entry
0709 13:07:15.546805 (+836909us) op_driver.cc:464] REPLICATION: finished
0709 13:07:15.882078 (+335273us) write_op.cc:301] APPLY: starting
0709 13:07:15.882205 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:16.052288 (+170083us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:16.052429 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:17.142801 (+1090372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:17.170798 (+ 27997us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:07:17.170883 (+    85us) write_op.cc:312] APPLY: finished
0709 13:07:17.171346 (+   463us) log.cc:844] Serialized 121 byte log entry
0709 13:07:17.280678 (+109332us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:17.297250 (+ 16572us) write_op.cc:454] Released schema lock
0709 13:07:17.311976 (+ 14726us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:17.393552 (+ 81576us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:17.393585 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1330625,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":306561,"apply.run_cpu_time_us":38998,"apply.run_wall_time_us":1482472,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58389,"num_ops":13,"prepare.queue_time_us":252529,"prepare.run_cpu_time_us":61714,"prepare.run_wall_time_us":483946,"raft.queue_time_us":219893,"raft.run_cpu_time_us":7425,"raft.run_wall_time_us":299278,"replication_time_us":783568,"thread_start_us":626106,"threads_started":5,"wal-append.queue_time_us":313010,"wal-append.run_cpu_time_us":14310,"wal-append.run_wall_time_us":2511693}]]}
I20260709 13:07:24.281432 27187 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:24.284821 27365 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.279505 26381 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.288225 27224 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.290820 26930 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.292284 27264 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.293731 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.295130 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:24.295571 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:24.280488 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2375) took 2012 ms. Trace:
W20260709 13:07:24.285738 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 877967us
W20260709 13:07:24.302636 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.310068 26381 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:24.306347 26987 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:24.314069 21728 catalog_manager.cc:5697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 4 to 10, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 10 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:24.309993 21904 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:24.305665 21830 rpcz_store.cc:276] 0709 13:07:22.268346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.530815 (+1262469us) service_pool.cc:224] Handling call
0709 13:07:23.531160 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.554582 (+ 23422us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:23.571875 (+ 17293us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.143501 (+571626us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.252729 (+109228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.252810 (+    81us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:24.252893 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.280049 (+ 27156us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b54002887d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:24.280106 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.280295 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14911,"prepare.queue_time_us":34231,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":55562,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":267,"spinlock_wait_cycles":53377920,"thread_start_us":471784,"threads_started":2,"wal-append.queue_time_us":335109}
I20260709 13:07:24.318557 26987 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:24.334501 26987 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:24.335860 21798 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.325803 26930 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:24.340003 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 104689us
W20260709 13:07:24.341915 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 46541.9us
I20260709 13:07:24.345975 27019 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.319689 27264 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.348418 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 680) took 2035 ms. Trace:
I20260709 13:07:24.334381 26993 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:24.353569 21904 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:24.348924 21833 rpcz_store.cc:276] 0709 13:07:22.312965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.555771 (+1242806us) service_pool.cc:224] Handling call
0709 13:07:23.556058 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:24.062388 (+506330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.064072 (+  1684us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.102776 (+ 38704us) log.cc:844] Serialized 52 byte log entry
0709 13:07:24.331281 (+228505us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:24.331325 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.333908 (+  2583us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.347954 (+ 14046us) raft_consensus.cc:1685] finished
0709 13:07:24.347983 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.348206 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":418421,"raft.queue_time_us":458857,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":146,"thread_start_us":218862,"threads_started":2,"wal-append.queue_time_us":225442}
I20260709 13:07:24.336715 21728 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.358856 27019 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:24.361130 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.358381 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.366556 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:24.369616 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.370525 27369 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.371644 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.372574 27369 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:24.374464 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.377128 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.361618 26993 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:24.382007 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.386296 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.388304 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.379539 27264 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:24.392410 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.390380 21728 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:24.395143 27019 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:24.396840 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.401453 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:24.399130 27264 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:24.405961 22552 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:07:24.407316 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.411065 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:24.411954 21978 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:24.412596 27226 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.412645 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:24.413458 21980 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:24.413298 27226 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.414777 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:24.415580 26993 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.416402 27226 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.399044 27019 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.422456 26381 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:24.422545 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:24.423413 21982 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:24.423277 26381 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.424209 27019 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.411098 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:24.436363 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:24.437574 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.439466 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.441115 21903 raft_consensus.cc:2410] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 20 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:07:24.441566 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:24.442540 21982 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:24.446786 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.452425 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.456915 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:24.458882 27247 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:24.459328 27247 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.459738 27247 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:24.460988 27071 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:24.462286 27071 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:24.462863 27071 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:24.464133 27071 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.465708 27071 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:24.466960 27378 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:07:24.468154 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 89248.2us
W20260709 13:07:24.462463 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.453949 21908 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
W20260709 13:07:24.475628 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.475843 27379 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:07:24.476292 26381 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.445629 27019 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:24.485934 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:24.487293 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:24.489400 26851 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:24.489923 27019 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.490460 27019 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.492658 27019 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.489938 26851 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.497712 21982 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:24.499035 26851 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.503929 27369 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.504719 27369 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:24.505561 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.502020 21975 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:24.511277 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:24.512050 22551 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:24.513092 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2395) took 1107 ms. Trace:
I20260709 13:07:24.513546 21831 rpcz_store.cc:276] 0709 13:07:23.405643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.210063 (+804420us) service_pool.cc:224] Handling call
0709 13:07:24.219749 (+  9686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.220460 (+   711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.220504 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.220989 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.333146 (+112157us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:24.352428 (+ 19282us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.358308 (+  5880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.358382 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.512835 (+154453us) raft_consensus.cc:1685] finished
0709 13:07:24.512863 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.513023 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7400,"prepare.queue_time_us":19127,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":6317,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":212,"thread_start_us":111128,"threads_started":1,"wal-append.queue_time_us":159510}
I20260709 13:07:24.530715 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:24.532938 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50659.1us
I20260709 13:07:24.524317 26877 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:24.537220 21904 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
W20260709 13:07:24.572736 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 165804us
I20260709 13:07:24.578428 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:24.574528 26930 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.579129 21833 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:24.579427 26930 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.584296 27369 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.584929 21829 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:24.588496 27264 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:24.589140 27264 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.589432 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.574630 21904 pending_rounds.cc:85] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 13
I20260709 13:07:24.594019 26930 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.601591 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:24.604732 21829 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:24.597555 21904 pending_rounds.cc:107] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:07:24.607223 21904 raft_consensus.cc:2889] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.618054 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:24.622959 27351 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:24.626361 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:24.631008 22546 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:24.632330 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:24.634730 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:24.635607 21832 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:24.637512 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.641307 26993 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.642091 26993 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.650305 26993 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.666472 27263 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:24.667454 27263 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:24.668217 27201 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.668766 27201 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.668926 27263 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.671840 27201 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:24.673425 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.675768 21907 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:24.675040 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:24.677150 22551 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:24.678375 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:24.679168 22546 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:24.680454 22520 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:24.681449 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 80777.7us
I20260709 13:07:24.682034 27226 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:24.682520 27226 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.682590 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.683005 27226 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:24.686987 27264 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.687960 27264 raft_consensus.cc:2764] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260709 13:07:24.688653 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 66870.2us
I20260709 13:07:24.699416 21874 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:24.700433 26381 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:24.596434 26877 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:24.690887 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.700944 26381 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:24.691500 27381 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:07:24.706755 27189 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:24.691910 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.687479 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.707404 27189 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:24.696892 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 179491us
I20260709 13:07:24.697790 21833 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:24.701504 26381 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:24.730510 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.730391 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:24.735788 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 146727us
I20260709 13:07:24.736359 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.737874 21909 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:24.738463 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.669992 27247 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.752880 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.739070 21900 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:24.758567 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:24.758491 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.760509 21905 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:24.731134 27071 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:24.762257 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:24.763911 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.759527 21908 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:24.728715 26851 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:24.760673 27233 tablet_copy_client.cc:538] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:24.721377 26987 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:24.775831 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 61238.9us
I20260709 13:07:24.772372 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.765501 27013 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.764458 27351 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:24.764853 27071 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:24.807348 27314 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:07:24.810217 27256 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:24.808983 27013 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:24.816061 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49098us
I20260709 13:07:24.816910 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.817600 27013 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.818395 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:24.787263 27279 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:24.821565 27369 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:24.808804 27071 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:24.778152 26851 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.830262 27256 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:24.819481 27189 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:24.851891 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:24.852728 21908 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
W20260709 13:07:24.854525 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.856263 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:24.862025 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:24.820056 27187 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:24.812520 27351 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:24.865830 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47507.8us
I20260709 13:07:24.865799 27156 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:24.870534 27156 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.870841 26851 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.871390 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:24.872991 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:24.873730 27014 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:24.874215 27014 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.874344 27365 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:24.875888 27365 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:24.820582 27390 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:07:24.878791 27247 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:24.870952 27156 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:24.883121 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:24.883805 22546 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:24.882107 27351 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.884872 27351 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:24.885214 27351 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.885558 27351 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:24.887042 26877 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.889067 27156 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:24.891381 27156 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:24.874639 27014 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:24.904227 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:24.870883 27389 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:07:24.869428 21908 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:24.902436 21906 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:24.906020 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:24.914081 26381 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.923863 26381 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:24.929831 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:24.923659 26851 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:24.968998 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 187887us
I20260709 13:07:24.974203 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:24.977263 22551 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.927313 27226 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:24.963075 27263 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:24.983506 21875 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 2.109s (SENT) [suppressed 10 similar messages]
I20260709 13:07:24.968634 26851 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:24.999423 22552 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:24.975069 26987 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:24.996134 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:25.015744 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 133046us
I20260709 13:07:25.017342 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:25.018777 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:25.019369 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 144869us
I20260709 13:07:25.020785 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.008392 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:25.030982 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.032368 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:25.034987 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.000517 27279 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:25.036118 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.038939 21975 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:25.040527 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.004619 27263 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.039255 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.051148 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.026779 27256 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:25.036645 27189 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:25.035979 27187 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.042547 27314 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:25.063360 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.061102 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.064057 21980 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:25.064248 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.055564 27019 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:25.037016 26877 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:07:25.057827 27256 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.056538 27156 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:25.059734 26993 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:07:25.054702 27400 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:25.072043 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.076503 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:25.078174 26987 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:25.078079 27279 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.071283 27187 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.061465 27264 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:25.084404 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.084340 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.085487 21974 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:25.085410 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:25.087213 21982 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:25.088181 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:25.105072 27082 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:25.105515 27082 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.105896 27082 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.107374 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.108623 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.109683 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.105089 27401 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:25.063730 26851 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.110430 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.111100 21977 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:25.111984 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.113062 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.109769 27365 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:25.114265 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 68919.3us
W20260709 13:07:25.087908 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 63853.3us
I20260709 13:07:25.113848 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.115715 21981 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:25.123908 21977 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:25.075515 27256 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.073031 27019 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:25.104830 21975 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.148532 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:25.086547 26987 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:25.104704 27264 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:25.151515 26987 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.152663 27397 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:25.152981 27314 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.151391 21983 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:25.118362 27226 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.165650 21974 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.171859 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:25.225114 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54155.6us
W20260709 13:07:25.225731 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.227316 21980 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:25.228307 27405 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:07:25.230381 27393 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.261s	user 0.002s	sys 0.000s
W20260709 13:07:25.230542 27392 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 13:07:25.234391 21875 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.799s (SENT)
W20260709 13:07:25.235118 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 86655.8us
I20260709 13:07:25.149199 27369 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:25.164211 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.236847 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:25.237969 21906 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:25.164395 27264 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:25.180994 27394 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:07:25.239125 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:25.239951 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.245062 21975 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:25.150112 27401 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:25.149081 27019 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:25.241245 27233 tablet_bootstrap.cc:492] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:07:25.251099 27082 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.252995 22551 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:25.246284 27403 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:25.254374 27399 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:07:25.243453 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 183072us
I20260709 13:07:25.258231 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.260684 27247 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:25.261119 27247 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:25.264462 27369 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:25.265643 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 85729.1us
I20260709 13:07:25.265618 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.263142 21976 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:25.268249 27189 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:25.271118 27189 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.271435 27395 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:25.272320 27399 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:25.253728 27014 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.274451 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.281952 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:25.233770 27314 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.233209 27397 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.280376 27187 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.244549 27400 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:07:25.292694 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.298424 27082 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:25.299590 27014 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:25.299767 27256 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.301721 27256 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:25.303452 27314 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:25.306555 27247 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.307672 21974 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:25.307730 27247 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.309319 27071 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.310454 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.324713 21832 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:25.325577 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.326113 21832 raft_consensus.cc:2376] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15. Re-sending same reply.
I20260709 13:07:25.326858 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.327476 21832 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:25.327950 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.328233 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.328663 21827 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.328941 21832 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:25.329727 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.311149 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.330555 21826 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:25.330772 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.331247 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.331377 21907 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:25.331825 21826 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:25.332602 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.333097 21826 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:25.333676 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:25.334491 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:25.335009 21905 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.338817 21833 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:25.313937 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.339946 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.340108 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.340587 21828 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:25.341061 21833 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:25.341346 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.314839 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.333847 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.312633 27264 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.326902 21831 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:25.319145 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.341965 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.427958 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.428567 21833 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:25.429096 27388 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:25.429561 27388 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:25.380201 27391 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.160s	user 0.003s	sys 0.007s
I20260709 13:07:25.429949 27388 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.359331 27187 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.350687 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.437954 27388 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:25.439091 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 105550us
I20260709 13:07:25.440021 27388 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.441433 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:25.354207 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.464490 21827 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:25.349715 27351 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.286497 27263 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:25.475402 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.343752 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.345312 27369 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:25.350080 27403 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.282796 27399 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:25.441829 27071 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.341918 21828 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.442330 27187 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.443368 21982 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:25.443586 27402 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.353724 21905 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
W20260709 13:07:25.492772 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 173704us
I20260709 13:07:25.445433 21834 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:25.447813 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:25.343369 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 65805.1us
I20260709 13:07:25.377516 21906 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:25.443701 27189 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.465548 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.465795 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.475781 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:25.476325 21829 raft_consensus.cc:2376] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15. Re-sending same reply.
I20260709 13:07:25.390331 27397 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:25.359740 27390 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:25.504891 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 57183.1us
I20260709 13:07:25.505208 27390 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.506851 27082 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:25.507381 27082 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:25.507989 27390 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.508262 27082 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.375020 27156 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:25.488281 21874 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.509732 27156 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:25.444233 27264 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:25.444748 21826 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.494659 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.497772 21907 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:25.498034 21909 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.483064 27369 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.346719 27401 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.493492 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.469020 27388 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.483678 27256 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:25.470470 27247 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:25.490881 27399 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.523082 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:25.525301 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 250175us
I20260709 13:07:25.492877 26993 raft_consensus.cc:2764] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:07:25.528261 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:25.528754 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 79882.7us
I20260709 13:07:25.530292 26381 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:25.530606 26381 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.530869 26381 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.529762 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:25.517972 27014 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:25.518342 27369 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.537266 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:25.537917 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.540438 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.541072 21907 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
W20260709 13:07:25.542341 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 47786.5us
I20260709 13:07:25.542944 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.528827 27071 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:25.546864 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:25.551405 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.552193 21983 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:25.553789 27406 raft_consensus.cc:2764] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:25.553884 27413 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:25.522377 27156 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.556232 27409 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:25.556620 27409 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:25.557116 27409 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:25.557610 27156 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:25.503159 27402 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.517480 27403 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.561547 27402 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.563170 27403 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.528075 27399 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:25.570712 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 129371us
I20260709 13:07:25.524708 27388 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.527427 27226 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:07:25.574707 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:25.577353 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:25.579504 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.579676 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.580472 21907 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:25.582383 27422 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:25.582913 27422 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:25.583743 27422 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.584785 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.585425 27403 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:25.585561 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.585811 27403 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.586344 27390 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:25.586696 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.587618 27390 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:25.588058 27390 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.588474 27390 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:25.594125 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.596968 27411 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:25.548422 27071 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:25.567004 27397 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.531373 27256 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:25.566614 27365 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.603717 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.611238 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.587132 27403 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:25.615067 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.626004 26381 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.596472 27400 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.630885 21908 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:25.633869 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.634610 21831 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:07:25.602155 27314 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:25.610631 27071 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.659479 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.660068 21832 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:25.666015 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:25.666887 22549 raft_consensus.cc:2368] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:25.667342 27256 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:25.668025 27187 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.628161 27156 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:25.673568 21827 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:25.674573 27187 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:25.674986 27263 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:25.675187 27264 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.673005 27014 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:25.675748 27396 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:25.651605 27314 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:25.637300 27400 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:25.700891 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.676693 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.675783 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:25.678656 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 82289.7us
I20260709 13:07:25.627985 27365 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:25.683403 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 189975us
I20260709 13:07:25.705425 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:25.683501 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.684423 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.687548 21982 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:25.706229 21834 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:25.675858 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.568797 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:25.707106 21974 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:25.688061 21909 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:25.618852 27013 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:07:25.696610 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:25.617923 27397 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.701494 21983 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
W20260709 13:07:25.672663 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 54802.2us
I20260709 13:07:25.712898 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:25.713511 22551 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:25.706264 21827 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:25.708760 21975 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:25.675307 26381 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:25.703441 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:25.714039 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 58154.6us
I20260709 13:07:25.714954 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.716370 21977 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.720816 22551 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:07:25.721954 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:25.722966 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.723575 21827 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.728086 21977 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:25.729607 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.729781 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.679680 27156 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:25.647594 26987 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.737473 21902 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:25.736562 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.737366 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.739543 21976 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:25.747175 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.747875 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.747954 21833 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.748430 21829 raft_consensus.cc:606] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.748876 21829 raft_consensus.cc:614] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:25.748992 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 92896.9us
I20260709 13:07:25.747627 26381 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:07:25.749850 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:25.753203 21827 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:25.754066 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:25.754354 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:25.754637 21903 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:25.704770 27400 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.755354 21906 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:25.763790 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.765441 22551 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:25.710104 27247 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.703075 27396 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:25.764379 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:25.770087 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 64745.4us
I20260709 13:07:25.772264 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:25.743521 27431 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:25.773175 27431 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:25.773175 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 60090.5us
I20260709 13:07:25.773708 27431 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.730607 27351 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:25.774698 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:25.774766 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.688715 27226 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:07:25.741797 27156 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.687700 27264 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.777915 21827 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:25.777228 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.689287 27187 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.782519 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.794561 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:25.782809 27396 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.785017 21828 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:25.800817 21827 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:25.801609 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.767310 27189 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.802238 21827 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:25.787504 21903 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:07:25.702382 27263 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.791924 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:25.786319 21978 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:25.763834 27425 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:25.777833 26877 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:25.812580 21976 raft_consensus.cc:2393] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:25.788395 27256 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:25.810351 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.900010 27187 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.860177 21834 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:25.990923 27415 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.417s	user 0.000s	sys 0.002s
I20260709 13:07:25.894479 27388 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.802881 27247 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:25.858366 27437 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.812858 27425 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:25.879169 27397 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:25.860100 21827 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:26.095058 21976 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:25.896461 21832 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:25.870517 27279 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:25.922405 21975 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:25.867563 27404 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:25.854995 27420 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:07:25.863168 27423 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:25.916729 27314 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:25.862841 27424 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:25.888756 27390 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.016597 21833 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:26.075073 27187 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:25.880781 27263 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:25.874543 21901 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:25.932556 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.094525 27425 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.885748 21826 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:25.810340 27409 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:25.867183 27418 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:07:25.874603 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:26.124485 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 249960us
I20260709 13:07:25.896199 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.126557 21830 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:25.875516 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.889225 27264 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.008953 27434 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:07:25.864262 27411 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:25.870399 27428 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:25.796900 27351 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:25.893338 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:25.890383 26987 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:26.077343 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 303143us
I20260709 13:07:26.066402 27406 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:26.098207 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 382757us
I20260709 13:07:26.103474 21827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
W20260709 13:07:26.105247 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 313372us
I20260709 13:07:26.105893 27404 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.107136 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:25.886962 27019 consensus_meta.cc:287] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.000s
I20260709 13:07:26.149362 27019 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.151590 27019 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.152027 21827 raft_consensus.cc:606] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.152403 21827 raft_consensus.cc:614] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:26.138768 26877 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:26.153160 26381 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:26.153541 26381 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:26.153956 26877 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.155424 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:26.156939 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:26.157693 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:26.158279 27429 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:26.158911 27449 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:26.159282 27449 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.159600 27449 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.160597 27189 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:26.161010 27189 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.161350 27189 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.020298 27431 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.163744 27431 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.104674 27279 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.114648 27444 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.173926 26987 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:26.174198 27444 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.174650 26987 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.176323 27444 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.177064 26987 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.177901 27409 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.115188 27413 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:26.116266 27390 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.116645 27395 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.179261 27413 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.179631 27395 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.179986 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.180591 21905 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:26.181239 27413 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.181408 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.181720 27395 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.182066 21904 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:26.146765 27406 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:26.182714 27406 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.122694 27187 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.142840 27422 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:07:26.186643 27071 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:07:26.186743 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.187227 27071 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.189508 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.191028 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.191711 21983 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.094754 27437 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.196178 27437 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:26.197062 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58903.8us
I20260709 13:07:26.198256 27447 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:26.200009 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:26.072575 27156 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.118419 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.128954 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:26.117889 27399 consensus_meta.cc:287] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.000s
I20260709 13:07:26.111377 27423 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:26.163868 26993 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:26.139323 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.140941 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.145722 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:26.134922 27351 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.094954 27400 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.147164 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.221815 27189 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.222622 21908 raft_consensus.cc:2368] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14.
I20260709 13:07:26.148600 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.223598 21901 raft_consensus.cc:2410] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:07:26.223781 27189 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.224347 21981 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.224857 27446 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:26.224673 27423 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.225368 27446 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.226696 27247 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.227448 27071 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.227491 27446 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.228907 27450 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:26.148670 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.229374 27450 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:25.779661 27014 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.211957 27264 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:26.230729 27264 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:26.231344 27450 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.231637 27264 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.171408 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:26.232617 27421 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:26.233153 27421 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.211719 27013 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:26.234726 27013 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.235239 27421 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.134290 27432 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:26.236179 27432 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:26.236577 27432 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.236775 27013 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.237294 27351 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.239437 27156 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.212255 27399 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.135279 21829 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:26.241955 27399 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:26.164330 27369 consensus_meta.cc:287] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 13:07:26.159606 27429 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:26.202718 27019 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.242945 27369 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.243420 27019 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.146309 21834 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:26.208707 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.210911 21976 raft_consensus.cc:2368] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:07:26.208024 26993 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:26.214600 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:26.206367 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 77491.9us
I20260709 13:07:26.215148 27279 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:26.249646 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 108813us
I20260709 13:07:26.250108 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.232757 21909 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.247473 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.216092 27404 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.185978 27187 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.249148 21825 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:26.216373 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.212986 26381 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.250905 21907 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:26.255553 27224 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:26.255918 27082 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:26.256634 27082 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:26.257014 26993 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.255960 27224 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.258675 27224 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.257555 27082 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.264632 21981 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:26.223639 27400 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.278062 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:26.203871 27365 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.280731 21983 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:26.288067 21909 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
W20260709 13:07:26.292514 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 88403.2us
W20260709 13:07:26.298105 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50699.2us
I20260709 13:07:26.302206 21833 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:07:26.301750 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 90577.8us
I20260709 13:07:26.303068 21976 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:26.250322 27396 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:26.307283 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.310418 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.311343 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.299558 27411 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:26.301944 27187 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:26.300135 27369 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.306681 27013 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.264392 27449 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.308696 27156 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.335568 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 196305us
I20260709 13:07:26.342464 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.336141 21983 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:07:26.323805 27403 consensus_meta.cc:287] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.000s
I20260709 13:07:26.341270 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.310879 27400 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:26.344820 21976 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:26.345713 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:26.346383 21829 raft_consensus.cc:606] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:26.346757 21829 raft_consensus.cc:614] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:26.346748 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.349299 27449 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.350584 27019 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:26.351770 21875 leader_election.cc:336] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.512s (SENT)
I20260709 13:07:26.352276 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:26.352058 27432 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.352725 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:26.354658 27014 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:26.357329 27428 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:26.357713 27428 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:26.358124 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.312681 27396 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:26.361756 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57319us
I20260709 13:07:26.383172 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.383981 21834 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:26.386613 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.387338 21983 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:26.386642 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.390712 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.391657 21827 raft_consensus.cc:2368] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15.
I20260709 13:07:26.392944 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.347292 27156 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.397099 27369 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:26.397801 27019 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:26.385004 27443 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:26.398452 27019 consensus_queue.cc:1243] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:26.399655 27396 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.373584 27411 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:26.344985 27187 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:26.367797 27445 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:07:26.400913 27187 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.402704 27404 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:26.403092 27404 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.403431 27404 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.404335 27156 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.324738 27454 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:07:26.411078 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.346293 27400 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.415410 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.416329 21976 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:26.417872 21982 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:26.419056 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.419247 21833 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.421734 21983 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:26.419919 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.375276 27432 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.423067 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.445416 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.445133 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.423756 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.461995 21829 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
W20260709 13:07:26.423013 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 63469.4us
I20260709 13:07:26.465255 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.447172 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.423784 26381 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.461948 21830 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.466832 21825 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:26.446803 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.430907 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.471765 21980 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:26.467947 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.468930 21982 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:07:26.431488 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.359258 27403 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.341780 27013 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.475107 21983 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.470233 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.478081 21833 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:26.478324 27456 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:26.424162 27400 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:26.479422 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 48630.4us
W20260709 13:07:26.481949 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 60270.1us
I20260709 13:07:26.365690 27425 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.407346 27444 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:26.358680 27428 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.490458 21798 leader_election.cc:400] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:07:26.490765 21798 leader_election.cc:403] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:26.492090 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.492965 21827 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 12.
I20260709 13:07:26.464109 27369 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:26.489491 21949 leader_election.cc:400] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15.
I20260709 13:07:26.494302 21949 leader_election.cc:403] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.494445 21980 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:26.494772 21975 raft_consensus.cc:2368] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:07:26.489691 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.495088 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.495332 21979 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.467752 27429 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:26.504884 21974 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:26.493188 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:26.507517 21949 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.507795 21829 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.508445 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.508746 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.506893 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.482098 27423 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:26.547888 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.509682 26381 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:26.553486 21979 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:26.559404 26381 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:26.489532 27399 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:26.515565 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.527333 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:26.514006 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:26.550818 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 43994.3us
I20260709 13:07:26.560293 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:26.559823 26381 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.561687 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:26.577375 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.577831 21903 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.562047 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:26.563791 27425 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.564049 26987 raft_consensus.cc:2764] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:07:26.564797 27459 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:07:26.598122 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.599946 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.600693 21980 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:26.566568 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:26.494294 27369 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:26.569991 21983 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:26.589609 27263 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.607448 21980 pending_rounds.cc:85] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 5
I20260709 13:07:26.617201 21980 pending_rounds.cc:107] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:26.588833 21903 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:26.617497 21980 raft_consensus.cc:2889] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.505534 27422 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.590670 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.618633 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.618834 21976 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:26.619118 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:26.571260 27437 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:26.514375 27449 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
W20260709 13:07:26.602506 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 75241.9us
I20260709 13:07:26.620553 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:26.622025 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:26.619192 21825 raft_consensus.cc:2376] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12. Re-sending same reply.
I20260709 13:07:26.510031 27411 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:26.609454 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.605240 21830 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:26.606128 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.512230 26993 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:26.579217 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.556332 27071 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:26.510344 27247 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:26.593415 27314 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:26.617949 26381 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.629801 21978 raft_consensus.cc:2393] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:26.630740 27454 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:07:26.634369 27429 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.636227 27013 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.557725 27264 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:07:26.615680 27428 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.601114 27443 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.589970 26877 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:26.641533 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.644713 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.663929 21834 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:26.606914 27462 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:26.648113 26381 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.618057 27279 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:26.667750 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.668361 21830 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:26.655215 27399 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:26.658594 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.671881 21825 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.638571 27247 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.617372 27156 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:26.643940 27071 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.640682 27014 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:26.695045 27014 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:26.696270 27014 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.644279 27397 raft_consensus.cc:2764] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:07:26.644454 27082 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:26.671211 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:26.699040 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 77112.2us
I20260709 13:07:26.682512 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.670199 26877 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.664708 27443 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.706303 21903 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:26.706436 27443 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.625427 27263 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.706712 27396 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:26.706776 27082 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:26.707360 27396 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.707996 27082 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.709486 27445 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:26.709688 27403 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.709981 27445 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:26.681978 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.697417 27224 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.650547 27411 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.704530 27413 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.708509 27263 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.672740 27462 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:26.707010 21830 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:26.690335 27247 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.701930 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:26.715478 21825 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:26.735687 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.736639 21825 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:26.720219 21834 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
W20260709 13:07:26.730670 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 48762.5us
I20260709 13:07:26.737555 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.660346 27406 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.711418 27071 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:26.711769 27156 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:26.740442 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.745527 21978 raft_consensus.cc:2368] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:07:26.745131 27156 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.751456 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.753706 21906 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:26.745453 27263 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.758774 27468 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:07:26.761128 27450 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:26.760913 27400 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.762344 27399 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.765062 27156 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.767717 27156 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.774344 26877 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.778290 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:26.778614 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.779764 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.780474 21825 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:26.781288 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.782968 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:26.787009 27351 consensus_meta.cc:287] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:07:26.787436 27351 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.789502 27351 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.790735 21832 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:26.793080 27411 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.778308 27462 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.792747 21903 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:26.797220 22546 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:26.798156 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.798852 21828 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:26.799521 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.800000 21828 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:26.800665 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.801260 21828 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:26.804396 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.804939 21827 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.805315 27445 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.807274 27404 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.807858 27369 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.808816 27369 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.809784 27406 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:26.812151 27469 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.182s	user 0.000s	sys 0.002s
I20260709 13:07:26.738942 27413 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.814471 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.815666 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.815995 27413 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.816651 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.817678 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.818648 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.819130 21830 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:26.819845 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.734697 27443 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:26.822647 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.820343 21830 raft_consensus.cc:2376] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15. Re-sending same reply.
I20260709 13:07:26.831760 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.829156 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.832118 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.833040 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.833633 21798 leader_election.cc:400] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:07:26.833927 21798 leader_election.cc:403] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.838781 21827 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:26.840162 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.841650 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.842530 21909 raft_consensus.cc:2410] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:07:26.842675 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:26.845165 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:26.845403 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 143571us
I20260709 13:07:26.845795 21826 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:26.846187 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:26.825243 21829 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:26.826237 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.848140 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.848677 21903 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:26.848882 21909 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:26.826853 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.827014 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:26.850078 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:26.801887 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.850783 21901 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:26.851302 21828 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:26.850795 21974 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:26.852308 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:26.855072 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:26.857653 21900 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:26.861492 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:26.830747 27233 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:07:26.862461 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:26.862010 21827 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:26.865651 21830 pending_rounds.cc:85] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 8
I20260709 13:07:26.867808 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:26.844002 27413 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.871398 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:26.874816 21979 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:26.873771 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:26.875967 22552 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:26.877241 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:26.879456 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:26.861467 26987 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:26.884639 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:26.863400 27351 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.758806 27263 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.871628 27448 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:26.866151 21830 pending_rounds.cc:107] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 12.9
I20260709 13:07:26.902348 21830 raft_consensus.cc:2917] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Aborting config change with OpId 12.9: Aborted: Op aborted by new leader
I20260709 13:07:26.902843 21830 raft_consensus.cc:2889] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.883227 27434 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:26.871320 27454 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:07:26.876565 27435 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:07:26.876761 27314 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 13:07:26.916882 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 339611us
I20260709 13:07:26.893369 27473 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:26.881019 27413 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:26.917865 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 71793.3us
I20260709 13:07:26.918805 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.922482 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:26.903725 26987 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:26.924996 27264 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:26.925949 27263 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.926465 27437 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:26.929683 21948 leader_election.cc:400] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14.
I20260709 13:07:26.930016 21948 leader_election.cc:403] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.930604 27264 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14.
I20260709 13:07:26.932521 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:26.935266 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:26.935880 27264 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:26.936522 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:26.938597 27247 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.934248 27224 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.941063 21832 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:07:26.944288 27400 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.945269 27404 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.948642 21825 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:26.950471 27247 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.954092 27463 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:26.954520 27463 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:26.955542 27473 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:26.955341 27463 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.955960 27473 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:26.956367 27463 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:26.956511 27071 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.961649 26987 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:26.962682 21981 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 13: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:26.965462 27351 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:07:26.949915 27413 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:26.969148 21832 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:26.971879 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52668 (request call id 18) took 10367 ms. Trace:
I20260709 13:07:26.973047 27422 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 14. Current term is 15.
I20260709 13:07:26.974802 27071 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:26.976379 21826 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:26.980988 27473 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:26.986413 27473 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:26.978070 21834 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:26.972426 21830 rpcz_store.cc:276] 0709 13:07:16.557389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.557502 (+   113us) service_pool.cc:224] Handling call
0709 13:07:16.660077 (+102575us) log.cc:844] Serialized 506 byte log entry
0709 13:07:16.961035 (+300958us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b540026df20. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef57142 00007fb75ef37eaa 00007fb75ef3ed53 00007fb75ef3ecd9 00007fb75ef3ec69 00007fb75ef3ec31 00007fb75ef3ddfd 000000000038f354 000000000038f199 00007fb75bef1475
0709 13:07:17.181948 (+220913us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18004bcbe0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e6a0a 00007fb75d8e6693 00007fb75d8e6631
0709 13:07:17.238809 (+ 56861us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b2c000014c8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e6a0a 00007fb75d8e6693 00007fb75d8e6631 00007fb75f01ab52 00007fb75f01acf5 00007fb75ef57691 00007fb75ef37eaa 00007fb75ef3ed53 00007fb75ef3ecd9 00007fb75ef3ec69
0709 13:07:17.335257 (+ 96448us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b180020c460. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75f01ad01 00007fb75ef57691 00007fb75ef37eaa 00007fb75ef3ed53 00007fb75ef3ecd9 00007fb75ef3ec69 00007fb75ef3ec31 00007fb75ef3ddfd 000000000038f354 000000000038f199
0709 13:07:17.338998 (+  3741us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b180020c460. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75f01ad01 00007fb75ef57691 00007fb75ef37eaa 00007fb75ef3ed53 00007fb75ef3ecd9 00007fb75ef3ec69 00007fb75ef3ec31 00007fb75ef3ddfd 000000000038f354 000000000038f199
0709 13:07:17.470975 (+131977us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4c003d6f40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d2aaa20 00007fb75d2bba29 00007fb75d2bc13f 00007fb75d2802ab 00007fb75d2adf3c 00007fb75d2ae3fe 00007fb75d53b50b 00007fb75ef3a381 00007fb75ef3826b 00007fb75ef3ed53 00007fb75ef3ecd9
0709 13:07:26.920321 (+9449346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6287,"raft.queue_time_us":42574,"raft.run_cpu_time_us":14696,"raft.run_wall_time_us":1480430,"spinlock_wait_cycles":1500517248,"thread_start_us":226912,"threads_started":2,"wal-append.queue_time_us":164249,"wal-append.run_cpu_time_us":2850,"wal-append.run_wall_time_us":1101711}
W20260709 13:07:27.001802 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 134913us
W20260709 13:07:27.011596 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 154815us
W20260709 13:07:27.013752 27471 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260709 13:07:27.016201 21827 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:27.016708 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:27.017369 21980 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:27.018044 21825 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:27.021129 27434 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:27.022086 27434 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:27.024972 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 102548us
I20260709 13:07:27.025588 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:27.025907 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:27.031282 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:27.016201 27467 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.439s	user 0.008s	sys 0.000s
I20260709 13:07:27.035617 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:27.039448 21825 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:27.010473 26877 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:27.037285 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:27.038502 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:27.043310 21834 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.034811 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:27.036496 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:27.033113 27397 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:27.041993 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:27.043376 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:27.044127 21829 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.048995 21832 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.040457 21974 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:07:27.046850 21948 leader_election.cc:400] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:27.046804 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:27.052985 21833 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:27.048260 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 167451us
I20260709 13:07:27.055531 21948 leader_election.cc:403] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:07:27.055832 22555 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:07:27.060266 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.066274 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.117339 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:27.118186 21825 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:27.134663 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 68532.9us
W20260709 13:07:27.136901 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 94237.6us
I20260709 13:07:27.139649 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.040494 27351 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.138410 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 79935us
I20260709 13:07:27.039870 27406 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:27.147073 21832 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
W20260709 13:07:27.116459 27233 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:27.141482 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:27.049424 27400 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:27.040104 27481 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:07:27.163810 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:27.158505 27429 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:07:27.050833 27444 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:27.161012 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:27.151857 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 126342us
I20260709 13:07:27.171680 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:27.172293 21832 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:27.172636 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:27.153556 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 126045us
I20260709 13:07:27.125797 27397 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:27.151678 27082 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:27.125289 27437 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:27.158757 27019 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:27.229656 27014 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:27.170356 27481 consensus_queue.cc:1243] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:27.232020 21974 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:27.163169 26987 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:27.259219 27452 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:07:27.261092 27464 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.261624 27464 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:27.263872 27464 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:27.235461 27448 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:27.232745 21829 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:27.233597 21834 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:27.234428 21833 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
W20260709 13:07:27.236893 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 64576us
W20260709 13:07:27.242015 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 81112.7us
I20260709 13:07:27.242686 27071 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:27.245873 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 2705e36077094db8a03a8b3e606284be: Aborted: Op aborted by new leader
I20260709 13:07:27.158612 27404 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:27.172379 27422 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:27.170933 27406 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:27.367117 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:27.370893 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:27.352140 21907 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:27.353575 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:27.183729 27400 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:27.255084 21825 raft_consensus.cc:2468] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:27.235141 27224 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:27.295969 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:27.156798 27351 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:27.250749 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 74922.3us
I20260709 13:07:27.253038 27019 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:27.328222 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:27.405265 21909 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:27.328333 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:27.403330 21907 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:27.374505 21902 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:27.330473 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:27.335521 21901 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:07:27.315693 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.406833 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:27.409727 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 113853us
I20260709 13:07:27.408041 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:27.411249 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:27.409865 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:27.412187 21908 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:27.413546 21900 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:27.415208 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:27.413911 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.416188 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:27.416646 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:27.417419 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:27.417526 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:27.360872 27428 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:27.370497 27422 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.419106 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:27.419710 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:27.464493 21977 raft_consensus.cc:2368] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:27.419704 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:27.268047 27448 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:27.472574 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53523.4us
I20260709 13:07:27.476943 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:27.420351 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:27.503068 27443 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:27.504968 27448 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:27.505208 27395 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:27.505679 27395 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.420492 27369 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:27.412765 27452 raft_consensus.cc:2764] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:07:27.509486 21901 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:07:27.509495 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:27.503103 27434 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:27.511307 27434 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.511739 27434 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:27.513165 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:27.422381 27409 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:07:27.514920 27487 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:07:27.514869 27019 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:27.529336 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:27.506031 27395 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:27.512683 27233 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:07:27.529393 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:27.518750 27493 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:07:27.506835 26877 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:27.474141 27422 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.600164 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:27.513728 27454 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:27.576014 21900 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.601046 21905 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:27.510520 27369 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.583513 27396 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:27.410571 27397 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:27.588896 27400 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:27.471374 27444 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:07:27.598492 21908 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:27.521680 27406 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:27.522466 27413 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:27.473802 27428 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:27.523572 27409 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:27.608295 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 192128us
I20260709 13:07:27.574764 27411 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:27.578675 27425 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:27.615272 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 201424us
I20260709 13:07:27.608803 27019 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:27.604111 27369 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.618793 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.603279 27454 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:27.620756 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.633383 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:27.614719 27014 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.615556 27413 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:27.619310 27409 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:27.642287 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:27.643061 21983 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:27.644521 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:27.645277 21906 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.644851 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:27.634931 27454 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:27.647938 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet 96da242efa5849aab4168785047cff48: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:27.648666 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:27.641335 27233 tablet_bootstrap.cc:492] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:27.656296 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.656759 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:27.642195 27413 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.670253 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:27.671007 21904 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.646747 27497 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:27.654837 27411 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:27.683879 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.685463 21906 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:27.692483 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.693538 21904 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:27.700148 21906 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:27.644479 27014 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:27.703936 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:27.705494 27233 tablet_bootstrap.cc:492] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:07:27.706313 27233 ts_tablet_manager.cc:1403] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 2.556s	user 0.033s	sys 0.025s
I20260709 13:07:27.706454 27014 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:27.708302 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.696260 27411 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.694562 26993 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:27.718106 27508 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:27.718796 27508 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:27.719228 27508 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:27.721174 27508 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:27.721639 27508 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:27.596158 27452 consensus_queue.cc:1175] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 14 status { last_received { term: 13 index: 12 } last_committed_idx: 12 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:27.667032 27498 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:27.711741 27497 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:27.778263 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:27.715209 27411 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:27.796331 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 140121us
I20260709 13:07:27.797398 21875 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.799688 21904 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:27.804160 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:27.804813 21906 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:27.724251 27071 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:27.791224 27497 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:27.825196 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 722) took 1117 ms. Trace:
I20260709 13:07:27.813597 27423 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:27.817355 27445 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:27.813815 27434 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:27.726364 27508 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:07:27.813279 26993 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:27.790473 26877 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:07:27.829743 21976 rpcz_store.cc:276] 0709 13:07:26.703871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.704017 (+   146us) service_pool.cc:224] Handling call
0709 13:07:26.704327 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.709755 (+  5428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.709784 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.710234 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.886785 (+176551us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:26.886825 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.813348 (+926523us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b54003f8c54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:27.813624 (+   276us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.813675 (+    51us) raft_consensus.cc:1685] finished
0709 13:07:27.813689 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.821395 (+  7706us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1543,"raft.queue_time_us":816,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":11043,"spinlock_wait_cycles":11840128,"thread_start_us":176107,"threads_started":1,"wal-append.queue_time_us":212211}
I20260709 13:07:27.817946 27509 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:27.813968 27496 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:27.844717 27452 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:27.846771 27500 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:27.852392 27443 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.803670 27444 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:07:27.855257 27507 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:27.856617 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:27.864625 27505 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.824092 27428 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:27.824385 27071 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:27.833971 27497 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:27.823208 27014 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:27.842120 27498 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:27.879103 21900 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:27.841650 27423 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:27.879915 27452 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:27.900152 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 711) took 1046 ms. Trace:
I20260709 13:07:27.913162 21827 rpcz_store.cc:276] 0709 13:07:26.853565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.865252 (+ 11687us) service_pool.cc:224] Handling call
0709 13:07:27.899993 (+1034741us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540011f154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:27.900096 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279226624}
I20260709 13:07:27.876009 26993 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:27.905766 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49223.3us
I20260709 13:07:27.928332 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:27.932821 27507 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:27.933332 27434 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.933451 27507 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:27.933863 27434 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:27.936187 27434 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:27.936765 27434 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.937268 27434 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:27.939680 27434 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:27.870764 27445 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:27.904984 27498 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:27.917834 27428 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:27.882334 27443 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:27.979616 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:27.965564 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:27.980314 21833 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:27.942106 27502 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:27.980633 21825 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
W20260709 13:07:27.989661 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 276363us
I20260709 13:07:27.990391 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:27.964002 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:27.991617 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:27.991756 21832 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:27.948566 27019 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:27.954461 27512 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.984719 21826 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: [17.12-18.13]
I20260709 13:07:27.952198 27428 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:27.986326 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet edb7f62b920e42349d56d878295176b2: Illegal state: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:27.932765 27506 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:27.882095 27501 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:07:27.967249 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:27.956574 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:28.005365 21827 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:27.954140 26877 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:27.993016 27432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.020s	sys 0.027s
I20260709 13:07:27.901829 27505 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:27.934402 27507 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:28.040913 27503 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:07:27.989032 27502 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:28.044162 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.113507 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:28.039472 27496 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:28.038471 27396 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:28.035936 27428 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:28.142904 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:28.148864 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 158555us
I20260709 13:07:28.041533 27498 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.047940 26877 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.162516 27498 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:27.987316 27444 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.089962 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.148221 21903 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:28.048130 27432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.020s	sys 0.027s
I20260709 13:07:28.161504 27396 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:28.177866 27395 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.004s
I20260709 13:07:28.206286 27395 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.207510 27071 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:28.139233 27448 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.002s
I20260709 13:07:28.164724 26877 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:28.127923 27452 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:28.050971 27351 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.046792 27019 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.258276 27019 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:28.045650 26993 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.260337 27448 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.164849 27496 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:28.264145 27496 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.041944 27423 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.178964 27396 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.107651 27514 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.158959 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:28.276027 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 117143us
I20260709 13:07:28.276829 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:28.180262 21873 leader_election.cc:400] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:07:28.278319 21873 leader_election.cc:403] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:07:28.178785 27444 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:28.182646 27488 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.022s	user 0.000s	sys 0.007s
I20260709 13:07:28.190083 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:28.291487 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 101473us
W20260709 13:07:28.190665 27516 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:28.193490 27502 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.040186 27512 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.196887 27505 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:28.197724 27509 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:28.089136 27314 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:28.198414 27443 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.151788 27233 raft_consensus.cc:359] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc [term 13 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.199045 27365 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:28.201202 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2422) took 1569 ms. Trace:
I20260709 13:07:28.202842 27445 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:28.209276 27409 consensus_meta.cc:287] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.003s
I20260709 13:07:28.307204 27506 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:28.212384 27399 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.212852 27402 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:28.213665 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:28.122604 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:28.373967 21834 raft_consensus.cc:2410] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:07:28.228310 21903 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
W20260709 13:07:28.375298 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 161703us
I20260709 13:07:28.376165 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:27.813279 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.239142 27279 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.239257 27511 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 13:07:28.389672 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.241891 27497 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.245184 27411 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.222072 27428 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.248040 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:28.409070 21976 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:28.248116 27395 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:28.249187 27369 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.004s
W20260709 13:07:28.249701 27413 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.567s	user 0.005s	sys 0.005s
W20260709 13:07:28.248805 27454 consensus_meta.cc:287] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.589s	user 0.002s	sys 0.008s
I20260709 13:07:28.259862 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:28.413304 21981 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:28.347208 27314 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.278059 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:28.416430 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 138439us
I20260709 13:07:28.292277 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:28.307806 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.302587 27396 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:28.338248 21832 raft_consensus.cc:1217] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Deduplicated request from leader. Original: 13.6->[15.7-20.9]   Dedup: 15.7->[18.8-20.9]
I20260709 13:07:28.417856 21832 pending_rounds.cc:85] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 7
I20260709 13:07:28.418193 21832 pending_rounds.cc:107] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:07:28.418455 21832 raft_consensus.cc:2889] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:28.331377 21728 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 128) took 13507 ms (client timeout 15000 ms). Trace:
I20260709 13:07:28.349418 21831 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:28.353076 21905 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:28.344609 21830 rpcz_store.cc:276] 0709 13:07:26.632058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.842029 (+209971us) service_pool.cc:224] Handling call
0709 13:07:26.842389 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.002844 (+160455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.002874 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.003288 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.162397 (+159109us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:27.183755 (+ 21358us) log.cc:844] Serialized 14 byte log entry
0709 13:07:27.256253 (+ 72498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.200734 (+944481us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b54002882d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:28.200780 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.200823 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:28.200995 (+   172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.201123 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21152,"prepare.queue_time_us":66050,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":6387,"raft.queue_time_us":27899,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":52993408,"thread_start_us":158639,"threads_started":1,"wal-append.queue_time_us":254987,"wal-append.run_cpu_time_us":1716,"wal-append.run_wall_time_us":1004854}
I20260709 13:07:28.307015 27014 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:28.209542 27422 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.600s	user 0.005s	sys 0.005s
I20260709 13:07:28.359586 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.332271 27404 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:28.306897 27508 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:07:28.356447 21826 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
W20260709 13:07:28.419037 21728 rpcz_store.cc:269] 0709 13:07:14.865235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.865472 (+   237us) service_pool.cc:224] Handling call
0709 13:07:28.331283 (+13465811us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:24.580184 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:24.580892 (+   708us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:24.580962 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:07:24.580983 (+    21us) tablet.cc:662] Decoding operations
0709 13:07:24.585803 (+  4820us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:24.585917 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:24.585948 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:07:24.587345 (+  1397us) tablet.cc:701] Row locks acquired
0709 13:07:24.587407 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:07:24.587582 (+   175us) write_op.cc:270] Start()
0709 13:07:24.587861 (+   279us) write_op.cc:276] Timestamp: P: 1783602444587503 usec, L: 0
0709 13:07:24.587942 (+    81us) op_driver.cc:348] REPLICATION: starting
0709 13:07:24.589075 (+  1133us) log.cc:844] Serialized 4746 byte log entry
0709 13:07:24.626093 (+ 37018us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75bed40ac 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b
0709 13:07:25.559078 (+932985us) op_driver.cc:464] REPLICATION: finished
0709 13:07:25.804462 (+245384us) write_op.cc:301] APPLY: starting
0709 13:07:25.809176 (+  4714us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:26.150592 (+341416us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:26.150661 (+    69us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:26.185611 (+ 34950us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:26.186066 (+   455us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:07:26.186122 (+    56us) write_op.cc:312] APPLY: finished
0709 13:07:26.331627 (+145505us) log.cc:844] Serialized 113 byte log entry
0709 13:07:26.347527 (+ 15900us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.348502 (+   975us) write_op.cc:454] Released schema lock
0709 13:07:26.348569 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:26.349063 (+   494us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:26.349095 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1173543,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":196390,"apply.run_cpu_time_us":17697,"apply.run_wall_time_us":560761,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54215,"num_ops":12,"prepare.queue_time_us":112536,"prepare.run_cpu_time_us":28698,"prepare.run_wall_time_us":285625,"raft.queue_time_us":327161,"raft.run_cpu_time_us":23847,"raft.run_wall_time_us":115222,"replication_time_us":970890,"spinlock_wait_cycles":5191424,"thread_start_us":650932,"threads_started":4,"wal-append.queue_time_us":375770,"wal-append.run_cpu_time_us":84018,"wal-append.run_wall_time_us":2392220}]]}
I20260709 13:07:28.387264 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.241178 27437 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:28.391263 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.391899 21902 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:28.344465 27365 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:28.350669 26877 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:28.359089 27403 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.477784 21900 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:28.404203 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:28.478375 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:28.478917 21976 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:28.430987 27014 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.302729 27514 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:28.293643 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 126882us
I20260709 13:07:28.402474 27279 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.390475 27247 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:28.422823 21901 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:28.404795 27502 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.402061 27452 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:28.443938 21830 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:28.405056 27187 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:28.371045 27409 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.334475 27509 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.452164 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:28.468668 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.469537 21904 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:28.374583 27399 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.442082 27397 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:28.386786 27402 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.371970 27506 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:28.484247 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:28.448915 27233 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:07:28.489512 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:28.422499 27369 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.423183 27413 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.495428 27187 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:28.518923 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 66870.5us
I20260709 13:07:28.594053 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:28.476903 27404 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:28.422626 27454 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.523083 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.447670 27396 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.485487 27264 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:28.485903 27014 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:28.496135 21731 catalog_manager.cc:5697] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 7 to 11, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 11 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:28.655975 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 171827us
I20260709 13:07:28.301546 27432 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.486330 27526 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:28.470688 27422 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:28.572451 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 280250us
W20260709 13:07:28.558455 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 183567us
I20260709 13:07:28.478508 27071 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:07:28.667831 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:28.583619 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 193061us
I20260709 13:07:28.476089 27437 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.585213 21976 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:28.503891 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:28.666318 21949 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:28.480521 27403 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.596859 27226 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:28.529863 27397 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.520299 27527 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:28.484112 26877 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.656623 27423 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.656862 21873 leader_election.cc:400] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:28.701267 21873 leader_election.cc:403] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:07:28.659693 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.690227 21731 catalog_manager.cc:5697] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:28.660286 21834 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:28.588681 27506 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:28.671797 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:28.587507 27530 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.499001 27452 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.602077 27187 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:28.488463 27445 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:28.674853 21949 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:28.625622 27406 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:28.698462 21974 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:28.659231 27444 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.517935 27515 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:28.720405 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 63704.3us
I20260709 13:07:28.739711 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.740166 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:28.740293 21908 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:28.666121 27264 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:28.736270 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 64563.7us
I20260709 13:07:28.695938 27397 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:28.687533 27247 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:28.754705 27508 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.707880 27527 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.763186 27437 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:28.763314 27422 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:28.763468 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:28.676726 27526 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.787858 27247 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.816105 27526 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:28.816311 27247 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:28.582669 27365 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.770346 27444 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:28.817296 27444 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:28.817770 27444 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:28.725744 27530 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.739264 27445 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.819895 27530 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:28.763192 27452 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.771597 27402 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:28.732410 27542 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.820796 27445 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:28.820895 27542 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.823307 27542 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:28.772689 27399 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:28.761541 27515 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:28.774688 27525 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:07:28.774152 27264 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.826568 21731 catalog_manager.cc:5697] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 4 to 10, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 10 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.758484 27314 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.727680 27517 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:28.673991 27432 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.730995 27434 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:28.809361 27071 raft_consensus.cc:2804] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:28.810484 27454 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.811448 27369 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.812525 27531 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.694026 27226 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.787684 26993 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.722748 27423 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.814445 27548 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:28.763765 27404 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.829123 21731 catalog_manager.cc:5697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 10 to 11, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 11 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.743069 27497 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:28.835988 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 229819us
I20260709 13:07:28.837244 27406 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:28.837886 27496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.003s	sys 0.007s
I20260709 13:07:28.761608 27428 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.892571 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:28.891526 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:28.755283 27543 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:28.839082 21829 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.004s
I20260709 13:07:28.673576 27233 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:28.785852 27544 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:28.914249 27071 raft_consensus.cc:697] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:28.938243 27496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.004s	sys 0.007s
I20260709 13:07:28.912768 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:28.917263 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 171549us
I20260709 13:07:28.831477 27437 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:28.924484 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 168326us
I20260709 13:07:28.839802 27517 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.891665 27452 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.933640 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:28.891575 27526 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.968251 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:28.969308 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:28.892884 27399 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:28.938125 22555 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:28.932753 21731 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 4 to 5, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 5 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:28.940764 21829 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.017s	sys 0.037s
I20260709 13:07:28.839357 27425 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.789834 27508 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:28.943377 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 268565us
I20260709 13:07:28.943442 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:29.035429 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 63637.2us
I20260709 13:07:28.776176 27395 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:28.960441 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:28.961115 22552 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:28.963040 21831 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:28.923290 26993 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.945442 27515 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:28.922405 27531 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:28.971355 27517 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:29.097915 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47388.7us
I20260709 13:07:28.978683 27432 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:29.032315 21976 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:29.049199 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:28.775389 27540 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:28.938472 27406 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:28.966334 27409 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.973214 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:29.094427 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:29.119884 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 146746us
I20260709 13:07:29.120090 21909 raft_consensus.cc:2368] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19.
I20260709 13:07:28.977065 27396 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.096271 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.137156 21908 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:28.965090 27413 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.961656 27543 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:28.980822 21981 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:29.097025 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:29.144412 21902 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:28.974361 27226 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.981703 27545 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:29.148372 27556 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:07:29.148772 27545 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.150547 27515 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.150722 27423 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.150928 27545 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.151397 27406 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.977625 27452 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:29.152535 27560 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:29.153311 27452 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.100471 27187 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.154410 27535 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:29.154953 27535 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:29.155891 27187 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.155819 27535 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.104178 27445 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 13:07:29.159045 27553 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:07:29.136073 26877 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.135749 27540 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.141407 27432 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:29.162736 27540 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:29.162911 27432 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:29.159039 27445 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:29.164331 27445 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:29.163836 27432 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.165119 27445 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.123646 21976 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:29.167107 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:29.126543 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.130404 27411 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.130710 21975 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:29.169198 21980 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:29.130316 27569 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:29.170478 21975 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:29.131083 27529 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:29.171411 27529 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.171677 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.173349 27529 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:29.173570 27509 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.000s
I20260709 13:07:29.131870 27521 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:29.179638 27521 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.180361 27397 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.181847 27521 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.132593 26993 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.133031 27527 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:28.960520 27544 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.134465 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.103828 27071 consensus_queue.cc:237] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.183148 27396 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:29.183372 27509 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.183779 27396 consensus_queue.cc:1243] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:29.184173 27544 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.184702 21904 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.090734 27526 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.135236 27531 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.134567 21731 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 10 to 11, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 11 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.136181 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 719) took 1153 ms. Trace:
I20260709 13:07:29.136261 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:28.980064 27444 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.141898 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:29.065208 27399 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.146667 27512 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.147321 27508 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:29.147646 27502 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.002s
I20260709 13:07:29.147946 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.088208 27425 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.151018 27515 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:29.121183 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 72101.2us
I20260709 13:07:29.169157 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:29.131517 27552 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.174206 27233 ts_tablet_manager.cc:1434] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 1.468s	user 0.012s	sys 0.000s
I20260709 13:07:29.174805 27445 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:29.175016 27014 consensus_meta.cc:287] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.500s	user 0.006s	sys 0.003s
I20260709 13:07:29.175408 27543 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.195966 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:29.224473 21975 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:29.195425 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.199407 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.195531 21829 rpcz_store.cc:276] 0709 13:07:27.982714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.982867 (+   153us) service_pool.cc:224] Handling call
0709 13:07:27.983266 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:27.985976 (+  2710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.986019 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:27.986681 (+   662us) log.cc:844] Serialized 52 byte log entry
0709 13:07:28.136285 (+149604us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:29.032745 (+896460us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.129799 (+ 97054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.129877 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.135993 (+  6116us) raft_consensus.cc:1685] finished
0709 13:07:29.136011 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.136129 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56715,"prepare.queue_time_us":527813,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":195636,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":49496,"thread_start_us":859247,"threads_started":3,"wal-append.queue_time_us":121789}
I20260709 13:07:29.201792 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.202121 21909 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:29.201797 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.201952 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.205950 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:29.200870 21731 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 7 to 9, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 9 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:29.212916 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.185324 27509 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.228605 21731 catalog_manager.cc:5697] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 6 to 8, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 8 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.216100 21949 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.217895 21908 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:29.223244 21904 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:29.231153 21731 catalog_manager.cc:5697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 3 to 10, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 10 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.232326 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.233510 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.234110 21909 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:29.226754 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:29.210677 27531 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.240808 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.241756 21829 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:29.243999 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.217748 27397 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:29.218248 27233 ts_tablet_manager.cc:1467] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Tablet startup took 1511ms
I20260709 13:07:29.266659 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:29.267444 21831 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:29.243845 21829 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:29.228909 27569 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:29.257771 21731 catalog_manager.cc:5697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:29.258299 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.240304 27404 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:29.262663 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.272567 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.223773 27556 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:07:29.229321 27014 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.271607 21828 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:29.285832 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.274047 22549 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:29.255905 27437 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:29.276407 21975 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:29.269126 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.282701 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.288829 27563 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.289002 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.289088 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.289721 21908 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:29.291465 21909 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:29.292034 21908 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:29.292672 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2465) took 1883 ms. Trace:
I20260709 13:07:29.290362 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.293078 21974 rpcz_store.cc:276] 0709 13:07:27.408973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.409088 (+   115us) service_pool.cc:224] Handling call
0709 13:07:29.292492 (+1883404us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003a4dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:29.292599 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2952817536}
I20260709 13:07:29.292662 21909 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:07:29.242715 27422 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:29.277083 21731 catalog_manager.cc:5697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 8 to 9, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 9 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.288518 21829 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:29.311515 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.319350 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:29.320408 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 77983.1us
I20260709 13:07:29.224643 27552 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.326220 21905 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:29.244294 27531 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.327023 27399 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:29.327369 27575 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:29.328404 27531 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.284967 27556 consensus_queue.cc:1243] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:29.332240 21829 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:29.343403 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.347888 21830 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:29.355044 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:29.355610 21983 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:29.304438 27437 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:29.310446 27548 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.363117 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.363184 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.366443 21977 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 12.
I20260709 13:07:29.365219 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:29.363591 21731 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:29.362377 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:29.266777 27233 ts_tablet_manager.cc:1469] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Trace:
0709 13:07:20.318549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.320174 (+  1625us) service_pool.cc:224] Handling call
0709 13:07:20.707599 (+387425us) ts_tablet_manager.cc:934] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
0709 13:07:22.149746 (+1442147us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:22.521147 (+371401us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:22.521269 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:22.922303 (+401034us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:22.944354 (+ 22051us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:22.944717 (+   363us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:22.944776 (+    59us) inbound_call.cc:177] Queueing success response
0709 13:07:25.106152 (+2161376us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:07:27.706636 (+2600484us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:07:27.852054 (+145418us) tablet_replica.cc:261] Starting instrumentation
0709 13:07:27.852684 (+   630us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":54933,"mutex_wait_us":25752,"raft.queue_time_us":6044,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4577,"tablet-copy.queue_time_us":264163,"tablet-download-pool.queue_time_us":8402,"tablet-download-pool.run_cpu_time_us":1695,"tablet-download-pool.run_wall_time_us":1164722,"thread_start_us":318056,"threads_started":2}
I20260709 13:07:29.368863 27526 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.362949 21974 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:29.372275 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.373011 21906 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:29.373765 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.363993 21909 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:29.375595 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:29.379027 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.357445 27404 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.358395 27437 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.382652 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.383106 21974 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:29.376700 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:29.384301 27570 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 13:07:29.386350 27557 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.419s	user 0.000s	sys 0.003s
I20260709 13:07:29.375190 27498 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:29.382758 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.389304 21978 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:29.391187 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.376564 27578 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:29.394989 27513 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.395471 27513 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.397405 27513 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.397212 27517 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.388496 27404 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.399312 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.399639 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.396525 21731 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.400766 21731 catalog_manager.cc:5697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:29.398231 27397 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:29.375152 27502 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:07:29.382498 27526 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.324653 27563 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.366214 27509 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:07:29.410006 21731 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 3 to 8, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 8 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.366701 27548 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.416213 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:29.405754 27506 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.000s
I20260709 13:07:29.416790 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:29.417379 22555 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:29.404788 27526 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.424170 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.424631 22555 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:29.427148 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.407604 27397 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:29.433554 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.435034 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.442440 21978 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:29.443495 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.444900 21832 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:29.433703 27434 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.454430 27397 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.457916 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.427244 27506 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.464445 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.469244 21978 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:29.471647 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:29.473680 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.429796 27540 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:07:29.445472 27425 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.482656 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.483971 27247 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:29.484519 21903 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:29.487110 21903 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:29.489487 27548 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.480875 27187 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:29.490973 27187 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:29.491333 27526 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.491468 27187 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.498893 27365 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.503161 21834 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:29.507740 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:29.508644 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.502528 27556 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:29.510057 21982 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:29.510412 27071 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:29.510107 27247 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.510828 27502 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:29.516242 27563 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.516640 27425 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.518307 27019 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.518947 27517 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.520390 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:29.521319 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:29.522205 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.528841 27448 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:29.539620 27585 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:07:29.564100 27506 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.564580 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 704) took 1468 ms. Trace:
I20260709 13:07:29.540413 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.565356 21828 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:29.564908 21901 rpcz_store.cc:276] 0709 13:07:28.096132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.096272 (+   140us) service_pool.cc:224] Handling call
0709 13:07:28.096642 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.488142 (+391500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.564365 (+1076223us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b540020b7d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:29.564523 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731861888}
W20260709 13:07:29.541136 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.566111 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.567116 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.567467 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:29.568811 21799 leader_election.cc:400] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19.
I20260709 13:07:29.569105 21799 leader_election.cc:403] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.569614 21832 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:29.542526 21843 tablet_copy_service.cc:342] P 479255846c5141b584b16aa253f587c7: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-2705e36077094db8a03a8b3e606284be received from {username='slave'} at 127.0.0.1:52674
I20260709 13:07:29.570425 21843 tablet_copy_service.cc:434] P 479255846c5141b584b16aa253f587c7: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-2705e36077094db8a03a8b3e606284be on tablet 2705e36077094db8a03a8b3e606284be with peer 0157b4f0725d4f92a53938c921db9efc
W20260709 13:07:29.570842 27587 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:07:29.570860 27425 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.571707 27514 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.543421 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.572732 27279 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.572911 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.573975 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.560992 27247 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.544495 21833 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:29.575510 27444 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.576175 27448 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:29.548580 21826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2450) took 1432 ms (client timeout 1522 ms). Trace:
I20260709 13:07:29.576397 27247 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:29.464591 27014 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.544261 27548 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 13:07:29.576707 21826 rpcz_store.cc:269] 0709 13:07:28.111274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.129001 (+ 17727us) service_pool.cc:224] Handling call
0709 13:07:29.543991 (+1414990us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540009db54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:29.544088 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450754432}
I20260709 13:07:29.551731 21903 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:07:29.553194 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 45560.7us
I20260709 13:07:29.464390 27434 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.580034 27434 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.580977 27434 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:29.582693 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 711) took 1096 ms. Trace:
I20260709 13:07:29.544687 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.583488 21979 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:29.583606 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.547794 27404 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:29.552968 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44428.5us
I20260709 13:07:29.574795 27403 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:29.582378 27019 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.555186 27507 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:29.541397 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2541) took 1234 ms. Trace:
I20260709 13:07:29.586411 21904 pending_rounds.cc:85] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 11
I20260709 13:07:29.592617 21904 pending_rounds.cc:107] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:07:29.573065 27425 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.592974 21904 raft_consensus.cc:2889] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.583069 21905 rpcz_store.cc:276] 0709 13:07:28.486713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.486863 (+   150us) service_pool.cc:224] Handling call
0709 13:07:28.517917 (+ 31054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.326710 (+808793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.582506 (+255796us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54002373d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:29.582645 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858344704}
I20260709 13:07:29.584905 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:29.589066 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:29.589706 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.591885 27546 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:29.589978 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:29.517647 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:29.557029 27543 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:29.593730 27247 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:07:29.600248 27019 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.605052 22546 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:29.606494 27514 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:29.608603 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2613) took 1274 ms. Trace:
I20260709 13:07:29.609697 27552 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.592315 21900 rpcz_store.cc:276] 0709 13:07:28.306743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.307804 (+  1061us) service_pool.cc:224] Handling call
0709 13:07:28.308128 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.478236 (+170108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.541183 (+1062947us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000fb754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:29.541349 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389280512}
I20260709 13:07:29.608963 21833 rpcz_store.cc:276] 0709 13:07:28.335333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.335444 (+   111us) service_pool.cc:224] Handling call
0709 13:07:29.544168 (+1208724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.575621 (+ 31453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.608434 (+ 32813us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540009db50. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:29.608550 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2779233536}
I20260709 13:07:29.606905 27402 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:29.612684 27402 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:29.612905 27448 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.613298 27448 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:29.613489 27402 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.614863 27402 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.614758 27548 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:29.616782 27422 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:29.617691 27403 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:29.619381 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.620788 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.562413 27502 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.624320 27502 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:29.625933 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 108388us
I20260709 13:07:29.627002 27571 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:29.627209 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.627883 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.629142 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.629676 21977 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 11.
I20260709 13:07:29.627506 27571 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:29.631793 27515 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.631987 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.632673 21905 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:29.632566 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.632200 27571 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.570324 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.634114 21982 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:29.634155 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:29.635025 21907 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:29.635931 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:29.636112 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44455.9us
W20260709 13:07:29.637814 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52999.2us
I20260709 13:07:29.637979 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.638749 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.639489 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:29.639771 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.645430 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.646018 21979 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:29.646914 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:29.643043 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.652801 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.657075 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.659559 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.658547 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:29.661635 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:29.662892 21981 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:29.664021 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:29.671159 21975 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:29.672410 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.676107 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.677345 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:29.678148 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.673730 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.678748 21832 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:29.678990 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.680015 21829 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:29.680601 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.679625 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:29.585326 27437 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.718910 21982 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:29.645778 27365 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:29.718194 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 70340.1us
I20260709 13:07:29.721088 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.720682 21825 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:29.683786 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.685387 21831 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:29.689342 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.695299 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:29.695626 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:29.695905 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:29.724049 21829 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:07:29.696216 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:29.725392 21977 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.725522 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:29.720043 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.729789 21826 raft_consensus.cc:2368] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:07:29.655617 27515 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:29.656550 27279 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:29.628522 27507 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:07:29.658788 27019 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:29.736145 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.737362 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.650233 27247 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:07:29.738830 27404 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:29.738350 27422 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:29.745577 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.722959 27071 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:29.781281 21981 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:29.782685 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.684333 27517 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:29.684703 27552 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:29.723625 27592 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:29.799674 27437 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.799794 27592 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:29.800350 27514 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.766522 27547 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:29.800935 27514 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.800346 27592 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:29.803438 27514 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.804682 26877 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.805074 27580 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.805222 26877 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.805665 27580 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.807538 26877 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.808025 27580 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:29.809804 27448 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.810499 27444 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:29.810956 27592 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.812068 27448 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:29.746857 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 82952.2us
I20260709 13:07:29.724341 27365 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:29.813705 27365 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:29.814074 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:29.815917 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:29.816653 27509 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:29.782757 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 95176.6us
I20260709 13:07:29.817310 27509 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:29.818408 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:29.818760 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:29.819607 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.735037 27515 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.820333 27515 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.820786 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:29.823254 27019 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:29.823412 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:29.823870 27019 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:29.824280 27578 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:29.824868 27578 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:29.824903 27019 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:29.764609 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.788209 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:29.791523 27517 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:29.786310 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.826772 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.827530 21975 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:29.825552 27578 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:29.798930 27552 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.827611 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:29.819628 27509 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:29.824937 21982 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:29.828572 21825 pending_rounds.cc:85] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 7
I20260709 13:07:29.851254 21825 pending_rounds.cc:107] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:07:29.851536 21825 raft_consensus.cc:2889] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:29.829010 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 43941.6us
I20260709 13:07:29.828717 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:29.799805 21903 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:29.739245 27540 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:07:29.843721 21830 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:29.867624 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.844765 21977 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:29.833915 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.869725 21979 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:29.783529 21981 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:29.848239 21829 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:29.849399 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.852965 27527 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:29.850293 27226 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:07:29.826363 27517 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.775807 27403 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:29.849327 27247 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:29.857129 27546 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19.
I20260709 13:07:29.857812 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.787480 27507 consensus_queue.cc:1243] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:29.858018 27187 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:29.902050 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.858420 27396 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:29.778337 27422 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.875069 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:29.907208 21830 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:29.876143 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:29.879884 27444 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:29.882349 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53826.4us
I20260709 13:07:29.882256 27527 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:29.893569 21980 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:29.849793 26877 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:29.860183 27552 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:29.900606 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:29.903132 21829 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
W20260709 13:07:29.903542 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45834.7us
I20260709 13:07:29.916361 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:29.916981 21830 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:29.878189 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 44350.3us
I20260709 13:07:29.918861 21826 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:07:29.919277 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:29.882437 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:29.920218 21826 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:29.921756 21826 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:29.922575 27226 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:29.923456 27226 consensus_queue.cc:1243] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:07:29.892875 27563 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:29.926563 27508 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:29.927065 21978 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:29.917119 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:29.897868 27509 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:29.933351 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:29.944821 21833 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:29.909075 27422 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:29.904405 27592 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:29.909005 27567 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:29.989534 21830 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:30.021773 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:30.003152 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.016664 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 83385.7us
I20260709 13:07:29.915768 27527 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.026114 21830 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:29.904760 27505 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:07:29.904570 27247 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.025894 27581 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:30.047722 27595 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:07:30.048347 27596 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:07:30.049185 27499 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:30.050477 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:30.021121 27567 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:30.052906 27463 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:29.940892 27509 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.988570 27552 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:29.988163 27535 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:30.153231 21833 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:07:30.159056 21949 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:30.161334 21979 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:30.166548 21978 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:30.052089 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:30.169015 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:30.169574 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:29.926697 27563 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.172555 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:30.179037 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:30.028453 27546 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:30.231814 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:30.233230 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:30.141340 27314 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.024s	sys 0.033s
I20260709 13:07:30.211983 21833 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
W20260709 13:07:30.215122 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 56194.1us
I20260709 13:07:30.234875 21833 pending_rounds.cc:85] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 12
I20260709 13:07:30.172550 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:30.153707 27556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.026s	sys 0.013s
I20260709 13:07:30.182621 21830 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: [17.12-18.13]
I20260709 13:07:30.193415 21978 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:30.235854 21833 pending_rounds.cc:107] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:07:30.149906 27592 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:30.316161 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:30.318753 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 83590.8us
I20260709 13:07:30.319530 21949 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:30.319777 21833 raft_consensus.cc:2889] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.177439 21828 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:30.322692 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:30.322876 21979 raft_consensus.cc:1217] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Deduplicated request from leader. Original: 17.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:07:30.183957 27567 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:30.324525 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 92500.4us
I20260709 13:07:30.325810 21979 raft_consensus.cc:1240] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:07:30.191696 27562 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:07:30.331014 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:30.329202 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:30.216627 27571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.019s	sys 0.018s
I20260709 13:07:30.180245 27509 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:30.321991 27314 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.027s	sys 0.037s
I20260709 13:07:30.179088 27445 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:30.353413 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:30.164633 27434 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.168s
I20260709 13:07:30.219074 27535 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:30.164474 27499 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:30.323279 27556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.029s	sys 0.015s
W20260709 13:07:30.354141 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 441774us
I20260709 13:07:30.442651 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:30.239961 27279 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:30.167656 27506 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.177s
I20260709 13:07:30.357802 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:30.240103 27264 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.357267 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:30.386454 27535 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:30.386353 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:30.356611 27552 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:30.404172 27247 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:30.404915 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:30.405186 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2558) took 1034 ms. Trace:
I20260709 13:07:30.450461 21905 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:30.316432 27546 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.406296 27404 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:30.410211 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2560) took 1039 ms. Trace:
W20260709 13:07:30.411720 27365 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 13:07:30.417107 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2453) took 1971 ms. Trace:
W20260709 13:07:30.344435 27571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.023s	sys 0.029s
W20260709 13:07:30.425316 21908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.023s	sys 0.020s
I20260709 13:07:30.439117 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:30.239837 27425 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:30.348546 26877 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.445990 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:30.446717 21900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.005s	sys 0.039s
W20260709 13:07:30.472848 21900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.005s	sys 0.039s
I20260709 13:07:30.355288 27547 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:30.445564 21831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.039s	sys 0.070s
W20260709 13:07:30.476262 21831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.039s	sys 0.071s
I20260709 13:07:30.446736 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:30.450381 21909 rpcz_store.cc:276] 0709 13:07:29.370501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.381492 (+ 10991us) service_pool.cc:224] Handling call
0709 13:07:29.381756 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.393510 (+ 11754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.393540 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.409179 (+ 15639us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.556415 (+147236us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:29.556859 (+   444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.556940 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.405003 (+848063us) raft_consensus.cc:1685] finished
0709 13:07:30.405022 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.405138 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5852,"raft.queue_time_us":5044,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":126484,"threads_started":1,"wal-append.queue_time_us":359874}
W20260709 13:07:30.452054 21907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.008s	sys 0.028s
W20260709 13:07:30.479533 21907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.008s	sys 0.028s
W20260709 13:07:30.459061 21908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.023s	sys 0.020s
I20260709 13:07:30.461973 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:30.444330 27515 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.623s	user 0.006s	sys 0.005s
I20260709 13:07:30.332616 27592 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:30.448009 27600 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:07:30.454061 21906 rpcz_store.cc:276] 0709 13:07:29.371107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.386572 (+ 15465us) service_pool.cc:224] Handling call
0709 13:07:29.386842 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.398810 (+ 11968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.398856 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.405549 (+  6693us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.784272 (+378723us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:29.784318 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.784394 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.409943 (+625549us) raft_consensus.cc:1685] finished
0709 13:07:30.409971 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.410121 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12769,"raft.queue_time_us":6196,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":334149,"threads_started":1,"wal-append.queue_time_us":935053}
I20260709 13:07:30.458073 21827 rpcz_store.cc:276] 0709 13:07:28.446138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.924724 (+478586us) service_pool.cc:224] Handling call
0709 13:07:28.940679 (+ 15955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.102578 (+161899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.102609 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.389491 (+286882us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b2c000014c8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:07:29.390753 (+  1262us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.551133 (+160380us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:29.551173 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.611644 (+ 60471us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b540017edd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:29.611688 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.416842 (+805154us) raft_consensus.cc:1685] finished
0709 13:07:30.416871 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.417035 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17514,"raft.queue_time_us":196644,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":28861,"spinlock_wait_cycles":9037824,"thread_start_us":256262,"threads_started":2,"wal-append.queue_time_us":249029}
I20260709 13:07:30.458458 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:30.459661 27597 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 13:07:30.359611 27508 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:07:30.358249 27445 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.479377 27014 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:30.455008 27556 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:30.447527 27402 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:07:30.506386 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.515722 27592 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:30.517462 27517 consensus_meta.cc:287] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.002s
I20260709 13:07:30.516996 27499 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:30.456146 27279 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.478108 27425 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:30.526815 21827 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:30.527215 27434 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.532230 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2479) took 1406 ms. Trace:
I20260709 13:07:30.485669 27187 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:30.457571 27552 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.471030 27365 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.580403 27463 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:30.580955 27463 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.582181 27365 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:30.542526 27499 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:30.481009 26877 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.539927 27445 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:30.550585 21976 rpcz_store.cc:276] 0709 13:07:29.126144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.168038 (+ 41894us) service_pool.cc:224] Handling call
0709 13:07:29.168347 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.168660 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.168691 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.568415 (+399724us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b2c00111818. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:07:29.568764 (+   349us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.767864 (+199100us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:29.767916 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.768012 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.531857 (+763845us) raft_consensus.cc:1685] finished
0709 13:07:30.531887 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.532147 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2431,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":32327936,"thread_start_us":198720,"threads_started":1,"wal-append.queue_time_us":363927}
I20260709 13:07:30.632232 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:30.560864 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.492143 27515 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.546195 27517 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.580240 27552 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:30.579841 27434 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:30.612672 21983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.027s	sys 0.020s
I20260709 13:07:30.523123 27619 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:30.643644 21983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.027s	sys 0.020s
I20260709 13:07:30.646492 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:30.548396 27548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.000s	sys 0.046s
W20260709 13:07:30.651551 21825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.041s	sys 0.062s
W20260709 13:07:30.652536 21825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.041s	sys 0.062s
I20260709 13:07:30.655200 21834 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:30.661731 21829 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:30.664382 21873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.003s	sys 0.053s
W20260709 13:07:30.664904 21873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.003s	sys 0.053s
W20260709 13:07:30.665591 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 837976us
I20260709 13:07:30.667021 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:30.680883 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:30.651350 27619 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:30.653019 27543 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:30.666955 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:30.706790 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:30.681751 27548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.000s	sys 0.047s
W20260709 13:07:30.710392 21975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.016s	sys 0.021s
W20260709 13:07:30.726400 21975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.017s	sys 0.021s
W20260709 13:07:30.723598 21904 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.017s	sys 0.011s
I20260709 13:07:30.729629 22550 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:07:30.729875 21826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.013s	sys 0.017s
W20260709 13:07:30.729498 21904 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.017s	sys 0.011s
I20260709 13:07:30.730989 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:30.730346 21826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.013s	sys 0.017s
I20260709 13:07:30.696146 27571 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.786938 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2567) took 1043 ms. Trace:
I20260709 13:07:30.789399 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2560) took 1138 ms. Trace:
I20260709 13:07:30.789927 21982 rpcz_store.cc:276] 0709 13:07:29.650716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.161738 (+511022us) service_pool.cc:224] Handling call
0709 13:07:30.162085 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.190997 (+ 28912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.191025 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.191066 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:30.191101 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.789110 (+598009us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b5400273b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:30.789177 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.789330 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65227648}
I20260709 13:07:30.787552 21981 rpcz_store.cc:276] 0709 13:07:29.743758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.165186 (+421428us) service_pool.cc:224] Handling call
0709 13:07:30.230338 (+ 65152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.464602 (+234264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.464649 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.464709 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.464761 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.786653 (+321892us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400165154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:30.786708 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.786864 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538150656}
I20260709 13:07:30.803251 27365 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:30.804456 27463 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:30.725355 27563 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:30.830680 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 720) took 1267 ms. Trace:
I20260709 13:07:30.811384 27397 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:30.833287 21904 rpcz_store.cc:276] 0709 13:07:29.585621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.585817 (+   196us) service_pool.cc:224] Handling call
0709 13:07:29.586206 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:29.640106 (+ 53900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.640134 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:29.640612 (+   478us) log.cc:844] Serialized 52 byte log entry
0709 13:07:29.944452 (+303840us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:30.045944 (+101492us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.731750 (+685806us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.810285 (+ 78535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.810387 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.830418 (+ 20031us) raft_consensus.cc:1685] finished
0709 13:07:30.830444 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.830609 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142155,"prepare.queue_time_us":105487,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":81,"raft.queue_time_us":456294,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":13010,"thread_start_us":833340,"threads_started":2,"wal-append.queue_time_us":784644}
W20260709 13:07:30.924054 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.929733 21800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.016s	sys 0.032s
I20260709 13:07:30.931593 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:30.932868 22521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.010s	sys 0.037s
W20260709 13:07:30.935618 22521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.010s	sys 0.038s
W20260709 13:07:30.936074 21800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.016s	sys 0.032s
W20260709 13:07:30.936183 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 763651us
I20260709 13:07:30.938661 22521 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:30.822579 27619 raft_consensus.cc:2764] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 13:07:30.943567 21832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.047s
W20260709 13:07:30.945257 21832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.000s	sys 0.047s
I20260709 13:07:30.832530 27279 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:30.949054 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.013s	sys 0.008s
W20260709 13:07:30.951337 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.013s	sys 0.008s
W20260709 13:07:30.951723 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 621032us
I20260709 13:07:30.818670 27571 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:30.952498 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.830262 27508 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.119s
W20260709 13:07:30.848187 27531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.011s	sys 0.018s
I20260709 13:07:30.841825 27014 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:30.967000 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:30.967877 21981 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
W20260709 13:07:30.952777 21949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.003s	sys 0.019s
I20260709 13:07:30.933082 27548 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:30.970512 21949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.003s	sys 0.019s
W20260709 13:07:30.974951 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 643978us
I20260709 13:07:30.975986 27279 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:30.951267 27226 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:30.971978 21980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.002s	sys 0.018s
I20260709 13:07:30.975983 27548 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:30.980417 27611 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:07:30.985453 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2496) took 1344 ms. Trace:
I20260709 13:07:30.985904 21974 rpcz_store.cc:276] 0709 13:07:29.641249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.642365 (+  1116us) service_pool.cc:224] Handling call
0709 13:07:29.655771 (+ 13406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.656094 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.656120 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.665844 (+  9724us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.163221 (+497377us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:30.163276 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.163361 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.985219 (+821858us) raft_consensus.cc:1685] finished
0709 13:07:30.985245 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.985385 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":313,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":16499,"thread_start_us":417205,"threads_started":1,"wal-append.queue_time_us":940571}
I20260709 13:07:30.982357 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2571) took 1192 ms. Trace:
I20260709 13:07:30.988399 21908 rpcz_store.cc:276] 0709 13:07:29.790079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.790334 (+   255us) service_pool.cc:224] Handling call
0709 13:07:29.809064 (+ 18730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.809425 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.809461 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.809963 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.518249 (+708286us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:30.518293 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.518355 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.982070 (+463715us) raft_consensus.cc:1685] finished
0709 13:07:30.982099 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.982285 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3999,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":670773,"threads_started":1,"wal-append.queue_time_us":1008455}
I20260709 13:07:30.983886 27548 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:30.995306 27605 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
W20260709 13:07:30.996438 27607 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 13:07:30.972821 27314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.014s	sys 0.006s
W20260709 13:07:31.006409 27314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.014s	sys 0.006s
W20260709 13:07:30.962427 21874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.002s	sys 0.019s
W20260709 13:07:31.007903 21874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.003s	sys 0.019s
I20260709 13:07:31.011631 27463 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:30.979573 21980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.002s	sys 0.019s
I20260709 13:07:31.015293 27502 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:31.015862 27502 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:31.016790 27502 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:30.961814 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.020920 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2635) took 1236 ms. Trace:
I20260709 13:07:31.021032 27569 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:31.021502 27613 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:07:31.022454 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 60697.1us
I20260709 13:07:31.022856 27425 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:31.021559 21825 rpcz_store.cc:276] 0709 13:07:29.784505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.828070 (+ 43565us) service_pool.cc:224] Handling call
0709 13:07:29.828388 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:29.901653 (+ 73265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.901685 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:29.902209 (+   524us) log.cc:844] Serialized 52 byte log entry
0709 13:07:30.653887 (+751678us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.653931 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.654002 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.020668 (+366666us) raft_consensus.cc:1685] finished
0709 13:07:31.020691 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.020849 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1035,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4533,"thread_start_us":724301,"threads_started":1,"wal-append.queue_time_us":1060351}
I20260709 13:07:31.023520 27425 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.024006 27425 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:31.027231 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2572) took 1236 ms. Trace:
I20260709 13:07:31.027959 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.029296 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:07:31.029485 27620 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:31.032786 27515 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.027606 21907 rpcz_store.cc:276] 0709 13:07:29.790403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.790861 (+   458us) service_pool.cc:224] Handling call
0709 13:07:29.791144 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.801106 (+  9962us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:29.801138 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.801639 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.480029 (+678390us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.480069 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.480136 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.027026 (+546890us) raft_consensus.cc:1685] finished
0709 13:07:31.027045 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.027166 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9575,"raft.queue_time_us":10740,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":678035,"threads_started":1,"wal-append.queue_time_us":1031781}
W20260709 13:07:31.036307 27422 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.008s	user 0.014s	sys 0.005s
I20260709 13:07:31.036578 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2645) took 1155 ms. Trace:
I20260709 13:07:31.037032 21829 rpcz_store.cc:276] 0709 13:07:29.881355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.013312 (+131957us) service_pool.cc:224] Handling call
0709 13:07:30.013640 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.662319 (+648679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.036362 (+374043us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54000311d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:31.036526 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489809152}
I20260709 13:07:31.036882 27422 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.039084 27546 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.039651 27546 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:31.040381 27546 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:31.040820 27546 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.041246 27546 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:30.968914 27619 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:31.047008 26877 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:31.048468 27615 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:07:31.050930 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2498) took 1408 ms. Trace:
I20260709 13:07:31.051443 21975 rpcz_store.cc:276] 0709 13:07:29.642885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.881471 (+238586us) service_pool.cc:224] Handling call
0709 13:07:29.881822 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.896651 (+ 14829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.896682 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.901707 (+  5025us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.726961 (+825254us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:30.727017 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.727117 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.050667 (+323550us) raft_consensus.cc:1685] finished
0709 13:07:31.050703 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.050861 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":316,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6960,"thread_start_us":712535,"threads_started":1,"wal-append.queue_time_us":1133461}
W20260709 13:07:31.053642 27617 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:31.053872 27434 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.055276 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2632) took 1271 ms. Trace:
I20260709 13:07:31.055716 21831 rpcz_store.cc:276] 0709 13:07:29.783527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.785348 (+  1821us) service_pool.cc:224] Handling call
0709 13:07:29.785711 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.825175 (+ 39464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.825207 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.825686 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.476736 (+651050us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:30.476795 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.476889 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.053067 (+576178us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:31.054943 (+  1876us) raft_consensus.cc:1685] finished
0709 13:07:31.054971 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.055210 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39043,"raft.queue_time_us":55639,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":15164,"spinlock_wait_cycles":7683328,"thread_start_us":650640,"threads_started":1,"wal-append.queue_time_us":1000450}
W20260709 13:07:31.058380 27610 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:31.061681 27547 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:31.062404 27547 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.064610 27547 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.065979 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2565) took 1434 ms. Trace:
I20260709 13:07:31.066282 27517 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.066497 21900 rpcz_store.cc:276] 0709 13:07:29.631144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.634643 (+  3499us) service_pool.cc:224] Handling call
0709 13:07:29.634914 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.635227 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.635253 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.635648 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.473342 (+837694us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:30.473404 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.473502 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.047860 (+574358us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:31.065623 (+ 17763us) raft_consensus.cc:1685] finished
0709 13:07:31.065650 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.065912 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29580,"raft.queue_time_us":963,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":11311,"spinlock_wait_cycles":29346176,"thread_start_us":837291,"threads_started":1,"wal-append.queue_time_us":1187048}
I20260709 13:07:31.068356 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2461) took 1391 ms. Trace:
I20260709 13:07:31.068779 21834 rpcz_store.cc:276] 0709 13:07:29.676815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.720286 (+ 43471us) service_pool.cc:224] Handling call
0709 13:07:29.743773 (+ 23487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.655739 (+911966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.068119 (+412380us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b540017e3d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:31.068295 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2095546240}
I20260709 13:07:31.069882 27543 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:31.070803 27543 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:31.071458 27581 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:31.071955 27581 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.072747 27622 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:31.073288 27622 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.074306 27563 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:30.964236 27531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.011s	sys 0.018s
I20260709 13:07:31.004510 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2497) took 1363 ms. Trace:
I20260709 13:07:31.077587 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.086902 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:31.087522 22551 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:31.087430 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:31.087821 22520 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.624s (SENT) [suppressed 9 similar messages]
I20260709 13:07:31.018226 21949 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:31.073894 27581 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:31.089301 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 71280.1us
I20260709 13:07:31.091739 21977 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:31.093151 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:31.084187 21983 rpcz_store.cc:276] 0709 13:07:29.641519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.641611 (+    92us) service_pool.cc:224] Handling call
0709 13:07:29.641866 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.642149 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.642192 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.642548 (+   356us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.649544 (+1006996us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:30.649597 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.649687 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.004237 (+354550us) raft_consensus.cc:1685] finished
0709 13:07:31.004266 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.004438 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3130,"raft.queue_time_us":602,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":7982,"thread_start_us":926069,"threads_started":1,"wal-append.queue_time_us":1289457}
I20260709 13:07:30.971412 27014 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:31.102591 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:31.103287 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2569) took 1321 ms. Trace:
I20260709 13:07:31.098001 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:31.105700 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:31.041643 27527 consensus_meta.cc:287] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.894s	user 0.011s	sys 0.000s
I20260709 13:07:30.957188 27396 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.127s
I20260709 13:07:31.107324 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:31.103825 21977 rpcz_store.cc:276] 0709 13:07:29.793123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.875729 (+ 82606us) service_pool.cc:224] Handling call
0709 13:07:31.103046 (+1227317us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000b7554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:31.103215 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2721292160}
I20260709 13:07:31.099545 27402 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:07:31.107478 27507 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:31.092703 27432 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:31.112389 27437 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:31.112757 27542 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:31.113511 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2647) took 1213 ms. Trace:
I20260709 13:07:31.099885 27508 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:31.122956 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:31.119259 21826 rpcz_store.cc:276] 0709 13:07:29.899634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.961291 (+ 61657us) service_pool.cc:224] Handling call
0709 13:07:29.961683 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.022896 (+ 61213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.022938 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.038398 (+ 15460us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.733694 (+695296us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:30.733753 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.733845 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.113312 (+379467us) raft_consensus.cc:1685] finished
0709 13:07:31.113340 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.113459 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95410,"raft.queue_time_us":61347,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":121560,"thread_start_us":680919,"threads_started":1,"wal-append.queue_time_us":1057771}
I20260709 13:07:31.131060 21977 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:31.131536 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:31.099119 27502 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:31.115499 22551 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:30.969605 27618 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:31.136740 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:31.114296 21828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.011s	sys 0.014s
I20260709 13:07:31.134460 21900 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:31.135064 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:31.133297 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:31.138545 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:31.139281 21828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.011s	sys 0.015s
W20260709 13:07:31.124373 27567 consensus_meta.cc:287] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.768s	user 0.011s	sys 0.000s
I20260709 13:07:31.140218 21907 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:31.143209 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:31.144630 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:31.145424 21908 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:31.148437 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.025s	sys 0.030s
W20260709 13:07:31.149775 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.025s	sys 0.030s
I20260709 13:07:31.118611 27507 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:31.093065 27563 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:31.152194 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 705505us
I20260709 13:07:31.046093 27619 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:31.152586 21909 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.009s	sys 0.046s
W20260709 13:07:31.156035 21909 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.010s	sys 0.047s
I20260709 13:07:31.153143 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:31.156548 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:31.156858 21906 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:07:31.145756 21872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.010s	sys 0.018s
W20260709 13:07:31.157506 21872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.010s	sys 0.018s
I20260709 13:07:31.117275 27527 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:31.159219 21875 leader_election.cc:400] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:07:31.136466 27437 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:31.152290 27578 consensus_meta.cc:287] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.297s	user 0.005s	sys 0.007s
W20260709 13:07:31.160594 27580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.008s	sys 0.021s
I20260709 13:07:31.177182 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:31.177704 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:31.152345 27425 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.169405 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:31.151556 27618 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:31.176657 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.161854 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:31.159736 27609 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.453s	user 0.002s	sys 0.000s
I20260709 13:07:31.173171 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:31.190846 21907 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:31.186969 21904 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:31.193182 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:31.198012 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:31.207221 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:31.208102 21904 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:31.208863 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:31.209715 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2570) took 1575 ms. Trace:
I20260709 13:07:31.210134 21901 rpcz_store.cc:276] 0709 13:07:29.634090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.636174 (+  2084us) service_pool.cc:224] Handling call
0709 13:07:29.636431 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.636730 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.636756 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.637115 (+   359us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.989177 (+352062us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:29.989215 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.989279 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.114444 (+1125165us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:31.209481 (+ 95037us) raft_consensus.cc:1685] finished
0709 13:07:31.209499 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.209668 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62009,"raft.queue_time_us":8341,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":1928,"spinlock_wait_cycles":16344320,"thread_start_us":314484,"threads_started":1,"wal-append.queue_time_us":985568}
I20260709 13:07:31.211905 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:31.212627 21906 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:31.212417 21901 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:31.217268 21907 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:31.209817 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:31.144153 27626 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:07:31.223694 21977 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:31.230273 21908 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:31.242089 21900 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:31.231703 21903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.016s	sys 0.008s
I20260709 13:07:31.151520 27567 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:31.177376 27019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.021s	sys 0.041s
W20260709 13:07:31.177150 27580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.008s	sys 0.022s
I20260709 13:07:31.154013 27548 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:31.234197 21977 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:07:31.243144 21903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.016s	sys 0.008s
I20260709 13:07:31.255738 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:31.253191 27019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.022s	sys 0.041s
I20260709 13:07:31.232818 27187 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:07:31.181815 27578 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:31.243685 27612 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:31.291469 21975 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:07:31.277982 27535 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.807s	user 0.004s	sys 0.008s
W20260709 13:07:31.294667 27631 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:07:31.295169 27509 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.934s	user 0.011s	sys 0.001s
I20260709 13:07:31.292007 27422 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:31.295760 27612 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.304039 27571 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:31.345672 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.295588 27402 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:31.241082 27507 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:31.310690 27506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.009s	sys 0.024s
I20260709 13:07:31.305763 27622 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:31.367606 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 338346us
W20260709 13:07:31.407393 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 453861us
I20260709 13:07:31.408488 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:31.448823 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 226860us
I20260709 13:07:31.453318 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:31.411971 27506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.009s	sys 0.025s
I20260709 13:07:31.291831 27437 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:31.467634 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.413405 27396 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:31.307245 27535 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.365422 27402 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:31.413821 27422 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.443516 27279 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:31.465001 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:31.459697 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 294981us
W20260709 13:07:31.474583 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 386769us
I20260709 13:07:31.497417 22551 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:31.464143 27454 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:31.473979 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 185181us
I20260709 13:07:31.295035 27618 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:31.452911 27507 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:31.360659 27509 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.358765 27546 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.476595 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.452142 27019 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:31.444867 27543 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:31.509974 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2567) took 1324 ms. Trace:
I20260709 13:07:31.485608 27403 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:31.514200 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:31.552093 21828 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:31.471601 27627 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:31.528934 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:31.512042 27598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.006s	sys 0.014s
I20260709 13:07:31.537137 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2644) took 1662 ms. Trace:
I20260709 13:07:31.537559 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:31.485334 27635 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.486559 27571 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:31.539227 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.472076 27505 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:31.491641 27279 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:31.455428 27629 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
W20260709 13:07:31.548730 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 72200.5us
I20260709 13:07:31.591899 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.543920 21903 rpcz_store.cc:276] 0709 13:07:30.185937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.463206 (+277269us) service_pool.cc:224] Handling call
0709 13:07:30.479422 (+ 16216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.479598 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:30.479852 (+   254us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.509633 (+1029781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.509682 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:31.509724 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.509812 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.509918 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":117,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"thread_start_us":1029340,"threads_started":2}
I20260709 13:07:31.500859 27515 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:31.488632 27527 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.507504 27514 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:31.553225 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 410221us
I20260709 13:07:31.559859 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.504916 27632 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:31.571731 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58456.2us
I20260709 13:07:31.527144 27397 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:31.512388 27454 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:31.575259 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.512187 27226 consensus_queue.cc:1059] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:07:31.501672 27422 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:31.566627 27598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.006s	sys 0.015s
I20260709 13:07:31.598789 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:31.534849 27396 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:07:31.597186 27515 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:31.513403 27506 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 13:07:31.573748 27638 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:07:31.552227 27580 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:31.602835 27578 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.552608 27640 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:31.501279 27531 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:07:31.555330 27627 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:31.613312 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 53530.3us
I20260709 13:07:31.581964 27563 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:31.591462 27505 consensus_queue.cc:1243] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 18.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:31.556397 27019 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.690567 27226 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:31.605856 27571 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:31.692881 22549 raft_consensus.cc:3055] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:07:31.693953 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.696902 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 98175.1us
I20260709 13:07:31.617580 27581 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:31.592041 27434 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:31.788208 27612 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:31.574831 27635 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:31.574060 27402 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:31.797274 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 176454us
I20260709 13:07:31.614306 27514 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.836927 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:31.732472 27515 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:31.702617 27567 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.871323 21798 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:31.928396 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57190.3us
I20260709 13:07:31.929525 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.869421 22549 raft_consensus.cc:740] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:31.618098 27632 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:31.893195 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 350244us
W20260709 13:07:31.783555 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.916616 21799 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad9d9c562d2d411db01a7eaf4427d325. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:31.802819 27580 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:31.933051 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:31.936519 22549 consensus_queue.cc:260] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:31.937997 22549 raft_consensus.cc:3060] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:31.933554 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 96341.2us
I20260709 13:07:31.940414 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.843518 27627 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:31.958971 21874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.007s	sys 0.009s
W20260709 13:07:31.960311 21874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.007s	sys 0.009s
W20260709 13:07:31.960942 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.869351 27571 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:31.700106 27279 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:31.987269 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.996084 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 76151.5us
I20260709 13:07:31.997478 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:31.984762 27226 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:31.998809 27226 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:31.998917 27650 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:07:31.999735 27226 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.003517 27425 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:32.006934 27454 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.008376 27019 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:31.984436 27581 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:32.011952 27502 consensus_meta.cc:287] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.869s	user 0.007s	sys 0.002s
I20260709 13:07:32.012681 21905 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:07:32.013017 21905 pending_rounds.cc:85] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 8
I20260709 13:07:32.013244 21905 pending_rounds.cc:107] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:07:32.013520 21905 raft_consensus.cc:2889] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:32.006100 27014 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.889s	user 0.006s	sys 0.002s
I20260709 13:07:32.015027 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:32.014853 27014 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.016160 27543 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:31.942519 27563 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:32.017144 27397 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:32.017599 27397 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:32.017828 27014 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.018105 27567 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:32.017625 27279 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:32.006078 27425 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:31.989352 27644 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.458s	user 0.000s	sys 0.001s
I20260709 13:07:32.019942 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2571) took 1832 ms. Trace:
I20260709 13:07:32.020941 27678 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:32.020431 21909 rpcz_store.cc:276] 0709 13:07:30.187269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.478701 (+291432us) service_pool.cc:224] Handling call
0709 13:07:30.478993 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.158212 (+679219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.158263 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.163648 (+  5385us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.487212 (+323564us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:31.487263 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.487336 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.019748 (+532412us) raft_consensus.cc:1685] finished
0709 13:07:32.019771 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.019894 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28174,"raft.queue_time_us":249568,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7373,"thread_start_us":933639,"threads_started":2,"wal-append.queue_time_us":831372}
I20260709 13:07:32.022125 27678 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:32.022557 27678 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:32.023509 27643 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:07:32.023451 27678 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.024776 27678 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:32.025076 27639 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:07:32.026352 27403 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:32.026721 27647 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:32.035030 27657 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.432s	user 0.004s	sys 0.003s
I20260709 13:07:32.026818 27403 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:31.557816 21832 rpcz_store.cc:276] 0709 13:07:29.874861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.015406 (+140545us) service_pool.cc:224] Handling call
0709 13:07:30.015847 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:30.146585 (+130738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.146628 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:30.178985 (+ 32357us) log.cc:844] Serialized 52 byte log entry
0709 13:07:30.947239 (+768254us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:31.364956 (+417717us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.446939 (+ 81983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.447230 (+   291us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.536716 (+ 89486us) raft_consensus.cc:1685] finished
0709 13:07:31.536763 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.537026 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159714,"prepare.queue_time_us":563252,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":127775,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":21337,"thread_start_us":1005499,"threads_started":2,"wal-append.queue_time_us":930980}
I20260709 13:07:32.020012 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 724) took 1214 ms. Trace:
I20260709 13:07:32.018193 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 743) took 2087 ms. Trace:
I20260709 13:07:32.071908 22549 raft_consensus.cc:1275] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:31.909443 27578 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:07:31.842209 27640 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:31.984640 27638 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:07:31.988652 27637 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 13:07:32.039286 21980 rpcz_store.cc:276] 0709 13:07:29.930940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.240374 (+309434us) service_pool.cc:224] Handling call
0709 13:07:30.240688 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.013472 (+772784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.013568 (+    96us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.014590 (+  1022us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.473103 (+458513us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:31.473148 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.474115 (+   967us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.017976 (+543861us) raft_consensus.cc:1685] finished
0709 13:07:32.017995 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.018118 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91144,"raft.queue_time_us":216921,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":11226,"thread_start_us":1063802,"threads_started":2,"wal-append.queue_time_us":582601}
I20260709 13:07:32.123272 22555 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:32.081230 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:32.081605 22551 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:31.991911 27571 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:32.038892 22550 rpcz_store.cc:276] 0709 13:07:30.805718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.805892 (+   174us) service_pool.cc:224] Handling call
0709 13:07:30.806350 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.806861 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.806906 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.807476 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.221069 (+413593us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:31.221121 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.221206 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.019836 (+798630us) raft_consensus.cc:1685] finished
0709 13:07:32.019852 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.019943 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3864,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7555,"thread_start_us":413223,"threads_started":1,"wal-append.queue_time_us":648547}
I20260709 13:07:32.017735 27535 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:31.927153 27434 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.144413 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:32.147511 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:32.036579 27397 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:32.150826 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.155494 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:32.055248 27641 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.156908 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.123814 27499 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.489s	user 0.011s	sys 0.003s
I20260709 13:07:32.018695 27567 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:32.053997 27506 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.988524 27645 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.299s
W20260709 13:07:31.988775 27663 consensus_queue.cc:1175] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 16 status { last_received { term: 16 index: 11 } last_committed_idx: 10 last_received_current_leader { term: 16 index: 11 } }
I20260709 13:07:32.134876 27505 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.134654 27509 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:32.175338 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.135054 27548 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.182541 27422 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:32.183576 27434 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:32.143023 27546 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:32.185315 27507 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.000s
I20260709 13:07:32.172385 27567 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:32.190308 27670 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:32.193635 27432 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:32.193683 27666 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:32.147924 27552 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:32.172706 27641 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.195351 27506 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:32.198488 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.234630 27514 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:32.244534 27630 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.079964 27581 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:32.223372 21949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.004s	sys 0.012s
W20260709 13:07:32.267836 21949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.004s	sys 0.012s
W20260709 13:07:32.268270 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 664157us
W20260709 13:07:32.203254 27508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.008s	sys 0.043s
I20260709 13:07:32.233353 27397 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.176918 27396 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.240867 27403 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.271481 27396 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.196818 27314 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:32.273113 27403 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:32.273031 27314 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.210631 27651 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:32.274492 27651 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.277181 27651 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:32.198582 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 51265.1us
I20260709 13:07:32.278493 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:32.279422 21832 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:32.279948 27314 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.281886 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:32.284423 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:32.285094 21825 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:32.285938 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:32.287302 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:32.258155 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 317825us
W20260709 13:07:32.172655 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 214533us
W20260709 13:07:32.264910 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 427983us
I20260709 13:07:32.295449 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:32.296985 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:32.271001 27508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.008s	sys 0.044s
I20260709 13:07:32.294214 21830 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:32.300138 21831 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:07:32.316329 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:32.317431 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:32.243456 27548 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:32.318076 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.266217 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.012s	sys 0.013s
I20260709 13:07:32.301229 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:32.319439 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.013s	sys 0.013s
I20260709 13:07:32.224870 27642 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:07:32.321058 21905 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:32.227869 27505 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.320813 21909 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:07:32.319151 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.319059 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:32.249550 27432 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:32.312122 27527 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:32.315521 27581 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:32.326310 21830 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:32.318449 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:32.328429 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:32.331897 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:32.330785 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.329064 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.341662 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:32.342031 21900 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:32.331252 21901 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:32.325163 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:32.322139 27546 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:32.264353 27552 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.314193 27619 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.316296 27279 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:32.336187 27432 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:32.253454 27670 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.347846 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:32.350179 27580 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:32.351678 22548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:32.352360 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.337788 27640 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:32.354961 27677 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:32.326664 27684 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:07:32.356871 22552 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:32.318923 27651 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:07:32.310060 27630 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.386755 27314 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:32.379665 27505 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.379683 27670 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.337364 27635 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.381172 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:32.383970 27402 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:32.388896 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:32.445686 21982 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:32.444576 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:32.389084 21975 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:32.446683 27633 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:32.321409 27397 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:07:32.375860 27581 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.421862 27684 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:32.448314 27684 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:32.449229 27684 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.380051 27641 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.378222 27498 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:32.374840 27506 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.390044 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.390394 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:32.390774 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.337249 27527 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:32.405726 27437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.013s	sys 0.020s
I20260709 13:07:32.360584 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.392179 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.391911 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:32.394685 21980 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:07:32.385723 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:32.336126 27514 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:07:32.402598 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.415079 21799 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:32.415953 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 68225.8us
I20260709 13:07:32.451326 21905 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:32.458215 21798 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:32.400699 27634 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.400147 27632 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:32.423313 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 64129.1us
W20260709 13:07:32.378998 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.398118 27279 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:32.419138 27691 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:32.421324 27688 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:07:32.440174 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:32.440537 27552 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:32.441253 27403 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:32.424705 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:32.451589 21902 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
W20260709 13:07:32.427846 27683 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:32.460469 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.460834 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:32.669195 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 211092us
I20260709 13:07:32.669584 27396 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.449265 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:32.671372 27422 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:32.671046 27279 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.670578 27697 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:32.671859 27422 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:32.672158 27697 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.672523 27422 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.672959 27697 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:32.450145 27571 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.674643 27630 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:32.431020 27569 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.676239 27569 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.676992 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:32.671066 27673 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:32.450412 27684 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:32.678453 27673 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.679107 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 845) took 2747 ms. Trace:
I20260709 13:07:32.679492 22549 rpcz_store.cc:276] 0709 13:07:29.931642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.931789 (+   147us) service_pool.cc:224] Handling call
0709 13:07:29.932075 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.072521 (+2140446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.678873 (+606352us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54004f7ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:32.679033 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3930227968}
I20260709 13:07:32.680552 27673 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:32.675613 27700 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.467746 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.545435 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:32.683023 21905 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:32.424053 27629 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:32.683440 22553 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:32.427193 27548 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:32.643750 27514 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:32.467566 21907 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 21: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:32.456993 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:32.491377 21830 raft_consensus.cc:2468] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:32.538822 21982 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:07:32.669965 21798 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:32.455196 21831 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:32.499244 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.454242 21900 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:07:32.686975 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 141612us
W20260709 13:07:32.582683 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 167676us
W20260709 13:07:32.627691 27649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.029s	sys 0.037s
I20260709 13:07:32.689317 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.690205 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.675551 27571 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:32.453528 27437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.013s	sys 0.020s
W20260709 13:07:32.589048 27622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.002s	sys 0.018s
I20260709 13:07:32.726697 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:32.455030 27642 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.591841 27633 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:32.735059 27633 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.729514 27514 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.737102 27633 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:32.451920 27627 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.729753 27632 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:32.729889 27569 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:32.738811 27632 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.739737 27546 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:32.741150 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 71259.6us
I20260709 13:07:32.741472 27632 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:32.741986 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:32.455231 27505 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.727133 21905 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:32.668334 27567 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.671905 27403 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:32.733028 27649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.035s	sys 0.041s
I20260709 13:07:32.727598 21902 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:32.686244 27629 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:32.733476 27676 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:32.734558 27673 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:32.742198 27548 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:32.744081 21834 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:32.744411 27627 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.738834 27642 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.726027 27506 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.746109 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76791.2us
W20260709 13:07:32.746711 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.747542 21981 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:32.747208 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:07:32.671482 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 222320us
I20260709 13:07:32.452162 27527 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:32.705682 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.808984 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:32.775476 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47863.7us
W20260709 13:07:32.778512 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.732661 27622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.002s	sys 0.019s
I20260709 13:07:32.750785 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:32.688426 27700 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.822029 27695 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:32.822695 27700 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:32.786775 22546 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:32.451273 27515 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.824421 27226 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:32.824904 27515 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.732008 27630 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:32.825604 27630 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.799821 27676 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:32.827755 27630 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.827204 27676 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.828315 21831 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:32.731806 27578 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:32.829051 27578 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.829739 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:32.774721 27552 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:32.672576 27634 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.680585 27697 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.832715 27634 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:32.804215 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.832957 27697 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.835600 21906 raft_consensus.cc:2410] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:07:32.836856 21833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.024s
W20260709 13:07:32.837260 21833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.007s	sys 0.024s
I20260709 13:07:32.810774 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:32.779810 27661 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:32.450477 27498 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:32.802896 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 55749.6us
I20260709 13:07:32.453127 27432 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.847203 27629 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.848421 27629 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:32.849398 27432 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:32.849294 27670 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:07:32.814014 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 63317.9us
I20260709 13:07:32.818316 27627 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:32.842475 27444 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:32.851938 27444 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:32.853184 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.852779 27444 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.853348 27653 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:32.853742 27653 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:32.820009 27567 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:32.775645 27632 consensus_queue.cc:1048] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:07:32.854602 27653 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.855643 27653 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.838701 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:32.857810 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:32.858297 21798 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:32.777997 27505 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.844666 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:32.847124 27671 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.847487 27578 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:32.860252 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.844010 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:32.880223 21982 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: [20.14-21.15]
I20260709 13:07:32.881644 21982 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
W20260709 13:07:32.860909 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.871429 21975 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:32.782228 27691 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:07:32.875205 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:32.882788 21974 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:32.875828 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:32.809808 27506 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.876080 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:32.885015 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.889580 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:32.834889 27633 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:32.839673 27635 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:32.893088 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.895967 21974 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12.
I20260709 13:07:32.897333 21949 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:32.925168 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.872843 27527 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:32.925554 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:32.897742 27701 ts_tablet_manager.cc:933] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:07:32.927146 21949 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:32.927361 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:32.929600 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:32.960728 21902 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:32.960623 22553 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:32.962409 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:32.963085 21982 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:32.930788 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:32.799598 27548 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:32.874917 27697 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:32.939980 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:32.961596 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:32.875161 27515 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:32.924921 21909 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:32.894852 27634 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:32.843371 27622 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:07:32.822738 27695 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.969270 21902 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:32.924369 27632 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:32.979508 27187 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.944846 27580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.004s
I20260709 13:07:32.975099 27432 raft_consensus.cc:2804] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:32.985699 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.987993 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 91509.3us
W20260709 13:07:33.032989 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.876205 27437 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:07:32.932173 27569 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:32.869979 27661 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.970906 27697 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:33.029824 21982 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:32.984529 21975 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:33.031148 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:32.845176 27403 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:32.958348 27678 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:07:32.886098 27671 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:33.006520 27580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.012s	sys 0.005s
I20260709 13:07:33.042069 21902 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.042330 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.050938 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.061131 21975 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:33.063326 27678 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:33.068528 27422 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:33.040665 27682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.014s	sys 0.028s
I20260709 13:07:33.044353 27697 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:32.961788 27498 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:33.080175 21903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.006s	sys 0.021s
W20260709 13:07:33.070389 27682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.014s	sys 0.031s
I20260709 13:07:33.040551 27432 raft_consensus.cc:697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:33.077154 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:33.075556 27622 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.083014 21903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.007s	sys 0.021s
I20260709 13:07:33.055203 27664 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:33.030237 27314 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:33.043330 27688 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:07:33.073870 27670 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.094748 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.042867 27665 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:33.028349 27187 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.098306 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:33.086329 27498 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:33.095604 21979 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
W20260709 13:07:33.098773 27705 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:07:33.091511 21902 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:33.096540 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:33.099682 21903 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.089322 27664 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.084143 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.111771 21975 raft_consensus.cc:2410] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:07:33.093359 27314 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:33.115285 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.149011 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:33.150549 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 258893us
I20260709 13:07:33.151300 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.097855 27665 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:33.153167 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:33.153254 21975 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:33.153936 21902 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:33.154862 21975 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:07:33.164479 21979 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:33.165354 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 275826us
I20260709 13:07:33.167232 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:33.113152 27664 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:33.091539 27622 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.175617 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:33.170501 27612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.027s
I20260709 13:07:33.099551 27670 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:33.173411 27703 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:07:33.163385 27627 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.168975 27542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.240s	user 0.012s	sys 0.045s
I20260709 13:07:33.160964 27642 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:33.174279 27621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.010s	sys 0.005s
I20260709 13:07:33.172513 27545 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:33.206002 27612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.027s
I20260709 13:07:33.227954 21902 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:07:33.208134 27505 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:33.216759 27621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.011s	sys 0.005s
W20260709 13:07:33.210740 27542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.293s	user 0.013s	sys 0.046s
I20260709 13:07:33.212497 27548 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:33.230361 27704 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
I20260709 13:07:33.225908 27665 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.242630 21903 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:33.265107 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:33.249130 21828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.038s
W20260709 13:07:33.346517 21828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.008s	sys 0.044s
I20260709 13:07:33.182322 27432 consensus_queue.cc:237] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:33.250778 27402 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.809s	user 0.011s	sys 0.002s
W20260709 13:07:33.246821 27707 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:07:33.218434 27627 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:33.244819 27708 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:07:33.265645 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.357398 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:33.365479 21829 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:33.366581 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:33.367259 21829 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:33.368149 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:33.368868 21829 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:33.369784 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:33.244915 27505 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:33.251370 27622 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:33.244197 27661 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:33.363886 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.247437 27515 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:33.251253 27578 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:33.209700 27314 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:33.370918 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.372263 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:33.226676 27545 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:33.375658 21903 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:07:33.378830 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2588) took 2145 ms. Trace:
I20260709 13:07:33.361020 27630 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:33.363135 27437 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.363293 27671 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:33.391842 21904 rpcz_store.cc:276] 0709 13:07:31.228347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.228474 (+   127us) service_pool.cc:224] Handling call
0709 13:07:31.228739 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.554230 (+325491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.554273 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.421080 (+866807us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800362560. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a
0709 13:07:32.602298 (+181218us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b2c00010828. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:07:32.643034 (+ 40736us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.081770 (+438736us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:33.081815 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.081881 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.373416 (+291535us) raft_consensus.cc:1685] finished
0709 13:07:33.373445 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.373594 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":314988,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":13009,"spinlock_wait_cycles":48297728,"thread_start_us":763463,"threads_started":2,"wal-append.queue_time_us":601801}
I20260709 13:07:33.402681 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:33.403355 21904 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:33.375679 27665 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.396728 21829 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:33.406999 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:33.408710 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:33.385200 21983 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:33.375960 27612 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.381284 27578 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:33.393368 27640 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:33.412237 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 747) took 1114 ms. Trace:
I20260709 13:07:33.420404 21825 rpcz_store.cc:276] 0709 13:07:32.297451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.297609 (+   158us) service_pool.cc:224] Handling call
0709 13:07:32.297989 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.298398 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.298435 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.298960 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.683295 (+384335us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:32.683332 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.683710 (+   378us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.411989 (+728279us) raft_consensus.cc:1685] finished
0709 13:07:33.412016 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.412169 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1318,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":383911,"threads_started":1,"wal-append.queue_time_us":669714}
I20260709 13:07:33.415004 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 749) took 1041 ms. Trace:
I20260709 13:07:33.406342 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:33.411684 27721 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:07:33.427544 27673 consensus_meta.cc:287] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.000s
W20260709 13:07:33.429800 27684 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.751s	user 0.005s	sys 0.005s
I20260709 13:07:33.393570 27569 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:07:33.434660 27716 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:33.399564 27630 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.504961 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.435937 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2662) took 1139 ms. Trace:
I20260709 13:07:33.506008 21833 rpcz_store.cc:276] 0709 13:07:32.296511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.302286 (+  5775us) service_pool.cc:224] Handling call
0709 13:07:32.302623 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.303001 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.303038 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.303570 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.837675 (+534105us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:32.837730 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.841265 (+  3535us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.435660 (+594395us) raft_consensus.cc:1685] finished
0709 13:07:33.435689 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.435866 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1161,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":533710,"threads_started":1,"wal-append.queue_time_us":786155}
I20260709 13:07:33.436472 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:33.386554 27676 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:07:33.516155 27647 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.439795 27691 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:07:33.516669 27647 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:33.420300 27640 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:33.537422 27697 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.537567 27640 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:33.538558 27640 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:33.539198 27670 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:33.381489 27505 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:33.542506 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.538492 27578 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:33.543828 27505 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:33.544253 27578 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:33.549249 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2510) took 2316 ms. Trace:
I20260709 13:07:33.549619 21981 rpcz_store.cc:276] 0709 13:07:31.233226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.233361 (+   135us) service_pool.cc:224] Handling call
0709 13:07:31.250580 (+ 17219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.802194 (+1551614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.548993 (+746799us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002260d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:33.549156 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3442148608}
I20260709 13:07:33.551193 21981 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:07:33.552080 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.554639 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2586) took 1224 ms. Trace:
I20260709 13:07:33.554993 21907 rpcz_store.cc:276] 0709 13:07:32.330126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.330554 (+   428us) service_pool.cc:224] Handling call
0709 13:07:33.554451 (+1223897us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540020b7d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:33.554567 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288855296}
I20260709 13:07:33.556037 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:33.556972 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:33.557863 27567 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:33.558274 27567 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:33.559139 27567 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:33.560226 27691 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:33.560624 27691 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:33.561043 27691 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.561520 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2595) took 1125 ms. Trace:
I20260709 13:07:33.563165 27422 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:33.561983 21905 rpcz_store.cc:276] 0709 13:07:32.435858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.777914 (+342056us) service_pool.cc:224] Handling call
0709 13:07:32.778203 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.835256 (+ 57053us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:32.850487 (+ 15231us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.233648 (+383161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.234992 (+  1344us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:33.235033 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.561272 (+326239us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b54000fb254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:33.561319 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.561456 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50899,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":1742,"raft.queue_time_us":86,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6875,"spinlock_wait_cycles":130751744,"thread_start_us":382846,"threads_started":1,"wal-append.queue_time_us":675916}
I20260709 13:07:33.564410 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:33.514626 27545 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:33.567184 27527 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.004s
I20260709 13:07:33.567687 21908 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
W20260709 13:07:33.568451 27653 consensus_meta.cc:287] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
I20260709 13:07:33.569643 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 2597) took 1133 ms. Trace:
I20260709 13:07:33.571384 21905 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:33.571905 27696 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.896s	user 0.000s	sys 0.019s
I20260709 13:07:33.573365 27552 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:33.573743 27552 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:33.574525 27552 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:33.575767 27552 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.575910 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54264 (request call id 753) took 1201 ms. Trace:
I20260709 13:07:33.576270 21976 rpcz_store.cc:276] 0709 13:07:32.374724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.375321 (+   597us) service_pool.cc:224] Handling call
0709 13:07:33.504801 (+1129480us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:07:33.575851 (+ 71050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3009408}
W20260709 13:07:33.577193 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.529824 27630 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:33.570019 21908 rpcz_store.cc:276] 0709 13:07:32.436416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.456595 (+ 20179us) service_pool.cc:224] Handling call
0709 13:07:33.569494 (+1112899us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b5400307354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:33.569593 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057578240}
I20260709 13:07:33.584416 21908 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:33.437956 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:33.588724 27697 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:33.590611 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 852) took 1158 ms. Trace:
I20260709 13:07:33.590968 22546 rpcz_store.cc:276] 0709 13:07:32.432637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.432758 (+   121us) service_pool.cc:224] Handling call
0709 13:07:32.535734 (+102976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.823494 (+287760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.590421 (+766927us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400705154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:33.590561 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576885632}
I20260709 13:07:33.408082 27187 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:33.594622 27629 consensus_meta.cc:287] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.746s	user 0.003s	sys 0.009s
I20260709 13:07:33.596568 27695 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:33.597498 21907 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:33.599313 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2587) took 1233 ms. Trace:
I20260709 13:07:33.599653 21906 rpcz_store.cc:276] 0709 13:07:32.366234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.389817 (+ 23583us) service_pool.cc:224] Handling call
0709 13:07:33.599128 (+1209311us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540020b2d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:33.599258 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883726208}
I20260709 13:07:33.603104 27314 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:33.603928 21900 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:07:33.604332 21900 pending_rounds.cc:85] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 7
I20260709 13:07:33.604549 21900 pending_rounds.cc:107] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:07:33.604774 21900 raft_consensus.cc:2889] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.605949 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2592) took 1171 ms. Trace:
I20260709 13:07:33.606354 21900 rpcz_store.cc:276] 0709 13:07:32.435028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.742822 (+307794us) service_pool.cc:224] Handling call
0709 13:07:32.743263 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.605183 (+861920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.605716 (+   533us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54003c9954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:33.605888 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978499456}
I20260709 13:07:33.608183 27647 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:33.416226 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:33.510553 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:33.424783 27514 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:33.522156 27444 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.406404 27437 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.611469 21904 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:33.613814 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2592) took 1221 ms. Trace:
I20260709 13:07:33.614245 21909 rpcz_store.cc:276] 0709 13:07:32.392602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.401204 (+  8602us) service_pool.cc:224] Handling call
0709 13:07:33.613623 (+1212419us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54002e72d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:33.613748 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075211136}
I20260709 13:07:33.615423 27636 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:33.615682 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2651) took 1344 ms. Trace:
I20260709 13:07:33.616096 21834 rpcz_store.cc:276] 0709 13:07:32.271571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.271746 (+   175us) service_pool.cc:224] Handling call
0709 13:07:32.358839 (+ 87093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.793828 (+434989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.615478 (+821650us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54001d7ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:33.615630 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885569280}
I20260709 13:07:33.615805 27636 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:33.617332 21834 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:33.617620 27636 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:33.525159 27627 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:33.519742 27542 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:33.618662 27636 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:33.618948 27542 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:33.619762 27542 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.624145 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2668) took 1318 ms. Trace:
I20260709 13:07:33.624562 21831 rpcz_store.cc:276] 0709 13:07:32.306001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.776578 (+470577us) service_pool.cc:224] Handling call
0709 13:07:32.776940 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.828695 (+ 51755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.623888 (+795193us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b540017f7d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:33.624080 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117715712}
I20260709 13:07:33.529747 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 753) took 1152 ms. Trace:
I20260709 13:07:33.625938 21833 rpcz_store.cc:276] 0709 13:07:32.377263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.527995 (+1150732us) service_pool.cc:224] Handling call
0709 13:07:33.528697 (+   702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.529021 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.529067 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.529153 (+    86us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:33.529228 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.529537 (+   309us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.529685 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:33.530439 27720 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:07:33.425541 21978 rpcz_store.cc:276] 0709 13:07:32.373568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.375689 (+  2121us) service_pool.cc:224] Handling call
0709 13:07:33.406865 (+1031176us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:07:33.414930 (+  8065us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3041536}
I20260709 13:07:33.630092 27403 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:33.534827 27725 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:07:33.509326 27684 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:33.631103 27684 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:33.421597 27612 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.443137 27673 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:33.541961 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2666) took 1236 ms. Trace:
I20260709 13:07:33.633440 21980 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
W20260709 13:07:33.591456 27699 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.923s	user 0.008s	sys 0.006s
I20260709 13:07:33.633662 21830 rpcz_store.cc:276] 0709 13:07:32.305460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.731722 (+426262us) service_pool.cc:224] Handling call
0709 13:07:32.748747 (+ 17025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.748978 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.749012 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.776447 (+ 27435us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.179285 (+402838us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:33.179339 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.179408 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.541764 (+362356us) raft_consensus.cc:1685] finished
0709 13:07:33.541781 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.541907 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":377692,"threads_started":1,"wal-append.queue_time_us":595461}
W20260709 13:07:33.575770 27226 consensus_meta.cc:287] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.000s
I20260709 13:07:33.638265 22548 raft_consensus.cc:606] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:33.638690 22548 raft_consensus.cc:614] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:33.641219 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:54160 (request call id 5) took 1289 ms. Trace:
I20260709 13:07:33.641618 22548 rpcz_store.cc:276] 0709 13:07:32.351365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.351525 (+   160us) service_pool.cc:224] Handling call
0709 13:07:33.640971 (+1289446us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002af3d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd8853 00007fb763fa660a 00007fb75d52c7d4 00007fb75d52c762 00007fb75d52c691 00007fb75d52c60c 00007fb75d52b8c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:33.641119 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2845930880}
I20260709 13:07:33.650373 21834 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:33.661980 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.662576 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.672279 27673 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.672951 27673 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.675330 27673 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:33.675833 27673 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.676254 27673 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.679888 27633 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:33.680465 27633 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:33.686323 22548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554595014abc431286bf4ba1922fc147"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:33.439107 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:33.687680 21829 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:33.687141 22548 raft_consensus.cc:606] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:33.688338 22548 raft_consensus.cc:614] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:33.558086 27664 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:33.691696 21974 raft_consensus.cc:2368] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:33.693055 27664 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:33.706431 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:33.707638 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:33.708642 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:33.725936 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:33.751379 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.767155 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.777848 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:33.779670 22519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.019s	sys 0.015s
W20260709 13:07:33.779983 22519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.019s	sys 0.015s
W20260709 13:07:33.780249 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 815417us
I20260709 13:07:33.780918 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:33.701702 27542 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:33.789438 21797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.020s	sys 0.055s
W20260709 13:07:33.789923 21797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.020s	sys 0.055s
W20260709 13:07:33.791064 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.791666 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.792536 21977 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.021s	sys 0.047s
W20260709 13:07:33.792831 21827 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.027s	sys 0.048s
I20260709 13:07:33.748431 27514 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:33.777138 27695 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:07:33.793424 21827 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.027s	sys 0.048s
I20260709 13:07:33.749332 27527 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:33.705096 27506 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:33.792869 21977 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.021s	sys 0.047s
W20260709 13:07:33.786617 27581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.022s	sys 0.046s
W20260709 13:07:33.819836 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.821111 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90821f4436f045a0a3847b276293f36f"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:33.812855 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:33.790931 27226 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:33.825404 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2665) took 1520 ms. Trace:
W20260709 13:07:33.776822 27701 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.031s	sys 0.032s
I20260709 13:07:33.788861 27659 raft_consensus.cc:2764] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:07:33.828058 21829 raft_consensus.cc:606] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:33.832655 21829 raft_consensus.cc:614] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:33.777663 27498 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:33.791241 27684 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:33.830786 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.116s	sys 0.198s
W20260709 13:07:33.834352 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.117s	sys 0.198s
I20260709 13:07:33.835556 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:33.822058 27695 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:33.829054 27581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.377s	user 0.022s	sys 0.046s
W20260709 13:07:33.837194 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 669987us
I20260709 13:07:33.834039 27498 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:33.844715 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:33.827525 27514 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:33.842898 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:33.829326 27527 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:33.834596 27647 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:33.849749 21832 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:33.857303 21798 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:33.838586 27540 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.011s
W20260709 13:07:33.832693 27701 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.031s	sys 0.032s
W20260709 13:07:33.883097 21975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.019s	sys 0.019s
I20260709 13:07:33.883496 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:33.883880 21975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.019s	sys 0.019s
I20260709 13:07:33.884665 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.885417 21974 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:33.830235 21827 rpcz_store.cc:276] 0709 13:07:32.305202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.681135 (+375933us) service_pool.cc:224] Handling call
0709 13:07:32.691443 (+ 10308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.727347 (+ 35904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.727380 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:32.739218 (+ 11838us) log.cc:844] Serialized 52 byte log entry
0709 13:07:33.099401 (+360183us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:33.612564 (+513163us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180032e960. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:33.822318 (+209754us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.822666 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.822760 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.822802 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:33.825221 (+  2419us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.825343 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11335,"prepare.queue_time_us":157615,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":1715,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":39724,"spinlock_wait_cycles":25322880,"thread_start_us":1067656,"threads_started":2,"wal-append.queue_time_us":594486}
I20260709 13:07:33.888832 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:33.889374 22547 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:33.889950 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:33.838099 27226 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:33.894637 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:33.842617 27567 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:33.842996 27515 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:33.843626 27695 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:33.893484 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.895617 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.896428 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.904328 21976 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:07:33.904834 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.905325 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.836187 27629 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:07:33.846328 27659 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:33.898324 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:33.899224 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.899358 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:33.913875 22549 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:33.915182 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.921083 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:33.843317 27499 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:33.906837 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.845394 27498 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:33.907756 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:33.896515 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:33.909126 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:33.910748 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:33.899667 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:07:33.849089 27580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.006s	sys 0.029s
I20260709 13:07:33.910944 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:33.924748 21975 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.983404 22546 raft_consensus.cc:2410] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:07:33.984177 21977 raft_consensus.cc:2376] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16. Re-sending same reply.
I20260709 13:07:33.985379 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:33.978709 22554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:33.989161 21974 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:33.990087 22554 raft_consensus.cc:606] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Received request to transfer leadership to TS 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:33.990450 22554 raft_consensus.cc:614] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:33.875854 27627 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:33.894249 27684 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:33.994567 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 95007.9us
I20260709 13:07:33.992329 22548 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:33.889794 27437 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:33.924921 27397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.019s	sys 0.052s
W20260709 13:07:33.910066 27264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.013s	sys 0.006s
W20260709 13:07:33.989930 27580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.006s	sys 0.030s
I20260709 13:07:33.902374 27581 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:34.004108 22553 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:33.900755 27647 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.905807 27546 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:33.997277 27665 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.001s
I20260709 13:07:34.009093 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:33.910818 27396 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:33.910495 27612 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:33.995699 27571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.002s	sys 0.018s
I20260709 13:07:33.992405 27673 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:34.004989 27397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.026s	sys 0.063s
W20260709 13:07:33.997150 27698 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.010s	sys 0.010s
I20260709 13:07:34.016559 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.016212 21977 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:34.018105 21834 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:33.984973 27701 tablet_copy_client.cc:323] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.129:39085
I20260709 13:07:34.015127 27633 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:34.090477 21902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.018s	sys 0.058s
W20260709 13:07:34.091050 21902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.019s	sys 0.059s
W20260709 13:07:34.027382 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.003486 27499 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.031900 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:33.997020 27659 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.035574 27678 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:34.023727 21975 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:34.010970 27684 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:07:34.007792 27264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.013s	sys 0.006s
I20260709 13:07:34.091768 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2595) took 1208 ms. Trace:
I20260709 13:07:34.092923 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:34.029094 27571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.002s	sys 0.018s
W20260709 13:07:34.096459 21799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.013s	sys 0.025s
I20260709 13:07:34.017525 27396 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:34.103449 21826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.014s	sys 0.066s
I20260709 13:07:34.108089 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:34.051934 27698 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.010s	sys 0.010s
I20260709 13:07:34.018149 27580 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:34.115826 21902 rpcz_store.cc:276] 0709 13:07:32.883335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.228811 (+345476us) service_pool.cc:224] Handling call
0709 13:07:33.248709 (+ 19898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.248910 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:33.338012 (+ 89102us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.091450 (+753438us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.091503 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:34.091551 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.091613 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.091717 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":88670,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":90,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":3919,"thread_start_us":753042,"threads_started":1}
W20260709 13:07:34.120357 21799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.014s	sys 0.029s
I20260709 13:07:34.120186 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:34.017340 27226 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:34.123057 21826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.014s	sys 0.066s
W20260709 13:07:34.124214 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 960068us
I20260709 13:07:34.016299 27647 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.128196 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.127140 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:34.130043 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:34.137367 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.139943 21904 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:34.108899 27678 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:34.141481 21799 connection.cc:256] RPC call timeout handler was delayed by -1.2254706429999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 13:07:34.142768 27678 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.012753 27514 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:34.147783 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.174s	user 0.019s	sys 0.032s
I20260709 13:07:34.140668 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2671) took 1827 ms. Trace:
W20260709 13:07:34.148103 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.019s	sys 0.032s
W20260709 13:07:34.145614 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.148270 21826 rpcz_store.cc:276] 0709 13:07:32.312960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.845406 (+532446us) service_pool.cc:224] Handling call
0709 13:07:32.845768 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.846012 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:33.265407 (+419395us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.140139 (+874732us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.140327 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.140378 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:34.140429 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.140497 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.140605 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":371942,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3962,"raft.queue_time_us":16427,"thread_start_us":1248925,"threads_started":2}
W20260709 13:07:34.150226 21901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.010s	sys 0.019s
I20260709 13:07:34.150476 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:34.150701 21901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.011s	sys 0.019s
W20260709 13:07:34.151826 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.002s	sys 0.020s
I20260709 13:07:34.115204 27684 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:34.017608 27527 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:34.152664 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.002s	sys 0.020s
W20260709 13:07:34.153036 21875 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.006s	sys 0.036s
W20260709 13:07:34.148656 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 1.21785e+06us
W20260709 13:07:34.155879 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.173702 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.174665 21875 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.006s	sys 0.037s
W20260709 13:07:34.175032 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 752277us
W20260709 13:07:34.173844 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 779596us
I20260709 13:07:34.158975 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:34.172276 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:34.182003 21829 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:34.171865 27732 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:07:34.146232 27629 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:34.188968 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.188014 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.192644 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.205814 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.211840 21829 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:07:34.172971 27627 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.200062 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.193246 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:34.177166 27684 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:34.216842 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.226289 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:34.227212 21873 leader_election.cc:400] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:34.217985 21974 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:34.185125 27634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.019s	sys 0.045s
I20260709 13:07:34.227070 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.227660 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:34.217404 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:34.109366 27499 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.227855 21873 leader_election.cc:403] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:34.228341 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:34.228595 21833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.006s	sys 0.010s
W20260709 13:07:34.257666 21833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.006s	sys 0.010s
W20260709 13:07:34.228884 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.258241 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.259559 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.260270 21974 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
W20260709 13:07:34.211862 21800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.008s	sys 0.015s
I20260709 13:07:34.204157 27678 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:34.238620 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.239997 21830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.009s	sys 0.008s
W20260709 13:07:34.269591 21830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.009s	sys 0.008s
I20260709 13:07:34.145406 27580 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:34.254299 21905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.022s
W20260709 13:07:34.238224 21831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.006s	sys 0.011s
W20260709 13:07:34.272778 21905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.001s	sys 0.022s
W20260709 13:07:34.261211 21800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.008s	sys 0.015s
W20260709 13:07:34.269883 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.272853 21831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.007s	sys 0.011s
I20260709 13:07:34.262485 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:34.224998 27432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.018s	sys 0.004s
W20260709 13:07:34.235282 27279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.030s	sys 0.051s
W20260709 13:07:34.254058 27545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.011s	sys 0.013s
W20260709 13:07:34.290838 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.215644 27396 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:34.231657 27634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.020s	sys 0.046s
I20260709 13:07:34.350749 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.351528 21906 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
W20260709 13:07:34.291741 27432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.019s	sys 0.005s
I20260709 13:07:34.313090 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.356884 21975 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:34.289969 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:34.292954 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:34.293540 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:34.263025 21843 tablet_copy_service.cc:140] P 479255846c5141b584b16aa253f587c7: Received BeginTabletCopySession request for tablet ad9d9c562d2d411db01a7eaf4427d325 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:52674)
I20260709 13:07:34.255100 27640 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:34.361974 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:34.362850 22554 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:34.363530 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.254947 27653 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:07:34.279917 27540 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:34.233913 27627 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:34.290653 27545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.011s	sys 0.013s
I20260709 13:07:34.270457 27506 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:07:34.280746 27444 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.671s	user 0.014s	sys 0.005s
W20260709 13:07:34.285185 27279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.031s	sys 0.051s
W20260709 13:07:34.347755 27726 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:34.230904 27630 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:07:34.376842 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:34.304839 27691 consensus_meta.cc:287] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.001s
I20260709 13:07:34.274212 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:34.253360 27629 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:34.364399 27640 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:34.368785 27578 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.824s	user 0.007s	sys 0.003s
I20260709 13:07:34.365132 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:34.349583 27742 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.309020 27717 log.cc:927] Time spent T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.330s	user 0.003s	sys 0.000s
I20260709 13:07:34.338500 27396 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:34.301302 27743 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:34.344954 27729 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.378247 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:34.396296 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:34.396720 22553 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:34.289079 22549 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:34.376837 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:34.367787 27540 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:34.341099 27636 consensus_meta.cc:287] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.006s
W20260709 13:07:34.339462 27314 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.736s	user 0.007s	sys 0.003s
W20260709 13:07:34.335951 27552 consensus_meta.cc:287] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.760s	user 0.009s	sys 0.000s
W20260709 13:07:34.315574 27403 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.004s
I20260709 13:07:34.308470 27499 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.322299 27580 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:34.325656 27647 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.380791 27444 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:34.391440 27432 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:34.390892 27640 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:34.415947 27540 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:34.429692 27567 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.442721 27567 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.390962 27691 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.412453 27627 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:34.423583 27659 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.426050 27743 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:34.395720 27742 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.426546 27729 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:34.488982 27754 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:07:34.494985 27745 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
I20260709 13:07:34.496544 27743 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:34.286407 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 69085.1us
I20260709 13:07:34.527314 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:34.529294 21799 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:34.530763 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:34.534080 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:34.536556 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:34.287432 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.305665 21829 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
W20260709 13:07:34.542606 21825 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.012s	sys 0.015s
W20260709 13:07:34.543190 21825 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.012s	sys 0.016s
I20260709 13:07:34.306394 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2680) took 1334 ms. Trace:
I20260709 13:07:34.341141 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2688) took 1167 ms. Trace:
I20260709 13:07:34.315251 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2660) took 2038 ms. Trace:
I20260709 13:07:34.352635 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.548528 21832 rpcz_store.cc:276] 0709 13:07:32.276954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.281133 (+  4179us) service_pool.cc:224] Handling call
0709 13:07:32.281398 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.881456 (+1600058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.315042 (+433586us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540017fcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:34.315197 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3606492928}
I20260709 13:07:34.549719 21834 raft_consensus.cc:2410] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:07:34.341579 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2677) took 1375 ms. Trace:
I20260709 13:07:34.550377 21906 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
W20260709 13:07:34.550694 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 292639us
I20260709 13:07:34.551376 21843 tablet_copy_service.cc:161] P 479255846c5141b584b16aa253f587c7: Beginning new tablet copy session on tablet ad9d9c562d2d411db01a7eaf4427d325 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:52674: session id = 0157b4f0725d4f92a53938c921db9efc-ad9d9c562d2d411db01a7eaf4427d325
I20260709 13:07:34.552644 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.339354 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.556676 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.557273 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.345599 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:34.325670 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.559278 21902 raft_consensus.cc:2368] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14.
I20260709 13:07:34.559172 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.560431 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2600) took 1184 ms. Trace:
I20260709 13:07:34.560644 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:34.552927 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.560895 21905 rpcz_store.cc:276] 0709 13:07:33.375936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.572529 (+196593us) service_pool.cc:224] Handling call
0709 13:07:33.572827 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.573035 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:33.573645 (+   610us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.559298 (+985653us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.559612 (+   314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.559668 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:34.559796 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.559947 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.560193 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":125703,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2995,"thread_start_us":984373,"threads_started":2,"wal-append.queue_time_us":756619}
I20260709 13:07:34.548448 21830 rpcz_store.cc:276] 0709 13:07:33.173991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.636665 (+462674us) service_pool.cc:224] Handling call
0709 13:07:33.636989 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:33.637389 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.637416 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:33.638000 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:07:34.270085 (+632085us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:34.289556 (+ 19471us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.338951 (+ 49395us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b18002301a0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef1522 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:34.340658 (+  1707us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b18002301a0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:07:34.340832 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.340899 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.340936 (+    37us) raft_consensus.cc:1685] finished
0709 13:07:34.340948 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.341089 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20326,"prepare.queue_time_us":22335,"prepare.run_cpu_time_us":693,"prepare.run_wall_time_us":2682,"raft.queue_time_us":52046,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"spinlock_wait_cycles":95164544,"thread_start_us":620132,"threads_started":1,"wal-append.queue_time_us":660352}
I20260709 13:07:34.564546 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.565256 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.565766 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.560876 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2594) took 1677 ms. Trace:
I20260709 13:07:34.547832 21833 rpcz_store.cc:276] 0709 13:07:32.971561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.628316 (+656755us) service_pool.cc:224] Handling call
0709 13:07:33.628568 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.628749 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:33.629016 (+   267us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.300026 (+671010us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.306024 (+  5998us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:34.306092 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.306197 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.306333 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73650,"prepare.queue_time_us":18449,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":43339,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":628746,"threads_started":1,"wal-append.queue_time_us":716345}
I20260709 13:07:34.339417 21908 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:07:34.604399 21901 rpcz_store.cc:276] 0709 13:07:32.883108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.200706 (+317598us) service_pool.cc:224] Handling call
0709 13:07:33.201296 (+   590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.201560 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.201597 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.204686 (+  3089us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.151226 (+946540us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:34.151281 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.164296 (+ 13015us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.494288 (+329992us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:34.560236 (+ 65948us) raft_consensus.cc:1685] finished
0709 13:07:34.560279 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.560687 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3082496,"thread_start_us":901711,"threads_started":1,"wal-append.queue_time_us":1117820}
I20260709 13:07:34.618999 27552 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:34.619714 22555 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:34.620471 21908 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:34.620580 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.622260 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.631743 22520 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:34.321714 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:34.385234 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 111127us
I20260709 13:07:34.566033 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.577241 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.571767 21977 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:34.585278 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.578826 21906 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:34.566665 21831 rpcz_store.cc:276] 0709 13:07:32.965920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.625561 (+659641us) service_pool.cc:224] Handling call
0709 13:07:33.625861 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.626046 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:33.626338 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.341287 (+714949us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.341334 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:34.341378 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.341436 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.341533 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67267,"prepare.queue_time_us":1188,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":67908,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":49,"thread_start_us":647337,"threads_started":1,"wal-append.queue_time_us":718082}
I20260709 13:07:34.581530 21904 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:34.597596 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.560413 21829 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:34.374126 21979 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:34.378312 21981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.013s	sys 0.037s
I20260709 13:07:34.683724 27627 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:34.684268 27432 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:34.684545 27627 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.685109 27432 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:34.685303 27627 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:34.383603 21982 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:34.301407 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:34.311651 27264 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
W20260709 13:07:34.607674 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 69649.2us
I20260709 13:07:34.689487 22553 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
W20260709 13:07:34.634974 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.690320 27630 consensus_queue.cc:1243] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:34.691277 27647 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:34.691588 27571 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:34.691800 27647 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:34.692425 27647 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:34.692462 27571 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:34.684036 27728 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:34.694825 27728 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:34.695118 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:34.695461 21980 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:34.696317 21829 raft_consensus.cc:2410] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:07:34.697073 27545 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:34.697355 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:34.619503 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:34.699591 22546 raft_consensus.cc:2410] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:07:34.702234 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.703009 27748 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:34.703351 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2664) took 2398 ms. Trace:
I20260709 13:07:34.703596 27748 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.704167 27748 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:34.702279 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.705194 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.705998 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.706974 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2674) took 2324 ms. Trace:
I20260709 13:07:34.707036 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.708258 21834 raft_consensus.cc:2410] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:07:34.634588 27498 consensus_meta.cc:287] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
I20260709 13:07:34.644708 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.624310 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:34.657603 27738 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:07:34.636796 27552 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:34.720032 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.721565 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.717842 27264 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:34.665263 27753 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:34.664055 21907 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:34.732648 21980 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:34.681519 21830 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:34.683982 21981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.013s	sys 0.037s
I20260709 13:07:34.323428 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.753934 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.695334 27728 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.624280 27765 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.712824 27580 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:34.712982 27774 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:34.663954 27678 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.721616 27552 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.707579 21825 rpcz_store.cc:276] 0709 13:07:32.382562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.585664 (+1203102us) service_pool.cc:224] Handling call
0709 13:07:33.585914 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.586087 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:34.543856 (+957769us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.682279 (+138423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.706480 (+ 24201us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:34.706626 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.706746 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.706891 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20917,"prepare.queue_time_us":26921,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":28,"raft.queue_time_us":29650,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"thread_start_us":1040718,"threads_started":2}
I20260709 13:07:34.664149 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:34.703781 21828 rpcz_store.cc:276] 0709 13:07:32.304936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.441516 (+136580us) service_pool.cc:224] Handling call
0709 13:07:32.441837 (+   321us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:32.739631 (+297794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.739663 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:32.740237 (+   574us) log.cc:844] Serialized 78 byte log entry
0709 13:07:33.347155 (+606918us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:33.359261 (+ 12106us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.359434 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.582634 (+223200us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540008a054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:33.582679 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.308896 (+726217us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b20001752f8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75eb8cb91 00007fb75ebaea19 00007fb75eb798c3 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169 00007fb75eb82131 00007fb75eb8142d 000000000038f354
0709 13:07:34.702899 (+394003us) raft_consensus.cc:1685] finished
0709 13:07:34.702933 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.703146 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11145,"prepare.queue_time_us":265378,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":220954,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":174,"spinlock_wait_cycles":690240896,"thread_start_us":606371,"threads_started":1,"wal-append.queue_time_us":1098418}
I20260709 13:07:34.712036 21832 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:34.725919 27630 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:34.709249 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:34.722414 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 400632us
I20260709 13:07:34.676505 27741 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:34.691946 27567 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:34.738837 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.734588 27264 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:34.739599 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.697882 27545 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.732254 27753 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.760224 22554 raft_consensus.cc:2410] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:07:34.810024 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.767982 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.811054 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.761049 21833 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:34.838903 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.845014 21828 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:34.769917 21909 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:34.784035 22553 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:34.843484 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.850760 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:34.851311 21980 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:34.851487 21832 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:34.852109 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 755) took 1871 ms. Trace:
W20260709 13:07:34.802605 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 307596us
I20260709 13:07:34.847009 21909 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:34.783125 21983 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
W20260709 13:07:34.855129 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 93567.2us
W20260709 13:07:34.862669 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.865403 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.775590 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:34.852941 21982 rpcz_store.cc:276] 0709 13:07:32.980231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.152158 (+171927us) service_pool.cc:224] Handling call
0709 13:07:33.173805 (+ 21647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.686714 (+1512909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.851753 (+165039us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002265d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:34.851941 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2781777792}
I20260709 13:07:34.870298 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:34.870434 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.851639 21977 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
W20260709 13:07:34.807060 27684 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.008s
I20260709 13:07:34.867142 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.874265 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.876390 21834 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:34.778396 27659 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:34.893190 21828 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
W20260709 13:07:34.894004 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.894510 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.896165 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.896541 27640 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.897557 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.899370 21905 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:34.899387 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:34.899528 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:34.909006 27688 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:34.909557 27688 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:34.909771 21833 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:34.912815 27774 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.913141 27432 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.776299 27765 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.791765 27498 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.899410 27640 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.920070 22548 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:07:34.920553 22548 pending_rounds.cc:85] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 12
I20260709 13:07:34.920840 22548 pending_rounds.cc:107] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:07:34.921182 22548 raft_consensus.cc:2889] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.901311 27678 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.924995 27678 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.925205 21831 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:07:34.902822 27684 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.926384 27659 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.927058 21831 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:07:34.928005 27684 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.928805 21831 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:34.929193 27659 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:34.930292 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 155079us
I20260709 13:07:34.929946 27264 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.931118 21949 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:34.931514 27264 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.932642 27753 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:34.933830 27765 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.934664 27749 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:34.934885 27279 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:34.935254 27279 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:34.935204 27749 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.935854 27279 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.935918 27749 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:34.936076 27667 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.936919 27667 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:34.937456 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.909996 27688 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:34.939023 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2610) took 1036 ms. Trace:
I20260709 13:07:34.939425 21976 rpcz_store.cc:276] 0709 13:07:33.902250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.989119 (+ 86869us) service_pool.cc:224] Handling call
0709 13:07:34.148360 (+159241us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b58000d3298. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9a22 00007fb764dd2c09 00007fb763f2cee0 00007fb763ff60ab 00007fb763ff6131 00007fb763fb7fc0 00007fb763fa2929 00007fb763fa23d2 00007fb75d519bd4
0709 13:07:34.148537 (+   177us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.148895 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:34.188572 (+ 39677us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.670261 (+481689us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.673502 (+  3241us) log.cc:844] Serialized 52 byte log entry
0709 13:07:34.727819 (+ 54317us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:34.784787 (+ 56968us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.916164 (+131377us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.938345 (+ 22181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.938577 (+   232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.938644 (+    67us) raft_consensus.cc:1685] finished
0709 13:07:34.938658 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.938831 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":272296,"prepare.queue_time_us":222488,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":139,"raft.queue_time_us":234787,"raft.run_cpu_time_us":584,"raft.run_wall_time_us":27563,"spinlock_wait_cycles":2402688,"thread_start_us":379476,"threads_started":1,"wal-append.queue_time_us":287260}
I20260709 13:07:34.942157 21829 raft_consensus.cc:2410] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:07:34.943046 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:07:34.944130 27735 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:34.918071 27741 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.944918 27735 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.943073 27753 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.759403 27571 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.946992 27753 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.948946 27691 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:34.949250 27498 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.952005 27742 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:34.953200 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2536) took 1742 ms. Trace:
I20260709 13:07:34.953730 21981 rpcz_store.cc:276] 0709 13:07:33.211128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.551818 (+340690us) service_pool.cc:224] Handling call
0709 13:07:33.552109 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.552504 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:33.552795 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.888271 (+1335476us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.950562 (+ 62291us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.950812 (+   250us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:34.950854 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.950993 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.952933 (+  1940us) raft_consensus.cc:1685] finished
0709 13:07:34.952954 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.953118 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79409,"prepare.queue_time_us":546,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":92472,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":26072,"thread_start_us":1186885,"threads_started":1,"wal-append.queue_time_us":905602}
I20260709 13:07:34.955780 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:34.957276 27753 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.958222 27753 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:34.957361 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:34.961401 21798 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:34.965437 27729 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:34.968276 21979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2531) took 1916 ms. Trace:
I20260709 13:07:34.970031 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:34.970341 21979 rpcz_store.cc:276] 0709 13:07:33.051366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.175490 (+124124us) service_pool.cc:224] Handling call
0709 13:07:33.175774 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.684631 (+1508857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.967808 (+283177us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002d5354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:34.968084 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2755368704}
I20260709 13:07:34.970664 21909 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.972298 21909 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:34.972453 27774 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.973201 21798 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:34.943848 21829 raft_consensus.cc:606] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:34.986881 27741 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.987493 27741 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:34.988133 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:34.988263 27749 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:34.989310 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2598) took 1096 ms. Trace:
I20260709 13:07:34.989439 21829 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:07:34.973343 27546 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:34.956110 21834 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:07:34.989733 21978 rpcz_store.cc:276] 0709 13:07:33.892596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.892719 (+   123us) service_pool.cc:224] Handling call
0709 13:07:33.893052 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.893392 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.893418 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.893908 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.356510 (+462602us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b18002a2b00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:07:34.784264 (+427754us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:34.784378 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.784492 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.960950 (+176458us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b18002a2b00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:34.978253 (+ 17303us) raft_consensus.cc:1685] finished
0709 13:07:34.978276 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.989115 (+ 10839us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1044,"raft.queue_time_us":710,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":77292,"spinlock_wait_cycles":16745088,"thread_start_us":300784,"threads_started":1,"wal-append.queue_time_us":768712}
I20260709 13:07:34.991914 27667 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:34.978029 27540 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.541s	user 0.017s	sys 0.014s
I20260709 13:07:34.992767 21834 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:07:34.992686 27540 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.994131 22551 raft_consensus.cc:2368] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:34.996203 21834 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:34.997975 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:34.998734 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.999436 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 82401.5us
I20260709 13:07:34.999857 27749 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:35.000113 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.001030 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:35.001152 27630 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.001617 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:34.980473 27545 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:34.977129 27678 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:34.977223 27403 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.001905 27630 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.003022 27653 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:35.004655 27444 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:35.007094 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:35.007978 27540 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.009131 27279 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:34.978487 27735 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:34.917160 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:34.988058 27741 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:34.997553 27748 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.015738 27653 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.033540 27653 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.021772 27691 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:35.013034 27403 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.021991 27774 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:35.040944 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:35.019471 27627 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.036224 27753 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:35.048659 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 50728.8us
W20260709 13:07:35.059090 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 128087us
W20260709 13:07:35.061239 27695 consensus_meta.cc:287] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.082s	user 0.006s	sys 0.013s
I20260709 13:07:35.062655 27741 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.045567 27691 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:35.074729 21832 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.054514 27753 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:35.075717 21909 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:35.075305 21827 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:35.061846 27695 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.068889 21843 tablet_copy_source_session.cc:215] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:35.068830 27749 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:35.066709 27728 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:35.086902 27636 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:07:35.080183 27635 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:35.092140 27786 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.078064 27753 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.104079 27749 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:35.104590 27749 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.104622 27728 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.102352 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:35.090101 27691 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:35.106082 27506 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.011s
I20260709 13:07:35.106572 27506 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
W20260709 13:07:35.110060 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 211956us
I20260709 13:07:35.103905 27786 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.089859 27580 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:35.109455 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2474) took 1092 ms. Trace:
I20260709 13:07:35.115536 21827 rpcz_store.cc:276] 0709 13:07:34.013350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.013795 (+   445us) service_pool.cc:224] Handling call
0709 13:07:35.105614 (+1091819us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b540011f654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:35.105751 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281062144}
W20260709 13:07:35.123499 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 65475.9us
I20260709 13:07:35.079180 27748 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.129912 27695 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:35.093158 27396 consensus_meta.cc:287] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.001s
I20260709 13:07:35.131929 27552 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:35.133209 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47502.9us
I20260709 13:07:35.134949 27264 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:35.135638 27647 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.136853 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:35.137431 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:35.137553 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:35.138705 22551 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:35.139312 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:35.140571 27786 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.095257 27630 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.142336 21830 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:35.173928 22550 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:35.142537 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:35.132926 27748 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:07:35.143826 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.146523 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.146799 27749 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.147405 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.147655 21902 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:35.094353 27403 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.149287 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2480) took 1123 ms. Trace:
I20260709 13:07:35.150110 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:35.151434 27653 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.152496 21905 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:35.183236 27728 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:35.171809 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 76688.1us
W20260709 13:07:35.179733 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.179864 21900 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:35.180182 21909 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:35.182801 27749 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.179850 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:35.172289 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:35.103950 27627 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.184173 21907 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:35.184751 21833 rpcz_store.cc:276] 0709 13:07:34.025817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.910542 (+884725us) service_pool.cc:224] Handling call
0709 13:07:34.910983 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.911442 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.911468 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.911995 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.068863 (+156868us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:35.068903 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.069055 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.149096 (+ 80041us) raft_consensus.cc:1685] finished
0709 13:07:35.149114 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.149228 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1203,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":156430,"threads_started":1,"wal-append.queue_time_us":235288}
I20260709 13:07:35.176440 27432 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.186510 27444 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:07:35.188414 27635 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:35.209561 27647 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.191883 27786 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:35.207299 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 96333.4us
I20260709 13:07:35.210145 27786 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:35.211100 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:35.211495 27786 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.212091 27749 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:35.212939 27786 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.213220 27749 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:35.192308 27728 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.213594 27749 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:35.213999 27749 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.215423 27728 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.216102 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:35.217052 27753 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.194942 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.195572 27396 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.196080 27743 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:35.196163 27691 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:35.227126 27691 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:35.227492 27691 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:35.228485 27691 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.229739 27691 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.230589 27743 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.197089 22547 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:35.197568 27580 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:35.173131 27688 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.199395 27403 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:35.199800 27279 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.200273 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:35.202672 27782 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.107s	user 0.000s	sys 0.004s
I20260709 13:07:35.206234 21827 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:35.206456 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.209266 27635 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.240018 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.194358 27741 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:35.219219 21828 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:35.219333 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 47121.2us
I20260709 13:07:35.220468 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:35.220402 27793 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:35.221797 27444 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:35.220343 27695 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:35.240865 21833 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
W20260709 13:07:35.246621 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.243248 21830 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:35.251245 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:35.254530 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53326.7us
I20260709 13:07:35.236299 27403 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:35.256219 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.258673 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.259057 21979 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:35.259145 27403 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.248013 27741 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.259714 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:35.258677 21978 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:35.260170 27741 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:35.260694 27403 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:35.261238 27748 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:35.262446 21949 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:35.263449 27635 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.251116 27444 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.264052 27667 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:35.264479 27444 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.264624 27667 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.265209 27667 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:35.251813 27647 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:35.266598 27647 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.267071 27647 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:35.233978 27396 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.263032 27748 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:35.253489 27695 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.272961 27695 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:35.273032 27775 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:35.273563 27775 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.273893 27775 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.278586 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.279345 27743 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.279516 21978 raft_consensus.cc:2410] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:07:35.280586 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2481) took 1240 ms. Trace:
I20260709 13:07:35.280941 21828 rpcz_store.cc:276] 0709 13:07:34.030319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.916273 (+885954us) service_pool.cc:224] Handling call
0709 13:07:35.020439 (+104166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.242551 (+222112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.270954 (+ 28403us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002887d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:35.271066 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455507712}
I20260709 13:07:35.282287 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:35.284582 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.284902 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:35.285637 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.285867 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.285935 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:35.286525 21976 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:35.286842 27630 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:35.287897 21948 leader_election.cc:400] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14.
I20260709 13:07:35.288218 21948 leader_election.cc:403] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.288601 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:35.288333 27444 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.289189 27540 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:35.289572 27540 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.289904 27540 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.289835 27678 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:07:35.292449 27795 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:35.292897 27795 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:35.293248 27795 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.295306 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.296926 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.297605 21827 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:35.302585 27630 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:35.304092 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.304879 21981 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:35.304788 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.305796 21828 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:35.306919 27788 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:07:35.307551 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.283761 21728 catalog_manager.cc:5697] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.311800 21976 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:35.313810 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:35.315336 22547 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:35.315140 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.272125 27396 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.317579 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.320212 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.320744 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.324338 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.325616 27264 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14.
I20260709 13:07:35.326675 21830 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.326575 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.327451 27653 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:35.328578 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.329803 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.337649 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.338263 21833 raft_consensus.cc:2376] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14. Re-sending same reply.
I20260709 13:07:35.339203 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.339701 21828 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 13: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.323489 27444 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.341812 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.343954 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:35.346609 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58104.2us
I20260709 13:07:35.330541 27749 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.354135 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.354674 21833 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:35.341374 27753 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.357450 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:35.358031 27792 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:35.358592 27701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9d9c562d2d411db01a7eaf4427d325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:35.363277 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:35.366235 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.364769 27796 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:35.365489 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.367762 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:35.355830 27743 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.365617 27678 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:07:35.374133 27749 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.368572 27796 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:35.374897 27729 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:35.375285 27729 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:35.373311 27653 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:35.375718 27796 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.376324 27653 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.376072 27729 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.376727 27653 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.376473 27795 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.376922 27796 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.377562 27729 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.380630 27743 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.384971 27635 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:35.385679 27753 raft_consensus.cc:993] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: : Instructing follower ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:07:35.386108 27753 raft_consensus.cc:1081] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Signalling peer ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:07:35.385923 27635 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:35.386850 27264 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:35.387693 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.387815 27743 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.388245 21825 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:35.385023 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.391261 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.392371 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.392920 27795 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.396298 22547 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:35.396535 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.370481 27552 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:35.422008 21832 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 19 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 7.
I20260709 13:07:35.397682 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.398077 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:35.398743 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.422741 21831 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:35.423521 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.424216 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:35.424680 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.425377 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:35.425712 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.426091 22551 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 13: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:35.426971 27743 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:35.427593 27743 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:35.399214 27753 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.401513 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.428319 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:35.428553 27743 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.430379 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.430558 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.431070 21982 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.402428 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.431883 21834 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.432672 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.434124 21977 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:35.434535 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.405733 27653 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.406589 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.422600 22553 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:35.406991 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.414842 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.420483 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:35.400043 27688 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.423588 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.416189 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:35.439615 21982 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:35.439772 21828 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.440423 22548 raft_consensus.cc:2410] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:07:35.437464 21830 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:35.441707 21798 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.447042 27653 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.365967 27695 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.450496 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.411693 27635 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:35.417028 27264 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.452451 27571 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:07:35.457234 21831 raft_consensus.cc:2410] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:07:35.457495 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:35.422766 27729 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:35.458745 27545 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:35.459470 27735 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:35.438552 27552 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:35.449622 27444 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:35.460238 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.460703 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:35.453111 27753 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:35.465426 27653 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:35.458689 21874 leader_election.cc:400] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:35.369231 27741 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.458236 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:35.466136 27636 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:07:35.471786 21826 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:35.475215 21728 catalog_manager.cc:5697] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:35.477831 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49648.4us
I20260709 13:07:35.457496 27630 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:35.479364 22547 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.472673 27403 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:35.471858 27729 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.482362 27498 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:35.482623 27653 raft_consensus.cc:3055] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:35.471060 27264 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:35.486888 27798 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:35.484850 27735 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:35.487730 21982 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:35.489600 27765 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:35.489832 27753 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.478729 27736 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:35.491214 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 73608.8us
I20260709 13:07:35.492147 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:35.497181 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:35.499138 27729 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:35.510977 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.498998 27397 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:07:35.512972 27397 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:35.513284 27397 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:35.477808 27444 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:35.503731 21977 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:07:35.477902 27432 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.501824 27792 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.484771 27630 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:35.510614 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.506951 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.482781 27635 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.516844 21833 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:35.497689 27403 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:35.502661 27653 raft_consensus.cc:740] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:35.522298 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.531436 22547 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:35.529788 21983 raft_consensus.cc:2376] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 12. Re-sending same reply.
I20260709 13:07:35.530396 22551 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:07:35.524925 27630 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.525141 21979 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:35.523746 21728 catalog_manager.cc:5697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.543556 21949 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:35.518987 27444 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:35.543484 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51388.8us
I20260709 13:07:35.520196 27498 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:35.520610 27736 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:35.520659 27540 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.552304 27688 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.549762 21977 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:35.554155 27688 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.555042 27540 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.555675 21907 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:35.556129 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:35.556159 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.557230 27498 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.557488 21905 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:35.557607 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:35.546511 27403 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:35.557771 27498 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.558348 21901 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:35.558596 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:35.559175 21907 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.553957 27736 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.559940 27498 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.514112 27397 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.561085 27397 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.550465 21974 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.562873 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:35.564227 27688 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.550984 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.566370 27403 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.520700 27775 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.568409 27403 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.569092 22550 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:07:35.570122 27775 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.520499 27647 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.570768 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.572324 27647 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.573077 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.573577 21826 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:35.576063 27701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60034 (request call id 730) took 3461 ms. Trace:
I20260709 13:07:35.576440 27701 rpcz_store.cc:276] 0709 13:07:32.135008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.147197 (+ 12189us) service_pool.cc:224] Handling call
0709 13:07:32.969703 (+822506us) ts_tablet_manager.cc:934] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
0709 13:07:35.356765 (+2387062us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:35.458027 (+101262us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:35.458149 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:35.575246 (+117097us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:35.575550 (+   304us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:35.575852 (+   302us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:35.575964 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":94821,"tablet-copy.queue_time_us":649682,"thread_start_us":1079373,"threads_started":2}
I20260709 13:07:35.580976 21826 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:07:35.582000 22521 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.582854 27647 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:35.583313 27647 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:35.536422 27552 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.584055 27552 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:35.584167 27647 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.586674 27695 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.548659 22551 pending_rounds.cc:85] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 13
I20260709 13:07:35.590627 22551 pending_rounds.cc:107] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:07:35.590971 22551 raft_consensus.cc:2889] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.543272 27728 raft_consensus.cc:2764] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:07:35.517530 27667 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.523504 27659 consensus_queue.cc:1059] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:35.602180 21907 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:35.599115 27775 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.601054 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.603402 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:35.607460 21975 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:07:35.608187 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.619761 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:35.620621 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:35.607534 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.618566 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.599418 27403 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:35.642057 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 110234us
I20260709 13:07:35.607307 27775 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.641134 27735 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.645476 27775 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.546290 27792 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.582036 27729 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.552268 27432 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.531952 27279 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:35.593519 27701 tablet_copy_client.cc:806] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:35.639936 27659 consensus_queue.cc:1243] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:07:35.663394 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.666778 21905 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:35.668131 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.668895 21983 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 12.
I20260709 13:07:35.671959 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:35.673990 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 122080us
I20260709 13:07:35.672314 21981 raft_consensus.cc:2376] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17. Re-sending same reply.
I20260709 13:07:35.676949 21798 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.680394 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.678085 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:35.676623 21909 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:35.691114 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:35.701913 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.682603 27691 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:35.693605 21728 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 11 to 18, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 18 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:35.724566 21909 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:35.732134 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55279us
I20260709 13:07:35.678337 27753 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:07:35.684355 27748 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:35.710604 27636 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:35.702939 27701 tablet_copy_client.cc:670] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:35.738637 21983 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:35.745718 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:35.747730 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.721239 27741 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.755926 21975 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:35.722363 27743 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:35.756286 21979 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:35.690374 27546 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:07:35.758565 21982 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:35.757988 21905 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:35.738816 27279 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.767673 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.769505 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57225us
I20260709 13:07:35.769876 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:35.772027 21905 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:35.761602 21728 catalog_manager.cc:5697] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 7 to 13, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 13 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:07:35.776638 21731 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33528 (request call id 224) took 50478 ms (client timeout 15000 ms). Trace:
I20260709 13:07:35.777493 27635 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:35.786518 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.786906 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:35.788125 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 102437us
I20260709 13:07:35.789841 21983 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.759678 27743 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.758764 27627 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:35.788494 21728 catalog_manager.cc:5697] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 10 to 15, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 15 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:35.800381 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.800694 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.804189 21833 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:35.741483 27691 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.805932 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.803927 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:35.807031 21830 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:35.809749 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.813076 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.814025 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.788801 27667 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.816536 21977 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:35.819269 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.819610 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.798898 27743 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.821969 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.823748 21905 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:35.825198 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.821584 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.827023 27627 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.827589 27804 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:35.828102 27804 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:35.829196 27627 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.828962 27804 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.829701 27729 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.830569 21978 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:35.831353 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.831666 27691 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.806035 27741 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.834830 27808 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:35.835156 27741 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.836268 21828 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.836735 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.837771 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.838387 21977 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:35.838691 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:35.839823 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:35.840658 27636 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.841225 27659 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:35.777211 21731 rpcz_store.cc:269] 0709 13:06:45.320830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.354905 (+ 34075us) service_pool.cc:224] Handling call
0709 13:07:35.694706 (+50339801us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:30.183480 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:30.414644 (+231164us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:30.414693 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:07:30.414736 (+    43us) tablet.cc:662] Decoding operations
0709 13:07:30.523826 (+109090us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:30.523942 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:30.523980 (+    38us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:30.552666 (+ 28686us) tablet.cc:701] Row locks acquired
0709 13:07:30.576488 (+ 23822us) write_op.cc:260] PREPARE: finished
0709 13:07:30.636729 (+ 60241us) write_op.cc:270] Start()
0709 13:07:30.650005 (+ 13276us) write_op.cc:276] Timestamp: P: 1783602450630818 usec, L: 0
0709 13:07:30.652649 (+  2644us) op_driver.cc:348] REPLICATION: starting
0709 13:07:30.833312 (+180663us) log.cc:844] Serialized 5960 byte log entry
0709 13:07:31.051788 (+218476us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75bed40ac 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b
0709 13:07:32.856940 (+1805152us) op_driver.cc:464] REPLICATION: finished
0709 13:07:34.332965 (+1476025us) write_op.cc:301] APPLY: starting
0709 13:07:34.333050 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:34.411870 (+ 78820us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:34.411909 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:34.669174 (+257265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:34.669869 (+   695us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:07:34.669987 (+   118us) write_op.cc:312] APPLY: finished
0709 13:07:34.670904 (+   917us) log.cc:844] Serialized 139 byte log entry
0709 13:07:34.914894 (+243990us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:35.040147 (+125253us) write_op.cc:454] Released schema lock
0709 13:07:35.051190 (+ 11043us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:35.096018 (+ 44828us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:35.096056 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52418,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":1475777,"apply.run_cpu_time_us":79115,"apply.run_wall_time_us":744457,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66737,"num_ops":15,"prepare.queue_time_us":496071,"prepare.run_cpu_time_us":29709,"prepare.run_wall_time_us":1529050,"raft.queue_time_us":825752,"raft.run_cpu_time_us":21774,"raft.run_wall_time_us":1280069,"replication_time_us":2204127,"spinlock_wait_cycles":6588544,"thread_start_us":2966928,"threads_started":5,"wal-append.queue_time_us":1503015,"wal-append.run_cpu_time_us":77731,"wal-append.run_wall_time_us":1754231}]]}
I20260709 13:07:35.836123 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.842202 21978 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:35.837214 27741 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.848146 27630 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.850754 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.851451 21825 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.852828 27264 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:35.853154 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.853813 21829 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:35.855906 21833 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:35.852435 27630 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:35.837217 21728 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 13 to 14, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 14 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:07:35.859822 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.861690 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:35.822140 27800 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:07:35.862937 21979 raft_consensus.cc:2368] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:35.864203 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.800416 27279 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.884186 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.967151 21974 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:35.967439 21983 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:35.866698 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:35.850783 27636 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.888113 27811 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:07:35.970697 27813 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:35.972084 27279 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.854135 27792 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.816567 27753 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:07:35.893537 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:35.893992 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 105471us
I20260709 13:07:35.975248 21979 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
W20260709 13:07:35.976020 27805 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:07:35.977041 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.883510 27729 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:35.978407 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.898072 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.861490 27444 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:35.910012 21978 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:35.910614 27743 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:35.914737 27264 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:35.916939 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.892867 27432 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:35.989449 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.990231 21832 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:35.922686 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.991061 21905 raft_consensus.cc:2410] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:07:35.935281 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.932852 21728 catalog_manager.cc:5697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.941857 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:35.991575 21909 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:35.991852 21833 raft_consensus.cc:2393] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 21: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:35.948251 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:35.949303 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:35.950958 21829 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:35.951051 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:35.949746 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:35.963016 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:35.867720 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:35.979465 21982 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:35.994449 21825 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:35.980737 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:35.998852 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 50692.8us
I20260709 13:07:35.999559 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.003310 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:35.978919 27729 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:36.027870 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47221.4us
I20260709 13:07:36.003196 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:36.031867 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.031353 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:36.025950 27279 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:36.023310 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.034994 21834 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.002517 27636 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:36.025731 21728 catalog_manager.cc:5697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 11 to 16, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 16 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:36.036089 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.036931 21975 raft_consensus.cc:2410] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:36.041587 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:36.042191 21974 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.021876 27647 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:36.046692 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.047724 21903 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:36.051942 21974 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:36.059605 21975 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:36.060647 27688 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:36.061055 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:36.061682 21974 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:36.064893 21834 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:36.059648 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.071200 21908 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:36.032330 27728 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:36.036541 27816 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.039319 27775 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:36.087183 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.069865 21728 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 5 to 11, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 11 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:36.038116 27279 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.098551 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.106400 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:36.069080 27571 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:36.065402 27653 consensus_queue.cc:260] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:36.088279 27798 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:36.111054 21909 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
W20260709 13:07:36.112665 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 248196us
I20260709 13:07:36.108917 27279 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.080302 27728 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:36.125818 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.128542 21728 catalog_manager.cc:5697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 9 to 16, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 16 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.129752 22550 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:36.137159 27786 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:36.137246 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 77729us
I20260709 13:07:36.137662 27786 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:36.138098 27786 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.138134 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.139428 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.139921 21908 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:36.140226 27403 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:36.140836 27264 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:36.118499 27701 tablet_copy_client.cc:538] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:36.143561 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:36.144387 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:36.145457 27667 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:36.146952 27729 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.152298 27264 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:36.152760 27545 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:36.155076 27444 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:36.155435 27825 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 13:07:36.155891 27444 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:36.156348 27444 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:36.107810 27803 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.352s	user 0.001s	sys 0.004s
I20260709 13:07:36.159099 27667 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:36.159337 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:36.160218 22550 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:36.160068 27667 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.107630 27571 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:36.121248 21903 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:36.165442 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:36.166633 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.160122 27792 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:36.171177 27571 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.172214 27792 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.171903 27728 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.157344 27444 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.187733 21903 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:07:36.189098 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.191883 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 78244.2us
I20260709 13:07:36.186520 21728 catalog_manager.cc:5697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 8 to 15, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 15 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.192992 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.176169 27792 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:36.180776 27571 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.181525 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:36.177201 21978 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:36.196614 21728 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:36.193607 21799 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.501s (SENT) [suppressed 33 similar messages]
W20260709 13:07:36.201957 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 165911us
I20260709 13:07:36.191325 27653 raft_consensus.cc:3060] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.204269 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:36.208245 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:36.198962 27728 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.212687 27802 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:36.220235 27743 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:36.204280 21728 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.221194 21902 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:36.221845 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.222671 27824 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:07:36.201664 27444 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.210481 21903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:07:36.204763 27804 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.211223 27688 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:36.247522 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.247807 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:36.248451 21978 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:36.244897 27540 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:36.250715 27540 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.251883 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.252482 21904 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:36.253686 27540 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:36.254492 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.254703 27775 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:36.255702 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.256543 21907 raft_consensus.cc:2410] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:36.256493 21908 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:07:36.258157 21906 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:36.259903 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:36.260833 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:36.261727 27636 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:36.257933 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.262850 21900 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:36.263878 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.264082 27786 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.240970 21728 catalog_manager.cc:5697] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 6 to 13, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 13 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.272156 21976 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:36.243193 27831 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:36.283640 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:36.284466 27279 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.275992 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:36.282626 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.279323 21728 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 10 to 17, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 17 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.267056 27688 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.275319 27636 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:36.238870 27802 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.277191 27831 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.276851 27647 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.278872 27775 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:36.322301 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 128714us
I20260709 13:07:36.323695 21728 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 9 to 16, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 16 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.325297 21903 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.359036 21903 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.274601 27816 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:07:36.326579 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 165686us
I20260709 13:07:36.360215 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:36.330551 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 55467.9us
I20260709 13:07:36.286904 27743 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:36.313915 27688 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:36.340564 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 173068us
I20260709 13:07:36.298651 27804 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:07:36.375423 21949 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:36.367045 21873 leader_election.cc:336] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 1.811s (SENT)
I20260709 13:07:36.377311 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.323413 27695 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:36.376134 21873 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:36.381352 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.381902 27506 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:36.385818 27792 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.386518 27816 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:36.386960 27816 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:36.388106 27792 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:36.387811 27816 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.374341 27403 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:36.390486 27279 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:36.375502 27647 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.390527 22551 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:36.394604 21904 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:36.396582 21728 catalog_manager.cc:5697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.399559 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:36.341575 27831 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.404237 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:36.403828 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:36.405633 21974 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:36.403178 21728 catalog_manager.cc:5697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 11 to 18, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 18 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.406029 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.404799 21976 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:36.399623 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.408308 21728 catalog_manager.cc:5697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 9 to 14, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 14 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:36.413759 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.391888 27695 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:36.416425 21728 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 7 to 12, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 12 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:36.419775 27804 raft_consensus.cc:2764] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:07:36.420655 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58539.8us
I20260709 13:07:36.422490 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:36.422950 21907 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:36.425231 21980 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:36.421689 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.426445 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:36.428161 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.428244 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.429019 21904 raft_consensus.cc:2368] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:36.433837 27741 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:36.434407 27741 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.437152 27741 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:36.438623 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.439214 21908 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:36.439980 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.440657 21908 raft_consensus.cc:2410] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:07:36.441385 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.441861 21908 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.407361 27792 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:36.401607 27841 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:36.444785 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:36.379021 27775 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.443384 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.415812 27540 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.448652 22553 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:07:36.441408 27838 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
I20260709 13:07:36.451752 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:36.415114 27627 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.414980 27667 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.450235 21978 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:07:36.456802 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:36.494812 21798 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:36.495086 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51798.2us
I20260709 13:07:36.495857 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.497375 21979 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:36.455533 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.447106 21728 catalog_manager.cc:5697] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 5 to 13, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 13 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.424821 27695 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:36.493480 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.495872 21976 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
W20260709 13:07:36.500874 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.501905 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.502848 27432 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:36.503346 27753 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:36.503799 27753 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:36.504171 27753 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:36.507406 27819 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:36.508002 27819 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:36.445604 27804 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:36.449072 27792 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.451576 27580 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:36.517963 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 62494.6us
I20260709 13:07:36.527729 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.523530 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.528734 21900 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:36.524468 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 102918us
I20260709 13:07:36.530807 27850 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:36.536269 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:36.539793 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 44015.4us
I20260709 13:07:36.540833 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.456667 27817 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:36.492991 27841 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:36.534135 21728 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 12 to 19, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 19 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:36.509107 27819 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:36.511219 27659 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:36.556005 21908 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:36.556908 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:36.532974 27792 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:36.492445 27506 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:07:36.561038 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:36.565898 27580 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:36.567216 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:36.567091 27580 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.568020 27855 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:36.568588 27855 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.514418 27635 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:07:36.493230 27540 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.570482 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:36.558714 27804 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.512404 27667 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.557637 27627 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:36.579068 21728 catalog_manager.cc:5697] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 10 to 20, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 20 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:36.584453 27835 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 13:07:36.585457 21717 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3d76b2c4699e43fba10eeb81a91e4913 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:36.586315 27852 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:07:36.577857 27279 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:36.586548 21717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54024.1us
I20260709 13:07:36.570796 27636 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:36.604157 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 63431us
I20260709 13:07:36.604887 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.601895 21728 catalog_manager.cc:5697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 10 to 17, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 17 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.607194 21728 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 8 to 17, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 17 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:36.608465 21728 catalog_manager.cc:5697] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 6 to 15. New cstate: current_term: 15 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:36.608916 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47977.9us
I20260709 13:07:36.609614 21728 catalog_manager.cc:5697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 9 to 17. New cstate: current_term: 17 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.581296 27811 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:36.560915 27848 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:07:36.614974 27854 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.621304 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.623622 27540 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:36.607808 27659 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:36.626539 27659 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:36.611689 27852 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:36.559587 27817 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.637921 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:36.642721 21978 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
W20260709 13:07:36.641093 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 73971.6us
I20260709 13:07:36.645808 21900 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:36.650251 21909 raft_consensus.cc:2410] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:36.651944 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:36.653179 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:36.653932 21831 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 22: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:36.641121 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.654944 21827 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:07:36.655332 21834 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:07:36.620923 27627 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:36.663502 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.673080 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:36.673820 21826 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:36.675303 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 65473.4us
I20260709 13:07:36.615814 27748 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:07:36.627336 27659 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.656482 27852 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:36.687737 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 117341us
I20260709 13:07:36.689610 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:36.675431 27627 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:36.695209 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.680114 27636 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.676604 27647 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:36.696101 21826 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:36.699857 21948 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.686453 27667 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:36.699860 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.676690 27804 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:07:36.709862 27804 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.702068 27545 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:07:36.711623 27695 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.686614 27653 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:36.713601 27695 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:36.709031 27840 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:07:36.709254 27856 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:07:36.713768 27846 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:07:36.704262 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.714537 27860 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:36.715154 27861 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:36.707072 27834 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.365s	user 0.002s	sys 0.000s
I20260709 13:07:36.706323 27636 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.711623 27753 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.713572 27653 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:36.722766 27862 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:36.702945 27580 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:36.727008 27851 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:36.727416 27804 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.723009 27852 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.628435 27841 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.738538 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.770346 27580 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:36.748291 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:36.786482 27855 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:36.787415 21827 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.788020 27546 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:36.749316 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:36.795184 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:36.795805 27861 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.796317 27861 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:36.799189 27832 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.544s	user 0.002s	sys 0.000s
I20260709 13:07:36.750363 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:36.801383 21833 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:36.713632 27792 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.757540 27403 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:36.757716 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53616.4us
W20260709 13:07:36.742061 27444 consensus_meta.cc:287] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 13:07:36.739291 27819 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:36.770319 27851 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:36.773293 27804 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:36.819720 21827 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:36.773481 27753 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:36.768831 27653 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:36.741446 27856 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:36.772614 27817 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:36.773029 27831 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:36.786454 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 48017.7us
I20260709 13:07:36.707516 27748 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:36.810948 21833 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:36.814944 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.811019 21903 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.825150 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:36.740270 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.825637 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.810706 27580 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:36.802464 27802 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:36.832579 21907 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:36.834008 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:36.834086 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.835073 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.835888 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.821193 27279 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:36.840226 21908 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.780051 27627 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:36.841084 27728 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.004s
I20260709 13:07:36.842996 27264 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:36.843484 27264 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:36.843714 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:07:36.844530 27837 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.510s	user 0.000s	sys 0.002s
I20260709 13:07:36.844336 27264 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.846035 21830 raft_consensus.cc:1217] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 11.6->[13.7-13.7]   Dedup: 13.7->[]
I20260709 13:07:36.846588 21830 raft_consensus.cc:1240] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:07:36.846625 27862 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:36.847318 27862 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:36.847405 27848 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:36.847779 27848 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:36.848254 27792 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:36.848193 27862 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.848627 27848 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.849843 27848 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.851825 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.852735 21904 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:36.853104 27816 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:36.854144 27836 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.595s	user 0.000s	sys 0.003s
I20260709 13:07:36.854326 27748 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:36.851027 27279 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:36.854450 27653 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.855280 27748 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.855818 27653 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:36.858405 21902 raft_consensus.cc:1275] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:36.840281 21900 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:36.861739 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.846735 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.864610 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.867259 21908 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:36.863323 21901 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:36.870414 22550 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:36.828981 27856 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:36.882293 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 218880us
I20260709 13:07:36.884544 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:36.851089 27833 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.585s	user 0.000s	sys 0.003s
I20260709 13:07:36.883306 22521 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.898648 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:36.883821 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:36.886776 21907 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:07:36.903043 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.907652 21900 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:36.908923 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.909628 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.909716 21909 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:36.914803 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:36.915335 21908 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:36.916181 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.867950 27819 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:36.921514 21901 raft_consensus.cc:2368] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15.
I20260709 13:07:36.903254 27552 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:36.927663 21832 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:36.934684 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:36.934984 21908 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:36.936489 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:36.838308 27817 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:07:36.944056 21907 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:36.911940 27861 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:36.951402 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 106010us
I20260709 13:07:36.923134 27860 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:36.951968 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:36.957144 21833 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:36.960321 27701 tablet_bootstrap.cc:492] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:07:36.961169 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:36.962148 27859 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:36.962846 27859 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:36.963057 27842 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:36.963708 27845 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.963315 27864 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.964483 27864 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.867777 27851 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:36.966864 27851 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:36.967306 27864 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:36.969172 21948 leader_election.cc:400] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:36.969626 21948 leader_election.cc:403] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:07:36.924764 27819 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:36.963814 27859 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:36.971913 27667 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:36.972604 27775 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:36.973712 27869 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:36.912276 27753 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:07:36.975006 27854 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:36.977308 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:36.978801 27786 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:36.979882 27874 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.982511 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:37.015478 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:37.015481 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:36.956405 27688 consensus_meta.cc:287] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.006s
I20260709 13:07:36.948580 27804 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:07:36.998387 27819 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.989961 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:37.062485 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:36.997448 27859 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:37.064309 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 74445.6us
I20260709 13:07:37.065452 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:37.016486 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:36.999095 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:37.065778 21977 raft_consensus.cc:2368] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19.
I20260709 13:07:37.015285 27636 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:37.000771 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:37.074082 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 75073.2us
I20260709 13:07:37.076915 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:37.075017 21799 leader_election.cc:400] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15.
W20260709 13:07:37.081089 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 80539us
W20260709 13:07:37.082587 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 140396us
W20260709 13:07:37.086093 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 208013us
I20260709 13:07:37.089028 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:37.095238 21977 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:37.059490 27854 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:37.101799 27786 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:37.071288 27864 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:37.076733 27630 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:37.097576 21798 leader_election.cc:400] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19.
I20260709 13:07:37.115955 21798 leader_election.cc:403] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:37.091552 27861 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:37.058866 27775 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:07:37.103334 27859 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.102579 27786 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:37.133569 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:37.089517 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 91157us
I20260709 13:07:37.106765 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:37.096587 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:37.057669 27874 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.058753 27688 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.123679 21906 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:37.124996 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:37.076930 27753 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:37.099655 27647 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.153672 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:37.106233 27540 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.154654 22553 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:07:37.084996 27636 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:07:37.156122 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 59668.8us
I20260709 13:07:37.157287 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:37.131736 27444 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:07:37.164795 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:37.166021 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 82691.6us
I20260709 13:07:37.167073 21873 leader_election.cc:400] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:37.167467 21873 leader_election.cc:403] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:37.108405 27854 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.135988 27861 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:37.152679 27748 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:37.218144 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:37.176478 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 95721.8us
I20260709 13:07:37.162639 27728 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:37.237346 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 130660us
I20260709 13:07:37.162533 27811 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:37.241251 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.239614 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 72737.8us
I20260709 13:07:37.242182 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:37.162333 27831 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:37.232825 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 97687us
I20260709 13:07:37.142263 27804 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:07:37.218789 27871 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:37.209156 27636 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.239213 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:37.162792 27647 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.254544 27888 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:37.267623 27888 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:37.247290 27859 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:37.165143 27540 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.276714 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:37.270330 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:37.277210 27540 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:07:37.211262 27667 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:07:37.245570 27811 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.256368 21976 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:37.234526 27847 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.265s
I20260709 13:07:37.166710 27856 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.272164 22554 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:37.243515 27872 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.288353 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:37.276772 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:37.260634 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:37.259627 27831 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:37.277884 27540 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:37.277917 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:37.301697 21830 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:37.288928 21825 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:37.300557 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:37.252321 27870 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:37.258345 27883 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:37.319898 21977 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:37.324728 21902 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:37.326295 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 65730.3us
I20260709 13:07:37.288697 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:37.343231 21978 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:37.294726 27860 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:37.328312 27635 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:37.329607 27861 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.331876 27897 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.332319 27862 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.331802 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:37.287928 27874 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:37.291879 27878 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:07:37.335410 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:37.359036 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:37.359813 21977 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:37.360332 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:37.361135 21906 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:37.362773 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:37.363161 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:37.364617 21976 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:37.339262 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:37.278148 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:37.286757 27876 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:07:37.293417 27830 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.044s	user 0.003s	sys 0.001s
I20260709 13:07:37.341737 21834 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:37.344691 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:37.351110 27753 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:07:37.338246 27872 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.258083 27636 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.297734 27854 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:37.365928 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:37.348785 27540 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:37.337646 27811 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:37.401387 21833 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:37.269251 27786 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.393361 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:37.356448 27886 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:37.394680 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:37.268651 27888 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.418938 22550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 864) took 1152 ms. Trace:
I20260709 13:07:37.297000 27845 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:37.397070 21825 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:37.396406 22520 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:37.421698 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:37.378398 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:37.406103 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 128008us
I20260709 13:07:37.414563 21906 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:37.423621 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:37.415441 21902 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:37.351866 27653 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:37.416668 21900 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:37.427038 27636 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:37.427440 27845 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:37.338974 27831 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:37.429167 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.430886 27831 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:37.431522 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:37.292392 27887 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:07:37.391651 27870 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:37.419343 22550 rpcz_store.cc:276] 0709 13:07:36.258882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.259683 (+   801us) service_pool.cc:224] Handling call
0709 13:07:37.410807 (+1151124us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400545954. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:37.410962 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397633920}
I20260709 13:07:37.434621 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:37.438601 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:37.439000 21902 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:37.439719 27894 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:37.440137 27894 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.440516 27894 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.446925 21900 raft_consensus.cc:2410] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:07:37.464015 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 97147.1us
I20260709 13:07:37.378013 27862 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.379732 27897 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.465646 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:37.465968 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:37.466238 21906 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:37.468637 22520 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:37.479588 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:37.481817 21900 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:37.489039 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:37.490661 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 56125.7us
I20260709 13:07:37.491400 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:37.494158 21979 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:37.437386 27886 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:37.473085 27831 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:37.513986 22554 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:37.507098 27653 raft_consensus.cc:2764] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:07:37.534199 21907 raft_consensus.cc:1240] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:37.536002 21907 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:37.545233 27647 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:37.549270 21982 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:07:37.551990 27850 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.568668 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:37.508771 27890 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:37.508483 27854 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:37.511374 27870 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.522521 27848 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.002s
I20260709 13:07:37.508839 27852 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:37.553840 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 868) took 1159 ms. Trace:
I20260709 13:07:37.573920 22550 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:37.525085 27898 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:37.570612 27580 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.004s
I20260709 13:07:37.564992 27874 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.652902 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:37.653252 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 186207us
I20260709 13:07:37.653244 27580 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.653402 27874 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.654598 21826 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:37.655582 27874 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:37.655520 27580 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:37.583688 27850 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.657788 27850 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:37.505695 27540 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.575042 27647 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:37.617874 27895 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:37.615307 22551 rpcz_store.cc:276] 0709 13:07:36.393975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.394150 (+   175us) service_pool.cc:224] Handling call
0709 13:07:36.394547 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.514268 (+119721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.514453 (+   185us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.514913 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.766681 (+251768us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:36.766734 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.553333 (+786599us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54007044d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:37.553399 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.553462 (+    63us) raft_consensus.cc:1685] finished
0709 13:07:37.553482 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.553741 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14671,"raft.queue_time_us":26676,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":30030080,"thread_start_us":281617,"threads_started":2,"wal-append.queue_time_us":230030}
I20260709 13:07:37.662613 27891 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:37.663699 27909 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:37.664052 27877 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:37.574816 27890 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:37.685902 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.664664 27900 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:37.665556 27905 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:37.569002 27908 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:37.583109 27856 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:37.678812 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.823601 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.679068 27831 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:37.568593 27775 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.097s
W20260709 13:07:37.789853 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 100003us
I20260709 13:07:37.801574 21799 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:37.782492 27743 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.803635 27896 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
W20260709 13:07:37.807674 27728 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.000s
W20260709 13:07:37.808017 27444 consensus_meta.cc:287] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.000s
W20260709 13:07:37.810948 27904 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:07:37.651126 27870 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.618441 27886 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:37.814957 27913 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:07:37.815362 27872 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:37.816679 27552 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.817339 27862 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:37.675587 27895 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.819020 27890 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:37.819876 27859 consensus_meta.cc:287] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.003s
I20260709 13:07:37.820170 27877 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:37.820588 27897 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:37.820763 21717 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3d76b2c4699e43fba10eeb81a91e4913 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:37.783483 27898 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.623876 27854 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.683696 27909 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:37.845715 21906 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:37.838096 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:37.783305 27874 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:37.860900 21901 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:37.847107 27728 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:37.847273 27855 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:37.884881 22520 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:37.885926 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:37.887152 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:37.847496 27743 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.852690 27444 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19.
W20260709 13:07:37.883621 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 45629.2us
I20260709 13:07:37.888844 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:37.893877 21829 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
W20260709 13:07:37.863420 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 372064us
I20260709 13:07:37.887735 21832 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:37.862839 27895 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:37.895340 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:37.897482 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:37.909765 21978 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:37.905514 21833 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:37.909935 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:37.861164 27552 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:37.874639 21717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 53930.9us
I20260709 13:07:37.890900 27890 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:37.899272 27736 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:37.885007 27909 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:37.916497 27848 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:37.932168 27848 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.932629 27848 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:37.902998 27802 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:07:37.935518 27802 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:37.935885 27802 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.936257 27802 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:37.938716 27635 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.939380 27635 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.897650 27647 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:37.942142 27647 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:37.943138 27647 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.946857 27743 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:37.949453 27819 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.878s	user 0.010s	sys 0.001s
I20260709 13:07:37.949925 27819 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.950336 27877 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.952203 27819 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:37.961341 21828 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
W20260709 13:07:37.964619 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 475663us
I20260709 13:07:37.916010 27855 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:37.971076 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.982136 21903 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:37.897867 27862 consensus_queue.cc:1059] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:07:37.987732 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:37.882937 27898 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:37.913935 27872 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:07:37.993269 27506 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.993798 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45494 (request call id 2628) took 1793 ms. Trace:
I20260709 13:07:37.993446 27855 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:37.999434 27552 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.000238 27895 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.001159 27890 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.003711 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.905748 27874 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.008337 21903 rpcz_store.cc:276] 0709 13:07:36.195248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.198882 (+  3634us) service_pool.cc:224] Handling call
0709 13:07:37.943706 (+1744824us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b5400308754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd5a3d 00007fb763fa5cd0 00007fb75d52a254 00007fb75d52a1e2 00007fb75d52a111 00007fb75d52a08c 00007fb75d529342 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:37.983400 (+ 39694us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186866048}
I20260709 13:07:37.892493 27831 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.051919 21979 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:37.990202 27775 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:38.045725 27842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.016s	sys 0.026s
I20260709 13:07:38.006557 27908 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:38.061146 27842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.016s	sys 0.027s
W20260709 13:07:38.070739 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 145197us
I20260709 13:07:38.048697 27397 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.080605 27919 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:07:38.081372 21832 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:07:38.106675 21832 pending_rounds.cc:85] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 11
I20260709 13:07:38.106984 21832 pending_rounds.cc:107] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:07:38.106457 27397 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.107252 21832 raft_consensus.cc:2889] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.107424 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2657) took 1107 ms. Trace:
I20260709 13:07:38.109105 27397 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.111166 27874 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.116803 27909 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.117969 22548 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:38.087169 27898 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.067255 27775 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.094581 27636 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:38.094822 27854 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.096666 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:38.053906 27890 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:38.097733 27911 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:07:38.098940 27927 raft_consensus.cc:3055] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:07:38.098999 27926 log.cc:927] Time spent T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:38.101187 27802 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.046263 27506 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.103868 27895 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:38.085378 27920 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:07:38.107870 21983 rpcz_store.cc:276] 0709 13:07:36.999894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.000117 (+   223us) service_pool.cc:224] Handling call
0709 13:07:37.000543 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.013117 (+ 12574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.013153 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.555408 (+542255us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b2c00111818. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:07:37.555893 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.652824 (+ 96931us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:37.652876 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.652963 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.107114 (+454151us) raft_consensus.cc:1685] finished
0709 13:07:38.107137 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.107360 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1406,"raft.queue_time_us":57794,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":18436,"spinlock_wait_cycles":6765952,"thread_start_us":96474,"threads_started":1,"wal-append.queue_time_us":304544}
I20260709 13:07:38.121321 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:38.085942 27736 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.123252 21828 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:38.139405 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:38.139750 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:38.139995 21832 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:38.140937 21828 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:38.141209 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:38.128978 27870 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.124521 21979 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:38.130256 27899 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:38.129221 27636 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:38.131911 27927 raft_consensus.cc:740] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:38.133002 27898 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:38.156585 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:38.157212 21830 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:38.157490 21830 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:38.138968 27736 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.159468 27898 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:38.159919 27870 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.165146 27927 consensus_queue.cc:260] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.166385 27870 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.167042 27927 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.168860 27870 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.175740 27636 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.177048 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2724) took 1433 ms. Trace:
I20260709 13:07:38.177611 21826 rpcz_store.cc:276] 0709 13:07:36.743891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.744068 (+   177us) service_pool.cc:224] Handling call
0709 13:07:36.744445 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.654938 (+910493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.176740 (+521802us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54002733d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:38.176969 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092743424}
I20260709 13:07:38.179080 21830 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.182112 21830 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:38.183975 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 749) took 1360 ms. Trace:
I20260709 13:07:38.184332 21905 rpcz_store.cc:276] 0709 13:07:36.823280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.823393 (+   113us) service_pool.cc:224] Handling call
0709 13:07:36.823685 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.823975 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.824000 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.824380 (+   380us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.416407 (+592027us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b18002117e0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:07:37.488148 (+ 71741us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:37.488184 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.488251 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.183725 (+695474us) raft_consensus.cc:1685] finished
0709 13:07:38.183745 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.183922 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3697,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":2614,"spinlock_wait_cycles":6272256,"thread_start_us":71543,"threads_started":1,"wal-append.queue_time_us":790488}
I20260709 13:07:38.179723 27636 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:38.182749 27877 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.181061 27647 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.197340 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:38.197891 27695 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.218773 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2725) took 1474 ms. Trace:
W20260709 13:07:38.203178 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.203205 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.210155 27934 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:38.219291 21834 rpcz_store.cc:276] 0709 13:07:36.744268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.746897 (+  2629us) service_pool.cc:224] Handling call
0709 13:07:36.747220 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.385473 (+638253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.218472 (+832999us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b540008af54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:38.218702 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366691072}
I20260709 13:07:38.224812 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.194092 27848 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.227100 27890 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.228685 27848 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:38.165158 27898 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.229764 27898 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:38.229954 27909 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:38.232751 27933 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:38.229986 27802 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:38.258976 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.261371 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.215758 27877 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.226380 27695 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.225318 27647 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.283588 21830 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:38.284569 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.285305 22553 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:38.286765 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:38.288208 27802 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:38.288360 27854 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:38.288865 27802 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.289387 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.291198 27802 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.291750 27695 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:38.291810 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.288868 27854 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.293273 27854 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.293735 27647 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:38.296396 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.254981 27775 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.305027 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.307894 21901 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:38.311569 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.310463 27877 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:38.323483 27811 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.904s	user 0.011s	sys 0.000s
I20260709 13:07:38.324007 27811 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:38.329478 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.334425 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60024 (request call id 878) took 1170 ms. Trace:
I20260709 13:07:38.330556 27886 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.334761 22554 rpcz_store.cc:276] 0709 13:07:37.163698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.163868 (+   170us) service_pool.cc:224] Handling call
0709 13:07:38.334255 (+1170387us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b54004f79d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:38.334373 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122730240}
I20260709 13:07:38.332865 27811 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.337409 27886 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.336380 27899 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:38.343530 27891 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:38.356884 27891 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:38.357061 22547 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
W20260709 13:07:38.354918 27894 consensus_meta.cc:287] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.914s	user 0.008s	sys 0.003s
I20260709 13:07:38.362496 27894 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.364401 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:38.364723 21901 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:38.365789 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.366460 21901 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:38.367210 21905 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:38.365814 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.370257 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:38.371065 21906 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:07:38.372965 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.373728 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.376415 27748 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.377065 27748 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.380184 27871 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:38.380833 27871 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.367331 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.382714 21901 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:38.367439 27894 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:07:38.384416 27871 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:38.388373 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:38.380232 27748 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.395583 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.396567 21983 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:38.397936 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:38.398739 27891 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.400552 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.401813 21980 raft_consensus.cc:2393] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:38.408521 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:38.412662 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.413725 21980 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:38.420784 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:38.421609 21975 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:38.428084 27635 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.432328 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.441502 21975 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:38.443230 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2659) took 1437 ms. Trace:
I20260709 13:07:38.443809 21982 rpcz_store.cc:276] 0709 13:07:37.005860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.005983 (+   123us) service_pool.cc:224] Handling call
0709 13:07:37.006273 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.566269 (+559996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.442147 (+875878us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54003a4dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:38.443149 (+  1002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1247855488}
I20260709 13:07:38.401916 27891 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.354084 27854 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.453006 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.453591 21981 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
W20260709 13:07:38.458947 27948 log.cc:927] Time spent T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:07:38.461673 27736 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.469853 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:38.475184 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.473196 27888 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:38.482800 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.483690 21982 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:38.482369 27688 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.491707 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.494618 21982 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:38.491365 27886 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.498487 27736 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.505051 27854 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.508846 27432 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:38.509459 27432 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.512571 27432 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.518078 27701 tablet_bootstrap.cc:492] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:38.519379 27701 tablet_bootstrap.cc:492] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:07:38.520215 27701 ts_tablet_manager.cc:1403] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 1.560s	user 0.041s	sys 0.027s
I20260709 13:07:38.520776 27854 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:38.521371 27854 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:38.520771 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.522400 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.524827 27854 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.525748 27854 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:38.526285 27854 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.528908 27854 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.531234 27432 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.531833 27432 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.533028 27701 raft_consensus.cc:359] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 12 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.533932 27432 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:38.534709 27701 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:07:38.535569 27701 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:07:38.536387 27928 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
I20260709 13:07:38.541160 27888 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.541676 27888 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.543900 27888 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.545439 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:38.550063 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.550761 22551 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:38.566075 21901 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:38.580178 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:38.581817 22551 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.581969 21902 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:38.582894 27852 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:38.587342 27852 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.591149 27852 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.592036 27701 ts_tablet_manager.cc:1434] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:07:38.593600 22551 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:38.595366 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:38.596285 27852 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:38.596830 27852 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:38.597622 27852 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.607086 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:38.609894 27397 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:38.610351 27397 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.610736 27397 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.618271 27397 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.622821 27397 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.625761 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:38.626415 22547 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.633745 22547 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:38.634729 21949 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:38.634908 21874 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:38.635031 27786 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:38.635929 27397 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:38.636468 27397 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:38.636677 27786 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:38.637324 27397 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.638343 27279 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:38.639190 27792 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:38.638392 27432 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:38.640457 27432 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:38.640323 27792 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:38.640846 27432 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:38.642328 27802 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:38.642742 27802 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:38.643898 27877 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:38.643553 27802 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.644306 27877 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:38.644799 27802 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.645144 27877 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.649227 22546 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:38.641815 27432 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:38.651968 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.659788 21906 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:38.660838 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.662022 21903 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:38.663757 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.663692 21906 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:38.664026 22553 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:38.667238 27852 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:38.668466 27852 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:38.669785 27852 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:38.391470 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:38.674613 21905 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.680091 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2651) took 1554 ms. Trace:
I20260709 13:07:38.680558 21902 rpcz_store.cc:276] 0709 13:07:37.126188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.439858 (+313670us) service_pool.cc:224] Handling call
0709 13:07:37.440143 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.582382 (+1142239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.679849 (+ 97467us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400002154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:38.680031 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2625164032}
I20260709 13:07:38.684208 22546 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:38.686198 27786 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:38.686944 21905 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:38.687985 27786 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.690609 22553 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:38.691408 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.692061 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2653) took 1363 ms. Trace:
I20260709 13:07:38.692446 21908 rpcz_store.cc:276] 0709 13:07:37.329001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.679611 (+350610us) service_pool.cc:224] Handling call
0709 13:07:37.679915 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.914053 (+234138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.914084 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.914132 (+    48us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:37.914182 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.691829 (+777647us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000fa854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:38.691878 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.692007 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538023680}
I20260709 13:07:38.651911 27432 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:38.689026 27659 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.688323 27852 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.697530 27852 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:38.698760 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.699651 21902 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:38.702822 21902 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:38.705344 22546 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 18. Ops: [16.12-16.12]
I20260709 13:07:38.705425 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 763) took 1264 ms. Trace:
W20260709 13:07:38.707907 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.708293 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.709107 22548 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:38.705868 21907 rpcz_store.cc:276] 0709 13:07:37.440690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.809820 (+369130us) service_pool.cc:224] Handling call
0709 13:07:37.810071 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.810806 (+   735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.810839 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.811342 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.864303 (+ 52961us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:37.864361 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.864451 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.515054 (+650603us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b24001cd648. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf2ffb0 00007fb75eba6488 00007fb75eba6be8 00007fb75eb7e398 00007fb75eb7976a 00007fb75eb78bb6
0709 13:07:38.705136 (+190082us) raft_consensus.cc:1685] finished
0709 13:07:38.705156 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.705366 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":209,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":26062592,"thread_start_us":52420,"threads_started":1,"wal-append.queue_time_us":112852}
I20260709 13:07:38.714562 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.714644 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.715276 22548 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:38.717464 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:38.718276 22553 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:38.720485 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:38.720676 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:38.721884 21907 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.726117 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.726819 21908 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:38.727049 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.727798 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.730813 21909 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:38.732784 21983 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:38.728024 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.735477 21905 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 21: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:38.728577 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.729104 27792 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:38.735080 27279 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.751080 27279 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.751839 21902 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:38.753044 27279 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:38.742807 27792 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.746881 27842 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:38.747578 27796 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:38.746001 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:38.737588 27802 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:38.761734 21907 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:38.738227 27403 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:38.765930 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:38.766331 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.767197 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.768128 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.764348 27802 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.770778 21978 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:07:38.772291 27802 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:38.764514 27796 consensus_queue.cc:1243] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:38.765054 27403 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.774881 27403 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:38.778616 27792 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:38.784444 21907 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:38.787169 21901 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:38.805075 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:38.806433 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:38.807361 27842 consensus_queue.cc:1048] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:38.809103 27842 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:38.809886 27842 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:38.820752 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:38.823360 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:38.825552 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:38.828231 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:38.829563 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.847162 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.848737 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:38.849210 21977 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:07:38.853000 27792 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:38.855070 27875 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:38.855882 27875 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:38.857034 27964 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:38.857595 27964 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.859912 27964 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.859792 27898 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:38.860611 27898 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:38.861857 27898 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:38.864759 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.866624 21977 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:38.868577 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:38.869160 21977 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.867128 27792 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:38.870342 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:38.871272 27875 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:38.871415 27792 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:38.871688 27875 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:38.871949 27792 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:38.874671 27792 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:38.872135 27875 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:38.881836 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.885665 27898 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:38.886595 27792 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.889119 27792 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:38.893050 27875 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.896059 27875 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.896622 27875 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.897078 27875 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.898602 27965 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:38.902384 27965 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.902431 21977 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:38.902935 27965 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:38.903714 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.900341 27875 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.904914 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:38.905478 21977 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:38.908107 27872 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:38.908993 27872 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:38.911607 21977 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:38.911414 27965 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.911824 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:38.912775 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:38.913569 27875 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:38.913930 27875 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.914314 27875 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:38.914341 27630 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:38.916026 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:38.916146 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:38.917081 27792 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:38.917567 27792 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:38.918404 27792 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:38.970970 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.769372 27279 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:38.950044 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:38.990118 27279 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:38.990759 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 88640.8us
I20260709 13:07:38.991039 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.990773 27635 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:38.991948 27635 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:38.921742 27852 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:38.928710 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.923245 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.894054 27877 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.912797 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.993637 21902 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
W20260709 13:07:38.994591 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 137343us
I20260709 13:07:38.924026 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:38.938634 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:38.992056 21905 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:38.995874 21977 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:38.967657 21983 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:38.997558 21906 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:38.990633 27279 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:38.998314 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:39.005952 21833 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:38.814610 27864 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:38.998584 27635 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.946286 27965 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:38.999505 21825 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:07:39.010475 21825 pending_rounds.cc:85] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 12
I20260709 13:07:39.010268 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.010872 21825 pending_rounds.cc:107] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:07:39.011260 21825 raft_consensus.cc:2889] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.999931 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:38.995790 21903 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:39.013115 21831 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 20: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:38.935225 27627 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.009142 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.012038 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.014025 21901 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:39.014127 21907 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:39.018014 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:39.019074 21843 tablet_copy_service.cc:342] P 479255846c5141b584b16aa253f587c7: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-ad9d9c562d2d411db01a7eaf4427d325 received from {username='slave'} at 127.0.0.1:52674
I20260709 13:07:39.019567 21843 tablet_copy_service.cc:434] P 479255846c5141b584b16aa253f587c7: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-ad9d9c562d2d411db01a7eaf4427d325 on tablet ad9d9c562d2d411db01a7eaf4427d325 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:39.022373 27965 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:39.023166 27965 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:38.997303 27852 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:39.026593 27635 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:39.010113 27864 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.046227 27864 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.046810 27864 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.047343 27864 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.049680 27864 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:38.921314 27875 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.052740 27875 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.041719 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.015273 27964 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:39.054360 27964 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:39.054472 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.055258 21902 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:39.055388 27964 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.057063 27964 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.027037 27922 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.062846 21903 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:39.062938 27922 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.065014 21906 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:39.066737 21980 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:39.067684 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.067819 21904 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:39.068019 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.068223 21980 raft_consensus.cc:2376] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18. Re-sending same reply.
I20260709 13:07:39.068384 27630 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.068622 21977 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.069067 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.068929 27630 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.069615 21980 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.026104 27965 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:39.070438 27965 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:39.070755 27965 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.071059 27965 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.075037 27864 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:39.076293 27922 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.077273 27852 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.095005 21833 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
I20260709 13:07:39.096421 21980 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:39.097500 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.101511 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.102614 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.105412 21977 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:39.106563 27506 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.038055 27627 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:39.113550 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 106930us
W20260709 13:07:39.130079 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 112118us
I20260709 13:07:39.134379 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.135756 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.138985 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.139679 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.143368 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.144385 21977 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:39.147423 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.149009 21977 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:39.150599 21977 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:39.151836 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.153594 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.155658 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.160386 21977 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:39.161381 27279 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.163986 27279 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:39.161813 21980 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:39.164284 27883 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:39.171015 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:39.153165 27971 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:39.150840 27973 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:39.187009 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.187598 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.188143 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.188385 27864 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:39.188694 21909 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:39.187026 27627 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.188619 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.194478 21903 raft_consensus.cc:2410] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:07:39.176292 27971 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.179056 27886 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:39.179251 27974 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:39.208606 27974 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.208993 27974 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.213725 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.201572 27864 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:39.216567 27974 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.217669 27279 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.218127 27279 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.220028 27279 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:39.220966 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.223641 27831 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:39.223984 27831 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.224354 27831 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.224401 27894 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:39.219995 27974 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:39.227946 27976 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:07:39.228883 21975 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:39.197230 27580 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:39.230592 27580 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.230909 27580 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:39.201529 27971 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:39.231925 27831 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.234297 27831 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.234664 27886 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:39.235551 27886 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.205817 27973 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:39.242967 21901 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:39.246313 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.255148 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.256008 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:39.257277 21873 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:39.269282 21901 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:39.270813 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.271682 21975 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:39.272433 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:39.272930 22548 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.270785 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.274323 21901 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.278077 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.278723 21978 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:39.270278 27875 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:39.282672 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.269905 27506 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:39.271958 27987 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:39.284595 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 61714.9us
I20260709 13:07:39.284986 21901 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:39.274564 27432 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:07:39.288002 22553 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 12 LEARNER]: Advancing to term 13
I20260709 13:07:39.287511 21975 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:39.288005 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.270632 27659 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:07:39.289547 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:39.289736 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:39.290191 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 150581us
I20260709 13:07:39.290306 27647 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 13:07:39.293570 27647 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:39.293893 27647 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:39.294745 27647 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.295950 27647 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:39.290264 27831 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:07:39.298270 21798 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.288273 27894 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:07:39.300789 27978 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:39.289536 21901 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:39.309281 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.310849 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:39.311468 22546 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:39.314227 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:39.314342 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.315060 27864 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:39.318375 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:39.319319 21901 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:39.322784 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:39.322908 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.315497 27974 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:39.325779 27974 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:39.326295 27974 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:39.325942 21901 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.327284 27974 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.313055 27635 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:07:39.337244 27922 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:39.337657 27922 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:39.325091 27964 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:39.340703 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 71301.9us
I20260709 13:07:39.335812 21798 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.342185 22553 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:39.320012 27864 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.347409 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:39.311429 27987 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:39.356716 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.357697 21901 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:39.356612 27875 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:39.354303 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.358484 21828 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:39.348871 27978 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:39.359321 21831 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:39.359865 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.359411 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.362156 21828 raft_consensus.cc:2410] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:07:39.362672 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.363327 21825 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:39.363543 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.363221 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.352072 27864 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.354266 27990 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:39.360859 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.364782 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.365195 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:39.371353 21830 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:39.371876 21831 raft_consensus.cc:2410] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:07:39.365545 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:39.372219 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.349098 27982 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:39.366122 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.374607 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:39.368141 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.369484 22546 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:39.321252 27965 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.375947 21975 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:07:39.370141 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:39.373127 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.374266 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.376446 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:39.376942 21982 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:39.369830 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.377995 21828 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:39.379645 21831 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:07:39.380112 21831 pending_rounds.cc:85] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 12
I20260709 13:07:39.380383 21831 pending_rounds.cc:107] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:07:39.380656 21831 raft_consensus.cc:2889] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.341445 27971 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.389256 21975 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:39.382864 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.382977 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.389837 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.390520 21826 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:39.373692 27506 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:39.394524 27506 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.394611 27984 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:39.395043 27506 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.395237 27984 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:39.396173 27984 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.358711 27659 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:07:39.398793 27659 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:39.399540 27981 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:07:39.400259 27659 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.402045 21902 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:07:39.402415 21902 pending_rounds.cc:85] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 8
I20260709 13:07:39.387465 21982 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:39.402608 21902 pending_rounds.cc:107] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:07:39.402863 21902 raft_consensus.cc:2889] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.360679 21901 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:39.353747 27627 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:39.391181 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:39.404052 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:39.407974 21829 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:39.355496 27964 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:07:39.406661 21832 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:07:39.359675 27635 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:07:39.427590 22546 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:39.390640 27978 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.431105 21828 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:39.429957 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.410548 27990 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:39.398087 27991 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.442091 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.429404 27982 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:39.374473 27922 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:39.451830 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 77355.3us
I20260709 13:07:39.453826 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.444020 27990 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:07:39.463357 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52252.8us
I20260709 13:07:39.448230 27432 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:39.469134 22548 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:39.467947 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.469542 21902 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:07:39.439589 27978 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.449883 27875 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.462745 27802 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:39.462263 27982 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:39.450245 27635 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:07:39.467674 27871 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:39.454698 27987 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:07:39.491806 27988 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:07:39.486888 27986 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:07:39.478000 27432 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:39.455483 27991 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.487540 27871 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.507893 27994 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.472772 27279 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:07:39.492847 27922 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:39.487792 27802 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:39.528182 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.537611 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2652) took 2409 ms. Trace:
I20260709 13:07:39.543133 27872 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:39.506765 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:39.495849 27997 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:39.566345 21900 rpcz_store.cc:276] 0709 13:07:37.128329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.498253 (+369924us) service_pool.cc:224] Handling call
0709 13:07:37.507578 (+  9325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.510565 (+  2987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.510599 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.525727 (+ 15128us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.825936 (+300209us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:37.854581 (+ 28645us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.855828 (+  1247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.855929 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.949168 (+ 93239us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b180022ea00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:39.536379 (+1587211us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b24001cd648. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf2ffb0 00007fb75eba6488 00007fb75eba6be8 00007fb75eb7e398 00007fb75eb7976a 00007fb75eb78bb6
0709 13:07:39.537312 (+   933us) raft_consensus.cc:1685] finished
0709 13:07:39.537345 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.537520 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3586,"prepare.queue_time_us":30652,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":9073,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":9725,"spinlock_wait_cycles":31953024,"thread_start_us":240574,"threads_started":1,"wal-append.queue_time_us":350173}
I20260709 13:07:39.518453 27635 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:39.515317 27988 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:39.557483 27871 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.492837 27580 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.563686 27965 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:39.528623 27877 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
W20260709 13:07:39.619715 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 89453.1us
I20260709 13:07:39.528710 27864 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.576758 27997 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.639727 21900 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:07:39.640846 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:39.609630 27971 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.663822 21827 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:39.641427 22547 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEARNER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:39.677847 22548 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:39.677785 22553 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:39.688488 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:39.689601 22546 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:39.568323 27994 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.662177 27997 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.499569 27990 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.706264 28013 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.706960 28013 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.707967 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.708072 27786 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:39.708513 21902 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:39.709214 28013 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.709359 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.709761 28013 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.710103 21979 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:39.710263 28013 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.712436 28013 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.712913 28013 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.713369 28013 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.708530 27786 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:39.715250 27786 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.716785 27973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52668 (request call id 21) took 9549 ms. Trace:
I20260709 13:07:39.716909 27786 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.717664 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.718279 21976 raft_consensus.cc:2376] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21. Re-sending same reply.
I20260709 13:07:39.718478 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.718948 28013 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.717290 27973 rpcz_store.cc:276] 0709 13:07:30.167584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.174109 (+  6525us) service_pool.cc:224] Handling call
0709 13:07:30.439181 (+265072us) log.cc:844] Serialized 506 byte log entry
0709 13:07:39.716666 (+9277485us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":702257,"threads_started":1,"wal-append.queue_time_us":883697,"wal-append.run_cpu_time_us":3387,"wal-append.run_wall_time_us":1875694}
W20260709 13:07:39.720064 27989 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:07:39.720957 27748 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.722254 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.722784 21903 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:39.725284 21902 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:39.728099 21902 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:39.728964 27978 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.729038 21902 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:39.679735 27630 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:39.734867 21977 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:07:39.737921 21977 pending_rounds.cc:85] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 11
I20260709 13:07:39.738289 21977 pending_rounds.cc:107] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:07:39.738610 21977 raft_consensus.cc:2889] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.670820 27965 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 13:07:39.742218 27999 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:07:39.743517 27506 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.762830 27580 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:39.710331 27969 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:39.745527 28003 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:39.735508 27985 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:07:39.746678 27864 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.694501 27971 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:39.758772 27659 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:39.760845 27991 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.761281 27997 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.721695 27748 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.764892 28003 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.775437 21903 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:39.613587 27982 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.686789 27802 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.684098 27432 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.770501 27506 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.735955 27993 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:07:39.777848 27971 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:39.801008 27659 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.819931 27659 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.799453 27864 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:39.822153 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800205980 after lost signal to thread 20697
I20260709 13:07:39.822558 27864 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:39.823237 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08003f10c0 after lost signal to thread 21766
W20260709 13:07:39.823596 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800320ea0 after lost signal to thread 21780
I20260709 13:07:39.824402 27864 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.792066 28003 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.826184 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2574) took 1060 ms. Trace:
I20260709 13:07:39.826551 21983 rpcz_store.cc:276] 0709 13:07:38.765618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.765748 (+   130us) service_pool.cc:224] Handling call
0709 13:07:39.825993 (+1060245us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b540005a5d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:39.826092 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7459712}
W20260709 13:07:39.824720 21930 debug-util.cc:398] Leaking SignalData structure 0x7b080035eca0 after lost signal to thread 21858
W20260709 13:07:39.833662 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08003956e0 after lost signal to thread 21859
W20260709 13:07:39.834735 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800261a80 after lost signal to thread 21933
I20260709 13:07:39.699622 27988 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.822000 27659 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:39.852226 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 461085us
I20260709 13:07:39.833178 27994 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.853400 21798 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.856539 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:39.870487 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.869611 21798 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.878813 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.880170 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.882366 28017 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:39.882890 28017 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.883563 27997 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.884135 27997 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.884756 28019 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.884532 27997 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.885229 28019 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.886638 27997 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.887290 27279 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:39.887792 27279 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.888228 28018 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:39.889743 27279 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:39.894526 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.872296 27580 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:39.895573 21902 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:39.897605 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.873067 27994 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:39.870872 27971 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.908648 21982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:07:39.909665 21902 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:39.905721 27871 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.909741 21982 raft_consensus.cc:606] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:07:39.916599 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.917503 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.926349 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.926892 21978 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:39.927652 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.910447 27279 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:39.928910 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.929340 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:39.932240 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.942622 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:39.943312 21982 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.921187 27580 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.951309 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.918865 27877 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:39.965029 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:39.965252 27877 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.910563 27994 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.956128 28024 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:39.963310 27580 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.940605 27872 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:39.965615 22546 raft_consensus.cc:606] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:39.967921 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:39.970307 27872 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:39.971233 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:39.971163 27872 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.971830 21908 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:39.972661 27647 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:39.973188 27647 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.973152 21978 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:39.974774 28017 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.975414 27647 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:39.952082 27978 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:07:39.976768 27978 consensus_queue.cc:1243] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:39.977703 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.975364 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.978785 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.939005 27965 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:39.954828 21975 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:39.940670 27748 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:39.984882 28019 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:39.985509 27965 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:39.967770 28003 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:39.986495 27965 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:39.987386 21831 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:39.988386 28003 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:39.989027 21902 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:39.950735 27973 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:39.987417 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:39.991989 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:39.992750 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.003087 21828 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:40.003268 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.003872 21907 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:40.004457 21974 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:40.004930 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:40.005841 21907 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:40.007330 21825 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:40.010450 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:40.013274 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.016403 21826 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:39.938560 27279 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:39.998656 21717 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3d76b2c4699e43fba10eeb81a91e4913 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:39.999150 27994 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.000327 27877 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:40.000638 27580 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.011752 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:39.965052 27871 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:40.037654 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.023447 21798 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.026590 21908 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:40.038506 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.005859 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:40.019783 22546 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:39.995015 21982 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
W20260709 13:07:40.056931 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 51168.1us
I20260709 13:07:40.021170 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:40.057860 21833 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:40.010041 27842 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.059369 21827 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:40.060374 21798 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.041626 27667 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:40.010483 27973 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.038666 27748 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:40.068140 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.068367 21982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:07:40.061450 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2668) took 1128 ms. Trace:
I20260709 13:07:40.071285 21908 rpcz_store.cc:276] 0709 13:07:38.927637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.928277 (+   640us) service_pool.cc:224] Handling call
0709 13:07:39.971136 (+1042859us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800003098. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beb9eee 0000000000375939 00007fb763f2d1e0 00007fb763ff60c4 00007fb763ff6131 00007fb763fa40a0 00007fb763fa3984 00007fb75d51e6d4 00007fb75d51e662
0709 13:07:40.056190 (+ 85054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3640704}
I20260709 13:07:40.068008 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.073827 21982 raft_consensus.cc:606] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:07:40.066279 21798 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:40.061384 27796 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.012s	sys 0.008s
W20260709 13:07:40.052767 21717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54161.2us
I20260709 13:07:40.052857 27792 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:07:40.085287 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.061542 28019 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:40.069154 27978 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:40.093736 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.094364 21830 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:40.095193 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:40.095368 28014 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 13:07:40.096807 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800370300 after lost signal to thread 22008
I20260709 13:07:40.098112 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:40.099215 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.067673 27842 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.100625 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.101226 27842 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:40.101550 21903 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:40.103295 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2683) took 1164 ms. Trace:
I20260709 13:07:40.104666 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:40.103646 21906 rpcz_store.cc:276] 0709 13:07:38.939357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.215215 (+275858us) service_pool.cc:224] Handling call
0709 13:07:39.215547 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.241648 (+ 26101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.241676 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.242098 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.281422 (+ 39324us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:39.283461 (+  2039us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.827581 (+544120us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b4800261e58. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:07:40.102899 (+275318us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b180024bda0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287
0709 13:07:40.103013 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.103090 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.103130 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:40.103144 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.103247 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34532,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":1302,"raft.queue_time_us":57929,"raft.run_cpu_time_us":1258,"raft.run_wall_time_us":586666,"spinlock_wait_cycles":7132416,"thread_start_us":67554,"threads_started":2,"wal-append.queue_time_us":69533}
I20260709 13:07:40.105235 22546 raft_consensus.cc:606] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.105609 22546 raft_consensus.cc:614] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.061726 27580 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:40.089800 28013 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:40.091878 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:40.115464 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 73307.4us
I20260709 13:07:40.115715 21831 raft_consensus.cc:2368] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:40.092763 27792 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:40.108753 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.119776 21949 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.120379 28012 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:40.106060 21906 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:40.069494 27667 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.126242 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.128109 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.129312 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.129937 21831 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:40.131771 27432 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:40.132313 27432 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.132352 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.132897 27432 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:40.133458 21831 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:40.134626 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.135535 21831 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:40.078667 27748 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.108980 27852 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:40.139309 21906 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:40.115008 27580 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.142895 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:40.144698 21831 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:40.145823 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 134162us
I20260709 13:07:40.149559 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:07:40.081467 27796 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.012s	sys 0.008s
I20260709 13:07:40.155012 27796 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:40.118757 27792 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:40.135165 27871 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:07:40.173938 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 52816.8us
I20260709 13:07:40.139020 27964 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:40.175084 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:40.177430 22546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:40.157143 27580 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:40.184494 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.141134 27982 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:07:40.199956 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:40.162703 27647 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:40.205941 27647 raft_consensus.cc:2764] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:07:40.207183 27647 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:40.209755 22519 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.214084 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.218436 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.227806 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:40.228613 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.157351 27852 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.162299 28013 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:07:40.183444 27871 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:40.227703 28032 log.cc:927] Time spent T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:07:40.220578 28012 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:40.195240 27964 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:40.242537 28035 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:07:40.227402 27997 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:40.230471 28041 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:40.256817 22546 raft_consensus.cc:606] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.262086 22546 raft_consensus.cc:614] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.242853 27279 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:40.243081 27647 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.268689 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:40.269019 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:40.269824 22554 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:07:40.272944 27647 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.275391 27647 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:40.258615 27736 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:40.258368 28019 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.290067 28003 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.230224 27792 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.291654 27279 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:40.278600 27871 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:40.318375 28035 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:40.279238 27997 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:40.368273 27997 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.328725 21831 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:40.336364 21830 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:07:40.337648 27748 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.330323 27736 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:40.339768 27975 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.140s	user 0.004s	sys 0.000s
I20260709 13:07:40.377162 21977 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:40.340066 28044 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
W20260709 13:07:40.340610 28036 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:07:40.340673 28047 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:07:40.348222 27973 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:40.349699 27432 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.351619 27964 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:40.351991 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 806) took 1145 ms. Trace:
I20260709 13:07:40.378364 27580 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.386302 21832 rpcz_store.cc:276] 0709 13:07:39.206582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.206961 (+   379us) service_pool.cc:224] Handling call
0709 13:07:39.207262 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.418694 (+211432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.351716 (+933022us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400337054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:40.351920 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448772352}
I20260709 13:07:40.352511 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:40.327046 27627 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:07:40.357407 21904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2639) took 3482 ms (client timeout 1591 ms). Trace:
I20260709 13:07:40.360119 28046 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:40.334012 28019 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.361652 28041 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:40.362959 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 134433us
I20260709 13:07:40.377192 27786 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:40.375559 21833 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:40.376438 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.379098 21983 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:40.379294 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 257803us
I20260709 13:07:40.379499 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.380447 21980 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:40.384055 21979 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:40.403132 21978 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:07:40.388916 21904 rpcz_store.cc:269] 0709 13:07:36.875278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.876314 (+  1036us) service_pool.cc:224] Handling call
0709 13:07:40.357212 (+3480898us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400076f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:40.357314 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4974050688}
W20260709 13:07:40.397169 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7be0 after lost signal to thread 22579
I20260709 13:07:40.383435 27792 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:40.373644 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 187374us
W20260709 13:07:40.404016 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800327bc0 after lost signal to thread 22580
I20260709 13:07:40.406471 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.406764 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.407657 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:40.410633 21983 raft_consensus.cc:2376] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16. Re-sending same reply.
I20260709 13:07:40.410708 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.408281 21977 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:40.410822 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.386322 27279 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.414081 21980 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:40.388756 27627 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:40.415561 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.366809 28003 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.418689 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.477212 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:40.478219 21980 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:40.479802 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.481405 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.482026 21982 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:40.484267 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.484711 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:40.485447 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.486559 21975 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:40.488189 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:40.493587 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:40.473012 27864 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:07:40.460541 27975 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:40.502156 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:40.504637 28017 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:40.506070 27992 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:40.506615 27992 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:40.507498 27992 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.408963 27973 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:07:40.490540 28041 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.512197 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:40.516831 21901 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:40.416934 27786 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:40.511487 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.514271 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:40.461617 27748 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:07:40.514676 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:40.521925 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800257400 after lost signal to thread 27901
W20260709 13:07:40.527323 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800348740 after lost signal to thread 27910
W20260709 13:07:40.526147 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 108364us
I20260709 13:07:40.459350 27279 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.516281 28017 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:40.535135 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2581) took 1767 ms. Trace:
I20260709 13:07:40.554572 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.417075 27736 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.518529 28046 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:40.551254 21981 rpcz_store.cc:276] 0709 13:07:38.768067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.768430 (+   363us) service_pool.cc:224] Handling call
0709 13:07:39.075461 (+307031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.075802 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.075833 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.076244 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.170210 (+ 93966us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:39.178636 (+  8426us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.194382 (+ 15746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.194479 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.321886 (+1127407us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:40.520783 (+198897us) raft_consensus.cc:1685] finished
0709 13:07:40.534863 (+ 14080us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.535064 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2113,"prepare.queue_time_us":364292,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":15966,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":4505,"spinlock_wait_cycles":2362624,"thread_start_us":93594,"threads_started":1,"wal-append.queue_time_us":106253}
I20260709 13:07:40.565297 21979 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:40.533485 28000 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:40.560727 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.557111 21901 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:40.586036 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.588290 21904 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:40.534466 28056 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.519817 28041 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.621721 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.633226 21908 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:40.566468 28053 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.635077 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 107058us
I20260709 13:07:40.587059 28000 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.642043 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 122781us
I20260709 13:07:40.559801 27965 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:07:40.645596 22546 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:07:40.631793 27875 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.652307 21901 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:40.652328 21908 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:40.652927 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 242296us
I20260709 13:07:40.654227 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:40.655359 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.656121 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.657050 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.637475 28057 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.645198 28000 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:40.672251 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.680337 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:40.656945 27580 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:40.690722 28054 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:40.691737 27748 raft_consensus.cc:993] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:07:40.656771 28053 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.632476 28056 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.693121 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:40.706192 21908 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:40.706648 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49670.2us
I20260709 13:07:40.708223 21949 leader_election.cc:400] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:40.677162 28063 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:40.668390 28057 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.699270 27432 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.699896 28068 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:40.646574 28017 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:07:40.708628 21949 leader_election.cc:403] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:40.718590 21908 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:40.659739 27875 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.727741 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.728770 21831 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:07:40.701431 28054 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:40.679539 28019 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:40.712136 27792 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:40.734009 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:40.718791 28003 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:40.740098 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55833us
I20260709 13:07:40.732081 27432 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:40.740834 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:40.741699 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.732616 28054 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:40.750555 28060 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:07:40.750838 28062 raft_consensus.cc:1081] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Signalling peer 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:07:40.755520 28055 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:40.740238 27786 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:40.760946 28065 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:40.754069 27792 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:40.763465 27875 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.763908 28057 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:40.761866 27792 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:40.743798 28068 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:40.768024 28068 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.768595 28068 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:40.766824 27792 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:40.770661 28041 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:40.751792 27279 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:40.815531 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 60753.8us
I20260709 13:07:40.816332 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:40.819962 28057 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:07:40.826007 28053 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.826277 28056 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.823048 27748 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:40.831022 27748 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:40.831079 27792 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.832118 27748 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.823948 28063 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:07:40.837664 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.842538 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.843225 21825 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:40.845566 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:40.846244 21833 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:40.847132 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.847759 21830 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:40.849037 21825 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:07:40.850813 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.851296 21832 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:40.854710 28054 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.857105 28054 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:40.857532 28001 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:40.859647 21833 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:40.859725 21979 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:40.860540 21980 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:40.865285 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:40.868341 28070 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:40.868585 27736 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:40.866977 27982 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.869282 27736 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.874593 27992 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.869230 28070 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.886667 27736 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.882985 27982 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.859324 28001 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.877666 27965 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:40.886678 28070 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.907549 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:40.884167 27792 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.911594 28001 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:40.912155 27990 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:40.913496 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:40.913879 21799 consensus_peers.cc:597] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bde6ac1d042400fbc88831c01b9fdda. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.905885 27736 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:40.917230 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:40.917822 22551 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:40.891548 27992 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.913306 28019 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:40.923449 22551 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:40.926483 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:40.926743 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:40.927820 22553 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:40.928184 22553 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:40.930053 22553 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.930954 22553 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:40.931258 27982 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:40.937016 21901 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:40.937394 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.908113 28000 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.938405 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:40.939693 28000 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:40.939842 21900 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:40.925928 28068 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.940927 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:40.941265 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.941489 21980 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:40.941847 21905 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:40.939721 21908 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:40.942353 28068 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:40.937969 22553 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:07:40.943737 22553 pending_rounds.cc:85] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 12
I20260709 13:07:40.944015 22553 pending_rounds.cc:107] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:07:40.944238 22553 raft_consensus.cc:2889] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.945722 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:40.947502 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:40.949672 21903 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:40.952968 27728 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:40.953284 28018 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:40.953399 28019 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:40.953394 27728 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.954561 28026 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 1.039s	user 0.000s	sys 0.003s
I20260709 13:07:40.954655 27728 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:40.952996 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 893) took 1462 ms. Trace:
I20260709 13:07:40.955449 22548 rpcz_store.cc:276] 0709 13:07:39.490634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.490794 (+   160us) service_pool.cc:224] Handling call
0709 13:07:39.519120 (+ 28326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.678445 (+159325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.952614 (+1274169us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000aa0d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:40.952923 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364589440}
I20260709 13:07:40.957074 27982 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:40.957557 27982 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:40.959506 27982 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:40.960032 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.960884 27992 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:40.961731 28079 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:07:40.962913 27852 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:40.963685 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 769) took 1328 ms. Trace:
I20260709 13:07:40.964075 22547 rpcz_store.cc:276] 0709 13:07:39.635548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.636122 (+   574us) service_pool.cc:224] Handling call
0709 13:07:39.636558 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.641269 (+  4711us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:39.768515 (+127246us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.801991 (+ 33476us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.877827 (+ 75836us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.877963 (+   136us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:40.034802 (+156839us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.035039 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.035133 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.954093 (+918960us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:40.963491 (+  9398us) raft_consensus.cc:1685] finished
0709 13:07:40.963514 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.963633 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5416,"prepare.queue_time_us":183437,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3289,"raft.queue_time_us":43705,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":30742,"spinlock_wait_cycles":6911232,"thread_start_us":188366,"threads_started":2,"wal-append.queue_time_us":125361}
I20260709 13:07:40.967312 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:40.970992 28073 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 13:07:40.973903 27980 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.683s	user 0.003s	sys 0.000s
I20260709 13:07:40.974805 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.975203 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:40.976099 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2681) took 2037 ms. Trace:
I20260709 13:07:40.976475 21909 rpcz_store.cc:276] 0709 13:07:38.938761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.189352 (+250591us) service_pool.cc:224] Handling call
0709 13:07:39.189653 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.189982 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.190012 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.191322 (+  1310us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.199528 (+  8206us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:39.199564 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.199629 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.973259 (+1773630us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:40.975731 (+  2472us) raft_consensus.cc:1685] finished
0709 13:07:40.975761 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.976026 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":3481856,"thread_start_us":7840,"threads_started":1,"wal-append.queue_time_us":78054}
I20260709 13:07:40.981552 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:40.982697 28080 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:40.986470 28024 raft_consensus.cc:1064] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:07:40.987428 27627 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:40.987871 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:40.988446 27627 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:40.984009 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.984640 21830 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:40.986076 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:40.992574 27647 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:40.996843 27667 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:40.919301 27736 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.002748 27736 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:41.003341 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:41.003336 21980 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:41.010221 27886 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:41.011174 27886 consensus_queue.cc:1243] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:41.012356 28041 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:41.012817 28041 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:41.013830 28041 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.015337 28041 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.018085 21982 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:41.019714 28001 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.020263 28001 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.026800 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.028532 27627 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:40.961824 27728 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.033077 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.036794 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.033568 27667 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.043843 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:41.045099 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.038264 27877 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:41.042364 27667 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.044776 27990 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:41.052150 27667 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:41.040833 27627 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.052071 27990 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.052999 27971 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.040544 27927 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:07:41.055541 28012 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:41.041172 28062 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:07:41.056806 28018 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:41.063777 27432 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:41.064240 27432 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:41.037927 28058 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 13:07:41.067970 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.496s	user 0.007s	sys 0.011s
W20260709 13:07:41.068734 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.496s	user 0.007s	sys 0.011s
W20260709 13:07:41.069239 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 1.56244e+06us
I20260709 13:07:41.069871 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:41.071712 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:41.073697 22553 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:41.075956 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:41.076546 22553 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.076551 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:41.077726 21979 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:41.080354 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:41.075577 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.083106 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.085280 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:41.086017 21979 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:41.088474 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:41.089152 21908 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:07:41.089313 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:41.090852 21903 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:41.097007 21980 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:41.100883 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:41.102057 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 67337.3us
I20260709 13:07:41.103042 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:41.108299 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:41.109153 21901 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:41.107437 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:41.114998 21906 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:07:41.119238 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:41.119843 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48167.1us
I20260709 13:07:41.121723 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:41.124097 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47626.2us
I20260709 13:07:41.124280 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:41.125814 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:41.126797 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:41.127441 22553 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:41.132230 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.129770 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:41.131254 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:41.147893 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:41.148612 22546 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:41.148699 21979 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:41.098356 27635 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:41.118279 28013 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:41.151283 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.151926 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:41.152027 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:41.152633 21981 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:41.129828 21908 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:41.152809 22553 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
W20260709 13:07:41.174124 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.106956 27988 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:41.178413 22551 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:07:41.152884 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:41.126101 28019 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:41.145569 27992 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:41.146147 27978 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:41.149540 28006 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:41.144379 27994 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:41.206856 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:41.125569 28053 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.188593 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 87607.2us
I20260709 13:07:41.189357 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:41.215961 21979 raft_consensus.cc:2376] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20. Re-sending same reply.
I20260709 13:07:41.129253 27653 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:41.193315 21827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3"
dest_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:40638
I20260709 13:07:41.220657 21827 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:41.194087 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:41.194633 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.221084 21827 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.195132 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.195513 21826 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:41.223857 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:41.197965 21909 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
W20260709 13:07:41.205178 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.191761 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:41.225299 21833 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:41.225704 21974 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
W20260709 13:07:41.206764 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53940.7us
I20260709 13:07:41.123063 27894 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:07:41.162148 27736 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.196938 27978 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:41.145078 28011 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:07:41.222651 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:41.228142 21976 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:41.221865 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:41.261514 21829 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:41.148156 27965 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:07:41.185041 27635 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:41.271028 21833 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:41.244112 21981 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:41.210283 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:41.188288 27992 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:41.273880 27992 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.274276 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:41.274344 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:41.218786 28017 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:41.285554 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:41.258911 21827 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.288329 21830 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:41.229892 27875 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:41.288348 28017 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.192162 27988 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 13:07:41.303026 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 84029.6us
I20260709 13:07:41.242895 27842 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:41.261628 27978 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.215291 28003 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:07:41.322259 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:41.323117 21908 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
W20260709 13:07:41.335839 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 50367.2us
I20260709 13:07:41.223387 28053 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.236230 28057 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:07:41.347232 21829 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:41.354616 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:41.292323 28046 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:41.230079 28006 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:07:41.307209 28017 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:41.284730 27982 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:07:41.377364 21903 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:41.351323 27580 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:41.378830 21903 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:41.353497 27748 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:41.390399 27894 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:41.391448 28102 ts_tablet_manager.cc:933] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:07:41.393887 28053 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:41.394515 28096 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.397641 28091 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:41.381814 28078 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.231s
I20260709 13:07:41.362972 28046 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:41.342329 28084 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 13:07:41.449144 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 226548us
W20260709 13:07:41.449841 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 146058us
I20260709 13:07:41.386853 27580 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:41.471731 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:41.472574 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:41.472422 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 188943us
I20260709 13:07:41.477632 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:41.413283 27748 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:41.479391 21949 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:41.504963 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.507189 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.506963 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:41.515235 21829 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:41.515239 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.517283 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:41.518844 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.520171 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:41.521263 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.478231 27580 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:41.503306 27802 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:41.503038 27748 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.427244 27894 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.527307 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.510756 27871 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:41.506489 27403 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:41.529942 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.535405 21829 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:07:41.535672 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 293214us
I20260709 13:07:41.535921 21832 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:41.543980 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.544171 21832 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:41.544759 21825 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:41.547555 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.548283 21830 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:41.531551 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.532804 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.549477 21833 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:41.503227 28067 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:41.523108 28006 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:41.527936 27802 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.561278 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.559424 28101 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:41.578537 28101 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:41.578612 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:41.579138 28101 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:41.580051 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.586066 28088 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:41.513998 27279 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:07:41.513460 28056 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:07:41.534598 27403 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.552045 27922 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:41.479696 28096 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.552634 27988 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:41.555757 27871 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:41.589125 27802 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:41.635253 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:41.587304 27842 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.586762 28088 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.603050 27875 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:41.658905 21825 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:41.603497 27403 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.607404 27922 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:41.659950 28018 consensus_meta.cc:287] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.009s
W20260709 13:07:41.692605 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 155318us
I20260709 13:07:41.710917 28018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52668 (request call id 22) took 1725 ms. Trace:
I20260709 13:07:41.711277 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:41.711356 28018 rpcz_store.cc:276] 0709 13:07:39.985276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.985413 (+   137us) service_pool.cc:224] Handling call
0709 13:07:39.999390 (+ 13977us) log.cc:844] Serialized 506 byte log entry
0709 13:07:40.822010 (+822620us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b18003b1760. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:41.710820 (+888810us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18164,"raft.queue_time_us":30195,"raft.run_cpu_time_us":1814,"raft.run_wall_time_us":4777,"spinlock_wait_cycles":2768128,"thread_start_us":63865,"threads_started":1,"wal-append.queue_time_us":91447}
I20260709 13:07:41.688464 28087 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:41.693955 28118 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.694367 28078 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:41.694804 27894 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:41.696563 28074 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:41.702826 28076 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.703142 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 195592us
I20260709 13:07:41.708606 28088 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:41.729460 28087 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:41.589272 28006 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.737617 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:41.712937 27992 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.687086 27922 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:41.746601 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 215127us
I20260709 13:07:41.683995 28111 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.751477 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:41.643151 27988 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:41.802304 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 44701.9us
I20260709 13:07:41.807363 21903 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:07:41.808104 21903 pending_rounds.cc:85] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 10
I20260709 13:07:41.808364 21903 pending_rounds.cc:107] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:07:41.808648 21903 raft_consensus.cc:2889] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:41.810948 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 195904us
I20260709 13:07:41.812433 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:41.813834 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:41.737259 27894 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:41.825465 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:41.756884 28088 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:41.832001 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:41.800733 27279 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:41.713300 28118 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.717448 27875 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.832227 28088 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.731220 28078 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.871497 28128 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:41.872543 28001 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:41.872923 27748 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:41.885499 28108 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:41.754705 28102 tablet_copy_client.cc:323] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.129:39085
I20260709 13:07:41.844908 27279 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.900557 27279 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.901607 27748 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:41.760295 28076 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.892930 28088 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:41.832919 27894 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.800555 28111 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.873936 27802 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.822177 27842 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.093s
W20260709 13:07:41.915294 27971 consensus_meta.cc:287] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.001s
W20260709 13:07:41.946131 21949 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.670s (SENT) [suppressed 8 similar messages]
I20260709 13:07:41.829366 27871 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.948926 21834 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:41.956831 28130 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:07:41.957306 28107 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:41.958196 27796 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.958041 28107 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:41.958601 28123 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:07:41.958876 27796 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.959162 28107 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:41.960547 28024 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.961660 28107 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:41.961820 28104 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:41.962836 27992 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:41.962128 28078 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:41.950436 28128 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:41.978766 27988 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:41.973448 28018 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:41.979480 28117 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.979799 27982 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:41.974951 28038 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.099s	user 0.010s	sys 0.000s
I20260709 13:07:41.993820 28052 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:41.968025 28096 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:41.995334 27894 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:41.907840 28087 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.014948 28029 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:07:41.981774 28006 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.022372 28076 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.019616 28111 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:41.958093 28115 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:07:42.039242 27279 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:42.018450 28116 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:42.018391 28052 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.055414 28052 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.018437 28119 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:42.059154 27580 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260709 13:07:42.059510 27786 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:42.059984 27786 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:42.060746 27786 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.059607 27580 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.073742 27786 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.075443 27580 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.032215 28118 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:42.051901 28017 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.665s	user 0.000s	sys 0.011s
I20260709 13:07:42.087692 27802 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:42.031376 28101 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:41.990993 28018 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:42.079986 27978 consensus_meta.cc:287] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.004s
I20260709 13:07:42.004248 27982 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.105262 28018 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.114481 27279 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:42.115245 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 402530us
I20260709 13:07:42.091583 27796 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:42.128665 21978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.004s	sys 0.012s
W20260709 13:07:42.133235 21978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.004s	sys 0.012s
I20260709 13:07:42.093039 28017 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.096027 27922 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.139037 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2723) took 1063 ms. Trace:
I20260709 13:07:42.106354 27978 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:42.148352 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.149161 21903 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:07:42.148411 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:42.155567 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:42.143509 21978 rpcz_store.cc:276] 0709 13:07:41.076089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.080060 (+  3971us) service_pool.cc:224] Handling call
0709 13:07:41.080368 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.080609 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:41.535061 (+454452us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.138589 (+603528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.138659 (+    70us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:42.138726 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.138812 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.138958 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1112,"prepare.queue_time_us":422678,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1719,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":1009942,"threads_started":2}
I20260709 13:07:42.153841 28124 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.213637 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 381893us
I20260709 13:07:42.216928 27982 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.218847 28101 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:42.221168 27667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.000s	sys 0.021s
I20260709 13:07:42.222129 28041 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.223660 27775 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:42.229656 21875 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:42.230542 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:42.243388 22546 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:42.230652 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:42.243975 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 297860us
W20260709 13:07:42.232219 27667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.000s	sys 0.021s
W20260709 13:07:42.232622 27403 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.006s
I20260709 13:07:42.244382 21874 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:42.248615 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.249496 21977 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:42.249590 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.250578 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.251432 27852 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:42.254593 27852 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:42.254978 27852 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.255049 27922 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.245750 27775 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.260295 27728 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.261296 28088 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.262720 27978 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.264159 27775 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.267536 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:42.269032 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:42.251703 27403 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:42.275906 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.278512 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:42.234055 28124 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.296049 28017 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.296249 27653 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:42.294845 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:42.266949 27875 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:42.273000 28135 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:07:42.247772 28041 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.296638 27653 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.299810 27842 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.293924 27922 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:42.306195 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:42.302492 21908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.019s	sys 0.018s
W20260709 13:07:42.310631 21908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.019s	sys 0.018s
W20260709 13:07:42.313290 21829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.010s	sys 0.012s
W20260709 13:07:42.313620 21829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.010s	sys 0.012s
I20260709 13:07:42.306257 27653 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.318427 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:42.318919 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:42.321188 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.332547 28115 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:42.321341 21980 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:42.313588 27922 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:42.335232 28124 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.299286 27852 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.339375 27403 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:42.339735 27852 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.328169 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:42.341102 28041 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.341838 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.342051 27728 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:42.342458 21974 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:42.342592 27728 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.343323 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.301548 27432 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.343885 21974 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:42.344787 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.345773 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:42.346463 27990 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.350224 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:42.350797 22547 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.328831 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:42.314077 28017 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:42.358443 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:42.356400 21907 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:42.358132 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:42.361123 21902 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:42.359129 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:42.361945 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:42.354598 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:42.363452 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:42.364080 21907 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:42.364440 21901 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:07:42.354105 21908 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:42.362097 21974 raft_consensus.cc:2368] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:42.366900 22547 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:42.362007 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:42.368171 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:42.331717 28142 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:42.372653 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53836.2us
I20260709 13:07:42.374054 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:07:42.375586 21946 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.026s
W20260709 13:07:42.375862 21946 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.026s
I20260709 13:07:42.335228 27922 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:42.379628 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:42.379345 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:42.404857 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.375145 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:42.411973 22553 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:42.413486 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:42.414134 21974 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:42.414454 21974 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:42.415475 21974 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.371634 28058 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:42.419667 28046 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.380512 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:42.416661 21974 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.423300 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:42.424265 21826 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:07:42.424853 21874 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:42.314536 27842 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.369480 27982 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.333827 28040 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:42.369294 27978 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:42.433967 21831 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:07:42.434046 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:42.435078 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59993.8us
W20260709 13:07:42.425454 27997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.912s	user 0.035s	sys 0.011s
I20260709 13:07:42.436357 21907 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:42.387229 27403 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:42.442075 21902 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:42.439036 21833 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:42.378911 27872 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:42.441200 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:42.451653 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.440915 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:42.489341 21908 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.455914 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:42.490985 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:42.493026 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:42.428635 27580 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.431815 28142 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.436977 27997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.941s	user 0.036s	sys 0.012s
I20260709 13:07:42.447820 27852 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.496249 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:42.444849 27875 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.493777 21825 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:42.501830 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.498483 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:42.432633 28101 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:42.428268 28058 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:42.498232 28147 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:42.485723 27988 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.496304 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:42.448693 27802 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:42.507045 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:42.486899 28087 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:42.496568 28148 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:42.513108 22555 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.513585 21902 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:42.528429 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:42.508955 28142 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.536537 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.530369 21908 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
W20260709 13:07:42.534485 21834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 2757) took 2532 ms (client timeout 1670 ms). Trace:
W20260709 13:07:42.539366 21834 rpcz_store.cc:269] 0709 13:07:40.001835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.002105 (+   270us) service_pool.cc:224] Handling call
0709 13:07:42.534283 (+2532178us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54000e9cd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:42.534392 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4351973248}
I20260709 13:07:42.508344 21974 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:42.517019 21833 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:42.488436 28018 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:42.521889 22553 raft_consensus.cc:2368] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24.
I20260709 13:07:42.499035 27403 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:42.450374 27978 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.515429 27852 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.439626 27982 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.505379 27728 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.538576 21980 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:42.597994 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.516353 28070 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:42.563814 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:42.494336 28121 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:07:42.512012 27580 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:42.517823 28158 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.579466 21829 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:42.590857 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:42.505743 28067 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:07:42.514185 27871 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:07:42.494629 27872 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.592466 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:42.529083 28068 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:42.585240 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.601873 21833 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:42.688843 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 96463.1us
I20260709 13:07:42.689486 21978 raft_consensus.cc:2410] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:07:42.603160 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:42.516433 28101 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.606437 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.606771 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:42.690603 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.601171 28070 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:42.611847 27728 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:42.711261 28115 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:42.606029 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:42.517095 27875 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.562732 27802 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:42.563243 27988 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:42.627756 21832 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:42.770646 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:42.601686 28092 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.133s	user 0.003s	sys 0.009s
I20260709 13:07:42.679929 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:42.776551 21907 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.534415 27653 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:42.777413 28150 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:07:42.778658 27653 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.779525 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2720) took 1688 ms. Trace:
I20260709 13:07:42.779899 21900 rpcz_store.cc:276] 0709 13:07:41.091455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.091573 (+   118us) service_pool.cc:224] Handling call
0709 13:07:41.091873 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.123427 (+ 31554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.123459 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.123910 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.231031 (+107121us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:41.231096 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.231188 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.531929 (+1300741us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:42.779248 (+247319us) raft_consensus.cc:1685] finished
0709 13:07:42.779271 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.779466 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31191,"raft.queue_time_us":31321,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":16765,"spinlock_wait_cycles":7504640,"thread_start_us":85328,"threads_started":1,"wal-append.queue_time_us":208885}
I20260709 13:07:42.531335 28054 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:07:42.583657 28006 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:42.600317 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:42.783192 28054 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:42.783334 28006 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.577247 21825 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:42.691850 22555 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:42.783885 28054 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:42.706468 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:42.783540 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 183308us
I20260709 13:07:42.784672 21901 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:42.537298 28087 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.785429 21873 leader_election.cc:400] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:42.785758 21873 leader_election.cc:403] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:07:42.786427 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:42.787853 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:42.596428 28018 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.720131 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.654479 28040 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:42.530089 28058 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.606966 28000 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:07:42.692991 28068 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:42.700965 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44166.1us
W20260709 13:07:42.708170 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 276018us
I20260709 13:07:42.805997 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:42.807592 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:42.612522 27997 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.648761 28158 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.813040 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:42.774677 28166 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:42.783809 28006 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:42.751142 27872 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.753863 21833 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:42.730911 28147 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.736244 27842 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.736008 28076 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:42.771314 21902 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
W20260709 13:07:42.771873 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 168802us
I20260709 13:07:42.816427 27802 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.727092 27403 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.774682 28142 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.776150 27988 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.713495 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:42.789763 21905 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:42.791643 21900 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:42.803752 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:42.783649 27875 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.801460 21907 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:42.761384 27580 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.869547 21827 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.869383 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2724) took 1687 ms. Trace:
I20260709 13:07:42.763765 27728 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.755375 28070 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.784427 28054 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.800639 28115 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.817047 28076 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:42.819061 28111 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:07:42.810627 28040 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:42.920841 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.030082 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.899489 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40638 (request call id 2793) took 1699 ms. Trace:
I20260709 13:07:43.032881 21827 rpcz_store.cc:276] 0709 13:07:41.192970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.193158 (+   188us) service_pool.cc:224] Handling call
0709 13:07:42.869423 (+1676265us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b4c003d6f40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d2aaa20 00007fb75d2bba29 00007fb75d2bc13f 00007fb75d2802ab 00007fb75d2adf3c 00007fb75d2ae3fe 00007fb75d53b88b 00007fb75ef3a495 00007fb75ef8b30f 00007fb75efd5a55 00007fb763fa5cd0
0709 13:07:42.892528 (+ 23105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112113024}
W20260709 13:07:42.892621 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 84109.6us
W20260709 13:07:42.814987 28163 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:07:42.892771 21904 rpcz_store.cc:276] 0709 13:07:41.182045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.182205 (+   160us) service_pool.cc:224] Handling call
0709 13:07:41.182594 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.219813 (+ 37219us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:41.358980 (+139167us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.484269 (+1125289us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b18004bbb60. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75eb864bc 00007fb75bed448b 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287
0709 13:07:42.484407 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.484491 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:42.484560 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.869156 (+384596us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b5400236ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:42.869201 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.869320 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30586,"prepare.queue_time_us":162835,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":152795,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2329,"spinlock_wait_cycles":88414336,"thread_start_us":275124,"threads_started":2}
I20260709 13:07:42.810295 28068 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:42.988881 28159 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:07:43.028780 28155 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
W20260709 13:07:42.979255 28162 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 13:07:42.897680 28157 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.314s	user 0.001s	sys 0.001s
I20260709 13:07:43.053380 28070 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:43.053777 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:43.057766 27653 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:43.069363 27984 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:43.069739 27984 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:43.070094 27984 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:43.070919 28076 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.071424 28076 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.071851 28076 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.892489 28170 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:43.073560 28170 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:43.073943 28170 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:42.878479 27994 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:43.039613 28167 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:07:42.922436 28052 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.922009 28178 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:43.025588 28062 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:43.099350 28062 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:42.925436 27872 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.918515 28147 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:43.103608 27872 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:43.104156 28147 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:43.105747 27872 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:43.106416 21843 tablet_copy_service.cc:140] P 479255846c5141b584b16aa253f587c7: Received BeginTabletCopySession request for tablet 6bde6ac1d042400fbc88831c01b9fdda from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:52674)
I20260709 13:07:43.106986 21843 tablet_copy_service.cc:161] P 479255846c5141b584b16aa253f587c7: Beginning new tablet copy session on tablet 6bde6ac1d042400fbc88831c01b9fdda from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:52674: session id = 0157b4f0725d4f92a53938c921db9efc-6bde6ac1d042400fbc88831c01b9fdda
I20260709 13:07:43.107113 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:42.892347 28145 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:42.893042 28071 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:43.041057 27978 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:42.896690 28175 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:43.066226 21904 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:42.999635 28101 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:42.963065 27852 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:42.901053 27875 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:43.044957 28087 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.094734 28052 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:43.098276 28178 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:43.107468 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.108376 21829 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:43.123119 28140 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:43.123549 28140 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:43.124905 28145 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:43.125329 27653 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:43.125550 28145 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:43.125861 27653 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:43.126391 27875 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:43.128530 27875 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:43.129825 28161 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:07:43.110452 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.131853 21832 raft_consensus.cc:2410] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:07:42.818114 27997 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.110997 21830 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:43.111707 22553 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:07:43.139809 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.140496 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.141001 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.142071 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 801) took 1952 ms. Trace:
I20260709 13:07:43.144883 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.146741 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.142558 21975 rpcz_store.cc:276] 0709 13:07:41.189479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.210720 (+ 21241us) service_pool.cc:224] Handling call
0709 13:07:41.211037 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.260956 (+ 49919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.260985 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.261439 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.441472 (+1180033us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b180045fc40. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:07:42.681595 (+240123us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:42.681653 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.681760 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.131141 (+449381us) raft_consensus.cc:1685] finished
0709 13:07:43.131168 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.141997 (+ 10829us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66114,"raft.queue_time_us":81124,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11879,"spinlock_wait_cycles":9925888,"thread_start_us":239884,"threads_started":1,"wal-append.queue_time_us":1605735}
I20260709 13:07:43.148499 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:43.112573 28169 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 13:07:43.113391 28172 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:07:43.124847 27984 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:43.149019 21975 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:43.156392 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:43.131640 28175 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:43.111999 28180 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:43.147764 27978 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.163982 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:43.169435 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:43.163103 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 375293us
I20260709 13:07:43.154254 28132 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:43.177227 27984 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.177877 27984 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:43.178038 28165 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:07:43.168357 27973 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.060845 28084 consensus_queue.cc:1175] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 18 status { last_received { term: 18 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: [17.10-17.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:43.181154 27973 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.183336 27973 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:43.186887 27922 consensus_meta.cc:287] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.000s
I20260709 13:07:43.187362 27922 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.189764 27922 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.190726 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:43.190903 28052 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:43.153891 28124 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:07:43.195024 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:43.165596 28175 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:43.164247 28018 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:43.199615 27973 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:43.196403 21975 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:07:43.167104 28178 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:43.201985 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.171264 27978 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.195379 28052 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:43.195488 28076 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:43.211488 21798 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:43.292052 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.296005 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:43.296717 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 86812.6us
I20260709 13:07:43.298388 21798 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:43.300915 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:43.299111 27973 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:43.284813 27922 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:43.195686 28132 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.309453 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.366350 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:43.367125 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.368129 28132 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:43.368346 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:43.369323 21828 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:43.301263 27872 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:43.314622 28062 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:43.315794 21831 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:43.316594 27653 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.318480 28123 raft_consensus.cc:993] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: : Instructing follower ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:07:43.371543 28123 raft_consensus.cc:1081] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Signalling peer ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:07:43.370795 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.373420 27653 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.373772 21828 raft_consensus.cc:2393] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:43.374725 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.375408 21828 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:43.376025 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:43.376585 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:43.331112 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.332682 27432 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:43.334251 27922 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.304785 28012 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:43.307891 27990 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:43.307677 28185 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:43.336309 27667 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:43.337505 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:43.337809 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:43.338152 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:43.341481 27982 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.341238 28063 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:43.344413 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:43.345198 28183 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:43.344452 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 905) took 1119 ms. Trace:
I20260709 13:07:43.347291 27748 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:43.347443 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:43.352272 21843 tablet_copy_source_session.cc:215] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:43.356650 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:43.356943 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.342000 28188 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:07:43.362603 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:43.362870 27728 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.363670 28054 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:43.194702 28180 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.376943 21900 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:43.330156 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2721) took 1525 ms. Trace:
I20260709 13:07:43.378422 21829 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:07:43.379652 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.433045 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.450867 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:43.529956 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:43.514914 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 792) took 1075 ms. Trace:
I20260709 13:07:43.444196 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 892) took 1213 ms. Trace:
I20260709 13:07:43.616917 21905 rpcz_store.cc:276] 0709 13:07:42.439610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.446646 (+  7036us) service_pool.cc:224] Handling call
0709 13:07:42.447113 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.877448 (+430335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.514643 (+637195us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54002e63d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:43.514848 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787289344}
I20260709 13:07:43.496637 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:43.623456 21832 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
W20260709 13:07:43.624045 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 276670us
I20260709 13:07:43.621871 21834 raft_consensus.cc:2368] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:43.616500 21909 rpcz_store.cc:276] 0709 13:07:41.804476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.805344 (+   868us) service_pool.cc:224] Handling call
0709 13:07:41.805677 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.915047 (+109370us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:41.929044 (+ 13997us) log.cc:844] Serialized 14 byte log entry
0709 13:07:42.369711 (+440667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.369755 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:42.369792 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.329876 (+960084us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002387d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:43.329937 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.330088 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5764,"prepare.queue_time_us":14255,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3338,"raft.queue_time_us":6235,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1673,"spinlock_wait_cycles":250950016,"thread_start_us":434540,"threads_started":1,"wal-append.queue_time_us":663584}
W20260709 13:07:43.580967 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.634371 21832 pending_rounds.cc:85] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 9
W20260709 13:07:43.623540 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 172758us
I20260709 13:07:43.512533 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:43.635763 21832 pending_rounds.cc:107] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:07:43.602345 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2741) took 1225 ms. Trace:
I20260709 13:07:43.636090 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:43.539381 21830 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:43.458395 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.636126 21832 raft_consensus.cc:2889] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:43.504508 21831 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:43.634805 22548 rpcz_store.cc:276] 0709 13:07:42.224646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.224769 (+   123us) service_pool.cc:224] Handling call
0709 13:07:42.225156 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:42.316857 (+ 91701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.316902 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:42.332879 (+ 15977us) log.cc:844] Serialized 52 byte log entry
0709 13:07:42.528899 (+196020us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:42.528997 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.344072 (+815075us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b54006801d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:43.344127 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.344180 (+    53us) raft_consensus.cc:1685] finished
0709 13:07:43.344196 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.344398 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":27946,"spinlock_wait_cycles":209772928,"thread_start_us":185001,"threads_started":1,"wal-append.queue_time_us":264656}
I20260709 13:07:43.633858 22554 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 24: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:43.639299 21825 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:43.379277 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:43.378816 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.640702 21828 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:43.620457 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.644968 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:43.645690 22550 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:43.385222 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.613933 21833 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:43.637603 21976 rpcz_store.cc:276] 0709 13:07:42.377267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.899189 (+521922us) service_pool.cc:224] Handling call
0709 13:07:43.029664 (+130475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.030046 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.030070 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.040080 (+ 10010us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.155776 (+115696us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:43.155818 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.155894 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.602022 (+446128us) raft_consensus.cc:1685] finished
0709 13:07:43.602052 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.602273 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1755,"raft.queue_time_us":121720,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4720,"spinlock_wait_cycles":153344,"thread_start_us":104483,"threads_started":1,"wal-append.queue_time_us":263983}
I20260709 13:07:43.617616 22551 rpcz_store.cc:276] 0709 13:07:42.230507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.230621 (+   114us) service_pool.cc:224] Handling call
0709 13:07:42.230888 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.266774 (+ 35886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.266809 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:42.266861 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:42.266913 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.443968 (+1177055us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b5400313dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:43.444016 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.444141 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81927552}
I20260709 13:07:43.499513 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2726) took 1144 ms. Trace:
I20260709 13:07:43.682361 21974 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:07:43.682597 22547 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.036s	sys 0.078s
W20260709 13:07:43.683398 22547 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.036s	sys 0.078s
W20260709 13:07:43.688078 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52076.2us
W20260709 13:07:43.484750 28006 consensus_meta.cc:287] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.001s
I20260709 13:07:43.878649 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.644657 27990 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:43.451543 28190 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.725479 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:43.952857 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.953361 28006 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:43.510953 28017 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:43.954051 27990 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.688122 28182 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:43.515295 28003 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:43.515246 28041 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.955020 28182 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:43.526122 28040 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:43.680672 21903 rpcz_store.cc:276] 0709 13:07:42.355309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.357164 (+  1855us) service_pool.cc:224] Handling call
0709 13:07:42.365474 (+  8310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:42.369856 (+  4382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.369900 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:42.372526 (+  2626us) log.cc:844] Serialized 52 byte log entry
0709 13:07:42.755016 (+382490us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b180046a8c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:07:43.057149 (+302133us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:43.057289 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.058357 (+  1068us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.106657 (+ 48300us) raft_consensus.cc:1685] finished
0709 13:07:43.106680 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.499330 (+392650us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b54002f58d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:43.499447 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10717,"raft.queue_time_us":6335,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":8091,"spinlock_wait_cycles":50685440,"thread_start_us":301094,"threads_started":1,"wal-append.queue_time_us":688160}
I20260709 13:07:43.955475 28006 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:43.495289 28088 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.955737 28041 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:43.956971 27971 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.711175 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:43.957784 22552 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:43.957568 27971 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.497812 28068 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.957998 27580 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:43.505940 28142 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:43.727733 27871 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:43.453465 27842 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.816524 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 181708us
I20260709 13:07:43.682024 28012 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:43.933820 21825 raft_consensus.cc:2410] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:07:43.971341 21900 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:43.873286 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 178245us
I20260709 13:07:43.867560 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.866952 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:43.974529 21976 raft_consensus.cc:2410] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:07:43.972929 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.520093 28046 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:43.690007 21977 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.048s	sys 0.071s
I20260709 13:07:43.737098 27728 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.984702 21977 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.053s	sys 0.074s
I20260709 13:07:43.984833 21978 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: [18.10-20.11]
I20260709 13:07:43.968052 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:43.682240 27927 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:43.954586 28017 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:43.977674 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:43.995707 22521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.010s	sys 0.039s
W20260709 13:07:43.996126 22521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.010s	sys 0.039s
W20260709 13:07:43.996716 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 840340us
I20260709 13:07:43.997514 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:43.967777 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 256695us
I20260709 13:07:43.975090 22548 raft_consensus.cc:2410] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:07:43.981364 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:43.725307 27864 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.492316 28115 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:43.532240 28158 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:43.987185 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:43.990439 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.972002 21875 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.016s	sys 0.024s
I20260709 13:07:43.985945 21982 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:07:44.026548 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:43.955040 28003 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:43.999310 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:43.990111 27403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.000s	sys 0.023s
I20260709 13:07:43.593106 28145 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.033283 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.986560 27872 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.587988 28175 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:43.959667 27997 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:43.986617 27988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.014s	sys 0.009s
W20260709 13:07:43.986799 28058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.017s	sys 0.005s
W20260709 13:07:44.021577 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46674.1us
W20260709 13:07:44.032505 27403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.000s	sys 0.024s
I20260709 13:07:44.004696 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.952366 28190 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:44.050757 28058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.018s	sys 0.005s
W20260709 13:07:44.029743 21875 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.016s	sys 0.025s
W20260709 13:07:44.056461 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 911326us
W20260709 13:07:44.043947 27988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.014s	sys 0.009s
I20260709 13:07:43.991813 27927 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.663393 27667 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.027705 27864 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.040655 28125 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:43.989598 27871 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:43.326041 28170 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:44.026814 28147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.007s	sys 0.022s
I20260709 13:07:44.022918 28088 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:44.078279 28147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.008s	sys 0.022s
I20260709 13:07:44.078848 28088 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:44.079514 28088 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:44.080135 28088 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.082625 28068 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.085011 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 811) took 1597 ms. Trace:
I20260709 13:07:44.086450 28000 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:44.086997 28000 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:44.043061 21908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.018s	sys 0.009s
W20260709 13:07:44.088281 21908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.018s	sys 0.009s
W20260709 13:07:44.028757 28123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.009s	sys 0.014s
W20260709 13:07:44.089018 28123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.009s	sys 0.014s
I20260709 13:07:44.089195 28000 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.089712 28000 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:44.056136 28067 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:44.085470 21977 rpcz_store.cc:276] 0709 13:07:42.487492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.038926 (+551434us) service_pool.cc:224] Handling call
0709 13:07:43.043535 (+  4609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.102501 (+ 58966us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:43.102771 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.985451 (+882680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.985498 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:43.985536 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.084740 (+ 99204us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b540005afd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:44.084797 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.084948 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4480,"prepare.queue_time_us":4306,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":1238,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":28774,"spinlock_wait_cycles":135060736,"thread_start_us":882296,"threads_started":1,"wal-append.queue_time_us":964649}
I20260709 13:07:44.091336 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.985774 27842 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.056531 28054 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:44.091737 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.092135 28054 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.092923 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:44.093117 27971 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.093279 27842 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:43.950831 28029 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:43.725910 28084 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.054936 22555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.002s	sys 0.023s
I20260709 13:07:44.055058 21826 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:43.517684 28140 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.058429 28012 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:43.976719 28142 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:44.037340 27990 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.644527 28185 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:44.060653 27279 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:43.989656 27728 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:44.062389 21827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.007s	sys 0.022s
I20260709 13:07:44.003173 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.028826 27982 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:44.029431 28179 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:44.052258 27978 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:44.064077 21718 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:44.040750 27872 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.062007 28115 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.072235 21975 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:44.073376 28062 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:44.073441 27864 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.076597 21831 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:07:44.279493 21830 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:44.280571 28192 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:44.280627 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:44.091156 28067 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.093957 21974 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:44.051143 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:43.955950 28182 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:44.104351 22555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.002s	sys 0.023s
W20260709 13:07:44.210466 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45071.4us
I20260709 13:07:44.226945 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:44.228186 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2750) took 1067 ms. Trace:
I20260709 13:07:44.229756 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.286116 21977 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:07:44.038722 27802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.000s	sys 0.023s
I20260709 13:07:44.065104 27927 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:44.234325 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.288546 21906 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:44.193243 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2742) took 1815 ms. Trace:
I20260709 13:07:44.289007 21978 rpcz_store.cc:276] 0709 13:07:42.377463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.903487 (+526024us) service_pool.cc:224] Handling call
0709 13:07:42.903924 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.985395 (+1081471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.192883 (+207488us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001f5c54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:44.193168 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485202176}
W20260709 13:07:44.236693 21827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.008s	sys 0.024s
I20260709 13:07:44.196533 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2753) took 1020 ms. Trace:
I20260709 13:07:44.291514 21983 rpcz_store.cc:276] 0709 13:07:43.176190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.195475 (+1019285us) service_pool.cc:224] Handling call
0709 13:07:44.195857 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.196112 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.196151 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.196209 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:44.196266 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.196341 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.196467 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.237620 27279 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:44.098214 28000 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:44.210754 27432 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.005s
I20260709 13:07:44.095615 27988 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:44.067575 28003 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.095470 28125 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.264581 27990 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.190033 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2751) took 1029 ms. Trace:
W20260709 13:07:44.273643 21718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 211533us
I20260709 13:07:44.279031 28062 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:44.094944 28070 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:44.286106 21976 rpcz_store.cc:276] 0709 13:07:43.160635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.036647 (+876012us) service_pool.cc:224] Handling call
0709 13:07:44.051305 (+ 14658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.113913 (+ 62608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.113943 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.113987 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:44.114027 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.227960 (+113933us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b54002c8b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:44.228010 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.228132 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143492992}
W20260709 13:07:44.288339 27802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.000s	sys 0.023s
I20260709 13:07:44.298627 28140 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.265666 28084 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.286473 21832 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:44.345026 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.299904 28198 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:44.299856 28185 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.299966 28170 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.277513 28054 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.198743 27922 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.300515 28145 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.239336 28006 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:44.303103 27667 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.302910 28142 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.129362 28029 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.303756 27279 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.304178 21978 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:44.288805 27871 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.306414 28175 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.307969 27728 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.309219 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 794) took 1199 ms. Trace:
I20260709 13:07:44.310658 28190 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.316099 28017 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.296437 21983 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:44.319864 28067 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:44.321170 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2646) took 1737 ms. Trace:
I20260709 13:07:44.401346 21975 rpcz_store.cc:276] 0709 13:07:42.583756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.477712 (+893956us) service_pool.cc:224] Handling call
0709 13:07:43.477987 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.274824 (+796837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.320942 (+ 46118us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54002c8654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:44.321117 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360079232}
I20260709 13:07:44.381073 28147 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.323339 21979 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:44.328974 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.404314 21833 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:07:44.332451 21831 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:44.336887 21982 rpcz_store.cc:276] 0709 13:07:43.160968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.189034 (+1028066us) service_pool.cc:224] Handling call
0709 13:07:44.189418 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.189646 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.189680 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.189734 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:44.189778 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.189845 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.189967 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.407374 21982 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:44.337978 21980 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:44.341441 21977 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:07:44.328620 27580 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.284947 28115 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.346014 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.346449 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2749) took 1188 ms. Trace:
I20260709 13:07:44.347570 21949 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:44.425454 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 77966.1us
I20260709 13:07:44.425069 21974 rpcz_store.cc:276] 0709 13:07:43.158195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.019612 (+861417us) service_pool.cc:224] Handling call
0709 13:07:44.037418 (+ 17806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.282431 (+245013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.346249 (+ 63818us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b54003a48d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:44.346401 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129310976}
I20260709 13:07:44.436378 28067 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:44.436805 27990 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.436985 28067 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:44.418524 27877 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.437566 28067 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:44.437674 27877 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.419893 28055 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.439000 28055 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:44.442790 28208 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:44.350270 21981 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:44.349903 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.373778 21828 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:44.378499 21976 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:44.348872 28180 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.369400 28003 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:44.458348 28190 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:44.460631 28029 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.348336 28198 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:44.338886 27988 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.464797 27988 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.390202 22555 rpcz_store.cc:276] 0709 13:07:43.109406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.110546 (+  1140us) service_pool.cc:224] Handling call
0709 13:07:43.117296 (+  6750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.117487 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:07:43.293090 (+175603us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.308895 (+1015805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.308947 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:44.308997 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.309060 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.309166 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23754,"prepare.queue_time_us":246827,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":31563,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":71,"thread_start_us":1158342,"threads_started":2}
I20260709 13:07:44.344265 28070 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.466929 28000 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:44.467132 28070 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.377929 28054 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:44.402680 21975 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:44.323127 28041 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.467854 28054 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.394282 28142 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.470098 28054 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.472774 28084 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:44.471657 28198 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.474145 28125 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:44.474247 28198 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.423899 28147 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.403680 28062 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.478482 28062 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:44.380440 28006 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:44.358271 22547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.022s	sys 0.047s
W20260709 13:07:44.480381 22547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.022s	sys 0.047s
I20260709 13:07:44.481384 22547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 795) took 1371 ms. Trace:
I20260709 13:07:44.481835 22547 rpcz_store.cc:276] 0709 13:07:43.109779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.109893 (+   114us) service_pool.cc:224] Handling call
0709 13:07:43.110214 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.110399 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:07:43.684396 (+573997us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.480891 (+796495us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.480979 (+    88us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:44.481052 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.481166 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.481316 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253665,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":1313108,"threads_started":2}
I20260709 13:07:44.486728 21826 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:07:44.423774 27792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.037s	sys 0.039s
I20260709 13:07:44.490339 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.494716 21826 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:44.497532 28190 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:44.499177 28115 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.502348 27667 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:44.504103 21798 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:44.494341 27792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.038s	sys 0.039s
I20260709 13:07:44.471310 28017 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:44.504748 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:44.509066 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 509774us
W20260709 13:07:44.517243 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 493211us
I20260709 13:07:44.524379 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.525348 21830 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:44.527076 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:44.526553 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:44.539469 27279 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:44.541855 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.542179 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.540151 27279 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.513648 28175 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:44.559906 28055 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.560524 22549 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:44.560871 27279 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:44.561152 28003 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:44.561739 28003 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.561672 21727 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:07:44.562723 21979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 2754) took 1386 ms (client timeout 1815 ms). Trace:
W20260709 13:07:44.563118 21979 rpcz_store.cc:269] 0709 13:07:43.176483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.295733 (+119250us) service_pool.cc:224] Handling call
0709 13:07:44.562571 (+1266838us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002d3a54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:44.562673 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2360835840}
I20260709 13:07:44.563333 21727 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 10 to 11, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 11 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:44.564117 28003 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:44.553035 28207 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.164s	user 0.003s	sys 0.000s
I20260709 13:07:44.565754 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2743) took 1202 ms. Trace:
I20260709 13:07:44.566128 21908 rpcz_store.cc:276] 0709 13:07:43.363710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.363814 (+   104us) service_pool.cc:224] Handling call
0709 13:07:43.364134 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.364555 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.364593 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.365160 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.088674 (+723514us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:44.088716 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.088785 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.552520 (+463735us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:44.565479 (+ 12959us) raft_consensus.cc:1685] finished
0709 13:07:44.565507 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.565698 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9839,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":10401536,"thread_start_us":723120,"threads_started":1,"wal-append.queue_time_us":979615}
I20260709 13:07:44.553524 28029 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:44.542667 28190 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:44.544272 28130 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:44.542338 28041 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:07:44.556058 28067 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.557770 28006 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.430017 27580 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.551163 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:44.571877 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.546599 27432 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:44.501595 28054 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 13:07:44.592561 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.007s	sys 0.011s
W20260709 13:07:44.593099 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.008s	sys 0.011s
W20260709 13:07:44.593536 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 532597us
W20260709 13:07:44.594008 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.009s	sys 0.017s
W20260709 13:07:44.594471 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.009s	sys 0.017s
I20260709 13:07:44.574252 28190 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:44.598006 21832 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
W20260709 13:07:44.600777 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.578824 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.573084 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:44.583557 21980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2639) took 2257 ms (client timeout 2481 ms). Trace:
I20260709 13:07:44.589654 27432 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.549602 27927 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.586826 27279 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.587704 22519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.013s	sys 0.017s
I20260709 13:07:44.545861 28017 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:44.573927 28003 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:44.607311 27279 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.582664 28130 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.585903 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2644) took 2023 ms. Trace:
I20260709 13:07:44.619580 21981 rpcz_store.cc:276] 0709 13:07:42.564443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.122355 (+557912us) service_pool.cc:224] Handling call
0709 13:07:43.122638 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.450816 (+1328178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.585614 (+134798us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54003f9b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:44.585830 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822823680}
W20260709 13:07:44.601697 21980 rpcz_store.cc:269] 0709 13:07:42.325816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.597775 (+271959us) service_pool.cc:224] Handling call
0709 13:07:44.583356 (+1985581us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54001f6154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:44.583469 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3999961856}
W20260709 13:07:44.604388 21874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.021s
W20260709 13:07:44.621573 21874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.007s	sys 0.021s
I20260709 13:07:44.602780 28190 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:44.602938 28041 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:44.605633 28029 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:07:44.608913 21902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.021s	sys 0.008s
I20260709 13:07:44.628382 27279 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:44.618079 21903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.011s	sys 0.021s
W20260709 13:07:44.628942 21903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.012s	sys 0.021s
I20260709 13:07:44.623329 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:44.623939 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.009s
W20260709 13:07:44.607290 22519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.013s	sys 0.017s
I20260709 13:07:44.626492 21978 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:07:44.590798 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.630029 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:44.601432 28188 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:44.628538 21902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.021s	sys 0.008s
I20260709 13:07:44.612939 28175 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:44.608726 27982 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:44.609567 27432 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:44.630139 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 603641us
I20260709 13:07:44.625167 28041 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:44.630651 21906 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:44.633906 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:44.614972 28017 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:44.607486 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 56400.9us
W20260709 13:07:44.640319 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.630651 21830 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:44.656438 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.657706 21830 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:44.645323 27802 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:44.651849 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:44.628422 28029 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:44.618356 28003 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:44.624347 28084 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:07:44.662096 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:44.663524 28115 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:44.634315 28175 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.667857 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:44.630916 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.012s	sys 0.009s
I20260709 13:07:44.635028 28188 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:44.681483 28204 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:44.642859 21948 leader_election.cc:400] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24.
I20260709 13:07:44.741276 21832 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
W20260709 13:07:44.809583 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 147571us
W20260709 13:07:44.754036 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 102268us
W20260709 13:07:44.816983 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 179947us
W20260709 13:07:44.735728 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.818367 21798 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:44.808133 21948 leader_election.cc:403] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:07:44.820283 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:44.772534 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.821444 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.810561 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:44.817548 21832 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:44.826561 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.827612 21979 raft_consensus.cc:2410] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:07:44.835485 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.828200 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.853948 21980 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:44.855269 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:44.855978 21830 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:07:44.855890 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45436.1us
W20260709 13:07:44.855595 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 212919us
I20260709 13:07:44.855473 27279 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24.
W20260709 13:07:44.808255 28012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.013s	sys 0.015s
I20260709 13:07:44.858353 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:44.861642 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:44.861934 21900 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:44.862565 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:44.858667 21825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.014s	sys 0.039s
I20260709 13:07:44.737112 28055 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:07:44.738735 28209 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:07:44.863054 21980 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 13:07:44.863154 21825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.014s	sys 0.039s
I20260709 13:07:44.864089 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.863584 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.869294 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:44.870087 21980 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:07:44.870384 21827 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.018s	sys 0.032s
W20260709 13:07:44.870680 21827 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.018s	sys 0.032s
I20260709 13:07:44.683205 28003 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.873376 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:44.816970 28175 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:44.874006 21901 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:44.864089 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:44.863641 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.875161 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.851548 28058 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:44.867005 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:44.867985 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:44.876397 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.738130 27877 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.735138 28130 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:44.869553 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.889761 21832 raft_consensus.cc:2393] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:44.889546 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:44.714854 28198 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.152s
I20260709 13:07:44.875633 21977 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 24: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:44.867252 21906 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:44.874110 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.880426 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.882867 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:44.861444 28012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.013s	sys 0.015s
I20260709 13:07:44.887626 21900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:55690
I20260709 13:07:44.855134 28001 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:44.890566 21979 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:44.872643 21904 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:44.904579 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:44.890714 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:44.897114 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.864742 28068 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.901216 21900 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:44.909313 21900 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:44.909205 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:44.865037 27982 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.865404 28055 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:44.883128 28210 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:07:44.920858 21901 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:07:44.868057 28115 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:44.655166 27978 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.239s
I20260709 13:07:44.876034 27864 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:44.881582 28067 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.735554 28041 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.880299 28142 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:44.683583 27802 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:45.080217 21983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.003s	sys 0.025s
I20260709 13:07:44.739310 28029 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.986217 21979 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:44.909049 28068 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.070909 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:44.910097 28214 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.008543 21900 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:44.872926 28211 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:07:45.075407 21906 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:44.924546 27927 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:44.882225 28058 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.924474 27982 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:45.080581 21983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.003s	sys 0.025s
I20260709 13:07:45.088864 21980 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:07:44.927920 28001 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.023547 27580 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:45.162144 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.081300 28017 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:45.090080 28140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.017s	sys 0.031s
W20260709 13:07:45.201858 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.085199 28070 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:45.089859 28068 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:45.087116 28142 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:45.084374 28153 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.022s	sys 0.063s
W20260709 13:07:45.262696 28153 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.022s	sys 0.065s
I20260709 13:07:45.100528 28214 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:45.087555 27792 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.023s	sys 0.038s
I20260709 13:07:45.166752 27982 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:45.255733 28140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.034s	sys 0.052s
W20260709 13:07:45.266460 27792 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.023s	sys 0.040s
W20260709 13:07:45.266623 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 798) took 1627 ms (client timeout 2034 ms). Trace:
I20260709 13:07:45.267395 27792 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:45.267938 27792 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:45.269393 28088 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:45.269016 27792 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.076000 27864 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.271700 27864 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:45.265852 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.273052 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.258062 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:45.278435 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:45.160140 28041 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:45.283299 28223 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:07:45.285502 27802 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:45.286501 27927 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:45.288035 27872 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:45.292261 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:45.293192 28182 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:45.293761 28182 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:45.269749 28088 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:45.294987 27432 consensus_meta.cc:287] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 13:07:45.295091 28088 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:45.295655 27432 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.296650 28088 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:45.300148 28001 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:45.300951 28220 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:07:45.275810 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.305625 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:45.314246 27802 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:45.022976 28115 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.101739 28058 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:45.257893 27748 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:45.319720 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 818) took 1266 ms. Trace:
I20260709 13:07:45.320272 21978 rpcz_store.cc:276] 0709 13:07:44.053194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.381926 (+328732us) service_pool.cc:224] Handling call
0709 13:07:44.382568 (+   642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.630356 (+247788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.319477 (+689121us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002d4454. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:45.319656 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560331520}
W20260709 13:07:45.267103 22549 rpcz_store.cc:269] 0709 13:07:43.638940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.639110 (+   170us) service_pool.cc:224] Handling call
0709 13:07:45.266479 (+1627369us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54005e01d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:45.266574 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396486016}
I20260709 13:07:45.330271 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.317942 28115 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:45.330582 28214 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:45.098590 28188 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:45.337235 28136 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:07:45.344825 28063 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.014s	sys 0.023s
I20260709 13:07:45.160410 28055 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:45.348675 28123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.005s	sys 0.034s
I20260709 13:07:45.350214 28136 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:45.366856 28190 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.003s
W20260709 13:07:45.381371 28206 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.962s	user 0.000s	sys 0.030s
W20260709 13:07:45.368093 28200 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.937s	user 0.003s	sys 0.000s
W20260709 13:07:45.386569 28203 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.955s	user 0.004s	sys 0.004s
I20260709 13:07:45.386945 28190 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.389238 28190 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:44.875449 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:44.914837 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:45.436216 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2833) took 1408 ms. Trace:
I20260709 13:07:45.438119 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:45.436959 21825 rpcz_store.cc:276] 0709 13:07:44.028048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.283089 (+255041us) service_pool.cc:224] Handling call
0709 13:07:44.306592 (+ 23503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.306970 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.307006 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.307525 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.869706 (+562181us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:44.869744 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.869808 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.435236 (+565428us) raft_consensus.cc:1685] finished
0709 13:07:45.435315 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.435861 (+   546us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1072,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":103,"thread_start_us":561880,"threads_started":1,"wal-append.queue_time_us":778682}
I20260709 13:07:45.440682 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:45.439071 21727 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:07:45.441429 21826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.012s	sys 0.000s
W20260709 13:07:45.442050 21826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.012s	sys 0.001s
W20260709 13:07:45.442199 21833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.000s	sys 0.020s
W20260709 13:07:45.442754 21833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.000s	sys 0.020s
I20260709 13:07:45.444310 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2844) took 1107 ms. Trace:
I20260709 13:07:45.444527 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2819) took 1449 ms. Trace:
I20260709 13:07:45.445078 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2740) took 1480 ms. Trace:
W20260709 13:07:45.446280 21831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.000s	sys 0.017s
W20260709 13:07:45.446453 21902 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.017s	sys 0.016s
W20260709 13:07:45.333940 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.544960 21902 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.017s	sys 0.018s
W20260709 13:07:45.546355 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.539763 22519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.016s	sys 0.029s
W20260709 13:07:45.547248 22519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.016s	sys 0.029s
W20260709 13:07:45.543489 22520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.004s	sys 0.033s
W20260709 13:07:45.547665 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 910537us
W20260709 13:07:45.548425 22520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.005s	sys 0.033s
W20260709 13:07:45.354928 28123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.005s	sys 0.035s
I20260709 13:07:45.550638 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:45.557440 28214 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:45.558526 28214 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:07:45.446369 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.482756 21825 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:07:45.566766 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:45.570955 21975 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:45.540400 21727 catalog_manager.cc:5697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:07:45.574317 21834 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.001s	sys 0.001s
W20260709 13:07:45.574832 21834 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.001s	sys 0.001s
I20260709 13:07:45.576577 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2831) took 1555 ms. Trace:
W20260709 13:07:45.577474 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.583951 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.562543 21825 pending_rounds.cc:85] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 11
I20260709 13:07:45.586158 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.444770 21833 rpcz_store.cc:276] 0709 13:07:44.337053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.405198 (+ 68145us) service_pool.cc:224] Handling call
0709 13:07:44.405527 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.405781 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:44.405816 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.427010 (+ 21194us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.443621 (+1016611us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:45.443740 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.443876 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.443952 (+    76us) raft_consensus.cc:1685] finished
0709 13:07:45.443964 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.444235 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1015827,"threads_started":1,"wal-append.queue_time_us":919379}
I20260709 13:07:45.603984 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:45.332799 27792 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:45.604568 28136 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.608026 21905 raft_consensus.cc:1240] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
W20260709 13:07:45.609105 27927 consensus_queue.cc:1175] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 20 status { last_received { term: 20 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 20 index: 12 } }
W20260709 13:07:45.586524 21908 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.008s	sys 0.018s
I20260709 13:07:45.444979 21828 rpcz_store.cc:276] 0709 13:07:43.994948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.995178 (+   230us) service_pool.cc:224] Handling call
0709 13:07:43.995511 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.456446 (+460935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.443933 (+987487us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54001d6ad4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:45.444322 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868879232}
W20260709 13:07:45.613296 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.591109 21825 pending_rounds.cc:107] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 14.12
W20260709 13:07:45.352741 28063 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.014s	sys 0.024s
I20260709 13:07:45.617652 21906 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:07:45.577065 21834 rpcz_store.cc:276] 0709 13:07:44.021111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.092278 (+ 71167us) service_pool.cc:224] Handling call
0709 13:07:44.092573 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.097229 (+  4656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.097267 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.231274 (+134007us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.660753 (+429479us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:45.575412 (+914659us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.576011 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.576143 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.576235 (+    92us) raft_consensus.cc:1685] finished
0709 13:07:45.576254 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.576510 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4321,"prepare.queue_time_us":628416,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":12215,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":32833,"thread_start_us":1140007,"threads_started":2,"wal-append.queue_time_us":1008663}
I20260709 13:07:45.621868 28041 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:45.596571 21900 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:45.613720 21831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.000s	sys 0.029s
I20260709 13:07:45.616370 21825 raft_consensus.cc:2889] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:45.635186 21908 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.009s	sys 0.018s
W20260709 13:07:45.637769 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 71343us
I20260709 13:07:45.591202 28055 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:45.665611 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.676908 21904 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:45.590852 21727 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:45.445705 21903 rpcz_store.cc:276] 0709 13:07:43.964201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.964532 (+   331us) service_pool.cc:224] Handling call
0709 13:07:43.964943 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:44.033430 (+ 68487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.033461 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:44.041473 (+  8012us) log.cc:844] Serialized 52 byte log entry
0709 13:07:44.629343 (+587870us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:44.629384 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.629472 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.444469 (+814997us) raft_consensus.cc:1685] finished
0709 13:07:45.444506 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.444794 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68063,"raft.queue_time_us":68656,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3416,"thread_start_us":550927,"threads_started":1,"wal-append.queue_time_us":892167}
W20260709 13:07:45.691347 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.696477 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:45.702035 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.010s	sys 0.034s
W20260709 13:07:45.702494 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.011s	sys 0.034s
I20260709 13:07:45.702620 28213 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.702833 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 831705us
I20260709 13:07:45.703455 28213 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:45.697748 21977 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.033s	sys 0.018s
W20260709 13:07:45.706418 21977 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.034s	sys 0.018s
I20260709 13:07:45.706326 28242 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:45.707715 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 192757us
I20260709 13:07:45.712023 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2849) took 1190 ms. Trace:
I20260709 13:07:45.713665 21826 rpcz_store.cc:276] 0709 13:07:44.521857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.522016 (+   159us) service_pool.cc:224] Handling call
0709 13:07:44.522429 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.522829 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.522874 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.546627 (+ 23753us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.442971 (+896344us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:45.443135 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.443390 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.692753 (+249363us) raft_consensus.cc:1685] finished
0709 13:07:45.692780 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.711955 (+ 19175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16909,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":3236,"thread_start_us":887068,"threads_started":1,"wal-append.queue_time_us":1062465}
I20260709 13:07:45.710424 28188 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.707404 28242 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:45.688874 28041 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:45.733101 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:45.733608 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2845) took 1393 ms. Trace:
W20260709 13:07:45.724040 28084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.010s	sys 0.010s
I20260709 13:07:45.745018 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:45.746315 21799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.012s	sys 0.044s
W20260709 13:07:45.746774 21799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.012s	sys 0.045s
W20260709 13:07:45.748466 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 1.08061e+06us
I20260709 13:07:45.750591 28188 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:45.751549 21728 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33528 (request call id 226) took 12376 ms (client timeout 15000 ms). Trace:
I20260709 13:07:45.754094 28188 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:45.754673 28140 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:45.758888 28140 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:45.742911 21800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.008s	sys 0.029s
W20260709 13:07:45.761603 21800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.009s	sys 0.029s
I20260709 13:07:45.760564 28140 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:45.769790 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:45.773263 28153 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:45.773659 28153 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.773993 28153 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:45.752022 21728 rpcz_store.cc:269] 0709 13:07:33.356121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.370544 (+ 14423us) service_pool.cc:224] Handling call
0709 13:07:34.190783 (+820239us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540037bed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef48090 00007fb75efe6f3a 00007fb764d9d1cc 00007fb764e9b37e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc 00007fb76335b392 00007fb75d31948c 00007fb75d3188c6
0709 13:07:45.729414 (+11538631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:36.833096 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:36.977886 (+144790us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:36.977943 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:07:36.977965 (+    22us) tablet.cc:662] Decoding operations
0709 13:07:37.472295 (+494330us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:37.495573 (+ 23278us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:37.498759 (+  3186us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:07:37.664791 (+166032us) tablet.cc:701] Row locks acquired
0709 13:07:37.664829 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:07:37.665001 (+   172us) write_op.cc:270] Start()
0709 13:07:37.665190 (+   189us) write_op.cc:276] Timestamp: P: 1783602457664940 usec, L: 0
0709 13:07:37.665220 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:07:37.865890 (+200670us) log.cc:844] Serialized 11052 byte log entry
0709 13:07:38.165426 (+299536us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b1800259720. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:38.534544 (+369118us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:38.558854 (+ 24310us) op_driver.cc:464] REPLICATION: finished
0709 13:07:38.591444 (+ 32590us) write_op.cc:301] APPLY: starting
0709 13:07:38.592398 (+   954us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:38.653454 (+ 61056us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:38.653494 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:38.833189 (+179695us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:38.833571 (+   382us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=0,mrs_lookups=0
0709 13:07:38.833616 (+    45us) write_op.cc:312] APPLY: finished
0709 13:07:38.834091 (+   475us) log.cc:844] Serialized 244 byte log entry
0709 13:07:38.834293 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:38.834503 (+   210us) write_op.cc:454] Released schema lock
0709 13:07:38.834561 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:38.834965 (+   404us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:38.834998 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":240834,"reported_tablets":51,"spinlock_wait_cycles":1399915392,"child_traces":[["op",{"apply.queue_time_us":32338,"apply.run_cpu_time_us":35437,"apply.run_wall_time_us":243502,"cfile_cache_hit":114,"cfile_cache_hit_bytes":120999,"num_ops":28,"prepare.queue_time_us":145052,"prepare.run_cpu_time_us":39409,"prepare.run_wall_time_us":1233930,"raft.queue_time_us":21042,"raft.run_cpu_time_us":13927,"raft.run_wall_time_us":27825,"replication_time_us":893472,"spinlock_wait_cycles":50239488,"thread_start_us":246530,"threads_started":4,"wal-append.queue_time_us":234723,"wal-append.run_cpu_time_us":10699,"wal-append.run_wall_time_us":1748801}]]}
I20260709 13:07:45.755205 21727 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 6 to 13, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130), no longer has a pending config: VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129), VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130), VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131), NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 13 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.737941 21978 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
W20260709 13:07:45.739180 21827 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.000s	sys 0.039s
W20260709 13:07:45.739858 21829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.017s	sys 0.043s
W20260709 13:07:45.783716 21827 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.000s	sys 0.040s
W20260709 13:07:45.784858 21829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.017s	sys 0.043s
W20260709 13:07:45.786274 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.735773 21831 rpcz_store.cc:276] 0709 13:07:44.340362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.420747 (+ 80385us) service_pool.cc:224] Handling call
0709 13:07:44.421137 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.421531 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.421569 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.427688 (+  6119us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.555282 (+127594us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b180022a2c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:07:45.694531 (+1139249us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:45.713116 (+ 18585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.719347 (+  6231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.722062 (+  2715us) raft_consensus.cc:1685] finished
0709 13:07:45.722077 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.733540 (+ 11463us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2920,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2085,"spinlock_wait_cycles":122230144,"thread_start_us":1081416,"threads_started":1,"wal-append.queue_time_us":930389}
W20260709 13:07:45.744442 28084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.011s	sys 0.011s
W20260709 13:07:45.795593 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.744179 28213 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:45.798637 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:45.800374 28244 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.800904 28062 consensus_meta.cc:287] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.322s	user 0.010s	sys 0.005s
I20260709 13:07:45.813120 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:45.812769 28115 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:45.814865 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:45.815649 22547 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:45.816074 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.801204 28244 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.831928 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:45.833410 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 83262us
I20260709 13:07:45.844812 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2751) took 1212 ms. Trace:
W20260709 13:07:45.845479 27982 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.010s
I20260709 13:07:45.846308 27982 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.849779 28216 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:45.851081 28216 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:45.851539 28216 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:45.851989 27982 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:45.852672 28088 consensus_meta.cc:287] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.007s
I20260709 13:07:45.852854 28216 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:45.854471 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2601) took 2548 ms. Trace:
I20260709 13:07:45.855921 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2739) took 1912 ms. Trace:
I20260709 13:07:45.854866 21827 rpcz_store.cc:276] 0709 13:07:43.306487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.306652 (+   165us) service_pool.cc:224] Handling call
0709 13:07:43.307057 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.338065 (+ 31008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.338098 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.338570 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.290603 (+952033us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:44.870967 (+580364us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.363321 (+492354us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:45.824508 (+461187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.837728 (+ 13220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.841845 (+  4117us) raft_consensus.cc:1685] finished
0709 13:07:45.854242 (+ 12397us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.854412 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49918,"prepare.queue_time_us":868873,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":66027,"raft.queue_time_us":342225,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":83144,"spinlock_wait_cycles":103430016,"thread_start_us":2434342,"threads_started":3,"wal-append.queue_time_us":1054877}
I20260709 13:07:45.856256 21902 rpcz_store.cc:276] 0709 13:07:43.943178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.964415 (+ 21237us) service_pool.cc:224] Handling call
0709 13:07:43.986714 (+ 22299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.632342 (+645628us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:45.545976 (+913634us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.729995 (+184019us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.853482 (+123487us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.853668 (+   186us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:45.853707 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.853784 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.855729 (+  1945us) raft_consensus.cc:1685] finished
0709 13:07:45.855747 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.855852 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48327,"prepare.queue_time_us":750425,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":57118,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":34155,"thread_start_us":1675908,"threads_started":3,"wal-append.queue_time_us":210927}
I20260709 13:07:45.857242 28245 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:45.860185 27802 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:45.863529 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.864492 21977 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:45.865379 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.849779 27728 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:45.866658 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2616) took 2490 ms. Trace:
I20260709 13:07:45.867125 21829 rpcz_store.cc:276] 0709 13:07:43.360132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.613034 (+252902us) service_pool.cc:224] Handling call
0709 13:07:43.740191 (+127157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.959401 (+219210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.959470 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.959940 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.409284 (+449344us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:44.897574 (+488290us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.830441 (+932867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.847796 (+ 17355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.849850 (+  2054us) raft_consensus.cc:1685] finished
0709 13:07:45.849869 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.850069 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218592,"prepare.queue_time_us":879592,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":602251,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":12408,"thread_start_us":1829343,"threads_started":3,"wal-append.queue_time_us":669797}
I20260709 13:07:45.868757 28244 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:45.869611 28175 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.972s	user 0.014s	sys 0.003s
I20260709 13:07:45.870442 27988 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:45.870818 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:45.872589 28147 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:45.873502 28247 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:45.873901 28247 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:45.874245 28247 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.875656 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:45.876016 28058 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.007s
I20260709 13:07:45.876590 28115 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:45.878139 28115 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:45.879729 27748 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:45.881976 28182 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:45.867038 21977 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:45.822988 28213 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:45.889132 28216 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:45.887501 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.876485 28058 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.872615 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:45.893395 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:45.894289 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2656) took 1026 ms. Trace:
I20260709 13:07:45.894997 28115 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:45.894712 21981 rpcz_store.cc:276] 0709 13:07:44.867276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.885803 (+ 18527us) service_pool.cc:224] Handling call
0709 13:07:44.886302 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.160788 (+274486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.160832 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.160904 (+    72us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:45.160957 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.893839 (+732882us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54003fa554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:45.893892 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.894098 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630638336}
W20260709 13:07:45.906351 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 94009.9us
I20260709 13:07:45.914309 28213 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:45.915508 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2761) took 1967 ms. Trace:
I20260709 13:07:45.916671 28213 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:45.915849 21983 rpcz_store.cc:276] 0709 13:07:43.947843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.292730 (+344887us) service_pool.cc:224] Handling call
0709 13:07:44.293086 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.296308 (+  3222us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:44.463598 (+167290us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.183330 (+719732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.183415 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:45.183480 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.915045 (+731565us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b5400413f54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:45.915101 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.915315 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32387,"raft.queue_time_us":32536,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":83921,"spinlock_wait_cycles":6866816,"thread_start_us":686902,"threads_started":1,"wal-append.queue_time_us":899373}
W20260709 13:07:45.924425 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.870121 28175 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:45.937884 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.930528 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.943487 21978 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:45.932196 21981 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:45.951761 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.911317 28244 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:45.957295 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:45.933236 28242 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:45.930084 28068 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.671s	user 0.016s	sys 0.007s
I20260709 13:07:45.973650 28068 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.976389 21980 raft_consensus.cc:2368] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:45.962658 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:45.963395 27982 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:45.984072 27982 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:45.964282 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:45.985214 21829 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:45.966578 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.990144 22547 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:07:45.968077 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54248 (request call id 17) took 3520 ms. Trace:
I20260709 13:07:45.931291 28041 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:45.970883 28250 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:45.845302 21908 rpcz_store.cc:276] 0709 13:07:44.632252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.632620 (+   368us) service_pool.cc:224] Handling call
0709 13:07:44.632957 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.633154 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:07:45.683908 (+1050754us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.834969 (+151061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.841959 (+  6990us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:45.844370 (+  2411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.844507 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.844745 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2422,"prepare.queue_time_us":745159,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":7962,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":6518,"thread_start_us":1055921,"threads_started":2}
I20260709 13:07:45.973065 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.973192 28175 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:45.958374 22550 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:45.960602 21727 catalog_manager.cc:5697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 10 to 13, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 13 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.980870 28029 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.955448 27988 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.983073 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:45.978358 21977 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:45.969966 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:45.958137 22549 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:45.991364 21982 rpcz_store.cc:276] 0709 13:07:42.447488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.428012 (+1980524us) service_pool.cc:224] Handling call
0709 13:07:45.967557 (+1539545us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540005a5d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe4735 00007fb763fa4d29 00007fb75d5231d4 00007fb75d523162 00007fb75d523091 00007fb75d52300c 00007fb75d5222c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:45.967803 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518069632}
I20260709 13:07:45.998665 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:45.960398 28170 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:45.960819 28213 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:46.007265 21826 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:46.008630 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.006289 21976 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:46.015409 21829 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
W20260709 13:07:46.015722 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.017189 21831 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:46.016682 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:46.006778 27982 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:46.020234 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 147750us
I20260709 13:07:46.021379 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:46.024868 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.025815 22549 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:46.022819 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.024852 22555 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:46.001389 28153 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.029361 21825 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.037253 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.038153 21826 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.032200 28250 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:46.044304 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.046502 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2658) took 1172 ms. Trace:
I20260709 13:07:46.047333 27877 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:46.043716 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2664) took 1109 ms. Trace:
I20260709 13:07:46.048277 21980 rpcz_store.cc:276] 0709 13:07:44.934641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.305332 (+370691us) service_pool.cc:224] Handling call
0709 13:07:46.043458 (+738126us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b540005b4d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:46.043637 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540392832}
I20260709 13:07:46.049021 28181 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:07:46.049254 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet efae0b9ae5b44891a8bd0df1878c7c42: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:46.049491 28181 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:46.050072 21980 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: [19.14-20.15]
I20260709 13:07:46.046952 21975 rpcz_store.cc:276] 0709 13:07:44.874506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.903704 (+ 29198us) service_pool.cc:224] Handling call
0709 13:07:44.903953 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.571561 (+667608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.046226 (+474665us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54002d4e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:46.046451 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398677888}
I20260709 13:07:46.032735 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:46.053527 22551 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.035805 22550 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:46.059825 21979 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:46.064803 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.031061 28063 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:46.066078 28063 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:46.066823 21831 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:46.067194 28063 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.067823 28153 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:46.068641 28063 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:46.068984 21829 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:46.025051 27988 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.077070 28102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bde6ac1d042400fbc88831c01b9fdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.032986 28170 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.080135 28170 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:46.081117 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.081918 22552 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:46.082340 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:46.082677 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:46.083199 22547 raft_consensus.cc:2410] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:07:46.069005 28142 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:46.085065 27988 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.064704 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.025597 28213 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.093530 21825 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:46.096967 22551 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:46.060817 28250 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.099334 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:46.100097 21825 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:46.100584 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.101676 21975 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:46.102977 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.103909 28213 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.108381 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.087891 27432 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:46.116129 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.117748 21826 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:46.128098 21825 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:46.130128 22549 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:46.135190 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.136437 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.139684 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.140630 28250 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:46.141116 28250 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:46.136600 22553 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:46.141577 28250 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.150774 21975 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:46.151654 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.152913 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:46.154470 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.153946 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.155174 21977 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.156523 28136 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.156611 28058 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:46.092352 21727 catalog_manager.cc:5697] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:07:46.138666 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.163954 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:46.165141 21829 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:46.167413 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 274292us
I20260709 13:07:46.170480 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:46.171752 21982 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:46.172622 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.172547 21727 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.173473 21982 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:07:46.175016 22555 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:46.176479 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.177266 21976 raft_consensus.cc:2368] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:07:46.180953 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.182582 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:46.134618 28181 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.183821 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:46.184276 28181 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:46.185411 28041 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:46.185806 28041 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:46.186228 28041 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:46.190330 28213 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:46.190398 28247 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.191567 28213 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:46.191645 21827 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:46.192044 28213 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:46.192473 28213 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.192685 28247 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.194833 28214 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:46.195194 28214 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:46.196063 28214 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.197219 28214 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:46.198701 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.199348 22553 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:46.200635 27802 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:46.201033 27802 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:46.201404 27802 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.172823 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.181845 21949 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.181934 21798 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.218150 21829 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:46.221832 21977 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:46.227087 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:46.227861 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 46019.9us
I20260709 13:07:46.230443 22553 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:46.228291 28058 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:46.246543 28058 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:46.247484 28058 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.251693 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.225549 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:46.252854 27432 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:46.253129 28182 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:46.253589 21833 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.254897 27432 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:07:46.255515 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.252838 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.227609 21980 raft_consensus.cc:2376] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21. Re-sending same reply.
I20260709 13:07:46.259775 28247 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:46.260293 28247 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.260655 28247 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:46.266304 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.253003 28213 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:46.271561 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 191122us
I20260709 13:07:46.273077 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:46.274313 28070 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.273870 21874 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:46.265619 21799 connection.cc:256] RPC call timeout handler was delayed by -1.1387957499999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 13:07:46.268043 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.258771 27432 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:46.283067 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 112689us
I20260709 13:07:46.267588 28055 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:46.282858 21828 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:46.262387 28250 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.291014 27988 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:46.291651 27988 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:46.291172 27432 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.292187 27988 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:46.296085 21798 leader_election.cc:400] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:07:46.296512 21798 leader_election.cc:403] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:07:46.287926 28041 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.300972 28250 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.301718 27580 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.302459 27580 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.305051 27580 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:46.285429 28142 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:46.306350 28142 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:46.306820 28142 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.307929 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.274875 28070 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.311316 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.311610 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.312124 21829 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 20: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:46.312387 21832 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:46.312125 28070 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.314548 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.281281 27982 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:46.315372 27982 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.317767 27982 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:46.323127 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 240517us
I20260709 13:07:46.324783 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.326589 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.327991 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:46.330003 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45793.5us
W20260709 13:07:46.333189 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.332620 21832 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:46.322739 28041 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.346870 21833 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:46.342792 27982 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:07:46.361637 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.346361 28213 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.360546 28070 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:46.372591 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:46.373440 21832 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 20: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:46.364190 28070 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.377214 28070 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.360759 27802 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.364557 28247 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.372592 28278 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:46.387387 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.388523 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:46.398005 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.399304 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.399571 21974 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:46.402907 21983 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:46.406797 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 140552us
I20260709 13:07:46.407351 28136 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:46.407887 28136 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:46.408493 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.408838 28136 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.409619 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.410660 28188 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:46.410984 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.411270 28188 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:46.412249 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.410794 28055 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:46.412392 28188 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.413610 28055 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.414422 21949 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.406430 27802 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:46.403004 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 107615us
I20260709 13:07:46.392987 28278 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.420408 28279 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:46.422610 28068 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:46.423621 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.424165 27988 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.426442 28180 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:46.426924 28276 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:46.429497 21874 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:46.430531 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 107967us
I20260709 13:07:46.404008 28070 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:46.439116 28070 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:46.445813 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 70995.3us
I20260709 13:07:46.446604 28070 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.451848 28247 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.453892 28068 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:46.455088 28068 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:46.455442 28068 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:46.456321 28068 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.431546 28279 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:46.450277 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.430222 28278 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.435662 28180 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.463552 28180 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.465936 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.467801 27988 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:46.468461 27988 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:46.469022 27988 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.470819 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.461199 28279 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:46.473433 21975 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:07:46.475071 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.480120 21798 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.489689 21825 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:46.490847 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:46.491225 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:46.491876 21828 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:46.497951 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.498430 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 78357.3us
I20260709 13:07:46.500345 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.501161 21979 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:46.503770 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.506718 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.506824 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:46.507638 21905 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 21: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:46.509073 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:46.509388 28279 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.509781 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.510339 28175 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:46.511237 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.511534 28250 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:46.512419 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.512859 21875 leader_election.cc:400] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:07:46.524991 27580 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:46.512768 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.526587 21902 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:07:46.527505 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.528671 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.529258 21902 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:46.530611 21905 raft_consensus.cc:2410] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:07:46.531191 21909 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:07:46.531572 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.532415 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.532807 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.533463 21905 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:46.533531 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.514511 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.515842 28281 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:46.534576 27279 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:07:46.534744 28288 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:46.515767 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.538326 28250 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:46.531666 21975 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:07:46.518374 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.538837 28250 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.517107 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.539152 28248 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:46.531685 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.538519 21904 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:46.535017 28281 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:46.520581 28068 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.544358 28142 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.547168 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:46.482018 28271 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
I20260709 13:07:46.545923 27988 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:46.530098 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.549497 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.545066 28279 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:46.495543 28188 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:46.551612 21909 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:46.557119 28029 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:07:46.558284 28102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60034 (request call id 786) took 5322 ms. Trace:
I20260709 13:07:46.558735 28102 rpcz_store.cc:276] 0709 13:07:41.236104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.236262 (+   158us) service_pool.cc:224] Handling call
0709 13:07:41.474059 (+237797us) ts_tablet_manager.cc:934] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
0709 13:07:46.075217 (+4601158us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:46.309001 (+233784us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:46.309123 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:46.521437 (+212314us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:46.557649 (+ 36212us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:46.558034 (+   385us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:46.558144 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":31049,"tablet-copy.queue_time_us":123963,"thread_start_us":100430,"threads_started":2}
I20260709 13:07:46.560441 28102 tablet_copy_client.cc:806] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:46.560236 28181 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:46.561178 28102 tablet_copy_client.cc:670] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:46.563578 28142 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:46.570670 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.585762 21974 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:46.587704 21983 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:07:46.590055 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:46.591609 28188 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:46.592999 28188 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.594388 27988 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:46.595233 21978 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23. Ops: [20.10-22.11]
I20260709 13:07:46.595563 21908 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:07:46.596412 28282 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:07:46.598505 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.599123 22555 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:46.539745 28248 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:46.595366 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:46.604822 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.599413 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.608631 21904 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:46.549150 28283 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:46.614317 21905 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:46.615283 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.616400 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.617056 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.620476 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.622044 21908 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:07:46.622475 21908 pending_rounds.cc:85] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 9
I20260709 13:07:46.622777 21908 pending_rounds.cc:107] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:07:46.623065 21908 raft_consensus.cc:2889] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.623216 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.623922 21907 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.624624 21908 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:46.617856 21905 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:46.632094 21976 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:46.625973 21908 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:07:46.635502 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.638224 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.634953 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:46.637887 27988 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:46.648838 27988 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.639750 28181 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.649294 27988 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:46.649931 28285 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:46.649654 28181 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.641034 28213 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:46.651587 28213 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:46.651989 28213 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:46.652060 28181 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:46.654115 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.654850 21908 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:46.655727 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.656296 21908 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:46.658449 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.640113 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.627729 28248 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.661614 21828 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:46.661052 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:46.662763 28041 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:46.668365 28216 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:46.671139 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.672474 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.673091 21902 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:46.676292 21908 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:07:46.677198 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.628801 28175 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 8 to 10, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:46.668219 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.679708 22555 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:46.683548 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.686702 21904 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:46.646742 28283 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:46.689985 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:46.694847 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:46.695617 22555 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:46.696040 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:46.696700 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 106763us
I20260709 13:07:46.698657 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.703289 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:46.703943 22551 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.704747 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:46.707764 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:46.708448 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:46.710366 28279 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:46.711061 28279 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.714600 22551 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:46.716022 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.723114 21902 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:07:46.724220 21902 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
W20260709 13:07:46.725814 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 285533us
W20260709 13:07:46.744617 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.746793 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 219328us
I20260709 13:07:46.750700 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:46.751466 21980 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:46.763036 28216 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:46.769922 28216 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.770416 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.785570 21980 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:46.786144 21908 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
W20260709 13:07:46.792999 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.794339 21798 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.798326 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.798758 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:46.800071 21977 raft_consensus.cc:2410] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:07:46.823052 27982 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:46.824158 21798 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.840093 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.803436 28055 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:07:46.834893 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 202175us
I20260709 13:07:46.841252 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.846499 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:46.856837 22521 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:46.863499 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:46.841173 28153 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.870843 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:46.856581 22551 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:46.851465 27728 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:46.888792 21907 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:46.860020 28170 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:46.897071 22554 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:46.870462 28029 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:46.901438 28289 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:07:46.903002 28289 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:46.903492 28289 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:46.904628 28289 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.909122 21873 leader_election.cc:400] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:46.909492 21873 leader_election.cc:403] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:07:46.863215 28055 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:46.909502 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:46.849609 28250 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:46.917197 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.922297 28279 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:46.923002 28102 tablet_copy_client.cc:538] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:46.893803 28265 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:46.851037 28278 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.918521 21900 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
W20260709 13:07:46.930962 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 106999us
W20260709 13:07:46.931846 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65593.4us
I20260709 13:07:46.911345 28170 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.918686 28296 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:46.944247 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 80891.1us
I20260709 13:07:46.878620 28153 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.950461 22555 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:46.951021 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:46.918128 27982 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:46.932888 28279 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17.
I20260709 13:07:46.955991 21901 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:07:46.893260 28213 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.962670 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:46.851892 28283 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.942940 28170 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:46.963092 28290 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.246s	user 0.001s	sys 0.001s
I20260709 13:07:46.950522 28070 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.970954 28055 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.972273 28070 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:46.946908 28296 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:46.988737 27988 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.988989 28248 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:46.958889 28289 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.990451 22553 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:07:46.990644 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:46.966801 27728 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:47.001958 28153 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:47.002625 28180 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.001s
I20260709 13:07:47.031201 21900 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:47.031154 28180 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:46.955785 28281 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:07:47.006817 28296 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:47.016108 21979 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:07:47.035557 28214 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.039572 27728 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.044219 28214 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.046553 28214 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:47.051224 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 88632.7us
I20260709 13:07:47.052420 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.055261 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:47.055594 27988 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:47.055950 21978 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:47.056221 27988 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:47.060894 28170 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.035415 21979 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:47.053881 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:07:47.078395 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.079910 21905 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:47.087054 21831 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:47.089138 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.089924 21831 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:07:47.092533 21831 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:47.094408 21832 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:07:47.095077 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.097780 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.105346 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:47.108371 28029 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:47.108879 28029 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.109294 28029 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:47.116619 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:47.122248 28278 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:47.123175 28213 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:46.959196 28291 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:07:47.023927 28282 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:47.128497 28180 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:47.129052 21900 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:47.131471 28170 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:47.132511 21828 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:47.132966 28136 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:47.134721 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.124336 28303 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:47.138832 28041 consensus_queue.cc:1059] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:07:47.141600 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.142417 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 152011us
I20260709 13:07:47.143846 28248 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:47.144683 28250 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:47.146406 28310 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.084s	user 0.002s	sys 0.000s
I20260709 13:07:47.149329 28102 tablet_bootstrap.cc:492] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:07:47.151881 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:47.152426 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.155293 28188 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:07:47.155436 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 101645us
I20260709 13:07:47.166818 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:47.138887 27982 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.151947 28278 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:47.138826 28305 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 13:07:47.095790 28214 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.167851 21905 raft_consensus.cc:2393] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 23: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:47.168637 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.168817 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:47.174737 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:47.176769 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.177899 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.177956 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.178791 21907 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 19: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:47.179092 21908 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:47.180081 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:47.180234 28029 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.180862 28214 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.182014 21909 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:47.183465 28214 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:47.180698 21903 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:47.171679 28147 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:47.189800 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:47.190440 21904 raft_consensus.cc:2376] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24. Re-sending same reply.
I20260709 13:07:47.190949 28029 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:47.194309 21903 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:47.170529 27432 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:47.195597 27432 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.195988 27432 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:47.199201 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.200805 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.201131 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.201704 21906 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:47.201833 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:47.202334 28115 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:47.202555 28188 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:47.202996 28188 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:47.203155 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:47.203433 28188 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.203755 21908 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:47.204214 28068 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:47.205685 28068 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:47.206112 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:47.206466 28180 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.206741 21978 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:47.207005 28180 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.208240 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:47.200652 28291 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:47.210136 21908 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:47.178823 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:47.222286 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 280685us
I20260709 13:07:47.230556 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.274838 21904 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:47.233927 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.165124 28296 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.264215 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:47.207932 28282 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:47.171222 28278 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:47.280957 28278 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.284256 21874 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:47.276137 21900 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
W20260709 13:07:47.276827 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 404783us
I20260709 13:07:47.288399 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.289228 21829 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:47.288635 21832 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:47.276544 21978 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:47.291404 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.289932 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:47.293184 22551 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:47.293347 21833 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:47.293306 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:47.294313 28214 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:47.294821 28214 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:47.295711 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:47.295717 28214 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.297358 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:47.297946 22551 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.303807 21874 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:47.307036 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:47.307615 22554 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:47.308202 28296 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:47.308928 28281 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:47.309684 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:47.310240 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:47.309098 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 107161us
I20260709 13:07:47.311487 28216 raft_consensus.cc:3055] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:47.312031 28216 raft_consensus.cc:740] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:47.312767 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:47.312050 28289 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:47.314296 28216 consensus_queue.cc:260] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.313871 28289 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:47.314881 28279 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:47.315884 28265 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:47.315944 21901 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:07:47.316401 28265 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:47.316637 28216 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:47.266810 28115 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:47.315963 28289 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.317382 28265 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.317523 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:47.320745 28320 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:47.318289 28041 consensus_queue.cc:1175] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "479255846c5141b584b16aa253f587c7" responder_term: 22 status { last_received { term: 22 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 22 index: 15 } }
I20260709 13:07:47.323230 28041 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:47.323630 28041 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:47.323993 28041 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:47.320454 28265 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:47.317545 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:47.327165 21983 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:47.328155 22547 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:47.328246 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.318046 22551 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:47.331151 21833 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:47.333170 27432 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.337534 22554 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:47.338029 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:47.330562 22520 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.518s (SENT) [suppressed 19 similar messages]
I20260709 13:07:47.338666 21907 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:47.340024 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.268285 28291 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:47.342458 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.344136 27432 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:47.343400 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:47.301219 28282 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:47.320760 28317 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:07:47.351222 28318 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:47.351734 28248 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:07:47.352787 28320 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:47.353021 28248 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:47.353190 28320 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:47.353438 28248 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:47.335276 28136 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:47.354964 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:47.357807 21907 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:47.354707 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:47.309484 28281 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:47.379590 21900 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:47.381222 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:47.381907 21979 raft_consensus.cc:2368] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16.
W20260709 13:07:47.382390 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 118813us
I20260709 13:07:47.384022 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:47.384701 21907 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:47.354148 28320 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.397267 28320 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:47.400270 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.351784 28318 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:47.402428 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:47.334467 28279 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:07:47.401585 28318 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.413242 27432 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:47.418179 27432 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:47.418881 27432 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:47.402535 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.435671 21834 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:47.437893 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:47.445351 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.446400 21829 raft_consensus.cc:2393] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:47.455648 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.465214 27432 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.447386 28147 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:47.468523 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:47.468752 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 72483.3us
I20260709 13:07:47.448719 27728 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:47.502816 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:47.506047 21907 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:07:47.521044 21907 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:47.386070 28248 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.523084 27432 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:47.523334 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.522989 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:47.534814 21827 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:47.524003 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:47.514504 27728 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:47.538151 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:47.525383 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.500830 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.459461 28303 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:47.542426 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 211873us
I20260709 13:07:47.543514 21829 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:07:47.543875 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.541608 27728 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:47.546898 28311 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:47.549814 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 91028.7us
I20260709 13:07:47.556113 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.459774 28282 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:47.558938 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.562112 21834 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:47.515225 28147 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.550609 28180 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:47.572706 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:47.580011 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 79294.4us
I20260709 13:07:47.580921 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:47.567235 27988 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:47.582192 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.586584 21829 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:07:47.551865 28311 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:47.470863 28291 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.590315 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:47.561473 28248 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:47.597533 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.624949 21827 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:47.593855 27432 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:07:47.602336 21718 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:47.610797 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.611294 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.539842 28281 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:47.628800 21718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 76978.6us
I20260709 13:07:47.586301 27988 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:47.643448 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.643986 27988 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.645196 27988 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:47.645496 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 64671.5us
I20260709 13:07:47.646248 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:47.646454 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49029.5us
I20260709 13:07:47.620831 28214 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:47.654791 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.657191 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:47.627463 28070 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.662002 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.658150 27432 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:47.641369 27982 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:47.641216 28153 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:47.682711 28041 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.684813 28041 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:47.686215 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.687304 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.684895 28278 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:47.704070 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:47.702875 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 383766us
I20260709 13:07:47.689126 27580 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:47.707010 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:47.714594 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.715088 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.637910 28303 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.719779 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:47.689803 28153 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:47.697302 28267 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:07:47.720790 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 62564.8us
I20260709 13:07:47.722797 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.727767 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.728650 28317 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.729070 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.729241 28181 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:47.729930 28181 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:47.730263 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:47.730928 28327 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:07:47.731833 28326 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:07:47.732321 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.733358 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:47.734135 28317 raft_consensus.cc:2764] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:07:47.737449 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:47.737857 21900 raft_consensus.cc:2410] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:07:47.742370 28170 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:47.744349 21983 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:47.746667 21831 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23. Ops: [20.10-22.11]
I20260709 13:07:47.754231 28311 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.750377 21831 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:07:47.699163 27982 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:47.674794 28070 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.757462 21831 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: [15.12-16.13]
I20260709 13:07:47.758425 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:47.768433 21834 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:07:47.769733 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 47017.8us
W20260709 13:07:47.775319 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 231563us
I20260709 13:07:47.778318 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:47.784533 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57953.1us
I20260709 13:07:47.787477 21981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:07:47.788407 21981 raft_consensus.cc:606] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.794832 22554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:47.724058 28153 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:47.724439 28267 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:47.802932 28334 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:47.803936 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:47.813510 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.820616 21834 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:47.769295 28283 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.822067 21832 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
W20260709 13:07:47.841789 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 247689us
W20260709 13:07:47.843240 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 109364us
I20260709 13:07:47.844599 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:47.852825 28181 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:07:47.859434 28328 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:07:47.843825 28296 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:47.859992 28332 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:47.860751 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:47.861423 28333 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:07:47.861728 28318 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:47.862123 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 91710.3us
I20260709 13:07:47.862921 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.864195 28281 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:47.864346 28282 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:47.864552 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.865738 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.866282 28341 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:07:47.843577 28265 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:47.868357 28265 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:47.871312 28041 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.871863 28041 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:47.872623 28323 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:07:47.874442 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.875166 28250 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:47.875675 28278 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:47.873945 28041 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:47.876452 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.877175 22551 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:47.878759 28278 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:47.878953 28250 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.859797 28181 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:47.841097 28330 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:47.880198 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.815433 28180 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:07:47.822553 28068 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:07:47.886438 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.831589 28055 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:07:47.890635 28250 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:47.885993 28188 consensus_meta.cc:287] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.003s
I20260709 13:07:47.893807 27728 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.844832 28062 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:07:47.885439 28181 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:47.890914 28147 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:47.907169 22553 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:47.896239 28330 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:47.898361 28278 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:47.913305 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:47.915169 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49495.3us
I20260709 13:07:47.855095 27982 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.919363 28320 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.920364 28330 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.885710 28267 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:47.921705 28267 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.895126 28188 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:47.925390 28188 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:47.926064 21979 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:47.928854 21873 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Timed out: RequestConsensusVote RPC to 127.20.53.131:42795 timed out after 2.042s (SENT)
I20260709 13:07:47.927788 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.897228 27432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54248 (request call id 18) took 1790 ms. Trace:
I20260709 13:07:47.929322 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:47.932304 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 87740.9us
I20260709 13:07:47.933630 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:47.934530 21798 leader_election.cc:400] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16.
W20260709 13:07:47.934682 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 80898.9us
I20260709 13:07:47.932196 27432 rpcz_store.cc:276] 0709 13:07:46.107214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.113936 (+  6722us) service_pool.cc:224] Handling call
0709 13:07:46.159552 (+ 45616us) log.cc:844] Serialized 506 byte log entry
0709 13:07:46.401914 (+242362us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b18002e9840. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75ef37b0b 00007fb75efbcb63 00007fb75efe4752 00007fb763fa4d29
0709 13:07:47.897139 (+1495225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136640,"raft.queue_time_us":152392,"raft.run_cpu_time_us":2167,"raft.run_wall_time_us":62679,"spinlock_wait_cycles":16494336,"thread_start_us":107636,"threads_started":1,"wal-append.queue_time_us":186844,"wal-append.run_cpu_time_us":3434,"wal-append.run_wall_time_us":1190011}
I20260709 13:07:47.941025 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:47.942952 27432 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:47.942572 21949 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:47.945914 27432 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:47.946456 27432 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:47.946771 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:47.947121 27432 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:47.943948 28188 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:07:47.948891 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:47.949815 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:47.937811 28278 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:47.958447 27432 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:47.976543 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.949925 28070 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:47.949699 28291 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:47.954607 28175 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:47.956453 28281 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:47.944283 28062 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:07:47.984359 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:48.033594 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.041738 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.054981 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 105229us
I20260709 13:07:48.056125 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.056895 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:48.057763 21900 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:07:48.058449 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 115639us
I20260709 13:07:48.060854 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:47.985159 28320 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:48.065754 21905 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:48.064052 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 96086us
I20260709 13:07:48.059185 21907 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:48.067243 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:48.034312 28303 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.961591 27988 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:07:48.071583 21832 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:07:48.075414 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:48.072175 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:48.076468 21978 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
W20260709 13:07:48.076967 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 108461us
I20260709 13:07:48.073570 21900 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:48.077666 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.052702 28278 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.082146 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:48.082798 21901 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:07:48.075279 21908 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:48.084266 21908 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:48.079473 21905 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:48.053465 28175 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:48.053161 28348 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:48.086386 21983 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:48.094429 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:48.067410 28291 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:48.078799 28341 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:48.108248 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.108273 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 157418us
I20260709 13:07:48.079131 28041 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:48.112571 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:48.126919 28351 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 13:07:48.133026 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 55430us
I20260709 13:07:48.133991 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.114598 21908 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.138715 22553 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
W20260709 13:07:48.143369 28342 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:07:48.144395 28354 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:07:48.144639 28347 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:07:48.144912 28354 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.145309 28354 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:48.145586 28350 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:48.146584 21829 raft_consensus.cc:1217] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 16.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:07:48.147076 21829 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:07:48.149001 28353 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:48.149513 28353 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:48.106779 27988 consensus_queue.cc:1243] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:07:48.150462 28353 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.151178 27988 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:48.151422 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.100485 28337 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:48.153640 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:48.153707 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 80204.9us
I20260709 13:07:48.162834 21798 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:48.163951 21978 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 13:07:48.153262 28281 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:48.167738 21908 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:48.090037 28303 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.170074 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:48.095890 28278 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.173875 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.138409 28341 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:48.153466 28324 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:48.162032 28291 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:48.178078 27988 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:48.191217 28136 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:48.191757 28136 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:48.192219 28136 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:48.195669 27988 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:48.196138 27728 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:48.196206 27988 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.200948 21908 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 10. (term mismatch)
I20260709 13:07:48.201462 21908 pending_rounds.cc:85] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 9
I20260709 13:07:48.201889 21908 pending_rounds.cc:107] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:07:48.202267 21908 raft_consensus.cc:2889] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:48.202768 21908 pending_rounds.cc:107] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 22.11
I20260709 13:07:48.203500 21908 raft_consensus.cc:2889] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:48.205010 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51444.3us
I20260709 13:07:48.206312 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.168957 28281 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:48.208647 21905 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
W20260709 13:07:48.222385 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 151166us
I20260709 13:07:48.186589 27580 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:48.185830 28324 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:48.222899 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 107030us
I20260709 13:07:48.231920 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:48.237218 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:48.237524 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 74621.8us
I20260709 13:07:48.237975 21826 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:48.238363 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:48.201552 28175 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.247457 28289 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:07:48.257905 28289 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:48.258297 28289 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:48.259089 28289 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.260308 28289 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.210959 28070 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:48.263616 28278 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:48.264272 28341 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.266024 27988 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:48.266590 28361 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:48.271010 28153 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.272951 28153 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:48.272584 28281 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.273851 28281 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:48.274071 28216 consensus_meta.cc:287] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.948s	user 0.004s	sys 0.007s
I20260709 13:07:48.274605 22554 raft_consensus.cc:606] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.274955 22554 raft_consensus.cc:614] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:48.275521 28147 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:48.275681 28303 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:48.280385 22554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:48.280864 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:48.281066 22554 raft_consensus.cc:606] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.281621 22554 raft_consensus.cc:614] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:48.226099 28291 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:48.228350 27580 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:48.299304 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 55188.1us
W20260709 13:07:48.300920 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 62671.7us
I20260709 13:07:48.304008 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.230509 28359 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:48.234896 28324 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.280758 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:48.308125 21831 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:48.309404 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:48.310075 21831 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:48.305296 22546 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
W20260709 13:07:48.317945 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 88837.8us
I20260709 13:07:48.318863 21983 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:48.223481 28368 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:07:48.322908 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:48.325587 22549 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:48.329483 22553 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:07:48.305234 27580 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:48.340943 21983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:07:48.341712 21983 raft_consensus.cc:606] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:48.345361 21983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff74442193fb468c966c8842f014e361"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:07:48.346046 21983 raft_consensus.cc:606] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:07:48.332607 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:48.306869 28283 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:48.329933 22553 pending_rounds.cc:85] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 14
I20260709 13:07:48.354561 22553 pending_rounds.cc:107] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:07:48.354902 22553 raft_consensus.cc:2889] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:48.334957 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.282871 28181 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.362771 28357 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:48.363729 27728 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:48.364804 27728 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:48.365244 27728 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:48.366469 27728 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.367995 27728 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.364804 28361 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:48.370270 28070 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:48.371982 28365 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:48.373623 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:48.374310 28365 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:48.375276 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:48.375247 28365 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:48.375813 28365 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:48.376695 28365 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.312314 28359 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:07:48.379139 21948 consensus_peers.cc:597] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff74442193fb468c966c8842f014e361. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.380123 28359 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:48.379230 21830 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:48.384186 21904 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:48.385444 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:48.387405 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:48.387626 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:48.343269 28248 consensus_meta.cc:287] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.713s	user 0.007s	sys 0.003s
I20260709 13:07:48.359867 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:48.331010 28279 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.405109 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:48.398137 22549 raft_consensus.cc:2368] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16.
I20260709 13:07:48.330763 28278 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:48.333267 28267 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:48.313392 28320 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:07:48.404948 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.406407 22554 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:48.406550 21825 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:48.378031 28365 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:48.422544 21828 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:48.424256 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:48.427103 22553 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.422580 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:48.427824 21901 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:48.421638 28359 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:48.358043 28265 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:07:48.422362 28267 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:48.463493 21975 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:48.404670 28041 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.034s
W20260709 13:07:48.466257 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.467338 21981 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:07:48.468055 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.468688 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:48.469831 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:48.470144 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:48.471026 21909 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:48.473083 22553 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:48.456528 21978 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:48.480381 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:48.485476 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:48.489807 21875 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:48.495741 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:48.470599 21900 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:48.421398 28279 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.508378 21975 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:48.423941 28278 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:48.464356 28282 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.001s
I20260709 13:07:48.465423 28267 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:48.528921 21906 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:48.529143 21907 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:07:48.520231 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 119578us
I20260709 13:07:48.449999 27988 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:07:48.454051 28360 consensus_queue.cc:1059] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:07:48.541831 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:48.548132 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:48.550554 21975 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:48.528995 28303 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:07:48.551939 28349 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.632s	user 0.005s	sys 0.007s
I20260709 13:07:48.542910 28341 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:48.552400 28250 consensus_meta.cc:287] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.658s	user 0.005s	sys 0.005s
I20260709 13:07:48.509595 28136 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:48.577767 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 82130.1us
I20260709 13:07:48.547492 28283 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:48.551717 28188 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.615240 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.539685 28354 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.657684 28359 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:48.678575 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.600440 28265 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:48.684834 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:48.685534 21901 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:07:48.600129 28250 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:48.656612 28216 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:48.658715 28382 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260709 13:07:48.696426 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:48.696879 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:48.697448 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:48.703199 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:48.697743 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:48.697826 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:48.705011 21974 raft_consensus.cc:2410] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:07:48.707690 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:48.707736 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 160128us
I20260709 13:07:48.673612 28283 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.710143 21977 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:48.713342 21976 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:48.685113 28265 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:48.712564 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:48.718740 21980 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:48.713130 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:48.733682 21978 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:48.680130 28188 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.600677 28341 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.707926 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:48.725149 21975 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:48.700256 28279 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:48.699419 28367 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.731920 21982 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:48.695116 27988 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.741988 22549 raft_consensus.cc:2410] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:07:48.769603 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:48.713537 28181 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:48.763365 28359 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:48.778751 28378 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:48.782287 27988 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:48.783051 28377 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:07:48.707410 28216 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.784627 27988 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:48.785956 28216 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:48.743494 28265 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:48.787523 28281 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.000s
I20260709 13:07:48.790535 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:48.791416 21901 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
W20260709 13:07:48.791977 28374 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:07:48.792418 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:48.793018 21901 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:48.795919 21902 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:07:48.802407 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61548us
I20260709 13:07:48.771652 21980 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:48.812687 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:48.819403 21974 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:48.821380 21975 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:48.781754 28324 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.824118 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:48.843540 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:48.850184 21980 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:48.853303 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:48.856598 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:48.857338 21834 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:48.771278 28367 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.821185 28216 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:07:48.860188 28382 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.825146 28062 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:07:48.904214 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51017.3us
I20260709 13:07:48.872304 28354 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:48.905472 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:48.857219 28303 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:07:48.911840 28278 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:48.921270 28394 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:48.957971 21901 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:48.925628 28136 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:48.907855 28382 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:48.982722 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:48.984018 21901 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:48.955909 28394 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:48.956523 28281 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.058251 21827 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:07:49.061671 21825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2641) took 1377 ms (client timeout 1803 ms). Trace:
W20260709 13:07:49.062275 21825 rpcz_store.cc:269] 0709 13:07:47.611773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.640994 (+ 29221us) service_pool.cc:224] Handling call
0709 13:07:48.988776 (+1347782us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54002729d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:48.988916 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753558400}
W20260709 13:07:49.075073 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 169693us
I20260709 13:07:48.966024 28368 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.095s
I20260709 13:07:48.966179 28188 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:48.980676 28283 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:48.964531 28348 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:07:49.059361 28278 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:49.080703 28373 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:07:49.099596 21981 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
W20260709 13:07:49.080406 28403 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:49.066828 28281 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.065059 28391 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.256s
I20260709 13:07:49.080044 28265 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.080500 28341 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:49.133947 28289 consensus_meta.cc:287] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.853s	user 0.007s	sys 0.001s
I20260709 13:07:49.108119 28367 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:49.105508 28398 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:07:49.139698 28341 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:49.143412 28341 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:49.144191 28341 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.144860 21905 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:07:49.140523 28400 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:07:49.145932 21905 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:49.146450 21905 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:49.101768 28411 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:49.147370 28411 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.147086 21905 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.147702 28411 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:49.148069 21905 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:49.150524 27728 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:49.150699 28341 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:49.151036 27728 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:49.152343 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 746527us
I20260709 13:07:49.153595 27728 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.142625 21906 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:49.153499 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:49.160974 28267 consensus_meta.cc:287] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.000s
I20260709 13:07:49.161329 28411 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.161736 28407 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.161572 28311 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:49.123239 28265 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.104208 21825 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:49.112026 28216 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.161139 28368 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:49.164786 28384 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.403s	user 0.001s	sys 0.001s
W20260709 13:07:49.106523 28405 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:07:49.113862 21903 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 13:07:49.169173 27580 consensus_meta.cc:287] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.002s
I20260709 13:07:49.101879 28278 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.093103 28324 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:49.130704 28402 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:07:49.111191 28394 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.172307 28392 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:49.108436 28382 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.119904 28391 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:07:49.175091 28175 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:49.176542 28365 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.000s
I20260709 13:07:49.117532 28281 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.183384 28248 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:49.185671 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.232347 21905 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:49.186946 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.234835 21975 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:49.187948 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:49.189708 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:49.190932 28369 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.189752 28267 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:48.988286 21901 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:07:49.197247 21980 raft_consensus.cc:1240] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:49.238193 21978 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:07:49.219063 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.239920 21909 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:49.241854 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:49.242612 22546 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:49.211396 28392 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:49.206754 28216 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.194868 28407 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.237178 28041 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:49.210409 27580 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:49.264101 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 407415us
I20260709 13:07:49.270417 22520 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:49.237602 28175 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.245424 28365 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:49.275585 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 56586.8us
I20260709 13:07:49.276307 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.277063 28365 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:49.277518 21948 leader_election.cc:400] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16.
I20260709 13:07:49.277832 21948 leader_election.cc:403] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:49.282483 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2933) took 1039 ms. Trace:
I20260709 13:07:49.284214 21902 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:49.282949 21833 rpcz_store.cc:276] 0709 13:07:48.243293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.243455 (+   162us) service_pool.cc:224] Handling call
0709 13:07:48.243821 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.325922 (+ 82101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.325950 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.457101 (+131151us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b18004a1be0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a
0709 13:07:48.519092 (+ 61991us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.802519 (+283427us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:48.802553 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.802615 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.268189 (+465574us) raft_consensus.cc:1685] finished
0709 13:07:49.268217 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.282407 (+ 14190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88631,"raft.queue_time_us":81727,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":15599,"spinlock_wait_cycles":13264512,"thread_start_us":250310,"threads_started":1,"wal-append.queue_time_us":384536}
I20260709 13:07:49.285285 21829 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:49.272012 21718 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:49.246829 28394 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:49.289901 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.264691 21900 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:49.296129 22546 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:07:49.299692 21902 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:07:49.300105 21902 pending_rounds.cc:85] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 12
I20260709 13:07:49.300359 21902 pending_rounds.cc:107] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:07:49.302999 21902 raft_consensus.cc:2889] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.267462 27728 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:49.344683 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 136007us
W20260709 13:07:49.344084 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 154438us
I20260709 13:07:49.345492 28070 raft_consensus.cc:3055] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:49.346062 28070 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:49.346994 28070 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:49.348363 28070 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.347713 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:49.349844 28359 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:49.246503 28369 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:49.359496 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.361164 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.361634 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.362437 21833 raft_consensus.cc:2410] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:07:49.362578 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.363288 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.363981 21833 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
W20260709 13:07:49.364351 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 86946.5us
I20260709 13:07:49.363485 21834 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:49.365090 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:49.365384 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.299393 28367 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 15. Current term is 16.
I20260709 13:07:49.371215 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:49.371342 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.371483 21983 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:49.374030 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.375089 22547 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:49.301687 28382 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.390296 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.350421 28359 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:49.330080 28420 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:49.352941 27728 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:49.402832 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:49.403873 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.370952 28291 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:49.368268 28248 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.303541 28416 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 13:07:49.357659 28391 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:07:49.391189 28068 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:49.431849 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2799) took 1035 ms. Trace:
I20260709 13:07:49.358753 28265 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:07:49.402762 27728 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:49.398633 28420 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:49.398448 28359 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:49.359792 28413 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:07:49.391656 28188 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:07:49.432396 21904 rpcz_store.cc:276] 0709 13:07:48.396125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.397093 (+   968us) service_pool.cc:224] Handling call
0709 13:07:48.421283 (+ 24190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.552982 (+131699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.553008 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.553043 (+    35us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:48.553071 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.431545 (+878474us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002e7cd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:49.431612 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.431776 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302499200}
W20260709 13:07:49.418780 28418 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:07:49.411839 28291 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.351526 28392 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.390396 28341 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:07:49.417107 28419 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:49.391359 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:49.460125 28411 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.398432 28382 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:49.465536 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 57333.1us
I20260709 13:07:49.418776 28248 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.460474 28420 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:49.496899 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.466179 28068 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:49.480139 28291 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:49.510205 28407 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:49.510514 28415 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:49.518877 28068 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.520074 28382 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.493798 28419 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.499747 28431 ts_tablet_manager.cc:933] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.522660 28278 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.532634 28267 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.548247 28369 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.537426 27580 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.546737 28436 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:07:49.586038 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2802) took 1052 ms. Trace:
I20260709 13:07:49.589150 21900 rpcz_store.cc:276] 0709 13:07:48.534070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.155449 (+621379us) service_pool.cc:224] Handling call
0709 13:07:49.155839 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.156115 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.156136 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.156916 (+   780us) log.cc:844] Serialized 506 byte log entry
0709 13:07:49.264565 (+107649us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:49.585300 (+320735us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.585608 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.585705 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.585759 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:49.585775 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.585968 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"thread_start_us":107272,"threads_started":1,"wal-append.queue_time_us":292744}
I20260709 13:07:49.577456 28428 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.601702 28436 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.603520 28436 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.605530 28436 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.606312 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2804) took 1063 ms. Trace:
I20260709 13:07:49.606679 21903 rpcz_store.cc:276] 0709 13:07:48.542561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.218913 (+676352us) service_pool.cc:224] Handling call
0709 13:07:49.239927 (+ 21014us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.247007 (+  7080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.247050 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.247568 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.462093 (+214525us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:49.478445 (+ 16352us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.479390 (+   945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.479460 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.567426 (+ 87966us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b1800103180. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:49.605988 (+ 38562us) raft_consensus.cc:1685] finished
0709 13:07:49.606105 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.606252 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":609,"prepare.queue_time_us":18802,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":834,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":18395,"spinlock_wait_cycles":8093056,"thread_start_us":174474,"threads_started":1,"wal-append.queue_time_us":300230}
I20260709 13:07:49.616021 28413 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:49.616822 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2805) took 1070 ms. Trace:
I20260709 13:07:49.617573 28248 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.617385 21905 rpcz_store.cc:276] 0709 13:07:48.550730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.233416 (+682686us) service_pool.cc:224] Handling call
0709 13:07:49.233789 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.241305 (+  7516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.241334 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.248511 (+  7177us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.492348 (+243837us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:49.492385 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.492447 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.616562 (+124115us) raft_consensus.cc:1685] finished
0709 13:07:49.616591 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.616752 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9179,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8124,"thread_start_us":189978,"threads_started":1,"wal-append.queue_time_us":284385}
W20260709 13:07:49.620254 28433 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:07:49.609514 28428 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.624536 28428 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.616601 28413 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.632530 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.634296 21974 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:49.634613 21974 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:49.609974 28419 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:49.636158 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.639441 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.641594 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:49.642110 21975 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:49.640198 21831 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:07:49.637408 21974 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.643399 21983 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:07:49.643685 21974 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:49.644462 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.646554 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.657265 28359 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.660102 28413 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.652648 28430 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:49.672991 21974 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:49.673457 28430 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.675819 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.676622 21983 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
W20260709 13:07:49.684516 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.684978 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.687316 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.688050 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.688422 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.689462 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.692771 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2656) took 1389 ms. Trace:
I20260709 13:07:49.693177 21829 rpcz_store.cc:276] 0709 13:07:48.303526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.303648 (+   122us) service_pool.cc:224] Handling call
0709 13:07:49.268626 (+964978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.285741 (+ 17115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.692590 (+406849us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b540017fcd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:49.692714 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185590144}
I20260709 13:07:49.695106 28324 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:49.696120 28324 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:49.696887 28324 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.697818 28324 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:49.700872 28175 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.700739 28420 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.702281 21834 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:07:49.706959 21975 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:07:49.715205 21829 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:49.715320 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.720233 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2790) took 1335 ms. Trace:
I20260709 13:07:49.720634 21907 rpcz_store.cc:276] 0709 13:07:48.384407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.384945 (+   538us) service_pool.cc:224] Handling call
0709 13:07:48.385194 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.529544 (+144350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.720016 (+1190472us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400078854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:49.720178 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330381184}
W20260709 13:07:49.722752 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.685626 28368 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:49.713714 28431 tablet_copy_client.cc:323] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.131:42795
I20260709 13:07:49.731812 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2925) took 1505 ms. Trace:
W20260709 13:07:49.732587 28380 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.039s	user 0.001s	sys 0.005s
I20260709 13:07:49.732228 21830 rpcz_store.cc:276] 0709 13:07:48.226613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.237354 (+ 10741us) service_pool.cc:224] Handling call
0709 13:07:48.237621 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.379101 (+141480us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:48.393253 (+ 14152us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.530798 (+137545us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.530864 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:48.530921 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.723628 (+1192707us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:49.731574 (+  7946us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540009d654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:49.731631 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.731762 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":978,"raft.queue_time_us":13096,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":4634,"spinlock_wait_cycles":332704256,"thread_start_us":136460,"threads_started":1,"wal-append.queue_time_us":379409}
I20260709 13:07:49.734490 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:49.735908 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.736964 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.737378 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:49.731917 28385 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.874s	user 0.004s	sys 0.000s
W20260709 13:07:49.735994 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.740664 21980 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:49.737030 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:49.742478 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.741566 28359 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.744055 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.744495 28420 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.745502 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.747898 28175 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:49.746049 21982 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:07:49.745550 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:49.748576 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.752417 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.718640 27728 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:49.753656 28265 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:49.755298 28382 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.755846 28382 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.757290 28365 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:49.728233 28368 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.751853 28359 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:49.747596 28337 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.789275 28359 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.792666 28440 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:49.789846 28265 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:49.747004 28386 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.750972 28181 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.757840 28382 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.808813 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:49.750813 28278 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:49.759438 28041 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:49.757856 28365 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.815351 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.790352 28360 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:49.817651 28372 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.143s	user 0.000s	sys 0.010s
I20260709 13:07:49.816373 28289 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:49.754436 28175 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.809532 28394 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:49.789965 28291 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.816480 28041 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:49.818572 28365 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:49.810086 28440 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.814626 28386 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.827399 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.821705 28278 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:49.816231 28181 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.808177 28337 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.826709 28289 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:07:49.824146 28394 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.839633 28440 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.841414 28386 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.820946 28360 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:49.841903 28289 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:49.842456 28289 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.843366 28360 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.829849 28382 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:49.841253 28278 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:49.845894 28289 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.848191 28337 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.850231 28175 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.851483 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:49.851670 21873 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:49.860620 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:49.861267 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.862828 22553 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:49.863463 28365 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:49.863616 28265 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.838049 28394 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.864244 28265 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.865612 28181 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.866698 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:49.866845 28359 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.868310 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:49.868827 22551 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:49.872044 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:49.869381 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:49.872872 22546 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:07:49.869609 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:07:49.862859 21874 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.872241 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2801) took 1338 ms. Trace:
I20260709 13:07:49.875185 21906 rpcz_store.cc:276] 0709 13:07:48.533802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.155436 (+621634us) service_pool.cc:224] Handling call
0709 13:07:49.155714 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.156030 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.156074 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.156488 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.321638 (+165150us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:49.371798 (+ 50160us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.372012 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.372095 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.866424 (+494329us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b1800027be0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:07:49.870129 (+  3705us) raft_consensus.cc:1685] finished
0709 13:07:49.872046 (+  1917us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.872184 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63007,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3478,"raft.queue_time_us":5372,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":13621,"spinlock_wait_cycles":7226752,"thread_start_us":164786,"threads_started":1,"wal-append.queue_time_us":236341}
W20260709 13:07:49.880692 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.871451 28289 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:49.883913 21949 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:49.859129 28337 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:49.888326 28453 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.871228 28382 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:49.871392 28358 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:49.874595 27728 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:49.903689 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:49.937664 21830 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:49.904048 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.939388 21832 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
W20260709 13:07:49.940204 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.942664 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.943310 21825 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:49.885080 28394 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:49.949615 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:49.953421 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 66662.8us
I20260709 13:07:49.903321 28062 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:07:49.879607 28353 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:07:49.899613 28136 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:49.968211 21833 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:49.958096 21900 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:07:49.969652 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:49.958595 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:49.959600 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 60819.3us
I20260709 13:07:49.963212 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:49.904237 28265 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.965420 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.956770 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:49.975289 21907 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:49.976663 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:49.977324 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 80026us
I20260709 13:07:49.963634 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:49.971846 21902 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:07:49.937295 28181 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:49.977475 21907 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:49.970669 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:49.980324 21904 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:07:49.980047 28181 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:49.981719 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:49.982510 21904 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:49.983117 28181 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:49.987002 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:49.945550 28296 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:49.987903 21907 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:07:49.988572 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:49.989388 21901 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:49.990247 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:49.896625 28369 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:07:49.989331 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:49.990803 21901 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:49.991410 21907 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:49.896785 28267 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:07:49.993815 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:49.994758 21907 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:49.951329 28394 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:49.902365 28337 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.001032 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:49.961879 28382 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.992003 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:49.960944 28346 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:50.000358 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:50.002135 21904 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:07:50.003232 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:50.004827 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:49.994966 28448 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:07:50.018190 21904 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:49.971374 28358 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:50.016877 21902 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:50.018308 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:50.022919 28330 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:50.023260 21902 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:50.023350 28330 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.023883 28330 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:50.024996 21901 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:50.025660 21900 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:50.019438 28289 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:50.027482 28358 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:50.030354 28055 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:50.030870 28068 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:50.031423 28068 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.033674 28068 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:50.033736 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:50.034685 28367 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.029441 21901 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:07:50.035229 28367 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.029120 28289 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.002406 28439 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:07:50.038998 28439 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:50.039348 28439 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:50.037454 28367 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:50.040225 28439 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.041234 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:50.041442 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:50.045807 21908 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:50.042928 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:50.047168 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:50.051050 21983 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:50.051244 21981 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:50.055404 21978 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 22: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:49.995589 28265 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:50.012202 28394 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:50.064078 21873 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:49.903661 28453 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.072830 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:50.021106 28395 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.042798 28420 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:50.029593 28458 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:50.005853 28296 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.091490 21902 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:07:50.091966 21902 pending_rounds.cc:85] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 9
I20260709 13:07:50.092252 21902 pending_rounds.cc:107] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:07:50.092576 21902 raft_consensus.cc:2889] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.078739 28458 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:50.075863 28291 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:50.081450 28439 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.041913 28346 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.079145 28420 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.043087 28382 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:50.101567 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 62110.2us
W20260709 13:07:50.106721 28452 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:50.108548 28296 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.110328 28386 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:50.122011 28453 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.074113 28265 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.126847 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:50.084146 28395 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.136620 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:50.127635 28420 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.157284 28136 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:50.177950 28136 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.182247 28136 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:50.184621 28430 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:50.173265 28296 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.186539 28296 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.187309 28346 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.188874 28296 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.190076 28068 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:50.192231 28395 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:50.196990 28382 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:50.134378 28457 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:07:50.197891 28136 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.174073 28353 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.201715 28353 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.202135 28353 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.123337 28041 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.180783 28458 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.205252 28458 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:50.196909 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:50.206998 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2792) took 1676 ms. Trace:
I20260709 13:07:50.173374 28463 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.205296 28303 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:50.207450 21909 rpcz_store.cc:276] 0709 13:07:48.531266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.987830 (+456564us) service_pool.cc:224] Handling call
0709 13:07:49.239694 (+251864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.240505 (+   811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.206794 (+966289us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540034a650. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:50.206936 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578345216}
I20260709 13:07:50.179327 28460 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:50.220490 28303 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.224359 28136 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:50.216355 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.206934 28330 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.206930 28357 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:07:50.238437 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 242545us
W20260709 13:07:50.229171 28417 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.726s	user 0.004s	sys 0.000s
I20260709 13:07:50.220104 28386 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:50.246147 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:50.263027 21905 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:50.263238 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:50.264070 21908 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:50.264292 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.264843 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.265463 21908 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:50.265731 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.266485 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.266880 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.267105 21901 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:50.267987 28311 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:50.268463 28311 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.268841 28311 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:50.239908 28357 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:50.270798 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.272194 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.272367 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.259152 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:50.219655 28463 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.272960 21908 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:50.280205 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:50.282336 28303 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:50.282536 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:50.283429 21799 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:50.284134 28430 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.284524 28430 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.284874 28430 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.256940 28386 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.288194 28386 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.290943 28070 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:50.291462 28070 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 22 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:50.292274 28070 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.279578 28363 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.255760 28281 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:07:50.270716 28337 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.244692 28460 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:07:50.294435 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:50.315237 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.343919 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 279864us
I20260709 13:07:50.345016 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:50.365406 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:50.292934 28102 tablet_bootstrap.cc:492] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:50.331872 28463 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.368023 28289 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:50.320027 28430 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.316326 28420 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.385497 28430 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.386437 28420 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:50.324798 28358 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.328375 28041 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.329156 28460 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:50.388727 28460 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:50.330330 28330 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:50.303575 28281 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:50.389848 28281 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:50.390779 28281 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.391990 28281 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:50.304064 28357 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.394270 28357 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:50.294341 28360 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:50.296772 28363 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.301728 28439 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:50.398582 28363 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.403136 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:50.408241 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.411166 21909 raft_consensus.cc:2410] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:07:50.413066 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.414278 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 209366us
I20260709 13:07:50.416008 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.294482 28395 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.114s
W20260709 13:07:50.417004 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.418365 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:50.420801 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:50.403383 28289 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.401158 28439 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:50.316546 28353 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.432183 21908 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:50.421993 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.435586 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:50.440202 21904 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:50.441833 22519 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:50.414283 28466 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.415035 28360 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:50.415407 28041 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.502281 22520 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.53.190:38207, user_credentials={real_user=slave}} blocked reactor thread for 49981.1us
I20260709 13:07:50.514544 21904 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:07:50.439733 28439 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:50.538458 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 135462us
W20260709 13:07:50.538861 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 97121.8us
I20260709 13:07:50.539234 21873 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:50.542272 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:50.543470 22553 raft_consensus.cc:2410] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:07:50.546861 21908 raft_consensus.cc:2468] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:50.563334 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:50.533456 28102 tablet_bootstrap.cc:492] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
W20260709 13:07:50.567706 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.570996 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.564045 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:50.563004 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:50.577023 22553 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
W20260709 13:07:50.584967 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 388122us
I20260709 13:07:50.540163 28348 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:50.540309 28430 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:50.602800 28471 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:07:50.603415 28353 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:50.523850 28360 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.523679 28041 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.606863 28330 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:50.607586 28330 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:50.608387 28041 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:50.611151 28394 consensus_meta.cc:287] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 13:07:50.611595 28394 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.612309 28311 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.514312 28466 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.614418 28311 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.615115 28430 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.615723 28466 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:50.617583 28430 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.561197 28469 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:50.618873 28469 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.619269 28469 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:50.620597 28394 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:50.564734 28468 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:50.621450 28468 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:50.621857 28468 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:50.614434 28348 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.623551 22551 raft_consensus.cc:1240] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:50.626567 28348 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.627708 28102 ts_tablet_manager.cc:1403] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 3.479s	user 0.050s	sys 0.017s
I20260709 13:07:50.628082 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2661) took 1267 ms. Trace:
I20260709 13:07:50.628495 21827 rpcz_store.cc:276] 0709 13:07:49.360602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.360816 (+   214us) service_pool.cc:224] Handling call
0709 13:07:50.627901 (+1267085us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54000e8dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:50.628029 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353786112}
W20260709 13:07:50.630000 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.631202 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:50.586097 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:50.634148 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48192.8us
I20260709 13:07:50.625871 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:50.644277 22553 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:50.655786 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:50.648056 28430 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:50.674376 21949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.015s
I20260709 13:07:50.648233 28479 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:50.680756 21949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.007s	sys 0.016s
W20260709 13:07:50.682145 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 522329us
I20260709 13:07:50.625854 28460 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.669087 28337 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:50.652060 28296 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:07:50.697224 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:50.698110 22553 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
W20260709 13:07:50.724061 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 178447us
W20260709 13:07:50.724351 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.664160 28318 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:07:50.686386 28357 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:50.694481 28479 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.696360 28395 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:50.770713 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:50.727901 28460 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.771821 28041 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:50.778888 28382 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.724514 28337 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:07:50.787319 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.772702 28357 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:50.775118 28467 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:50.794032 22551 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:50.771600 28363 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.797575 28357 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.775454 28395 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.812167 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:50.813513 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:50.827206 21828 raft_consensus.cc:3060] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:50.814802 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:50.815971 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:50.771689 28479 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.787403 28360 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:50.816427 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:50.828310 21826 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
W20260709 13:07:50.831862 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.799993 28453 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:50.890053 28482 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:07:50.792897 28041 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.896304 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:50.795495 28382 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.935032 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:50.935781 21830 raft_consensus.cc:2368] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:50.913944 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:50.913143 22553 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:50.916445 21831 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:07:50.937805 21831 pending_rounds.cc:85] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 12
I20260709 13:07:50.938208 21831 pending_rounds.cc:107] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:07:50.938555 21831 raft_consensus.cc:2889] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.839735 28353 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:50.941045 21826 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:07:50.941179 28353 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.941337 28102 raft_consensus.cc:359] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:50.942190 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:50.942685 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:50.943369 21834 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:50.946208 28041 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:50.912947 28430 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:50.800570 28467 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.946935 28430 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:50.947826 28430 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:50.948566 28467 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:50.942258 28102 raft_consensus.cc:740] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:07:50.949851 28102 consensus_queue.cc:260] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:50.950155 28353 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:50.940155 28453 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:50.936765 21827 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:50.954228 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.856173 28216 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:07:50.959051 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 289809us
W20260709 13:07:50.943189 28486 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:07:50.956369 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:50.953737 22520 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:50.965672 21832 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:50.965772 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:50.913046 28459 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:50.973245 21828 raft_consensus.cc:2468] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:07:50.933290 28490 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:50.977823 21827 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:50.977988 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:50.978583 21903 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
W20260709 13:07:50.984772 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 259986us
W20260709 13:07:50.985231 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.984184 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:50.988109 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.937947 28070 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:50.988865 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:50.989452 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:50.996976 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:50.999637 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:51.005661 21949 leader_election.cc:400] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:51.006402 21949 leader_election.cc:403] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:07:50.963862 28438 consensus_queue.cc:1059] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:07:51.009732 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:51.012329 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.975653 28497 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:51.031203 21834 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:51.043218 21993 tablet_copy_service.cc:140] P 3d76b2c4699e43fba10eeb81a91e4913: Received BeginTabletCopySession request for tablet ff74442193fb468c966c8842f014e361 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:54264)
I20260709 13:07:51.043895 21993 tablet_copy_service.cc:161] P 3d76b2c4699e43fba10eeb81a91e4913: Beginning new tablet copy session on tablet ff74442193fb468c966c8842f014e361 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:54264: session id = 0157b4f0725d4f92a53938c921db9efc-ff74442193fb468c966c8842f014e361
I20260709 13:07:51.046415 28502 raft_consensus.cc:2804] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:51.047041 28502 raft_consensus.cc:697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:51.047942 28502 consensus_queue.cc:237] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:51.047963 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53633.3us
I20260709 13:07:51.050518 28136 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:07:51.053004 28487 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:51.048499 28394 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.030179 28102 ts_tablet_manager.cc:1434] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.402s	user 0.005s	sys 0.004s
I20260709 13:07:51.059134 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:51.056690 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.976231 28459 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.028307 28318 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:51.011394 28467 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.066720 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.067906 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.068429 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.068478 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.096167 21983 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:51.069783 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.072286 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:51.089566 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 100769us
I20260709 13:07:51.098903 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.099875 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:51.000996 28070 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.091567 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:51.101058 21975 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:51.101855 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:51.097970 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 107286us
I20260709 13:07:51.104905 21834 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:51.105335 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:51.102496 21979 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:51.103577 21978 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:51.099191 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:51.110683 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.111789 21833 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:51.066861 28136 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.112877 28136 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.114413 28070 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.089002 28466 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:51.114797 28136 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:51.115001 28466 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.115379 28466 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:51.115931 28289 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.000s
W20260709 13:07:51.116405 28500 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:51.116765 28479 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.089738 28499 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:51.064266 28472 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:07:51.118191 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.090076 28318 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:51.088694 28296 raft_consensus.cc:3055] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:07:51.121227 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.121322 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 167697us
I20260709 13:07:51.122597 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.122025 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.125047 22520 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.101754 28337 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.101567 28495 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.116405 28289 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:51.119300 28363 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.143821 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.139884 22519 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.144533 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:51.147485 21833 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:51.124042 28353 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:51.123790 28318 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:51.057605 28497 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.125417 28395 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:51.151846 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 60347.1us
I20260709 13:07:51.099123 28469 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.123997 28296 raft_consensus.cc:740] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:51.139557 28472 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:51.140396 28479 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:51.158070 28472 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:51.167788 21843 tablet_copy_service.cc:342] P 479255846c5141b584b16aa253f587c7: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-6bde6ac1d042400fbc88831c01b9fdda received from {username='slave'} at 127.0.0.1:52674
I20260709 13:07:51.168177 21993 tablet_copy_source_session.cc:215] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:51.168429 28472 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.169827 28472 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:51.168251 21843 tablet_copy_service.cc:434] P 479255846c5141b584b16aa253f587c7: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-6bde6ac1d042400fbc88831c01b9fdda on tablet 6bde6ac1d042400fbc88831c01b9fdda with peer 0157b4f0725d4f92a53938c921db9efc
W20260709 13:07:51.176709 21718 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:51.177541 21833 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:51.179932 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.180538 22546 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:51.183264 28469 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.182410 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:51.189282 28468 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.000s
I20260709 13:07:51.188495 21833 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:51.194761 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:51.195103 28358 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:51.195344 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.198506 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.199015 21980 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:51.199656 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:51.200482 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.200379 28296 consensus_queue.cc:260] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.201072 21978 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:51.201575 28296 raft_consensus.cc:3060] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:51.168208 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:51.204285 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.207056 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.154673 28216 raft_consensus.cc:2804] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:51.204447 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:51.149586 28508 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:51.213105 28508 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.209940 21905 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:51.149796 28510 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:51.185889 28497 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.189801 28468 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.216392 21979 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:51.163543 28479 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.158887 28353 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:51.182926 28348 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:07:51.218807 28382 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.219918 28216 raft_consensus.cc:697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:51.224534 28479 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:51.145713 28495 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:51.227263 28510 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.226364 28504 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:51.260242 28459 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.249182 28453 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.271268 28510 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.259055 28504 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.273872 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.274648 21901 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:51.275184 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2828) took 1010 ms. Trace:
I20260709 13:07:51.260843 28517 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:51.275530 21901 rpcz_store.cc:276] 0709 13:07:50.264853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.273557 (+1008704us) service_pool.cc:224] Handling call
0709 13:07:51.275122 (+  1565us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:51.291098 28507 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:07:51.294569 28216 consensus_queue.cc:237] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.298424 28521 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:51.298807 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.299023 28521 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:51.301955 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.301285 28521 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:51.269506 28353 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:51.304004 28439 consensus_meta.cc:287] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.000s
I20260709 13:07:51.288414 28517 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.305648 28365 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:51.391925 28508 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:51.306497 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.311335 22547 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:07:51.320479 22554 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
W20260709 13:07:51.287498 28498 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:51.390805 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.392184 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.393828 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:51.279165 28504 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.409518 22552 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:51.409582 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:51.410290 21904 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.392104 28459 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:51.405421 28382 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:51.394948 28439 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.431305 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:51.280460 28510 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.434881 21901 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:51.395375 28365 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:51.442936 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.443511 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.445030 28528 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:51.446264 21974 raft_consensus.cc:2410] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
W20260709 13:07:51.448799 28522 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:51.450654 28514 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:07:51.453096 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.454927 28495 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:51.470824 28520 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:51.482209 21904 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:51.454105 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.495105 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:51.498301 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.506835 22549 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:51.514806 21901 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:07:51.520439 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.521886 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.442935 28521 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.422210 28459 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:51.535777 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 395939us
I20260709 13:07:51.536765 22519 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:51.530351 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.531189 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:51.531899 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.518860 28468 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:51.517233 28382 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:51.538028 21904 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:51.540513 21907 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:51.541301 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:51.541926 21903 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:51.542583 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.543617 21829 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 20: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:51.540203 28509 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:51.527885 28337 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:51.547518 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.553138 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:51.554626 21907 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.557545 22551 raft_consensus.cc:1240] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:51.530601 28521 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.559006 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:51.559490 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.559608 22555 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.560469 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.560544 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.562228 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:51.562032 28481 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.007s	sys 0.007s
W20260709 13:07:51.563500 28481 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.007s	sys 0.008s
I20260709 13:07:51.563789 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.564580 28517 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:51.568888 28460 consensus_meta.cc:287] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.791s	user 0.002s	sys 0.006s
W20260709 13:07:51.562216 28518 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:51.571206 28431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff74442193fb468c966c8842f014e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:51.553951 28509 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:51.554227 28468 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:51.563133 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.591775 28468 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:51.593577 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.594650 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.595405 21904 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:51.576395 21907 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:51.580349 28439 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:51.606967 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:51.585460 28504 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.550843 28382 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.587077 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.608525 21909 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:51.598475 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2810) took 1629 ms. Trace:
I20260709 13:07:51.602543 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.609774 21900 rpcz_store.cc:276] 0709 13:07:49.968998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.999792 (+ 30794us) service_pool.cc:224] Handling call
0709 13:07:50.025495 (+ 25703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.026015 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.598347 (+1572332us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b5400077450. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:51.598435 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58529536}
I20260709 13:07:51.614884 22555 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:51.555750 28337 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.606776 28517 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:51.609206 28460 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.638962 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:51.639685 21907 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:51.640544 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:51.641275 21907 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:51.642730 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.633880 28510 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:51.643292 21901 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:51.643424 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.643922 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.644586 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:51.648110 21948 connection.cc:256] RPC call timeout handler was delayed by -1.3886299679999183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 13:07:51.649566 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.650089 21976 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:51.650419 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.650873 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.653800 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.653950 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.654789 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:51.656642 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.658144 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.658387 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.659725 21977 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:51.661755 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.662436 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:51.663144 21901 raft_consensus.cc:2368] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
W20260709 13:07:51.662318 21875 leader_election.cc:336] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.803s (SENT)
I20260709 13:07:51.665879 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.666427 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.666206 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.667637 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:51.670588 28188 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.671067 28188 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.678687 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.679492 21979 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:51.679806 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 836) took 1723 ms. Trace:
I20260709 13:07:51.680341 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.681474 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.681703 22549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 932) took 1140 ms. Trace:
I20260709 13:07:51.682060 22549 rpcz_store.cc:276] 0709 13:07:50.541457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.541591 (+   134us) service_pool.cc:224] Handling call
0709 13:07:50.569225 (+ 27634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.518052 (+948827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.681452 (+163400us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54004920d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:51.681622 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155738368}
I20260709 13:07:51.684012 28472 consensus_queue.cc:1059] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:51.684974 28472 raft_consensus.cc:3055] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:51.685317 28472 raft_consensus.cc:740] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:51.687176 28457 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:51.687739 28457 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:51.688616 28457 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.690753 28337 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.661788 28521 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:51.680179 21906 rpcz_store.cc:276] 0709 13:07:49.956105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.956278 (+   173us) service_pool.cc:224] Handling call
0709 13:07:49.963953 (+  7675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.174511 (+210558us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:50.174546 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.177793 (+  3247us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.526497 (+348704us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:50.526554 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.679397 (+1152843us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540034a654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:51.679448 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.679493 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:51.679523 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.679742 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36220,"raft.queue_time_us":65485,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2644,"spinlock_wait_cycles":401482368,"thread_start_us":321745,"threads_started":1,"wal-append.queue_time_us":404001,"wal-append.run_cpu_time_us":1590,"wal-append.run_wall_time_us":1003378}
I20260709 13:07:51.158221 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:51.697490 28265 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.698408 28459 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.699491 28468 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.664484 28365 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:51.703644 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.704972 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:07:51.664829 28534 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:07:51.635735 28460 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.635725 28517 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.706497 28267 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:51.713802 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.717453 28382 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.717988 28504 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.718672 28524 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:51.719957 28508 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:51.720425 28474 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 1.116s	user 0.005s	sys 0.007s
I20260709 13:07:51.707489 28365 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:51.724464 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:51.709586 28458 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:51.728216 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:51.729202 28508 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:51.710806 28479 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.702888 28472 consensus_queue.cc:260] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.722123 28524 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:51.740947 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:51.715018 28353 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:07:51.731889 28527 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:07:51.751274 28318 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 13:07:51.727792 28358 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:07:51.733224 28458 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:51.755317 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:51.759213 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:51.752099 28472 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:51.776851 28394 consensus_meta.cc:287] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.000s
I20260709 13:07:51.777266 28394 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:51.760335 28318 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.782356 28318 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:51.762185 28479 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:51.785063 21982 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:51.795461 28386 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.796042 28386 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:51.799757 28386 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.806404 28517 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:51.752014 28365 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:51.764153 28524 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.772126 28458 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.761358 28519 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:51.810055 22554 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:51.827970 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:51.829447 28539 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:51.829542 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.830881 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.831903 28386 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:51.832418 28386 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.834409 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.837287 28468 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:51.837610 28267 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:51.838006 28468 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.838232 28267 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:51.840253 28267 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:51.840313 28468 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:51.809595 28466 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.003s
I20260709 13:07:51.843367 28188 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:51.811343 28527 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:51.854983 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:51.858806 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 95930.4us
W20260709 13:07:51.861317 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 102179us
W20260709 13:07:51.862576 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.864039 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.884552 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.885887 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.886582 21978 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:07:51.888976 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.889503 21948 leader_election.cc:400] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17.
I20260709 13:07:51.850867 28392 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:51.890522 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.896741 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.892109 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:51.892532 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.899785 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.889660 21977 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:51.901508 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.902122 21908 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:51.906277 21903 raft_consensus.cc:2410] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 23 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:07:51.902408 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.906766 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.907366 22554 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 17: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:51.908320 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.909196 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.911185 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:51.911734 21900 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:07:51.913403 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.915398 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.913771 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:51.918212 21873 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.921113 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:51.851259 28466 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.922580 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.930083 22555 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 22: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:51.889706 28289 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:51.883059 28459 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:51.926693 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.927274 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.893540 28382 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.916286 28468 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:51.934248 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:51.954185 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:51.906296 28041 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.976301 22547 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
W20260709 13:07:51.976686 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 58605.1us
I20260709 13:07:51.976392 21832 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:51.977524 28382 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.936337 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:51.935199 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:51.955993 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:51.910959 28265 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:51.919939 28469 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:51.932753 28291 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:51.993297 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57026.6us
I20260709 13:07:51.926033 28386 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:51.932598 28463 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:52.040668 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.967839 28460 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:51.986851 28358 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:52.046042 28458 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:52.048534 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:52.049214 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:52.053737 21982 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:52.049628 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:52.051826 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 60769.3us
I20260709 13:07:52.058243 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:51.989737 28394 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.928139 28467 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
I20260709 13:07:52.106447 28469 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:52.107266 28394 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:52.108649 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 44568.7us
I20260709 13:07:52.109553 21874 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:51.986202 28459 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:51.991623 28041 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.070691 28460 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:52.071374 28468 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:52.039638 28289 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.053071 28358 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:52.092250 21832 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:52.093037 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:52.117782 21834 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.099488 28419 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:51.987664 28337 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 13:07:52.104704 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:51.992117 28265 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:52.055501 28458 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:52.113920 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:52.096176 28541 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 13:07:52.118877 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 197826us
I20260709 13:07:52.119740 21907 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:07:52.130913 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:52.134873 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:52.135443 21908 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:52.135653 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:52.137503 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:52.138058 21908 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.132783 28291 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:52.119421 28358 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.146670 28430 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.129176 28419 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.129033 28265 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:52.157176 21908 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:52.159003 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:52.167459 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 62886.8us
I20260709 13:07:52.170325 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.128110 28394 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:52.129503 28458 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:52.129700 28544 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.177732 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:52.142656 28291 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.176090 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.178709 21908 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:52.186213 21904 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:52.189245 21901 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:07:52.186820 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.193323 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:52.194123 21904 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:52.195545 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:52.195605 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.174103 28460 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:52.171783 28508 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.174705 28337 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:52.202796 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:52.177255 28365 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:52.185330 28291 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:52.214825 22553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 840) took 1469 ms (client timeout 1617 ms). Trace:
I20260709 13:07:52.185264 28481 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:52.217957 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:52.219733 22553 rpcz_store.cc:269] 0709 13:07:50.731100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.734758 (+  3658us) service_pool.cc:224] Handling call
0709 13:07:52.199823 (+1465065us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54005e01d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:52.199948 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286761216}
I20260709 13:07:52.168543 28353 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:52.227648 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2978) took 1235 ms. Trace:
I20260709 13:07:52.192217 28552 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:52.199509 28401 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.229050 21826 rpcz_store.cc:276] 0709 13:07:50.992695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.992825 (+   130us) service_pool.cc:224] Handling call
0709 13:07:51.033100 (+ 40275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.036347 (+  3247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.036393 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.036453 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:51.036499 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.227369 (+1190870us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b540008a054. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:52.227441 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.227582 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6917504}
I20260709 13:07:52.215090 28457 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:52.230430 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:52.236047 21904 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:52.203671 28041 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.206139 28267 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:52.229358 21905 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:52.239327 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.187927 28544 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.206621 28460 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:52.219017 28337 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:52.229663 28479 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:52.259147 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:52.265132 22548 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:52.265671 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 863) took 1274 ms. Trace:
W20260709 13:07:52.266919 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.266090 21825 rpcz_store.cc:276] 0709 13:07:50.991198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.996306 (+  5108us) service_pool.cc:224] Handling call
0709 13:07:51.026840 (+ 30534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.027110 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:07:51.145299 (+118189us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.223005 (+ 77706us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.265219 (+1042214us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b1800482ec0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:07:52.265359 (+   140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.265404 (+    45us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:07:52.265453 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.265514 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.265613 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1047984,"prepare.queue_time_us":85619,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":1042771,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":1778,"spinlock_wait_cycles":4384512,"thread_start_us":155315,"threads_started":2,"wal-append.queue_time_us":123773}
I20260709 13:07:52.269498 28070 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.270829 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2975) took 1286 ms. Trace:
I20260709 13:07:52.271195 21828 rpcz_store.cc:276] 0709 13:07:50.984638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.986332 (+  1694us) service_pool.cc:224] Handling call
0709 13:07:50.986559 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.986737 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:07:51.223302 (+236565us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.270529 (+1047227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.270575 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:52.270619 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.270679 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.270779 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1034838,"prepare.queue_time_us":106031,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"thread_start_us":196843,"threads_started":2,"wal-append.queue_time_us":76343}
W20260709 13:07:52.272782 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 959860us
I20260709 13:07:52.274510 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.274664 28527 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:52.275274 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.239848 28419 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.277833 27580 raft_consensus.cc:2764] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:07:52.278360 28296 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:52.278774 28296 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:52.279165 28296 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:52.282507 28466 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:52.285979 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.287534 21798 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.288894 28170 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:52.289755 28170 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.291106 28457 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:52.292484 28457 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.294369 28365 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.294986 28365 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.297607 28365 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:52.250651 28267 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.298466 28267 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.237005 28502 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:07:52.305228 28502 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:52.305621 28502 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:52.313416 28502 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.239979 28188 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:52.237905 28552 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.277523 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.325712 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.327204 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.240518 28517 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:52.231305 28497 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:07:52.344271 21981 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 22: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:07:52.322558 28547 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:07:52.332080 28472 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.230088 28481 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.264093 28479 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:52.354477 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 95777.2us
I20260709 13:07:52.359462 21830 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:52.358404 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:52.364730 21905 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:52.269963 28070 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.361121 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.361949 22553 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:07:52.363848 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 86399.5us
I20260709 13:07:52.383102 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.348869 28289 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.342442 28502 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:52.328068 28188 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:52.370298 28430 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:52.372785 28267 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.387029 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.390358 28512 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.411998 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:07:52.412772 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 174405us
I20260709 13:07:52.357419 28438 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:52.343603 28552 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.379665 28517 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:52.382413 28479 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.411769 28430 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:52.418941 28392 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.003s
I20260709 13:07:52.418995 28521 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:52.414721 28348 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:52.452719 21834 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:52.454587 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.366969 21798 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.388267 28495 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:07:52.387995 28363 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:07:52.421082 28490 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:52.363067 28472 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.469357 21833 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
W20260709 13:07:52.472446 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 105576us
I20260709 13:07:52.474370 28330 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:52.474433 28392 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.452653 28382 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.464963 28430 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:52.463126 28469 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.456071 28504 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:52.481571 28496 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.468068 28521 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.488193 28330 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:52.493355 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 77171.5us
I20260709 13:07:52.418356 28460 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.452852 28516 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:07:52.504998 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:52.503273 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 114302us
I20260709 13:07:52.480906 28490 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:52.508421 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:52.513797 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:52.515188 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.521104 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:52.505927 28521 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.525472 28330 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:52.530750 28559 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:52.533972 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2672) took 1466 ms. Trace:
I20260709 13:07:52.557399 21829 rpcz_store.cc:276] 0709 13:07:51.068088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.613350 (+545262us) service_pool.cc:224] Handling call
0709 13:07:51.613641 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.282504 (+668863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.282535 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.282951 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.471335 (+188384us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:52.471371 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.471429 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.533773 (+ 62344us) raft_consensus.cc:1685] finished
0709 13:07:52.533792 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.533915 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":668516,"raft.queue_time_us":669254,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":69,"thread_start_us":188021,"threads_started":1,"wal-append.queue_time_us":244982}
W20260709 13:07:52.536306 28548 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.461s	user 0.004s	sys 0.000s
W20260709 13:07:52.539001 28558 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:52.567026 28544 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:52.571329 28447 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:52.571717 28447 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:52.572014 28291 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.572419 28447 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.573801 28447 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:52.557451 28358 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:52.575663 21833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2680) took 1503 ms (client timeout 1787 ms). Trace:
I20260709 13:07:52.576134 28358 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:52.576573 21977 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
W20260709 13:07:52.577278 28556 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:07:52.578761 28481 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.583194 28472 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:52.523653 28318 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:52.584013 28318 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:52.584477 28291 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:52.485924 28188 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:52.591441 28289 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.591889 28521 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.551173 28459 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.506067 28496 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.523299 28512 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:52.526511 28348 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:52.594878 28348 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:52.595242 28348 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.553184 28265 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.515089 28490 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.583226 28070 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:52.547020 21830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 864) took 1550 ms (client timeout 1602 ms). Trace:
I20260709 13:07:52.513878 28170 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:07:52.504349 28469 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.504210 28504 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.569617 28296 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.584874 28318 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.591960 28289 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.548189 28363 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:07:52.576038 21833 rpcz_store.cc:269] 0709 13:07:51.072133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.194236 (+122103us) service_pool.cc:224] Handling call
0709 13:07:52.575499 (+1381263us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400287dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:52.575611 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2905171328}
I20260709 13:07:52.549502 28337 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.610875 21908 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:52.553864 28458 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:52.615694 22521 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.602s (SENT) [suppressed 4 similar messages]
W20260709 13:07:52.709965 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.712726 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 191710us
I20260709 13:07:52.556633 28460 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:52.717027 21830 rpcz_store.cc:269] 0709 13:07:50.996560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.996696 (+   136us) service_pool.cc:224] Handling call
0709 13:07:52.546859 (+1550163us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540017e8d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:52.546969 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3131508096}
I20260709 13:07:52.669543 28041 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.651732 28557 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 13:07:52.711966 28267 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:52.723570 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.725378 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:52.729200 22555 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:52.730388 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.725306 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:52.628155 28431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60024 (request call id 935) took 3394 ms. Trace:
I20260709 13:07:52.611963 28265 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:52.622900 28517 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:52.721753 28311 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:52.720053 28496 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.725401 28188 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.611617 28481 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.125s
I20260709 13:07:52.729900 28363 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:52.614145 28430 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.671043 28479 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.735999 28392 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:52.771111 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.637923 28552 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:52.775118 28363 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.729321 28438 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:07:52.781635 22555 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:52.746289 28311 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:52.806813 28311 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.776940 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 2981) took 1616 ms. Trace:
W20260709 13:07:52.793207 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.724125 28041 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.800611 22548 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:52.801357 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:52.812434 21900 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:52.803308 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:52.755398 28521 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:52.810436 21831 rpcz_store.cc:276] 0709 13:07:51.160884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.694603 (+533719us) service_pool.cc:224] Handling call
0709 13:07:51.694862 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.283772 (+588910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.283802 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.284189 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.513388 (+229199us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:52.513425 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.513492 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.776685 (+263193us) raft_consensus.cc:1685] finished
0709 13:07:52.776714 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.776874 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":588568,"raft.queue_time_us":589417,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":228931,"threads_started":1,"wal-append.queue_time_us":462507}
I20260709 13:07:52.777487 28496 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:52.817821 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:52.818593 21901 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:52.820608 28512 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.821125 28512 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.823242 28512 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.823735 28512 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:52.823911 28458 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:52.824187 28512 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.827620 28041 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.829878 28496 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:52.830797 28496 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.834250 28296 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.834789 28512 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:52.834290 28311 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.836087 28348 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.837095 28311 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.838544 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:52.839462 21902 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:52.853928 21905 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:52.781093 28392 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:52.805550 28570 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:52.865613 28430 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.737030 28431 rpcz_store.cc:276] 0709 13:07:49.233445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.243317 (+  9872us) service_pool.cc:224] Handling call
0709 13:07:49.527833 (+284516us) ts_tablet_manager.cc:934] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
0709 13:07:51.551743 (+2023910us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:52.227205 (+675462us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:52.237076 (+  9871us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:52.627429 (+390353us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:52.627698 (+   269us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:52.628006 (+   308us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:52.628075 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":54077,"tablet-copy.queue_time_us":162105,"thread_start_us":140909,"threads_started":2}
I20260709 13:07:52.871116 28431 tablet_copy_client.cc:806] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:52.871641 28431 tablet_copy_client.cc:670] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
W20260709 13:07:52.876305 21727 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 222) took 46563 ms (client timeout 15000 ms). Trace:
I20260709 13:07:52.878108 28337 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:52.878500 21874 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.879521 28041 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:52.880478 28041 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:52.880785 28041 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:52.861819 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 338343us
I20260709 13:07:52.882143 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:52.882736 22553 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:07:52.851560 21725 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 16 to 21, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 21 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:52.858737 28392 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.881896 28570 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:52.898653 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 387589us
I20260709 13:07:52.909118 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:52.910938 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:52.891477 21798 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:52.939112 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.942569 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:52.917726 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:52.919225 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:52.922407 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:52.944578 21900 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.924345 22554 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:52.929550 22548 raft_consensus.cc:2368] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18.
I20260709 13:07:52.889504 28460 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:52.937872 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:52.898504 28511 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:52.887272 28490 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.946849 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:52.948341 21904 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:52.947773 21907 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.902572 28570 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:52.953132 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 61730.8us
I20260709 13:07:52.916574 28560 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:52.913478 28070 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:52.957826 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:52.958609 21830 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:52.891074 28041 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:52.940259 28289 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.968286 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:52.992122 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:52.992206 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:52.948365 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:52.994515 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:52.995229 21833 raft_consensus.cc:2393] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 20: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:52.947636 28267 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.999696 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 51392.6us
W20260709 13:07:52.985021 28573 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:07:53.003793 21907 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:53.004177 21829 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:52.997797 21900 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:53.011610 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:53.012256 21902 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:53.012504 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.005009 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.007900 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.008595 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:53.015184 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.016719 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:53.017516 21833 raft_consensus.cc:2376] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18. Re-sending same reply.
I20260709 13:07:52.957454 28382 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:52.955375 28511 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:53.005414 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.006987 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:52.947028 28348 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:52.962921 28460 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:52.991492 28490 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:53.033845 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:53.010848 28188 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:52.983641 28504 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:52.983249 28479 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:53.022948 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:53.043327 22555 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:53.022992 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.023272 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.044589 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:53.023945 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.025000 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.045506 21825 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
W20260709 13:07:53.045768 21799 connection.cc:256] RPC call timeout handler was delayed by -1.1503422780000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:07:53.027926 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:52.946143 28568 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:07:53.049047 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:53.029069 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.030035 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:53.032413 21975 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:53.050078 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.050402 21829 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:53.050752 21834 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:52.960860 28430 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:53.037900 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:52.961279 28560 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:52.985405 28070 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:53.022226 28041 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:53.040267 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:53.033420 28552 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:53.047469 21830 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:53.044665 21833 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:52.983058 28469 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:53.009114 21904 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:07:53.068215 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:53.052050 21834 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:53.054817 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:53.055853 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:53.056646 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:53.073851 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:53.074582 21975 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:53.074955 21902 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:53.075518 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:53.059373 21828 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:53.060204 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.060304 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:53.077528 21825 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:53.010911 28267 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.040930 28188 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.080770 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:53.081161 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:53.082451 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:53.082834 21834 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:53.085402 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.079950 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:53.053754 28430 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.093497 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:53.049479 28348 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.136546 28348 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:53.138485 28469 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:53.139045 28348 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:53.028820 28382 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.148248 21829 raft_consensus.cc:1275] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:07:53.098150 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:53.149997 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51953.3us
I20260709 13:07:53.150890 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:53.088338 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:53.092763 28188 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:53.103868 28577 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.107446 28267 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:53.107375 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:53.165958 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 58657.2us
I20260709 13:07:53.167431 28577 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:53.168045 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:53.169478 28577 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:53.169891 21830 raft_consensus.cc:1275] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:07:53.108263 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.170235 21830 pending_rounds.cc:85] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 11
I20260709 13:07:53.170487 21830 pending_rounds.cc:107] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 17.12
W20260709 13:07:53.110946 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 88102.3us
I20260709 13:07:53.170691 21830 raft_consensus.cc:2889] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.171521 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:53.107949 28296 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:53.172044 28170 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:53.172462 28170 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.172797 28170 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:53.172075 21902 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:07:53.177561 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:53.178773 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:53.179304 28070 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:53.180677 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:53.152089 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 63834.3us
I20260709 13:07:53.183377 28431 tablet_copy_client.cc:538] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:53.188262 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:53.189219 21905 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:53.189792 21826 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:53.190390 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:53.190876 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 575172us
I20260709 13:07:53.192365 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:53.135113 28460 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:53.062460 28517 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:53.163241 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:53.167773 28318 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:53.154846 21983 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:07:53.195421 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:53.195545 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.139704 28430 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:53.196593 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:53.160555 28504 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:53.191751 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:53.245771 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 54104us
I20260709 13:07:53.172465 28296 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:53.254839 21949 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:53.255472 21975 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:53.196060 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:53.200765 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49980.9us
I20260709 13:07:53.243134 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:53.161348 28469 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:53.246588 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:53.268141 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:52.982700 21725 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 13 to 16, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 16 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:53.272837 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:53.269034 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:53.285290 21832 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:07:53.231269 28575 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:53.229393 28289 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:53.227839 28318 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:53.283243 28577 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:53.290027 28508 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:53.293322 28188 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.313032 28563 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:53.323864 28563 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.324254 28563 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:53.325273 28188 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:53.294548 28511 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:07:53.326486 21976 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:53.326335 28577 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:52.876732 21727 rpcz_store.cc:269] 0709 13:07:06.313227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.314711 (+  1484us) service_pool.cc:224] Handling call
0709 13:07:52.876203 (+46561492us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:46.772741 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:46.773550 (+   809us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:46.773625 (+    75us) write_op.cc:435] Acquired schema lock
0709 13:07:46.773654 (+    29us) tablet.cc:662] Decoding operations
0709 13:07:46.917762 (+144108us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:46.926384 (+  8622us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:46.926432 (+    48us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:46.927490 (+  1058us) tablet.cc:701] Row locks acquired
0709 13:07:46.927542 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:07:46.927729 (+   187us) write_op.cc:270] Start()
0709 13:07:46.927885 (+   156us) write_op.cc:276] Timestamp: P: 1783602466927657 usec, L: 0
0709 13:07:46.927925 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:07:46.928637 (+   712us) log.cc:844] Serialized 3631 byte log entry
0709 13:07:47.871399 (+942762us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:48.122486 (+251087us) op_driver.cc:464] REPLICATION: finished
0709 13:07:48.249619 (+127133us) write_op.cc:301] APPLY: starting
0709 13:07:48.249720 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:48.366556 (+116836us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:48.366599 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:48.793295 (+426696us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:48.793671 (+   376us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 13:07:48.793711 (+    40us) write_op.cc:312] APPLY: finished
0709 13:07:48.794071 (+   360us) log.cc:844] Serialized 89 byte log entry
0709 13:07:48.794288 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:48.794422 (+   134us) write_op.cc:454] Released schema lock
0709 13:07:48.794484 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:48.794952 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:48.794983 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1910945,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":102576,"apply.run_cpu_time_us":14968,"apply.run_wall_time_us":550269,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41693,"num_ops":9,"prepare.queue_time_us":117689,"prepare.run_cpu_time_us":86977,"prepare.run_wall_time_us":669803,"raft.queue_time_us":248389,"raft.run_cpu_time_us":16364,"raft.run_wall_time_us":64484,"replication_time_us":1194376,"spinlock_wait_cycles":20928896,"thread_start_us":845890,"threads_started":4,"wal-append.queue_time_us":642531,"wal-append.run_cpu_time_us":47541,"wal-append.run_wall_time_us":2222911}]]}
I20260709 13:07:53.328696 28577 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:53.241376 28517 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.252717 28497 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:53.227504 28311 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:07:53.255926 28296 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:53.298116 28584 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:53.255313 28496 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 23.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:07:53.282883 28562 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:53.247087 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:53.360572 21905 raft_consensus.cc:2368] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20.
I20260709 13:07:53.246366 28504 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:53.289378 21875 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:53.363265 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 73966.6us
I20260709 13:07:53.257489 28267 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:53.305086 28291 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:53.365782 28267 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:53.302690 28136 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:53.322579 28318 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:53.301828 21725 catalog_manager.cc:5697] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 11 to 19, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 19 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:53.364334 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:53.367076 28296 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.363754 28504 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:53.302882 28458 consensus_queue.cc:1059] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:07:53.371500 28136 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:53.314244 28459 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:07:53.374979 28136 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.373108 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:53.354709 28188 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:07:53.382503 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:53.366192 28552 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:53.393517 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:53.354410 28497 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:53.377131 28572 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:53.380692 28291 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:53.373261 28267 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.388664 28337 raft_consensus.cc:2764] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:07:53.397290 28469 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:53.439736 28585 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
W20260709 13:07:53.447243 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53841.7us
I20260709 13:07:53.448141 21875 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:53.457506 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:53.465161 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 144873us
I20260709 13:07:53.436904 28552 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:53.468397 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:53.465169 22521 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:53.475082 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:53.479599 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:53.461380 28265 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:53.477752 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 208817us
I20260709 13:07:53.465078 28458 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:53.485185 21948 leader_election.cc:400] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18.
I20260709 13:07:53.474470 28469 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:53.487926 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:53.489272 21948 leader_election.cc:403] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:07:53.483142 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:53.481521 28578 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.224s	user 0.000s	sys 0.008s
I20260709 13:07:53.478101 28517 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:53.477021 28291 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:53.479205 28481 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:53.517604 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 321577us
I20260709 13:07:53.547966 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:53.484102 28337 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:53.484252 28502 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:53.526662 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:53.549575 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 64482.3us
W20260709 13:07:53.550392 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 67232.6us
W20260709 13:07:53.528426 28582 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:07:53.486152 28430 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:53.528036 28575 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:53.564639 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 96855.8us
W20260709 13:07:53.600613 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52737.2us
I20260709 13:07:53.605249 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:53.551119 28291 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:53.527808 28330 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:53.559092 28265 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:53.623548 21827 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:53.525384 28458 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:53.600611 28511 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:53.637714 28265 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:53.638734 28346 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:53.635957 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:53.604414 28577 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:07:53.644615 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 45896.5us
W20260709 13:07:53.633873 28588 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:07:53.634902 28431 tablet_bootstrap.cc:492] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
W20260709 13:07:53.593696 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 67163.7us
I20260709 13:07:53.630910 28291 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:53.631098 28512 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:07:53.558995 28572 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:07:53.659981 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:53.638418 28611 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:53.459196 21725 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 13 to 22. New cstate: current_term: 22 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:53.673492 28590 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:07:53.662123 28607 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:53.658576 28346 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:53.723194 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 63295.8us
W20260709 13:07:53.671165 28596 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:07:53.660552 28577 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.740682 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:53.654875 28265 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:53.738559 28605 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
W20260709 13:07:53.749673 28597 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:07:53.727248 28524 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:07:53.751287 28606 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:07:53.752563 28600 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:07:53.753305 28041 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.684s	user 0.005s	sys 0.005s
I20260709 13:07:53.745568 28363 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:53.754438 28601 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.755034 28601 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:53.756716 28570 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.002s
I20260709 13:07:53.752166 21725 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.757171 28570 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.758332 21825 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:53.758508 28595 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:07:53.730252 28603 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:07:53.759189 28392 consensus_meta.cc:287] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.860s	user 0.009s	sys 0.001s
I20260709 13:07:53.762534 28392 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:53.763068 28612 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:07:53.764706 28392 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:53.764786 28589 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:07:53.767143 28458 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:53.767640 28458 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.768023 28502 consensus_queue.cc:1048] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:53.769688 28512 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:53.744961 28577 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:53.771759 28170 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
I20260709 13:07:53.772948 28430 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:53.720957 28460 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.730783 28611 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.662269 28575 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.739878 28346 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:53.723143 28469 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:53.790046 28460 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.790289 28603 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:53.790045 28363 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.768046 28458 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.769927 28502 consensus_queue.cc:1048] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:07:53.790621 28170 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:53.809724 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.810652 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:53.812273 21904 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:53.819169 21900 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:53.803025 28318 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:53.868432 28508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.007s
I20260709 13:07:53.917371 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:53.928682 21834 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:53.867242 28601 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:53.866211 28337 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.921370 28508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.007s
W20260709 13:07:53.989193 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 314764us
I20260709 13:07:53.995755 28289 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:53.820454 28469 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.926743 28618 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:53.825708 28363 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.031561 28560 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.032171 28560 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.032636 28560 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.035778 21832 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:54.038522 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:54.039620 28318 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.039676 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.041301 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.042073 21833 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:54.043177 28170 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.043901 28623 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.044389 28623 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:53.825505 28603 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.052469 21832 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:07:54.020758 28289 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:54.019625 28337 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.061195 28363 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.062284 28568 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:54.063201 28516 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:54.067567 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2693) took 1060 ms. Trace:
W20260709 13:07:54.067895 28504 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.006s
I20260709 13:07:54.068883 21725 catalog_manager.cc:5697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:54.070652 28563 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.000s
I20260709 13:07:54.070577 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 2860) took 1162 ms. Trace:
I20260709 13:07:54.146924 21903 rpcz_store.cc:276] 0709 13:07:52.908599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.908830 (+   231us) service_pool.cc:224] Handling call
0709 13:07:54.070368 (+1161538us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400078354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:54.070495 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313687296}
I20260709 13:07:54.075136 28458 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:54.076015 28570 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.073613 28265 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.097093 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.097646 21832 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:54.018121 28619 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:54.026343 28618 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:54.125696 21827 rpcz_store.cc:276] 0709 13:07:53.006805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.007570 (+   765us) service_pool.cc:224] Handling call
0709 13:07:54.067376 (+1059806us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400288cd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:54.067508 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399902976}
I20260709 13:07:54.130565 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.131449 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.162636 21979 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:54.135093 21976 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:54.137414 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.078111 28460 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:54.144517 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.035s	sys 0.084s
I20260709 13:07:54.149931 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:54.168283 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.035s	sys 0.084s
I20260709 13:07:54.168500 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:54.168617 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 603581us
I20260709 13:07:54.144214 28623 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.103327 28524 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:54.155349 21982 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:54.125319 28516 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:54.163889 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.165516 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.165807 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.096688 28620 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:54.151870 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.184152 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.172646 21908 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:54.172935 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.174086 21829 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:54.172678 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.153512 28497 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.177079 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.189592 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.146526 28504 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.195919 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.197714 28382 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.199234 21903 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:07:54.200281 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:54.200531 28599 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.571s	user 0.008s	sys 0.008s
I20260709 13:07:54.200834 21903 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:54.188337 28460 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.202633 28460 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.202989 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:54.204391 28594 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.681s	user 0.002s	sys 0.019s
I20260709 13:07:54.205470 28460 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.148041 28563 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.208007 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 2897) took 1176 ms. Trace:
I20260709 13:07:54.208139 28563 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:54.208395 21977 rpcz_store.cc:276] 0709 13:07:53.031445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.032790 (+  1345us) service_pool.cc:224] Handling call
0709 13:07:53.033110 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.049256 (+ 16146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.049304 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:53.049859 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.377228 (+327369us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:53.379520 (+  2292us) log.cc:844] Serialized 14 byte log entry
0709 13:07:53.379727 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.379808 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.203779 (+823971us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:07:54.207736 (+  3957us) raft_consensus.cc:1685] finished
0709 13:07:54.207834 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.207955 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15640,"prepare.queue_time_us":3001,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":41440,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8338,"spinlock_wait_cycles":40083840,"thread_start_us":327057,"threads_started":1,"wal-append.queue_time_us":424740}
I20260709 13:07:54.170747 28392 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:07:54.223842 28337 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.195170 28623 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:54.224792 28623 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.166389 28619 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.226413 28618 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.227685 28618 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:54.228408 28619 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.231510 28504 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.187971 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.190869 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:07:54.232234 28291 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.000s
I20260709 13:07:54.232681 21908 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:54.232769 28291 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.234138 28469 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.235855 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.236467 21974 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:54.236624 28603 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.192242 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.193692 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.239868 28577 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.240940 28516 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.242877 22553 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:07:54.243211 28481 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.000s
I20260709 13:07:54.243580 28481 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.245831 28607 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18.
I20260709 13:07:54.194774 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3017) took 1005 ms. Trace:
I20260709 13:07:54.246917 28348 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:54.247422 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.251139 21830 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:54.188309 21979 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:54.211401 28265 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.139971 28568 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.246626 21825 rpcz_store.cc:276] 0709 13:07:53.189448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.193516 (+  4068us) service_pool.cc:224] Handling call
0709 13:07:53.240580 (+ 47064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.758799 (+518219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.194576 (+435777us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540017f2d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:54.194721 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190173568}
I20260709 13:07:54.253973 28568 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.183914 28524 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.188707 28628 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:54.188716 28620 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.256114 28524 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.189311 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.257155 28628 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.259639 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.259932 21980 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:54.260237 21829 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:54.261610 28504 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.171814 28560 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.222846 21907 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:07:54.262061 28504 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.158658 28289 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.263200 28497 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.263507 28289 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:54.263680 28497 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.235868 28517 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:54.264909 28517 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:54.265767 28497 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:54.210925 28624 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:54.247429 28348 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:54.271921 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52674 (request call id 868) took 1225 ms. Trace:
I20260709 13:07:54.271162 28348 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.272575 28620 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.273505 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.269656 28296 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:54.226863 28623 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.272315 21828 rpcz_store.cc:276] 0709 13:07:53.046724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.271225 (+1224501us) service_pool.cc:224] Handling call
0709 13:07:54.271492 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.271642 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.271666 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.271706 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:54.271735 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.271786 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.271873 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.259150 28628 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.276454 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:54.277663 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.287120 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.276073 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:54.296005 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.295557 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 207710us
I20260709 13:07:54.301263 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.269420 28577 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.247255 28346 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.304092 21949 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:54.306972 21980 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:54.308143 21908 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:54.274890 28348 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:54.308926 21978 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:54.295389 28623 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:54.314894 28568 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:54.315065 22548 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:54.322602 21874 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:54.328840 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.300673 28365 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.305303 28504 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.334406 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:54.332921 21831 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:54.338078 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:54.338860 21830 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:54.315110 28617 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:54.342770 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.343614 21828 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:54.326292 28568 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:54.344843 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.350945 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.351583 22555 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:54.349576 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.353535 21833 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:54.353555 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3015) took 1164 ms. Trace:
I20260709 13:07:54.354113 21834 rpcz_store.cc:276] 0709 13:07:53.188866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.189556 (+   690us) service_pool.cc:224] Handling call
0709 13:07:53.189799 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.929198 (+739399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.353367 (+424169us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54000ea1d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:07:54.353506 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698759424}
I20260709 13:07:54.265956 28517 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.359529 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.350895 21977 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:54.328671 28628 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:54.356457 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.357806 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:54.358031 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.362548 21908 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:54.362767 21907 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:54.333636 28563 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.363402 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.354595 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.332733 28265 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:54.308560 28524 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:07:54.361092 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:54.359206 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.365497 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.366822 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.352819 28502 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:54.395781 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.395586 21982 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:54.395754 21834 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 22: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:54.396557 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.326057 28618 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:07:54.356006 28337 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.352957 28568 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:54.404641 21901 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:54.371918 21974 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:07:54.345311 28188 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:07:54.344591 28457 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:54.421976 21974 pending_rounds.cc:85] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 12
I20260709 13:07:54.422677 21974 pending_rounds.cc:107] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:07:54.422991 21974 raft_consensus.cc:2889] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.402141 21908 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:07:54.409618 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:54.418206 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 44284.1us
I20260709 13:07:54.367833 28265 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.331308 28623 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.355634 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:54.427017 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:54.373836 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:54.345114 28365 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:54.403733 28469 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.428534 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 230749us
I20260709 13:07:54.418821 28458 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:54.441452 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:54.442127 21834 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:54.443573 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.410881 28517 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.445544 21903 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:07:54.438470 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:54.360352 28521 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:07:54.444238 21830 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:07:54.402505 28563 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.431294 28291 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.447383 21981 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:07:54.432088 28382 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.431020 28560 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:54.370247 28628 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.421226 28502 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:54.432266 28265 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:54.448405 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 92836.5us
I20260709 13:07:54.449126 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.450690 28459 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.435989 28460 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.453054 21825 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:54.418974 28337 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.454596 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.462363 21983 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:54.441109 28458 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:54.463477 21834 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:07:54.464913 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:54.442979 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:54.440145 28469 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.435849 28614 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:54.566823 28650 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.570920 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:54.570843 28650 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.571683 28636 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.572322 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:54.572182 28636 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:54.573040 28318 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.507465 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:54.574378 28577 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:54.509344 28628 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.474320 28504 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:54.576107 28504 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.576468 28504 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:54.576771 28636 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.520447 21825 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:54.578722 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.579509 21974 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:07:54.349062 28617 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.582194 28617 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:54.582808 21909 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:07:54.582643 28458 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.569802 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.583644 28458 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:54.583762 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:54.525399 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:54.584491 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 119695us
I20260709 13:07:54.585736 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:54.587407 28635 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:07:54.587740 28188 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:54.589780 28617 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:54.590305 28136 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:54.584438 28563 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.543905 22549 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:07:54.454308 28574 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:54.460929 28382 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.602277 28502 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.602766 28382 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.604029 28574 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:54.604590 28574 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:54.555517 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 107802us
I20260709 13:07:54.560261 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:54.560909 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:54.562553 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:54.567874 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 194089us
I20260709 13:07:54.573060 28650 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.574605 21901 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:54.574839 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:54.503435 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:54.508008 28632 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:07:54.583925 22548 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 23: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:54.620002 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:54.584328 21909 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:54.473121 28621 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.573828 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:54.522128 28346 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:54.607314 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 164382us
I20260709 13:07:54.612775 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:54.607544 22555 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:54.608186 21902 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:07:54.611536 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.636885 21907 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:54.619169 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:54.620767 21978 raft_consensus.cc:2410] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:07:54.565064 28633 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:07:54.622332 22553 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 17: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:07:54.635480 21718 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:54.622888 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:54.637704 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.638347 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.638448 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:54.638950 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.671916 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.639070 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.679234 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.679584 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.683094 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.680457 21829 raft_consensus.cc:2368] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
I20260709 13:07:54.677667 21830 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 20: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:54.681366 21825 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 20: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:54.686028 21828 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
W20260709 13:07:54.687652 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 113857us
W20260709 13:07:54.688705 21718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53291.7us
I20260709 13:07:54.690466 21834 raft_consensus.cc:2393] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:54.681001 21832 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:54.605611 28560 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:54.694108 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.694839 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:54.695418 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.697028 21900 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:54.727361 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.699810 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.642884 28348 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:54.728775 21902 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:54.617841 28563 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 13:07:54.698057 21828 raft_consensus.cc:2368] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23.
I20260709 13:07:54.730424 28607 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:54.730960 28607 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:54.731956 28607 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.734699 21907 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:54.735275 21901 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: [17.10-18.11]
I20260709 13:07:54.621456 28460 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:54.744933 22520 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:54.749147 22520 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:54.749912 21875 leader_election.cc:400] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
I20260709 13:07:54.750375 21875 leader_election.cc:403] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:07:54.690277 28382 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:54.690455 28459 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:54.768322 22555 raft_consensus.cc:2410] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:07:54.693638 28631 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.757507 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 69052.2us
I20260709 13:07:54.752100 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.848268 21907 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:54.671360 28645 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:54.785799 28630 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.786137 28644 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:07:54.786506 28623 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.792284 28628 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
W20260709 13:07:54.776482 28639 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:07:54.774405 28650 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.736182 28560 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.798311 28574 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.799381 28601 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:07:54.806589 28643 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:07:54.807514 28337 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.783174 28365 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:54.811076 28611 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:54.814234 28469 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.816008 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:54.777577 28382 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.818612 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:54.899819 22551 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:07:54.771553 28479 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:54.801944 28289 consensus_meta.cc:287] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.001s
I20260709 13:07:54.828583 28265 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.834771 22519 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:54.836472 21909 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:07:54.836889 21949 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:54.910468 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 75803.2us
W20260709 13:07:54.837602 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.911705 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.859354 28630 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.843887 28524 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:54.742950 28460 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:54.845539 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 258173us
I20260709 13:07:54.642951 28621 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.852208 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:54.847294 28562 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:54.781855 28459 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:54.880366 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 131788us
I20260709 13:07:54.935354 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
W20260709 13:07:54.882258 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 248133us
I20260709 13:07:54.937077 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:54.886417 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:54.855648 28496 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
W20260709 13:07:54.941143 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 54832.7us
I20260709 13:07:54.940659 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:54.943878 21900 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:54.943986 21798 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:54.864069 28394 consensus_queue.cc:1175] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac1dd8ad9fc44263932ec57d9376a271" responder_term: 18 status { last_received { term: 18 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 18 index: 11 } }
W20260709 13:07:54.843194 28296 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.004s
I20260709 13:07:54.915151 21828 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:07:54.915843 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.920745 21831 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:54.926831 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:54.948060 21830 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:54.934281 28460 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:54.936393 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:54.937865 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 101043us
W20260709 13:07:54.940770 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 88875.4us
I20260709 13:07:54.923306 28430 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:54.953680 21875 leader_election.cc:400] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23.
I20260709 13:07:54.957702 21875 leader_election.cc:403] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:07:54.858234 28631 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:54.925907 28650 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:54.947757 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:54.926379 28524 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:54.941800 28289 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:54.943403 28636 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:54.968489 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.945679 28625 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:54.961915 28296 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:54.943204 28560 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:54.948381 28348 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:54.923568 28568 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:54.968575 21979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:07:54.958241 28517 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:54.958560 28512 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.979343 21979 raft_consensus.cc:606] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:07:54.973357 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:54.978139 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 206079us
I20260709 13:07:54.959870 28469 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:54.945859 28479 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:54.963572 28650 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.971413 28611 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23.
I20260709 13:07:54.952347 28318 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:07:54.970896 28289 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.961727 28634 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:07:54.981976 28521 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:07:55.002035 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 58135.5us
I20260709 13:07:54.962363 28430 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:54.983433 28469 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.983853 28296 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:54.984246 28348 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:54.990603 28289 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:54.989535 28650 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:55.020569 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 66588.1us
I20260709 13:07:55.021376 21799 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:54.983892 28512 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.024210 28625 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:55.025053 28517 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:55.004577 28521 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:55.010850 28469 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:55.011312 28508 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:55.029930 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:54.983445 28524 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.028566 21798 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:55.033813 22551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:55.033814 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:55.046063 22551 raft_consensus.cc:606] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:55.046506 22551 raft_consensus.cc:614] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:55.022542 28382 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.049369 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.051432 22555 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:55.049088 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.051309 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.055222 22548 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:55.057331 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.058317 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:55.030553 28574 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:55.034336 28634 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:55.067760 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:55.035127 28636 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:55.034915 28521 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:55.037238 28508 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.086337 28508 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:55.031515 28496 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:07:55.090646 28616 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:55.091161 28616 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:55.094568 28504 consensus_meta.cc:287] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
W20260709 13:07:55.073800 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 45306.6us
W20260709 13:07:55.076138 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 46303.6us
W20260709 13:07:55.077105 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 88110.7us
I20260709 13:07:55.099362 21799 leader_election.cc:400] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20.
I20260709 13:07:55.099890 21799 leader_election.cc:403] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:07:55.070616 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.052556 28466 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:55.084465 28631 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.113766 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.114578 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:55.117197 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:55.113711 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:55.117915 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.114053 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.114108 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:55.118753 21978 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:55.119441 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:55.120417 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.120697 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.068183 28188 raft_consensus.cc:2764] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:07:55.094961 28504 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.119441 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:55.120438 22551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7"
dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:54160
I20260709 13:07:55.077828 28382 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:55.134011 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.134785 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.142383 28365 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.142628 28625 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.143396 28430 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.146306 22551 raft_consensus.cc:606] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:55.077610 28601 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:55.127616 28496 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20.
I20260709 13:07:55.095875 28318 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:55.100049 28479 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:55.096076 28363 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:55.141641 28650 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.161986 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.162572 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.150633 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.167920 21978 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:55.168411 22548 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:55.161023 28621 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:55.146543 28630 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.173348 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:55.159308 28459 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.186216 28265 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.169690 28318 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.208660 21902 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:55.196028 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:55.209717 21978 raft_consensus.cc:2376] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18. Re-sending same reply.
I20260709 13:07:55.171118 28568 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.166884 28601 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.191690 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:55.198354 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.201690 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:55.202277 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.212922 21979 raft_consensus.cc:2376] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20. Re-sending same reply.
I20260709 13:07:55.213582 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:55.206875 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 82095us
I20260709 13:07:55.193958 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.207800 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.215018 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.215159 21980 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:55.161249 28508 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:55.163708 28365 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.211350 22553 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:55.216053 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:55.212450 21901 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:55.216624 21980 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.215473 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.211066 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.161962 28382 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.217630 21978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90821f4436f045a0a3847b276293f36f"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:07:55.210350 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:55.216401 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.218431 21974 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:55.219419 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.220367 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.223088 28650 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.103647 28296 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:55.160656 28517 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.146123 28348 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.212720 28318 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:55.228298 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.226604 21980 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:55.239045 21827 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:07:55.248772 21827 pending_rounds.cc:85] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 10
I20260709 13:07:55.249032 21827 pending_rounds.cc:107] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:07:55.249240 21827 raft_consensus.cc:2889] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:55.241137 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:55.213824 28504 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.242304 21828 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.224278 28289 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.246366 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:55.214323 28601 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:55.252748 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.241273 21901 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:55.250515 21977 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:55.265698 21825 raft_consensus.cc:1217] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 18.10->[20.11-22.12]   Dedup: 20.11->[22.12-22.12]
I20260709 13:07:55.266242 21825 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: [20.11-22.12]
I20260709 13:07:55.255190 21979 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:55.255394 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:55.258011 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:55.226959 28630 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.244844 28631 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:55.225059 28459 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:55.258649 21980 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:55.258594 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:55.232174 28265 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:55.267530 22520 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:55.274336 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.275612 28568 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:55.275436 28560 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:55.275544 28681 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:07:55.261534 28657 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:55.292547 21909 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:07:55.298454 21828 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:07:55.300200 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.293560 28672 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:55.273172 28611 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:55.302778 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.307328 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:55.261612 28496 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:55.261848 28502 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:07:55.290975 28265 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:55.300022 28504 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:55.317900 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:55.304740 28459 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:55.358465 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 94047.8us
I20260709 13:07:55.279903 28630 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.383740 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:55.410553 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 92757.6us
I20260709 13:07:55.313616 28619 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:55.411563 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.363364 28631 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:55.342638 28672 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:07:55.458899 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47406.1us
I20260709 13:07:55.462385 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.314689 28382 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.370072 28265 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:55.484229 21873 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:55.468662 28632 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:07:55.459022 28628 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:55.409688 28504 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:55.580071 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:55.586292 21974 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:55.468518 28459 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:55.370898 28458 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.191s
I20260709 13:07:55.392002 28664 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.187s
I20260709 13:07:55.582708 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:55.599465 21979 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:07:55.561049 28619 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:55.603525 21974 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:07:55.593040 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:55.615219 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 131065us
I20260709 13:07:55.568689 28605 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:55.587706 28628 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.649014 28670 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:55.649935 28610 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:55.650339 28610 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:55.651585 28682 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:55.644407 28560 raft_consensus.cc:2764] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:07:55.654834 28678 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:07:55.655730 28346 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:55.656108 28346 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:55.640719 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 47778.8us
W20260709 13:07:55.643085 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.633131 21979 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:55.609795 28631 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:55.666693 28687 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:55.657128 28337 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:55.659088 28611 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.658500 28628 raft_consensus.cc:3060] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:55.663640 28458 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:55.677358 28289 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.687567 28365 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:55.703436 28521 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.003s
I20260709 13:07:55.685673 28611 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.658147 28605 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.698290 28458 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.722445 28630 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.723999 28631 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.725245 28611 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:55.726032 28683 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:07:55.651104 28610 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.720288 28521 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:55.726992 28460 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.000s
I20260709 13:07:55.727036 28610 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:55.727509 28460 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.728754 28521 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.729385 28460 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.686867 28504 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.738327 28516 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:55.774652 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 390724us
I20260709 13:07:55.777781 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:55.783946 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.786456 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.786950 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.797996 21978 raft_consensus.cc:606] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:07:55.798453 21979 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:55.807374 28605 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.814751 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55690 (request call id 880) took 1091 ms. Trace:
I20260709 13:07:55.815366 21900 rpcz_store.cc:276] 0709 13:07:54.718322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.727132 (+  8810us) service_pool.cc:224] Handling call
0709 13:07:55.809682 (+1082550us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540034a154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:55.809907 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495425280}
I20260709 13:07:55.816663 28616 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.689613 28337 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.843371 28631 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.844375 28458 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:55.844257 28631 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.686614 28346 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.855156 28460 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:55.862560 28481 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.866221 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 64164.3us
I20260709 13:07:55.867931 28611 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:55.868976 28698 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:55.869832 28698 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.870587 28691 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:55.872742 28698 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:55.879703 28668 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:55.880702 28382 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:55.880777 28668 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.882004 28382 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.883736 28337 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.884526 28337 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:55.863418 28481 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.886150 28696 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:55.887084 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.887287 28631 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.887639 28668 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.887364 28041 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:55.888362 28481 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.868855 28611 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.889077 28041 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.890239 28289 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.891116 28289 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.856531 28460 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.892381 28611 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.894066 28289 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:55.906224 28041 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.911754 28289 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:55.912482 28289 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.916393 28630 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:07:55.919127 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.898046 28619 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:55.920751 28619 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.923239 28382 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.910349 28616 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.897336 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.895057 28560 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.879582 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.885447 28337 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.896311 28460 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.931607 28289 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.917461 28630 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.944036 21975 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:07:55.949245 28041 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:55.950440 28041 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:55.950835 28041 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:55.950806 28560 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:55.952435 28041 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.953622 28560 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.953918 28041 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:55.959196 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:55.962317 28337 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:55.887118 28696 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.968662 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:07:55.968901 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 62960.2us
I20260709 13:07:55.970646 28696 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:55.965261 21974 raft_consensus.cc:2410] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:07:55.966660 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.972330 22551 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:55.973281 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.967576 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:55.974395 22555 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:55.971554 21901 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:07:55.975809 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.976405 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:55.976732 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.977111 22554 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.978775 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:55.979527 22549 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:07:55.987914 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:55.993191 28524 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:55.997375 28628 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:55.996223 28569 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:55.998638 28569 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.001374 28569 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:07:56.001511 28584 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.013s	sys 0.001s
I20260709 13:07:55.954854 28630 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.003795 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:07:56.002046 28584 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.013s	sys 0.001s
I20260709 13:07:56.007280 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:56.007886 22549 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:55.996441 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:55.996155 28188 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.027387 21909 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:56.028198 28512 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:56.028330 28469 consensus_meta.cc:287] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.980s	user 0.005s	sys 0.015s
I20260709 13:07:56.030246 28469 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.033964 21901 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:56.034142 28614 raft_consensus.cc:993] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:07:56.035236 28614 raft_consensus.cc:1081] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Signalling peer 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:07:56.035950 21902 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:07:56.039520 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 54827.6us
I20260709 13:07:56.032352 28469 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.040778 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:56.044956 22554 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:07:56.037786 28337 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.048780 28337 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.019497 28188 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.052981 28188 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:56.058411 28562 raft_consensus.cc:993] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: : Instructing follower ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:07:56.058768 28628 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.059176 28562 raft_consensus.cc:1081] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Signalling peer ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:07:56.064517 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:56.068926 28188 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.069769 28575 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:56.069700 28188 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.070727 22519 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:56.044212 28458 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.071965 21979 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:56.065951 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:56.078620 28575 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.099660 28575 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:56.100865 21903 raft_consensus.cc:1240] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:07:56.102304 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:56.103179 28524 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:56.103638 28524 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.104101 28524 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:56.105393 28318 consensus_meta.cc:287] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.842s	user 0.006s	sys 0.011s
I20260709 13:07:56.065912 28508 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:56.106628 21976 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:56.106765 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:56.107553 21906 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.110813 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.111706 21907 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:56.111765 28508 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:07:56.112277 28508 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:56.112668 28508 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:56.112793 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:56.115422 22547 raft_consensus.cc:2410] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:07:56.115737 21901 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:56.115931 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.116618 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.116969 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.118076 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:56.116706 21904 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:56.114023 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.119395 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.061713 28265 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.117961 21901 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:56.132297 21907 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:56.136768 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.137593 21901 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:56.105821 28318 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:56.143409 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.143882 28430 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:56.144187 21829 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:56.148253 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 77808.1us
I20260709 13:07:56.140509 21975 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:07:56.160526 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.161950 28619 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.122635 28458 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.166975 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:56.168684 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.133656 28289 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.140002 28497 raft_consensus.cc:2804] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:56.186065 28497 raft_consensus.cc:697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:56.172950 28504 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:56.186841 28504 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:56.187408 28504 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:56.187475 28497 consensus_queue.cc:237] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.171828 21907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:55690
I20260709 13:07:56.190382 28289 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.190886 21907 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:56.191411 21907 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:56.192976 28289 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.154680 28430 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:56.195250 28430 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.196487 28430 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:56.198956 28686 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.554s	user 0.002s	sys 0.002s
I20260709 13:07:56.200237 21826 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:56.202780 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 956) took 1146 ms. Trace:
I20260709 13:07:56.181327 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:56.178529 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:56.179978 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 43630.9us
I20260709 13:07:56.204725 28289 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:56.183943 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.205582 28607 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:56.181218 28601 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.900s	user 0.010s	sys 0.010s
I20260709 13:07:56.206674 28318 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.207984 21830 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:56.212481 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2754) took 1095 ms. Trace:
I20260709 13:07:56.212878 21976 rpcz_store.cc:276] 0709 13:07:55.117144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.117717 (+   573us) service_pool.cc:224] Handling call
0709 13:07:56.212296 (+1094579us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54003f9b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:56.212407 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2271851904}
W20260709 13:07:56.216800 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.217792 28671 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.233913 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.204661 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:56.247991 21906 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:56.203228 22548 rpcz_store.cc:276] 0709 13:07:55.056197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.057073 (+   876us) service_pool.cc:224] Handling call
0709 13:07:56.202338 (+1145265us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400313dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:56.202560 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249858432}
W20260709 13:07:56.260522 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 102438us
W20260709 13:07:56.285794 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 87438.7us
W20260709 13:07:56.290560 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 67029.1us
I20260709 13:07:56.292514 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:56.206717 28601 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.301477 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.228356 28671 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.303961 21979 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:56.295051 28458 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:56.287249 21978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:07:56.312090 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.309006 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2724) took 1188 ms. Trace:
I20260709 13:07:56.313511 21874 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:56.303076 28318 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:56.309741 28041 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:07:56.309392 21978 raft_consensus.cc:606] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.319957 21978 raft_consensus.cc:614] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:56.313524 21830 rpcz_store.cc:276] 0709 13:07:55.119095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.119192 (+    97us) service_pool.cc:224] Handling call
0709 13:07:56.300425 (+1181233us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540009d654. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:56.307615 (+  7190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500907136}
I20260709 13:07:56.323786 28479 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:56.324254 28479 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.324673 28479 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:56.326311 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.309562 28289 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:07:56.329316 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.330273 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.330713 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.331007 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.331311 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.331432 21828 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:07:56.331997 28625 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.332695 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.332667 28625 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.334146 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:56.334656 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 130153us
I20260709 13:07:56.335886 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:56.337098 21907 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.338102 21903 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
W20260709 13:07:56.338477 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.339062 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:56.340359 21874 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.342116 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.342350 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.344316 21874 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.321849 28469 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:56.337304 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:56.346331 28630 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:56.349327 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.349175 28659 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:56.352818 28659 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:56.353809 28659 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.355070 28659 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:56.355437 28671 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.357069 28560 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:56.359378 28188 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.334254 28629 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.362592 28629 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.362927 28601 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.349737 28469 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.363808 28469 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:56.363911 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:56.364780 28629 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.365164 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.319356 28318 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:56.367278 28318 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:56.370385 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:56.322458 28696 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.050s
I20260709 13:07:56.374133 21825 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:07:56.375277 28041 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:56.375653 28041 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:56.364792 21980 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:56.393484 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.393862 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.394482 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:56.349676 28458 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.407605 28575 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.408013 28458 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.409713 28575 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.410424 21976 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:56.411029 28431 tablet_bootstrap.cc:492] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=3 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:56.412035 21906 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:56.412464 28431 tablet_bootstrap.cc:492] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:07:56.347757 28619 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:56.394502 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.455610 28041 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.456881 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.401665 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.458709 21978 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:56.401913 21832 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:07:56.460191 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.461275 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:56.402590 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 58366.1us
I20260709 13:07:56.463495 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.464356 21978 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:56.361536 28524 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.464921 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.465942 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.402839 28625 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.407109 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.466558 28524 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.457998 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.414690 28346 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:56.398435 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.467787 21825 raft_consensus.cc:2393] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:56.420929 28469 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.468593 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.469188 21825 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:07:56.421319 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.469947 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.431973 28653 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:56.469867 28469 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.435091 28562 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.433699 28337 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.436992 21907 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.472147 28562 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.473464 28318 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.438333 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:56.441349 28265 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.442528 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:56.443136 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.407137 28508 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.450542 28563 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.451771 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:56.438334 28601 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:07:56.452628 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:56.495195 22547 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:56.453286 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:56.453680 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:56.497196 22553 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:56.433895 28504 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.454988 28458 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.463610 21874 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.456881 28041 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:56.466920 21831 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:56.470495 28617 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.471011 21979 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:56.437425 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:56.438437 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:56.436035 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.423480 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:56.506266 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 82946.9us
I20260709 13:07:56.475030 28562 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.476822 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.510051 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:56.510861 22547 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:56.406451 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.478338 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:56.478484 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.479764 21978 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:07:56.480075 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.480644 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:56.481757 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:56.482362 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:56.483325 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 146161us
W20260709 13:07:56.483939 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.458089 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:56.416178 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.514150 22554 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 22: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:07:56.491639 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.497467 22548 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:56.490028 28584 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:56.490726 28431 ts_tablet_manager.cc:1403] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 2.931s	user 0.048s	sys 0.029s
I20260709 13:07:56.517400 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:56.517963 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.519263 21974 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:56.520422 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:56.518790 28469 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:07:56.530334 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.528834 21830 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:56.530870 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:56.534297 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:56.534677 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:56.537016 28713 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:56.533731 22549 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
W20260709 13:07:56.538337 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 95266.3us
I20260709 13:07:56.510437 28337 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:56.539574 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:56.539772 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.542202 21828 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:56.538024 21834 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:56.543210 28607 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:56.543704 28607 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:56.543756 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 80256us
I20260709 13:07:56.544174 28607 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:56.540402 28619 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:56.544610 21874 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.544831 28619 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.545233 28619 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.537976 28458 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:56.546494 28458 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.546793 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.547211 21827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa"
dest_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:40638
I20260709 13:07:56.547101 28431 raft_consensus.cc:359] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:56.547847 21827 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:56.548043 28431 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:07:56.504490 28563 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:56.562960 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.546887 28458 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.563057 28431 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:56.548905 28628 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:56.555977 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.564543 28628 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:56.564941 28628 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.565307 28628 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:56.560491 28584 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:56.559464 28289 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.560061 21799 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:56.566715 28289 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.568941 28289 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.548244 21827 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.569870 28584 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:56.514806 28617 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.571272 28318 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.570412 28584 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:56.572031 28348 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:56.572666 28348 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.572968 28584 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.574321 21983 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:56.557862 28607 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:56.575764 21983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2755) took 1430 ms (client timeout 1706 ms). Trace:
I20260709 13:07:56.576304 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.549901 21981 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 24. Current term is 25. Ops: []
I20260709 13:07:56.558909 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.578863 21832 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:56.580497 21825 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:56.578130 21827 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:56.587711 21983 rpcz_store.cc:269] 0709 13:07:55.145883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.146008 (+   125us) service_pool.cc:224] Handling call
0709 13:07:56.575576 (+1429568us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54003fa554. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:56.575716 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3199021824}
I20260709 13:07:56.595084 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.596128 28469 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:56.596835 28265 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:56.598794 28469 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:56.599862 28469 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.602885 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:56.604863 22553 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:07:56.605638 22547 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:56.541772 28337 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:56.541194 28524 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:56.607339 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.608536 28504 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:56.619648 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:56.608815 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 64318.8us
I20260709 13:07:56.609238 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:56.601934 28560 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:56.578474 28562 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:56.623795 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:56.614389 28524 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.624032 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:56.559238 28630 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.621209 21830 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:56.591223 28617 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:56.631821 21982 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:07:56.623435 21834 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:56.563333 28479 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.625878 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.633153 21827 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.614190 28337 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:56.613687 28265 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:56.640131 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:56.640085 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:56.638525 28346 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:56.656469 21825 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:56.631914 28524 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.658191 22548 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 17: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:56.639477 28671 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:56.658490 28617 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:56.661828 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:56.669517 21982 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:56.669867 21982 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:56.652611 28508 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.663288 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:56.657011 28348 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.661211 28346 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.686956 28346 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.689292 28619 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.681661 28607 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.624132 28653 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:07:56.682840 21979 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:56.668694 28671 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.683432 28521 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:56.668762 28431 ts_tablet_manager.cc:1434] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.139s	user 0.007s	sys 0.001s
I20260709 13:07:56.659668 28562 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.670529 28617 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.700130 21831 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:56.692859 21982 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.701149 21982 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.675138 28563 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:56.705137 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.713320 21832 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:56.701773 28617 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.714617 21830 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:07:56.716321 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 62813.3us
I20260709 13:07:56.714897 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:56.697446 28671 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:56.699060 28521 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.718312 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.741997 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.725816 28521 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:56.752514 21907 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:07:56.742645 21831 raft_consensus.cc:2376] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19. Re-sending same reply.
I20260709 13:07:56.701994 28458 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:56.764364 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51420.2us
I20260709 13:07:56.766570 28560 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:56.770859 28560 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.772801 28560 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.773232 28560 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:56.773862 21828 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:07:56.774258 28265 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:56.714628 28695 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:56.775949 21983 raft_consensus.cc:1240] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:56.776547 28458 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.777299 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.778388 21979 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:56.789644 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.773716 28560 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.795114 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.799106 21828 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 20: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:56.797053 21982 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:56.798192 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.786546 28289 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:56.806521 21875 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:56.807945 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.811648 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.813696 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.814585 21834 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:56.818879 21904 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:56.820534 28726 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:56.820976 21905 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:07:56.811897 28430 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:56.830484 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:56.834823 28562 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.837366 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.838903 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.840195 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:56.841120 21829 raft_consensus.cc:2410] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:07:56.841805 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.842384 21900 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:56.842602 28696 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.843057 28479 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.843364 28696 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.844601 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:56.845784 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.846410 21909 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:56.846994 28628 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.848425 21900 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:56.849402 28628 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.802632 28265 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:56.851058 28265 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.855123 28696 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:56.857930 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:56.860404 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:56.861106 21909 raft_consensus.cc:2368] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24.
I20260709 13:07:56.860976 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:56.861687 22553 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 23: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:07:56.862313 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.863796 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:56.864367 21909 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.867149 28628 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:56.867666 28628 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:56.868526 28628 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.870085 21993 tablet_copy_service.cc:342] P 3d76b2c4699e43fba10eeb81a91e4913: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-ff74442193fb468c966c8842f014e361 received from {username='slave'} at 127.0.0.1:54264
I20260709 13:07:56.870317 21979 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:56.870641 21993 tablet_copy_service.cc:434] P 3d76b2c4699e43fba10eeb81a91e4913: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-ff74442193fb468c966c8842f014e361 on tablet ff74442193fb468c966c8842f014e361 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:56.872046 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:07:56.872694 28729 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:07:56.873262 21909 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:56.874889 21831 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:07:56.878454 22549 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:56.878872 28337 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.881572 28346 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:56.883755 28289 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.883934 28346 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.884263 28289 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:56.890708 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:56.891341 21982 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.890805 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:56.897812 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:56.897169 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:56.909621 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:56.917129 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:56.918614 21798 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:56.920194 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:56.920868 22547 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:56.922642 22549 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:56.926998 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.830514 28430 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:56.931241 28296 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:56.817027 21723 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 15 to 17, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 17 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:56.949935 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:07:56.932004 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 122262us
I20260709 13:07:56.931918 28681 consensus_queue.cc:1059] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:56.932636 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.918501 28696 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:56.934613 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:56.953450 21979 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:56.925354 28479 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:56.938464 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:56.940140 28619 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.954896 28659 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:07:56.958511 28659 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:07:56.958868 28659 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:56.959674 28659 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.960844 28659 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:07:56.925165 28713 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:07:56.913318 28605 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:56.942787 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:56.944550 21982 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:56.931314 28497 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:56.956287 28696 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:56.965260 22549 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:56.962790 22555 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 14 LEARNER]: Advancing to term 16
I20260709 13:07:56.881556 28337 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:56.962086 28560 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:56.941437 28430 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:56.938038 28671 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:56.979393 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 309793us
I20260709 13:07:56.955181 28296 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:56.967695 28605 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.984654 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:56.954984 28601 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:07:56.985364 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:56.988984 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:56.990470 22551 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 23: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:56.992377 21907 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.991037 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:07:56.999696 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.967865 28504 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:07:56.986779 28630 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:56.990499 28605 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:57.025251 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.020458 28713 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:07:57.040256 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 69249.9us
I20260709 13:07:57.022120 28430 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:57.038718 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:57.047736 22551 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:57.061213 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.069631 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:57.074371 28521 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.076709 28521 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:57.083691 22550 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:57.084488 21832 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:07:57.018980 28617 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.019361 28629 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:07:57.090829 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.095393 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:57.100589 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:07:57.104940 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.124217 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.131491 21907 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:57.134351 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.135802 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.067885 28713 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:57.138391 28041 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:57.079102 28508 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.140820 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:57.092080 28497 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:57.137975 28607 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:57.147363 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:57.148258 28508 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:57.154913 28731 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:07:57.156796 28365 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:57.042433 28296 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.167752 28713 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.171365 28664 raft_consensus.cc:3055] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:57.139396 28625 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:57.175675 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.195148 21906 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:57.175995 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.187911 22555 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:57.188665 21907 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:57.137782 28479 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:57.171938 28289 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.042328 28696 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.205472 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:57.206355 21905 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:57.207433 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.208976 21906 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:07:57.204587 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:57.212467 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:57.213828 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:57.188889 28619 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:57.192634 28497 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:57.219043 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.220516 28289 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:57.221419 21906 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:07:57.230207 21903 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:57.229027 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:57.229584 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 91367.7us
I20260709 13:07:57.234419 22547 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:07:57.193259 28664 raft_consensus.cc:740] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:57.193734 28365 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:57.237988 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:57.239693 28605 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.240140 21906 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:07:57.217547 28524 consensus_meta.cc:287] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.002s
I20260709 13:07:57.212046 28671 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:57.247810 21949 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:57.252971 21874 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.256832 21904 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:57.210500 28681 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:07:57.240952 28625 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:57.246795 28584 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:57.271049 28563 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:07:57.295284 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 97551.1us
I20260709 13:07:57.284972 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:57.245919 28497 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:57.273304 28469 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:57.286144 28741 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.282968 28617 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:57.286440 28584 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:57.255663 28524 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:57.326104 21875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.030s
W20260709 13:07:57.326545 21875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.006s	sys 0.030s
I20260709 13:07:57.327212 28625 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.327080 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 520592us
I20260709 13:07:57.248364 28619 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:57.307956 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:57.327761 28625 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.333526 28625 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:57.324069 28584 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.283923 28560 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:07:57.300444 28563 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:57.348140 22551 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:07:57.349653 21909 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:57.323899 28562 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.362690 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 118827us
W20260709 13:07:57.365599 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 128489us
I20260709 13:07:57.366784 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.353556 28665 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:57.298833 28664 consensus_queue.cc:260] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.372933 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.373337 21980 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:57.337163 28741 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.383272 21909 raft_consensus.cc:1275] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:57.368697 28265 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:57.396476 22520 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:57.398361 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:57.399010 21826 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:57.403795 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:57.371762 28665 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:57.414960 21826 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:57.359992 28562 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.426712 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:57.411303 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:57.428700 21830 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.429654 21834 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 22: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:07:57.430528 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.433557 28508 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:57.434975 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:57.394347 28563 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.436755 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:57.437049 28734 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:57.437316 21834 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.437623 28734 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:57.389418 28504 consensus_queue.cc:1059] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:07:57.395169 28265 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:57.414186 28617 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.413869 28664 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:57.452006 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 89773.6us
I20260709 13:07:57.453572 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.461107 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:57.461202 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:57.460453 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:57.462462 21831 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:57.464589 28737 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:07:57.465555 28740 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:07:57.467787 28619 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:57.469358 28562 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:57.470053 28562 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:57.424708 28758 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:07:57.475385 28741 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:57.476333 28524 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:57.369129 28497 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.484192 21834 raft_consensus.cc:2468] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:57.358692 28365 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.424250 28607 consensus_queue.cc:1059] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:07:57.460341 28738 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:07:57.447988 28734 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:57.506529 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53042.5us
I20260709 13:07:57.507390 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:57.513306 28607 raft_consensus.cc:3055] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:57.513787 28607 raft_consensus.cc:740] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:57.514492 28752 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:57.514884 28607 consensus_queue.cc:260] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:57.516409 28745 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:07:57.516463 28607 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.517623 28265 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.518886 28265 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:57.513542 28751 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:07:57.509253 28671 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:57.450825 28617 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.562366 28665 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.603698 21831 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:57.567216 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.550884 21723 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.510694 28458 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:07:57.617471 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.614863 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47730.2us
I20260709 13:07:57.615453 28758 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.616025 28616 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:57.538954 28524 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:07:57.551735 28671 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:57.633741 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.637475 28665 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:57.635823 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3099) took 1082 ms. Trace:
I20260709 13:07:57.648222 21948 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.632942 28616 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:57.635679 28671 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:57.632951 28619 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:57.642524 21833 rpcz_store.cc:276] 0709 13:07:56.553822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.603982 (+ 50160us) service_pool.cc:224] Handling call
0709 13:07:56.609177 (+  5195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.623628 (+ 14451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.623657 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.641343 (+ 17686us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.043725 (+402382us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:57.043780 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.043864 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.635543 (+591679us) raft_consensus.cc:1685] finished
0709 13:07:57.635576 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.635751 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10862,"raft.queue_time_us":15186,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":9156,"thread_start_us":373951,"threads_started":1,"wal-append.queue_time_us":550770}
W20260709 13:07:57.653329 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 283730us
W20260709 13:07:57.650323 28430 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.001s
I20260709 13:07:57.633104 28758 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.658733 21832 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:07:57.656450 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 214120us
I20260709 13:07:57.653936 28616 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:57.673764 21875 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:07:57.674959 21799 leader_election.cc:400] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24.
I20260709 13:07:57.675294 21799 leader_election.cc:403] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
W20260709 13:07:57.657871 28732 log.cc:927] Time spent T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:07:57.686576 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:57.688304 28757 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.688845 28757 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.689723 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:57.691854 28734 raft_consensus.cc:2804] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:07:57.688335 21873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.021s	sys 0.011s
W20260709 13:07:57.702751 21873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.021s	sys 0.012s
W20260709 13:07:57.703263 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 1.10037e+06us
W20260709 13:07:57.704313 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.704183 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.674661 28469 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:57.712139 28617 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:57.712107 28469 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.713546 28438 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:57.657708 28619 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.714285 28758 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:57.718521 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:57.720362 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:57.723410 21974 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:57.691018 28757 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:57.707432 28734 raft_consensus.cc:697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:57.707899 28713 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24.
I20260709 13:07:57.706751 28760 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:57.720294 28469 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:57.785878 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:07:57.786485 28742 log.cc:927] Time spent T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.318s	user 0.002s	sys 0.000s
W20260709 13:07:57.787907 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.790441 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.781872 28771 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:57.718874 28619 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:57.798240 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:57.710014 28560 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:57.721395 28739 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:57.777781 28628 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.718062 28665 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:07:57.793781 21874 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.799966 28760 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:57.807291 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.810364 28521 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:07:57.811225 21725 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 129) took 22516 ms (client timeout 15000 ms). Trace:
I20260709 13:07:57.817610 28458 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:57.818418 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:07:57.818344 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 111341us
I20260709 13:07:57.819401 28734 consensus_queue.cc:237] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.637269 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:57.806417 28469 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:57.831815 21830 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:57.846880 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:57.845996 28521 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:57.851713 21723 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 12 to 21. New cstate: current_term: 21 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:57.848574 28758 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:57.854900 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:57.824849 28628 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.857617 28458 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:57.858518 28458 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.858930 28628 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:57.861310 28365 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:57.861967 28365 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:57.862320 28617 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:07:57.864040 28584 consensus_meta.cc:287] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.001s
I20260709 13:07:57.864593 28584 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.829695 28760 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:57.856884 21981 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:57.867906 28671 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.869844 28671 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:57.870353 21979 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:57.872766 28616 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.826546 28560 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:57.874603 28758 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:57.875705 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:57.875218 28560 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.877815 28617 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:07:57.847404 28619 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:57.864034 28562 raft_consensus.cc:3055] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:57.878772 28562 raft_consensus.cc:740] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:57.880118 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:57.879897 28562 consensus_queue.cc:260] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.881017 28562 raft_consensus.cc:3060] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.878728 28619 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:57.882510 28619 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:57.884982 28469 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:57.885571 28469 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.853497 21723 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.840821 28265 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:57.891191 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:57.891916 22553 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 21: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:07:57.893064 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49278.3us
I20260709 13:07:57.894099 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:57.894764 22553 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:57.896759 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:57.897475 22553 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:57.894021 21723 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 12 to 15, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 15 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:57.899291 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:57.901424 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:57.911237 22555 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
W20260709 13:07:57.915292 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 108064us
I20260709 13:07:57.917695 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.908103 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.897799 28521 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.923926 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.924381 22553 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:57.930802 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.932883 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:57.932091 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:57.943006 28584 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:57.944545 28785 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:57.930707 28758 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:57.930567 28747 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:57.950291 28763 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:57.950876 28763 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:57.951866 28763 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:07:57.952440 28616 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:57.953166 28747 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:57.926196 28524 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:57.954615 28524 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.956581 28524 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:57.957043 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:57.889950 28619 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:57.962203 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 134176us
I20260709 13:07:57.962915 28616 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:57.963121 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:57.963478 28616 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:57.964388 28616 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:57.961918 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:57.958482 21873 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.970897 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:57.973403 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:57.974220 21831 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:57.976351 21827 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:57.976830 21826 raft_consensus.cc:1240] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 19. Current term is 20. Ops: [15.12-19.14]
I20260709 13:07:57.977339 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:57.978039 21832 raft_consensus.cc:2393] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 24: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:57.977929 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.978546 21902 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:57.978875 28664 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:57.978674 28469 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:57.981406 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.987792 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.988834 21907 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:07:57.990738 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:57.930796 28265 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:58.000078 28747 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:58.000097 28628 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:58.000566 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:58.006191 21907 raft_consensus.cc:2410] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:07:57.979401 28664 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.008670 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.009230 21903 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:58.009717 21978 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:58.000752 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:57.996057 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:58.003324 21901 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:57.957082 28524 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:58.004400 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.016435 21906 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:58.016474 21830 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:07:58.005132 21904 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:58.006844 21905 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:07:58.001557 21723 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 11 to 19, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 19 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:58.015079 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.015740 21900 raft_consensus.cc:2393] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:58.015776 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:58.020316 28041 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:57.994974 28785 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:58.036157 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.036530 21906 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:58.036813 21907 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:58.019750 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:58.019618 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:58.022452 28041 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.037947 28041 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:58.023368 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:58.025767 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:07:58.027184 28733 log.cc:927] Time spent T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.396s	user 0.001s	sys 0.000s
I20260709 13:07:58.027693 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:58.028326 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.030372 28701 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:07:58.031709 28469 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:58.034962 28629 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:58.043346 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:58.047896 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:58.049384 21900 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:07:58.060544 28041 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.016078 28524 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.068989 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:58.073836 28041 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:58.075884 21907 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:58.079908 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:58.080582 21830 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:58.047888 28785 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:07:58.084372 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 58674.8us
I20260709 13:07:58.050312 28629 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.059628 28671 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.063203 28479 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:58.088004 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:58.071919 28524 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:58.097325 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:58.035941 28497 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:07:58.043368 28318 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:58.109112 21830 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:07:58.072101 28265 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:58.111573 21832 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:58.110495 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:58.082760 28521 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:58.050371 28584 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:07:58.109174 28760 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.117797 28773 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:58.118639 28607 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:58.119062 28607 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.119444 28607 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:58.119657 28760 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:58.120244 28760 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.120669 28760 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:58.122697 28786 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:58.122911 21981 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:58.094074 28629 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.088486 28785 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.125396 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.126892 21978 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:58.085902 28734 raft_consensus.cc:2764] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:07:58.128681 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.128067 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:58.138563 28748 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.629s	user 0.000s	sys 0.003s
I20260709 13:07:58.138831 28619 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:58.132056 21723 catalog_manager.cc:5697] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.142442 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.143945 21904 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: [17.10-19.11]
I20260709 13:07:58.132333 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.153582 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:58.109720 28458 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:58.147670 28766 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:58.112414 28479 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:58.181964 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.128902 28438 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.141466 21723 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.124632 28763 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:58.153622 28773 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:58.200625 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.124302 28265 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.189489 28713 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:58.216043 21903 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:58.188798 28659 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:58.191437 28619 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:58.190078 28766 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:07:58.221669 28563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.004s	sys 0.015s
W20260709 13:07:58.224856 28774 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.534s	user 0.002s	sys 0.000s
I20260709 13:07:58.278330 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:58.210973 28458 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:58.218251 28713 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:07:58.236202 28750 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.865s	user 0.000s	sys 0.007s
I20260709 13:07:58.249768 28562 consensus_queue.cc:1048] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:58.255892 28767 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:58.260385 28659 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.262962 28760 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:58.284256 28607 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.286393 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.287017 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.288563 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.342190 22548 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:58.342744 21906 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:58.289234 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:58.291042 28790 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:07:58.291044 28605 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:58.266680 21723 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 13 to 19, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 19 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.296341 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:07:58.348937 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 46499.7us
I20260709 13:07:58.215831 28773 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:07:58.231794 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.211066 28763 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.208297 28438 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.228477 28664 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:58.321098 28734 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:58.341866 28767 consensus_queue.cc:1243] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:07:58.274739 28619 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:58.271661 28563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.004s	sys 0.015s
I20260709 13:07:58.348548 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:58.354341 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:58.354470 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:58.370190 21830 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.363072 28773 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.365259 28438 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:58.344887 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55755.9us
I20260709 13:07:58.360435 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:58.376323 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:58.361482 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:58.377736 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:58.380543 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:58.370077 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:58.381971 21832 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:57.842981 21725 rpcz_store.cc:269] 0709 13:07:35.294818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.295119 (+   301us) service_pool.cc:224] Handling call
0709 13:07:57.810963 (+22515844us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:55.034724 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:55.196458 (+161734us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:55.198926 (+  2468us) write_op.cc:435] Acquired schema lock
0709 13:07:55.203444 (+  4518us) tablet.cc:662] Decoding operations
0709 13:07:55.277869 (+ 74425us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:55.277935 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:55.277968 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:07:55.278589 (+   621us) tablet.cc:701] Row locks acquired
0709 13:07:55.278610 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:55.278759 (+   149us) write_op.cc:270] Start()
0709 13:07:55.278875 (+   116us) write_op.cc:276] Timestamp: P: 1783602475278714 usec, L: 0
0709 13:07:55.278897 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:55.284467 (+  5570us) log.cc:844] Serialized 2452 byte log entry
0709 13:07:55.645187 (+360720us) op_driver.cc:464] REPLICATION: finished
0709 13:07:55.739491 (+ 94304us) write_op.cc:301] APPLY: starting
0709 13:07:55.739569 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:55.746213 (+  6644us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:55.746331 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:55.901139 (+154808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:55.901683 (+   544us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:07:55.905672 (+  3989us) write_op.cc:312] APPLY: finished
0709 13:07:55.906345 (+   673us) log.cc:844] Serialized 65 byte log entry
0709 13:07:55.955133 (+ 48788us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:55.984315 (+ 29182us) write_op.cc:454] Released schema lock
0709 13:07:55.984381 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:55.985207 (+   826us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:55.985247 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":156213,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":81778,"apply.run_cpu_time_us":11099,"apply.run_wall_time_us":245568,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":523136,"prepare.run_cpu_time_us":13825,"prepare.run_wall_time_us":286275,"raft.queue_time_us":86680,"raft.run_cpu_time_us":7072,"raft.run_wall_time_us":233427,"replication_time_us":308105,"thread_start_us":526202,"threads_started":4,"wal-append.queue_time_us":27984,"wal-append.run_cpu_time_us":4881,"wal-append.run_wall_time_us":1605625}]]}
I20260709 13:07:58.398656 28762 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:07:58.370112 21906 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:58.399237 28762 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.401328 28762 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:58.370690 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:58.372220 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.349565 28747 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:58.386230 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3105) took 1486 ms. Trace:
I20260709 13:07:58.385957 28664 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:58.386361 28784 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:58.386842 28469 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:58.403894 21828 rpcz_store.cc:276] 0709 13:07:56.887738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.908193 (+ 20455us) service_pool.cc:224] Handling call
0709 13:07:56.908511 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.912661 (+  4150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.912702 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.922235 (+  9533us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.095985 (+173750us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:57.096036 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.096121 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.235832 (+1139711us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b2400120bd8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf3009d 00007fb75eb6210e 00007fb75eb7988c 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221
0709 13:07:58.367343 (+131511us) raft_consensus.cc:1685] finished
0709 13:07:58.367366 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.373922 (+  6556us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25060,"raft.queue_time_us":4673,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6198,"spinlock_wait_cycles":29505792,"thread_start_us":141258,"threads_started":1,"wal-append.queue_time_us":369420}
I20260709 13:07:58.405144 28659 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:07:58.405532 28664 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:58.332891 28479 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.406543 28664 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.408480 28763 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:58.387288 28741 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:58.375733 28767 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:07:58.386981 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.412029 21830 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:07:58.414942 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:58.425355 21834 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
W20260709 13:07:58.416679 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 217099us
I20260709 13:07:58.418058 21901 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:58.403906 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:58.375231 28758 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:58.420311 28563 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:58.433276 21982 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:07:58.443425 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:07:58.445731 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 91821.6us
I20260709 13:07:58.448276 22548 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:58.452409 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.454530 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.470908 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:58.427515 28747 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:58.371374 28734 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.479369 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:58.457099 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:58.475026 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.435783 28265 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:58.456197 21832 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:07:58.482520 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.485709 21978 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:58.481158 21833 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:07:58.477169 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:58.486835 22552 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:07:58.487550 21982 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:58.489570 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 179192us
I20260709 13:07:58.424197 28625 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:07:58.498963 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.499109 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.471249 28771 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.500514 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.503271 21980 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:07:58.439201 28802 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:07:58.505093 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:58.408960 28713 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.450075 28763 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:07:58.416173 28458 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.509920 21908 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:07:58.445297 28438 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:07:58.512995 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:58.512661 28796 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:07:58.582857 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.474395 28755 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:07:58.509502 28625 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:58.493096 28521 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:07:58.510627 28762 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:58.606813 28809 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:58.607838 28795 log.cc:927] Time spent T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 13:07:58.608574 28799 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:07:58.609258 28797 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:07:58.612501 28607 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:58.624993 22552 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 16 LEARNER]: Advancing to term 18
I20260709 13:07:58.611675 28734 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:58.613214 28755 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:58.605997 28625 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:58.625123 28524 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.511564 28296 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 13:07:58.510141 28771 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.620836 28762 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:58.654459 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 144919us
I20260709 13:07:58.656796 21829 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:58.654486 22552 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:58.660020 21833 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:07:58.661265 28664 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:58.668520 21983 raft_consensus.cc:2368] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22.
W20260709 13:07:58.672122 28671 consensus_meta.cc:287] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:07:58.672542 28671 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:58.623226 28785 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.655823 28762 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.672435 21723 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.695084 22552 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:58.698089 28625 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.699518 28625 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:58.703866 28605 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:58.707012 28804 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.711938 21902 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:58.630142 28809 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.673290 28803 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:07:58.716930 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:58.721027 28607 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:07:58.723582 28805 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
I20260709 13:07:58.731550 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:58.732370 28348 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:58.732844 28348 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:58.734120 28458 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:58.735554 28607 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:58.736835 28607 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:07:58.741652 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 298320us
I20260709 13:07:58.742936 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:58.745340 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:58.747246 28584 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:58.733954 28348 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.752375 28348 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.747689 28584 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:58.766419 28584 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.767728 28584 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:58.707576 28804 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.771265 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.771646 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.777442 21832 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:07:58.782501 21832 pending_rounds.cc:85] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 8
I20260709 13:07:58.777905 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:58.786758 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.787127 21826 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:58.787854 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.787977 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.788940 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.789253 21826 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:58.790174 28785 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:58.790643 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.790961 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.776919 28823 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:58.782719 21832 pending_rounds.cc:107] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:07:58.791806 28766 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.792630 21832 raft_consensus.cc:2889] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:58.792855 28629 consensus_meta.cc:287] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.002s
I20260709 13:07:58.793180 28766 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.793306 28629 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.791946 28823 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.794486 28823 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.795544 28804 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:58.797981 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.801329 28629 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:58.798430 28681 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:58.798908 28757 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:58.802243 28619 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:58.802335 28296 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:58.802915 28798 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:58.803669 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:58.798528 28713 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:58.806325 21834 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:58.806620 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:58.806874 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:58.807458 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:07:58.791699 28628 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.783s	user 0.007s	sys 0.012s
I20260709 13:07:58.838591 21825 raft_consensus.cc:2368] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20.
I20260709 13:07:58.854647 28798 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:58.838951 28628 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:58.855186 28798 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:58.859611 28560 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.860062 28560 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.860880 21875 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:58.861591 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.862138 21909 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:58.864967 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:58.865715 21906 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 16: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:58.862030 28560 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:58.862820 21908 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:58.872171 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:58.854888 28524 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:58.872772 28823 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.873934 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.874513 21908 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.875312 28743 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:58.875676 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:58.876510 28619 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:58.875358 21909 raft_consensus.cc:2468] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:07:58.808284 28806 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:58.878286 28806 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:58.879073 21909 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:58.879235 28806 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:58.880455 21900 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:58.869580 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:07:58.884032 21905 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.886389 21723 catalog_manager.cc:5697] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.888528 21723 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 13 to 16, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 16 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:58.816949 28296 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.902555 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:58.917395 21905 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:07:58.926088 28619 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:58.927053 28619 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:58.929128 21718 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:58.898550 28296 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.906088 28628 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:07:58.913925 21908 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:07:58.939453 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:58.898578 28811 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:07:58.906548 28560 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:58.979358 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:58.941771 28758 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:58.978704 28773 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.989517 28773 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:58.992215 28773 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:59.025954 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 46670.7us
I20260709 13:07:58.982496 28831 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.046433 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:59.048956 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:59.049703 22553 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:59.044718 21834 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:59.045288 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:58.995214 28318 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:59.051179 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:59.051316 28318 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:59.052305 28318 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:59.053615 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:59.054235 21977 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:07:59.054286 28809 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:59.052313 21829 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:59.062687 21825 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:58.890146 21723 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index -1 to 10, term changed from 11 to 13, VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 13 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:58.993999 28628 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:59.093230 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:07:59.093966 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:59.097518 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 101641us
I20260709 13:07:59.098264 22520 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:59.043023 28584 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.100797 21826 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:07:59.086364 28560 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:59.112375 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:59.117094 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:07:59.122305 21982 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24. Ops: [21.12-23.13]
I20260709 13:07:59.043077 28813 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 13:07:59.128049 21977 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:59.130250 28318 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:59.102355 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:59.099411 28695 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.169354 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 52340.8us
I20260709 13:07:59.173696 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:07:59.120213 22553 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:59.169502 21979 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:07:59.170186 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 68285.3us
I20260709 13:07:59.175726 22551 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:59.112856 28773 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.179491 22547 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:07:59.183890 22547 pending_rounds.cc:85] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 14
I20260709 13:07:59.184177 22547 pending_rounds.cc:107] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:07:59.184432 22547 raft_consensus.cc:2889] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.138201 28812 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.203998 21798 leader_election.cc:400] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22.
W20260709 13:07:59.206136 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 103867us
I20260709 13:07:59.211958 22551 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:07:59.213910 28818 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:07:59.215591 28743 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:07:59.216322 28820 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:07:59.216629 28743 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.217134 28665 consensus_queue.cc:1059] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:59.113386 28798 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:59.178853 28629 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:59.220882 21948 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:59.220570 21977 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:59.108979 28584 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.247473 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:07:59.218768 28743 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:59.222332 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:59.206357 28777 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:59.253826 21975 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:07:59.219327 28617 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.227025 28822 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 13:07:59.218115 28836 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:07:59.268467 22547 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:59.267221 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:59.253216 21948 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:07:59.105124 28831 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.278302 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:07:59.284363 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:59.288443 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:07:59.290868 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 83743.9us
I20260709 13:07:59.296036 21875 leader_election.cc:400] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20.
I20260709 13:07:59.296350 21875 leader_election.cc:403] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:07:59.209170 28734 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:59.297122 28560 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20.
I20260709 13:07:59.267841 28813 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:59.208045 28762 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.301067 28665 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:59.183707 28695 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.250524 28629 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:07:59.305963 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:59.207419 28773 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.321720 21975 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 25: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:07:59.331552 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:07:59.295630 28265 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:59.303447 28605 raft_consensus.cc:2804] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:59.342625 21833 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:59.270891 28617 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:59.294545 28758 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:07:59.323598 28629 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:59.351382 22549 raft_consensus.cc:1275] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:59.352425 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:59.354779 21901 raft_consensus.cc:2410] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
W20260709 13:07:59.355288 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 48519.2us
W20260709 13:07:59.356281 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.337237 28760 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.353266 21908 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:07:59.314370 28560 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:07:59.348688 28734 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:59.310762 28671 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:07:59.366444 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:59.369634 21902 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:07:59.339962 28763 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:07:59.348374 28767 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.375174 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:59.350349 28605 raft_consensus.cc:697] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:07:59.377943 28348 consensus_meta.cc:287] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.625s	user 0.012s	sys 0.001s
W20260709 13:07:59.386075 28713 consensus_meta.cc:287] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.001s
W20260709 13:07:59.393051 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.364234 28458 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:07:59.249783 21723 catalog_manager.cc:5697] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 13 to 15, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 15 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:07:59.365343 28760 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:59.390204 28837 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:07:59.393838 28828 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:59.384263 28767 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.403949 28828 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:59.371809 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76480.8us
I20260709 13:07:59.399399 28829 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.399205 28826 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:59.419400 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:59.402555 28847 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.402376 28584 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:59.423473 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:07:59.396620 28653 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:07:59.425549 28829 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.431707 21974 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:07:59.432960 21828 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:07:59.414680 28828 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:59.448748 28767 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:07:59.449790 28695 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:59.406574 28809 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:07:59.428645 28763 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:07:59.460901 28773 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:59.462355 28605 consensus_queue.cc:237] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:59.465365 28617 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:59.409049 28521 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:07:59.467032 28521 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:59.467466 28521 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:59.432699 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:59.438843 28831 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:07:59.439589 28841 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:07:59.442397 28560 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.443177 28762 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:59.434098 28847 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.458783 21723 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index -1 to 9, term changed from 12 to 14, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to <none>, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 14 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:07:59.474236 21977 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:07:59.490197 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.477586 28847 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:59.494410 28348 raft_consensus.cc:1064] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:07:59.473644 28560 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.496347 21833 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:07:59.479547 28771 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:59.500551 28560 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:59.496807 28348 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.501565 28829 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:07:59.501164 21834 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:07:59.475718 28812 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:59.506822 21830 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:07:59.509042 21827 raft_consensus.cc:1275] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:59.515522 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:59.519971 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:59.523172 21830 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:59.526603 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:59.527937 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:59.528697 28713 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:59.529582 28664 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:59.529963 28664 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.541085 28265 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:59.545132 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:07:59.541687 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 145145us
I20260709 13:07:59.541775 28826 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:59.545454 28664 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:59.545802 21827 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:07:59.546505 21830 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:07:59.546682 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:59.569428 21826 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:07:59.468431 28521 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:59.540220 28619 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.585666 28806 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:59.575377 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:07:59.594760 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:07:59.568209 28296 consensus_meta.cc:287] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.634s	user 0.002s	sys 0.007s
I20260709 13:07:59.539810 28629 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:59.647181 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:07:59.657729 21983 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
I20260709 13:07:59.648115 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:07:59.544920 28813 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:07:59.664755 21826 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:59.601888 28826 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:59.603883 28695 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:59.681432 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:59.596874 28619 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.683940 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:59.684530 21826 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:07:59.687975 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:07:59.664352 28601 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:59.601555 28296 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:59.691802 28695 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:07:59.673602 28826 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.656494 28831 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:07:59.680823 28823 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:07:59.718096 21831 raft_consensus.cc:2368] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21.
I20260709 13:07:59.698706 28601 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.709406 28826 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:59.726244 28601 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:59.759341 28767 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:07:59.713519 28828 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:59.798964 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.813697 21974 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:59.840250 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2759) took 1067 ms. Trace:
I20260709 13:07:59.840808 21831 rpcz_store.cc:276] 0709 13:07:58.772370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.772464 (+    94us) service_pool.cc:224] Handling call
0709 13:07:59.823929 (+1051465us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540017f2d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:07:59.840171 (+ 16242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037677440}
I20260709 13:07:59.803574 28665 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.849162 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.857865 21904 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:59.858229 21904 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:07:59.858878 21904 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.863490 21904 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:59.865090 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.866092 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:59.868340 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:07:59.859679 28265 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.861835 28858 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:59.801505 28767 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:07:59.850543 28773 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:07:59.987602 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.790745 28695 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:07:59.796732 28813 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:07:59.946992 21799 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.514s (SENT) [suppressed 9 similar messages]
I20260709 13:08:00.023729 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:00.044816 21981 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:00.054687 21900 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:00.056757 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:00.057509 21909 raft_consensus.cc:2393] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:07:59.871709 28659 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:00.030857 28562 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.034337 28760 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:00.036927 28798 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:00.072917 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:07:59.992779 28734 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:07:59.848182 28438 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:08:00.058876 28629 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:00.086138 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:00.060385 21907 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:07:59.993952 28853 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:07:59.861932 28665 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:00.067207 21825 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:00.094359 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:00.068719 21901 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24. Ops: [21.12-23.13]
W20260709 13:08:00.042057 28855 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:08:00.073781 22553 raft_consensus.cc:2368] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22.
I20260709 13:08:00.075416 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:00.040975 21831 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:00.059362 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:00.083686 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:00.027189 28681 raft_consensus.cc:3055] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:00.041636 28773 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:00.006330 28265 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:00.153258 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:00.081689 28560 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:00.103570 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:00.071080 28659 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:00.133773 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:00.084213 28619 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:00.084295 28734 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:00.160897 28265 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:00.161419 28560 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:00.188247 28560 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:00.162575 21905 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:00.163228 28877 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.189409 28877 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:00.192008 28877 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:00.073165 28562 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:00.181414 21828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 3140) took 1711 ms (client timeout 2036 ms). Trace:
W20260709 13:08:00.269055 21828 rpcz_store.cc:269] 0709 13:07:58.470595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.470701 (+   106us) service_pool.cc:224] Handling call
0709 13:08:00.181227 (+1710526us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540011e254. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:00.181353 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139207424}
I20260709 13:08:00.270552 21901 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:00.173974 21908 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:08:00.304025 22518 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.371887 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:00.373206 21901 raft_consensus.cc:2410] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:08:00.399809 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.426579 28872 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 13:08:00.422051 22549 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:08:00.120460 28681 raft_consensus.cc:740] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:08:00.454756 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 507761us
W20260709 13:08:00.466490 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 370892us
I20260709 13:08:00.471581 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:00.472393 21975 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:00.473291 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:00.481616 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.483153 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:00.509780 22552 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
W20260709 13:08:00.427743 28860 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.298s	user 0.000s	sys 0.000s
W20260709 13:08:00.556497 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.579115 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 97123.4us
I20260709 13:08:00.270200 28619 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:00.668654 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:00.670331 21900 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:00.670568 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3164) took 1391 ms. Trace:
I20260709 13:08:00.428961 28828 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:00.434365 28877 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:00.690800 21904 consensus_meta.cc:287] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.827s	user 0.009s	sys 0.001s
I20260709 13:08:00.695129 21904 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:00.695662 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:00.695947 21832 rpcz_store.cc:276] 0709 13:07:59.279379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.279632 (+   253us) service_pool.cc:224] Handling call
0709 13:07:59.279903 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.297970 (+ 18067us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:07:59.315876 (+ 17906us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.525205 (+209329us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.538878 (+ 13673us) log.cc:844] Serialized 26 byte log entry
0709 13:07:59.539179 (+   301us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:59.539227 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.539309 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.817905 (+278596us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b1800340cc0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:08:00.019568 (+201663us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b1800340cc0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:08:00.579251 (+559683us) raft_consensus.cc:1685] finished
0709 13:08:00.579283 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.670493 (+ 91210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56995,"prepare.queue_time_us":19111,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":16155,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":13613,"spinlock_wait_cycles":52913792,"thread_start_us":170476,"threads_started":1,"wal-append.queue_time_us":182261}
I20260709 13:08:00.707938 22550 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:00.714336 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:00.727216 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:00.728010 22553 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:08:00.684927 28812 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:08:00.702730 28874 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:08:00.742587 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:00.750706 22555 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 25.
I20260709 13:08:00.750718 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:00.759543 21976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.020s	sys 0.076s
W20260709 13:08:00.764531 21976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.020s	sys 0.076s
I20260709 13:08:00.702941 28802 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.725737 28785 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:08:00.732414 28560 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.716706 28563 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:08:00.750299 28813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.076s	sys 0.096s
I20260709 13:08:00.723187 28828 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:00.732146 28849 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:00.688987 28619 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:00.733469 28760 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:08:00.816682 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 119671us
I20260709 13:08:00.763897 28812 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.715783 28877 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:00.800005 28813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.076s	sys 0.097s
I20260709 13:08:00.807819 28563 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:00.740212 28681 consensus_queue.cc:260] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:00.828961 28812 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:00.899489 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2774) took 1332 ms. Trace:
I20260709 13:08:00.900065 21830 rpcz_store.cc:276] 0709 13:07:59.566841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.568518 (+  1677us) service_pool.cc:224] Handling call
0709 13:07:59.568795 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.569088 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:07:59.700509 (+131421us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.365630 (+665121us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.366103 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.366275 (+   172us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:00.366308 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.366373 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.899195 (+532822us) raft_consensus.cc:1685] finished
0709 13:08:00.899225 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.899411 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200,"prepare.queue_time_us":233740,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":168816,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":233987,"thread_start_us":740841,"threads_started":3,"wal-append.queue_time_us":369524}
I20260709 13:08:00.787215 28802 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:00.800064 28560 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:00.821373 28828 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:00.842373 28760 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:00.910223 28665 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:00.910653 28681 raft_consensus.cc:3060] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:01.003019 28895 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:08:00.836472 28849 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:01.009914 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.858408 28265 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:01.019338 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 276837us
W20260709 13:08:01.057608 21981 consensus_meta.cc:287] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.969s	user 0.009s	sys 0.002s
I20260709 13:08:01.010844 28896 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.144668 21981 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:01.146920 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 3028) took 1063 ms. Trace:
I20260709 13:08:01.147321 21981 rpcz_store.cc:276] 0709 13:08:00.083604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.085842 (+  2238us) service_pool.cc:224] Handling call
0709 13:08:01.146854 (+1061012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:01.125370 28695 raft_consensus.cc:1064] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:08:01.080438 28318 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.084019 28773 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.126309 28665 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.153399 28734 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:01.176644 28826 consensus_meta.cc:287] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.395s	user 0.004s	sys 0.007s
W20260709 13:08:01.165921 28601 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.368s	user 0.011s	sys 0.000s
I20260709 13:08:01.149423 28763 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.143500 28899 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.084309 28265 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.155097 28659 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.204363 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 904) took 1536 ms. Trace:
W20260709 13:08:01.224551 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.228140 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.189898 28877 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.192690 28563 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.193004 28734 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:08:01.234076 21978 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 3014) took 1811 ms (client timeout 1757 ms). Trace:
I20260709 13:08:01.192941 28908 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.180488 28318 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.222725 28562 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:01.243533 21978 rpcz_store.cc:269] 0709 13:07:59.423111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.423213 (+   102us) service_pool.cc:224] Handling call
0709 13:08:01.233878 (+1810665us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540001f4d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:01.234010 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3360640768}
I20260709 13:08:01.229331 28619 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.182862 28665 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.258558 21980 raft_consensus.cc:1240] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24. Ops: [21.12-23.13]
W20260709 13:08:01.244380 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 346978us
I20260709 13:08:01.207059 28601 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.234906 21976 rpcz_store.cc:276] 0709 13:07:59.656606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.659278 (+  2672us) service_pool.cc:224] Handling call
0709 13:07:59.677557 (+ 18279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.677758 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:00.117222 (+439464us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.191829 (+1074607us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:01.192089 (+   260us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:01.192248 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.192454 (+   206us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.192809 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":899,"prepare.queue_time_us":388534,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4631,"raft.queue_time_us":147856,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":59732,"thread_start_us":1491266,"threads_started":3}
I20260709 13:08:01.228883 28889 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.205489 28763 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.247465 28734 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.265033 28904 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.302820 28915 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:01.303532 28849 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.305330 28601 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.305616 28763 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.251247 28877 consensus_queue.cc:1048] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:08:01.306334 28763 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:01.306991 28763 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.308663 28910 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.309459 28763 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.307401 28877 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:01.280504 28734 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:01.283428 28605 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:08:01.280361 28897 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:08:01.152321 28896 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.197176 28826 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.303428 28915 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.284888 28802 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:01.223968 28899 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:01.314749 22554 raft_consensus.cc:2393] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 24: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:01.309213 28910 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.268435 28908 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.280401 28619 consensus_queue.cc:1048] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
W20260709 13:08:01.326812 28907 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:08:01.334391 28886 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 13:08:01.310133 28763 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:01.344543 28849 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.364434 28878 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 13:08:01.359777 28882 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:08:01.343580 28828 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.310318 28900 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.312743 28760 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:01.284296 28889 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.318456 28888 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.285495 28901 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:08:01.409878 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.414638 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.373750 28898 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:01.310581 28877 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.420711 21976 raft_consensus.cc:2410] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:08:01.404770 28560 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.431815 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.432245 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:08:01.415225 28880 log.cc:927] Time spent T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:08:01.427902 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:01.437534 21976 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:01.428108 28919 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.429141 21981 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:01.429649 28910 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.313194 28605 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.422847 28913 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.432580 21978 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:08:01.429490 28898 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.458827 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2959) took 1075 ms. Trace:
I20260709 13:08:01.405922 28763 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:01.431054 28664 consensus_meta.cc:287] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.853s	user 0.008s	sys 0.006s
I20260709 13:08:01.405824 28849 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.337139 28904 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:08:01.444548 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.414856 28900 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.459259 21908 rpcz_store.cc:276] 0709 13:08:00.370075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.370262 (+   187us) service_pool.cc:224] Handling call
0709 13:08:00.370706 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.400931 (+ 30225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.400976 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.401564 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.972600 (+571036us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:00.972642 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.972711 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.445244 (+472533us) raft_consensus.cc:1685] finished
0709 13:08:01.445268 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.445386 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48443,"raft.queue_time_us":48097,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":20385,"thread_start_us":256323,"threads_started":1,"wal-append.queue_time_us":602563}
W20260709 13:08:01.465509 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 187160us
I20260709 13:08:01.443832 28917 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:01.445360 28265 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:01.468482 22550 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.023s	sys 0.024s
W20260709 13:08:01.496521 22550 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.023s	sys 0.024s
W20260709 13:08:01.498858 21947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.011s	sys 0.011s
W20260709 13:08:01.517920 21947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.012s	sys 0.012s
I20260709 13:08:01.519518 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:01.520185 21798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.012s	sys 0.009s
W20260709 13:08:01.520799 21798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.012s	sys 0.009s
I20260709 13:08:01.520462 22547 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 22: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:01.424782 28888 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.468138 28560 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.471657 28318 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.468816 28619 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.462515 28913 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.529497 28760 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:01.529663 28927 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.530541 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:01.530583 28918 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.468500 28910 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:08:01.550397 28918 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.530248 28898 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.532191 21798 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:01.443080 28919 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.551721 28896 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.552117 28734 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.553166 28919 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.552490 28918 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:01.556389 28875 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.547s	user 0.002s	sys 0.000s
I20260709 13:08:01.557080 28734 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.559008 28903 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.559614 28767 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.559547 28903 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.561757 28903 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.562704 28933 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.563133 28890 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.752s	user 0.001s	sys 0.001s
I20260709 13:08:01.563220 28933 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.564977 28763 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.449234 28695 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.466841 28664 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:01.529696 28912 log.cc:927] Time spent T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:08:01.529803 28922 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
W20260709 13:08:01.571300 22552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 888) took 1480 ms (client timeout 1758 ms). Trace:
I20260709 13:08:01.569108 22553 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:08:01.567611 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 887) took 1483 ms. Trace:
I20260709 13:08:01.549852 22546 raft_consensus.cc:2410] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
W20260709 13:08:01.549669 22549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 884) took 1479 ms (client timeout 1841 ms). Trace:
W20260709 13:08:01.660704 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 128575us
W20260709 13:08:01.576449 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 117047us
I20260709 13:08:01.549324 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2775) took 1950 ms. Trace:
W20260709 13:08:01.660840 22549 rpcz_store.cc:269] 0709 13:08:00.070428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.070558 (+   130us) service_pool.cc:224] Handling call
0709 13:08:01.549508 (+1478950us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400680e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:01.549615 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740937472}
W20260709 13:08:01.577361 22552 rpcz_store.cc:269] 0709 13:08:00.091328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.091529 (+   201us) service_pool.cc:224] Handling call
0709 13:08:01.571116 (+1479587us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400638154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:01.571232 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817684352}
I20260709 13:08:01.667234 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:01.578084 21976 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:08:01.577611 22554 rpcz_store.cc:276] 0709 13:08:00.084463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.084587 (+   124us) service_pool.cc:224] Handling call
0709 13:08:01.567360 (+1482773us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002debd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:01.567543 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804633472}
I20260709 13:08:01.667423 21829 rpcz_store.cc:276] 0709 13:07:59.598812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.598964 (+   152us) service_pool.cc:224] Handling call
0709 13:07:59.599388 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.656676 (+ 57288us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:07:59.846982 (+190306us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.375096 (+528114us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.375661 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.375816 (+   155us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:00.375860 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.375945 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.549129 (+1173184us) raft_consensus.cc:1685] finished
0709 13:08:01.549147 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.549267 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":256514,"prepare.queue_time_us":169148,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":403032,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":79420,"thread_start_us":393042,"threads_started":2,"wal-append.queue_time_us":1171957}
I20260709 13:08:01.677419 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:01.678946 21826 raft_consensus.cc:2393] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:01.541432 28926 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.567804 28889 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:01.680433 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.579236 28713 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.682327 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.574054 28877 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.683377 28938 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:08:01.542109 28812 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.001s
I20260709 13:08:01.571307 28849 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:01.542943 28605 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.539382 28899 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.569639 28915 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.574321 28826 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.542259 28665 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.545322 28904 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:01.681582 28918 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.540657 28900 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.666854 28937 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.676410 28896 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:01.549010 28908 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.574296 28933 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:01.676669 28767 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.544809 28913 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:01.678937 28919 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.572018 28560 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.712416 28849 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:01.547727 28888 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.667296 28763 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:08:01.542888 28619 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.546445 28927 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.723495 21976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:01.716570 28903 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.723893 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3169) took 2063 ms. Trace:
I20260709 13:08:01.717890 28605 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:01.695448 28713 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.729220 21976 raft_consensus.cc:606] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:01.691466 28926 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.731002 21827 rpcz_store.cc:276] 0709 13:07:59.660417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.791853 (+131436us) service_pool.cc:224] Handling call
0709 13:07:59.805342 (+ 13489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.774392 (+969050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.774459 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.775200 (+   741us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.182566 (+407366us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:01.182611 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.552864 (+370253us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54000e9cd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:01.552928 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.719554 (+166626us) raft_consensus.cc:1685] finished
0709 13:08:01.719581 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.723820 (+  4239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223790,"raft.queue_time_us":527644,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":22574,"spinlock_wait_cycles":805273472,"thread_start_us":723625,"threads_started":2,"wal-append.queue_time_us":523566}
I20260709 13:08:01.709663 28812 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.736624 28605 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:01.738339 28814 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.726423 28913 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.738843 28605 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.739147 28913 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.741251 28913 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:01.742280 28923 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.742800 28923 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.744374 28926 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:01.727178 28896 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:01.744774 28923 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.745327 28934 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.745466 28896 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.745858 28934 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.733729 28936 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.727531 28919 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.747913 28936 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.725179 28767 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.759915 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.760784 28767 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.749940 28919 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.721724 28918 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.709846 28938 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.769786 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.767251 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.770115 21975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:01.770918 21975 raft_consensus.cc:606] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:01.775287 28521 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:01.775642 28927 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.786502 28713 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.786897 28812 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.789594 28619 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.738897 28848 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:01.757807 28936 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.809141 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.734926 28903 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:01.769724 28798 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 1.690s	user 0.007s	sys 0.007s
I20260709 13:08:01.793395 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2939) took 1745 ms. Trace:
I20260709 13:08:01.795987 28619 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:01.797066 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.797694 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.797801 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.798514 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.802794 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.803898 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:01.799068 28849 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.738843 28814 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.728870 28937 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:01.813525 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:01.791010 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 123892us
I20260709 13:08:01.804016 28918 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.915886 28899 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.916512 28899 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.919345 28757 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.919839 28757 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.921386 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 986) took 1226 ms. Trace:
I20260709 13:08:01.924338 28757 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.925786 21905 rpcz_store.cc:276] 0709 13:08:00.047486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.047834 (+   348us) service_pool.cc:224] Handling call
0709 13:08:00.048181 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.188923 (+140742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.793154 (+1604231us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002f4ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:01.793336 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262261120}
I20260709 13:08:01.926810 28934 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:01.889348 28936 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:08:01.830750 21875 connection.cc:256] RPC call timeout handler was delayed by -1.6587693899999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:08:01.814555 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 135926us
I20260709 13:08:01.930761 21982 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:01.936810 28901 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.937429 28901 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:01.931450 21826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 3168) took 2271 ms (client timeout 2939 ms). Trace:
W20260709 13:08:01.823661 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.933215 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 1006) took 1166 ms. Trace:
I20260709 13:08:01.940368 21977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:01.940863 21948 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:01.944478 21977 raft_consensus.cc:606] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
W20260709 13:08:01.940438 21826 rpcz_store.cc:269] 0709 13:07:59.660202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.687689 (+ 27487us) service_pool.cc:224] Handling call
0709 13:08:01.931245 (+2243556us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001d79d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:01.931370 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4562055936}
I20260709 13:08:01.941286 22551 rpcz_store.cc:276] 0709 13:08:00.766610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.768360 (+  1750us) service_pool.cc:224] Handling call
0709 13:08:00.794692 (+ 26332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.084019 (+289327us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:08:01.265355 (+181336us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.378679 (+113324us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:01.378748 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:01.378814 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.932968 (+554154us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54005e01d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:01.933015 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.933140 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":413837,"raft.queue_time_us":3508,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11817,"spinlock_wait_cycles":698634752,"thread_start_us":228342,"threads_started":2,"wal-append.queue_time_us":232467}
I20260709 13:08:01.921759 22555 rpcz_store.cc:276] 0709 13:08:00.695305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.695400 (+    95us) service_pool.cc:224] Handling call
0709 13:08:01.921203 (+1225803us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b54002508d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:01.921329 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125179648}
W20260709 13:08:01.940158 21875 connection.cc:256] RPC call timeout handler was delayed by -1.5451906920000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:08:01.948592 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:01.949173 28826 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.951275 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:01.951459 28826 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.951952 28560 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.954210 28826 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.936043 28936 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.890129 28923 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.958904 28923 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:01.960579 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:01.960958 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:01.962565 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:01.963213 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:01.958377 28885 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.774094 28664 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:01.770036 28919 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:01.964803 28885 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.965322 28919 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.952759 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:01.967293 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.968528 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:01.959887 28903 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:01.820493 28812 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.138s
I20260709 13:08:01.949174 28849 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:01.969051 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:01.974030 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:01.969944 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:01.974752 21983 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:01.970227 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:01.970808 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:01.971099 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:01.975947 21905 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
W20260709 13:08:01.880844 28878 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:08:01.976251 21834 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.982780 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:01.819834 28767 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.989864 21974 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:01.989759 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:01.982923 21826 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:01.994069 21834 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:08:01.993778 21982 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:01.995042 21825 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:08:01.971135 28922 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:01.998961 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.002427 21907 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:01.975132 28812 consensus_queue.cc:1243] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:02.000377 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:02.014494 28760 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:02.004060 28926 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:02.015583 28922 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:02.018239 28938 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:02.019486 28607 raft_consensus.cc:993] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:02.005185 28936 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:02.006417 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 1004) took 1273 ms. Trace:
I20260709 13:08:02.020062 28671 raft_consensus.cc:1081] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Signalling peer 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:02.020331 22553 rpcz_store.cc:276] 0709 13:08:00.733099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.757937 (+ 24838us) service_pool.cc:224] Handling call
0709 13:08:01.567968 (+810031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.577460 (+  9492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.006231 (+428771us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54002debd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:02.006364 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861807872}
I20260709 13:08:02.023480 28917 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.023622 21978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edb7f62b920e42349d56d878295176b2"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:02.023995 28917 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:02.024266 21978 raft_consensus.cc:606] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:02.006735 28885 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.007191 28937 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:02.010475 28899 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.031035 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.031695 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.031762 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.038429 21834 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:08:02.034072 21828 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:08:02.040226 21828 pending_rounds.cc:85] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 12
I20260709 13:08:02.040551 21828 pending_rounds.cc:107] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:08:02.040807 21828 raft_consensus.cc:2889] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.041050 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:02.014034 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 439521us
I20260709 13:08:02.043658 28296 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.044148 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.044770 21833 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:08:01.999504 28767 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:02.041710 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.049068 21974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:02.049853 21982 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:02.052346 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.049847 21974 raft_consensus.cc:606] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:02.054749 21974 raft_consensus.cc:614] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:02.059374 28767 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.037868 21830 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:01.813699 28848 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:02.064224 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.064206 28848 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:02.066108 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2961) took 1650 ms. Trace:
I20260709 13:08:02.066599 21901 rpcz_store.cc:276] 0709 13:08:00.416018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.483245 (+ 67227us) service_pool.cc:224] Handling call
0709 13:08:00.673826 (+190581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.876181 (+202355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.876244 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.876305 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:00.876379 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.065878 (+1189499us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002382d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:02.065928 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.066046 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464726272}
I20260709 13:08:01.982867 28619 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:02.068121 28919 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.068658 28952 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:02.069478 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3025) took 2372 ms. Trace:
I20260709 13:08:02.082974 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.072093 28922 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:02.072654 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.084357 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.084725 21982 raft_consensus.cc:2368] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19.
I20260709 13:08:02.085188 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.086229 21977 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:08:02.034476 28849 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:02.075222 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:02.089665 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:02.089852 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.076366 21978 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:02.079641 28847 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:02.080540 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2962) took 1606 ms. Trace:
I20260709 13:08:01.999711 28560 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:02.091301 21902 rpcz_store.cc:276] 0709 13:08:00.474767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.475143 (+   376us) service_pool.cc:224] Handling call
0709 13:08:00.475474 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.835122 (+359648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.835167 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.835221 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:00.835275 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.080284 (+1245009us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54000fbc54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:02.080335 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.080480 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826625920}
I20260709 13:08:02.082911 21980 rpcz_store.cc:276] 0709 13:07:59.697412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.697870 (+   458us) service_pool.cc:224] Handling call
0709 13:07:59.711348 (+ 13478us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.272319 (+1560971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.069210 (+796891us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54003f9154. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:02.069401 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3557617920}
I20260709 13:08:02.097699 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.092734 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.098546 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.090474 21830 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:08:02.101193 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.101799 21833 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:02.103108 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.103909 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.104635 21828 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:02.105399 28318 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:02.106042 28812 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:02.106675 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:02.109006 21979 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:02.107558 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:02.108073 28767 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:02.110438 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.108271 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.111142 21902 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 13.
I20260709 13:08:02.111872 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.106729 28560 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:02.109954 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:02.114048 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.115250 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.115742 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:02.103967 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.098845 21829 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:08:02.098270 21974 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:08:02.116451 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.117959 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.117179 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:02.122431 21831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f"
dest_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:40638
I20260709 13:08:02.123126 21831 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:02.123222 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:02.123528 21831 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:02.124619 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.120291 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.126223 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:02.119716 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.127861 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:02.089619 28892 log.cc:927] Time spent T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.863s	user 0.003s	sys 0.000s
I20260709 13:08:02.129325 22551 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:08:02.129323 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.131847 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:02.132400 22551 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:08:02.137156 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.142656 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.143783 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.089033 28952 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:02.098055 28922 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:02.183059 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.148018 21875 leader_election.cc:400] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21.
W20260709 13:08:02.188551 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 61528.1us
I20260709 13:08:02.184989 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:02.215262 21902 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:08:02.186590 28734 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:02.216820 28560 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.217161 28734 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:02.195238 28619 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.117036 28923 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:02.148540 28901 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.219635 28734 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.200011 21831 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:02.157857 28917 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:02.220546 21833 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:08:02.134800 28767 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:02.222851 28767 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:02.223863 28767 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:02.222014 21831 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.227579 21977 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:08:02.213804 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 65965.9us
I20260709 13:08:02.231456 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:02.158221 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:02.234946 22554 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:08:02.129334 28812 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:08:02.186728 28949 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:08:02.197206 28899 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.251488 21978 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:02.256764 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.257304 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.258206 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.258414 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.258980 21904 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:02.259497 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.260807 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.261780 21905 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:08:02.183195 28831 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:02.265072 21875 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:02.266209 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.266247 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.272869 21901 raft_consensus.cc:2410] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:08:02.239356 28917 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:02.273783 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:02.275120 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:02.267208 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.269505 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.276691 21909 raft_consensus.cc:2410] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:08:02.271049 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:02.271265 21799 connection.cc:256] RPC call timeout handler was delayed by -1.0436848409999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 13:08:02.274981 21798 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:02.282845 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.284107 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:02.285670 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.286475 21904 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:02.287982 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.277243 21900 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:02.240784 28812 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:02.290560 21799 leader_election.cc:400] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22.
I20260709 13:08:02.292179 21799 leader_election.cc:403] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:08:02.293345 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.294099 21900 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:08:02.291390 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:02.296098 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.296128 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:02.296693 21905 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:02.295708 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.297780 21901 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:02.299630 28936 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:02.296703 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:08:02.297809 28951 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 13:08:02.301821 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.265830 28734 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:02.302980 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.272998 28901 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:02.295694 28812 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:02.282917 28885 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.291563 28914 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:02.318781 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:02.290305 28318 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:02.290367 28785 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:02.325682 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.331074 21906 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:08:02.272454 28899 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:02.305150 28877 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:02.300268 28826 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:02.303223 28884 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22.
I20260709 13:08:02.289780 28827 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:02.304158 21904 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:02.282933 28923 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:08:02.302889 28936 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:02.283202 28831 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:02.336009 21900 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:02.461493 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:02.356383 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 81499.8us
I20260709 13:08:02.305313 28734 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:02.356113 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 59477.4us
I20260709 13:08:02.509786 21799 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:08:02.452162 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.471179 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:02.479290 28939 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.714s	user 0.002s	sys 0.000s
I20260709 13:08:02.493530 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:02.512172 21979 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:02.495642 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:02.496373 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:02.497393 22519 leader_election.cc:400] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19.
I20260709 13:08:02.514917 22519 leader_election.cc:403] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:02.330719 28318 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.504325 28814 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:02.466034 21906 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 13.
I20260709 13:08:02.413054 28915 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:02.629477 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:02.462883 28877 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:02.388973 28584 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:02.531430 28826 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:02.651747 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 135978us
W20260709 13:08:02.651608 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 141901us
I20260709 13:08:02.511617 28827 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:02.630625 28619 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:02.464030 28936 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:02.329046 28885 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:02.672544 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 129203us
I20260709 13:08:02.682331 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:02.503899 28831 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:02.646963 28877 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:02.665884 21874 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:02.651561 28922 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:02.684540 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.689482 21825 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:02.647064 28771 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:02.690337 21980 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.017s	sys 0.032s
I20260709 13:08:02.517072 28916 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.146s
I20260709 13:08:02.545554 28318 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:02.726501 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 60703.7us
W20260709 13:08:02.683705 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.661203 28843 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:02.729871 21980 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.017s	sys 0.033s
W20260709 13:08:02.735526 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53359.9us
I20260709 13:08:02.678764 28619 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:02.767040 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.769639 21833 raft_consensus.cc:2410] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:08:02.677357 28952 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:02.776602 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.693020 28915 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:08:02.783979 21902 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 13:08:02.738397 28831 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:08:02.783085 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 44998.2us
I20260709 13:08:02.787850 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:02.788831 21902 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 26.
I20260709 13:08:02.793733 21798 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:02.790038 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.678318 28814 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:08:02.814086 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.838802 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:02.842981 21833 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:02.846513 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:02.847258 21975 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:02.847597 21975 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:02.848481 21975 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:02.849866 21975 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:02.850490 28867 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:02.851717 28867 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:02.740907 28771 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:02.854308 28867 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:02.857470 28919 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.858732 28883 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:02.859268 28883 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:02.796862 28961 log.cc:927] Time spent T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:08:02.856180 28771 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:02.870116 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 374521us
I20260709 13:08:02.802505 28814 consensus_queue.cc:1243] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:02.889124 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:02.894594 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 397376us
I20260709 13:08:02.979290 22519 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:02.874119 21975 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:02.882306 21905 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:08:02.883344 22553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.011s	sys 0.006s
W20260709 13:08:02.981647 22553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.014s	sys 0.009s
I20260709 13:08:02.879822 21908 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:02.801249 28952 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:02.796835 28870 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:02.799191 28923 raft_consensus.cc:2764] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:08:02.800213 28438 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:02.890441 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:02.975273 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:03.002628 21902 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.004438 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:02.976676 21976 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:08:03.006608 21976 pending_rounds.cc:85] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 11
I20260709 13:08:03.006917 21976 pending_rounds.cc:107] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:08:03.007210 21976 raft_consensus.cc:2889] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.986287 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:03.014963 22553 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.858008 28919 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:02.989754 28827 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:02.882957 28956 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.443s	user 0.001s	sys 0.001s
I20260709 13:08:02.992764 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:02.838096 28348 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:03.029829 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:02.992303 21907 pending_rounds.cc:85] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 13
I20260709 13:08:03.030896 21907 pending_rounds.cc:107] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:08:03.031170 21907 raft_consensus.cc:2889] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.035511 21833 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:08:03.036686 21902 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:03.038029 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.030484 21825 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:08:02.990563 28767 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:02.988011 28952 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.013351 28438 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.056787 22553 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:08:03.063108 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.015416 28734 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:03.044616 28901 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.017s	sys 0.039s
I20260709 13:08:02.805976 28826 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:03.075374 21834 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:02.978101 28619 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.013659 28870 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:03.053524 28952 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:03.089946 21979 consensus_meta.cc:287] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.000s
I20260709 13:08:03.091470 21979 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 26.
I20260709 13:08:03.061066 28438 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:03.084384 28811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.018s	sys 0.052s
I20260709 13:08:03.099797 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:08:03.102700 21982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.017s	sys 0.034s
W20260709 13:08:03.103325 21982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.017s	sys 0.035s
I20260709 13:08:03.014837 28915 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:03.103657 21833 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:08:03.108134 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 913) took 1022 ms. Trace:
W20260709 13:08:03.083627 28901 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.017s	sys 0.041s
I20260709 13:08:03.050541 28348 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.129283 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.132795 21825 raft_consensus.cc:2410] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
W20260709 13:08:03.133072 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.126230 21982 rpcz_store.cc:276] 0709 13:08:02.085452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.085612 (+   160us) service_pool.cc:224] Handling call
0709 13:08:02.085842 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.086029 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:08:02.418663 (+332634us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.107824 (+689161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.107873 (+    49us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:03.107928 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.107990 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.108086 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":762887,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":3973,"thread_start_us":973020,"threads_started":2}
I20260709 13:08:03.088415 28969 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:03.100386 28914 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.010s	sys 0.044s
W20260709 13:08:03.124276 28811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.019s	sys 0.053s
W20260709 13:08:03.161269 22521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.026s	sys 0.030s
W20260709 13:08:03.161607 28671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.008s	sys 0.049s
I20260709 13:08:03.131484 28922 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:03.171834 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:03.152943 28958 log.cc:927] Time spent T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
W20260709 13:08:03.174857 22521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.026s	sys 0.031s
I20260709 13:08:03.135917 28901 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:03.131363 28885 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.187994 28348 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.193293 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:03.176306 28671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.008s	sys 0.049s
I20260709 13:08:03.165743 28971 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:03.177438 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.204551 22553 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
W20260709 13:08:03.175074 28914 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.010s	sys 0.045s
W20260709 13:08:03.210175 28965 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:08:03.211054 28870 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:03.216712 28919 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.216773 28922 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:03.218360 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.219231 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:03.206025 28966 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:08:03.227588 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.204648 28971 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:03.227896 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.219441 22548 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:03.228647 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2836) took 1015 ms. Trace:
I20260709 13:08:03.220526 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.229118 21983 rpcz_store.cc:276] 0709 13:08:02.212842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.218995 (+1006153us) service_pool.cc:224] Handling call
0709 13:08:03.228595 (+  9600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.221858 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:03.163378 28969 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.224493 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.246201 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.257835 21982 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 22: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:03.260481 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.265239 21826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2778) took 1317 ms. Trace:
W20260709 13:08:03.245656 28968 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:03.268817 21826 rpcz_store.cc:276] 0709 13:08:01.948073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.948298 (+   225us) service_pool.cc:224] Handling call
0709 13:08:03.265044 (+1316746us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b540011e754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:03.265171 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76036352}
I20260709 13:08:03.269754 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.273254 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 3205) took 1122 ms. Trace:
I20260709 13:08:03.273645 21829 rpcz_store.cc:276] 0709 13:08:02.150428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.269468 (+1119040us) service_pool.cc:224] Handling call
0709 13:08:03.273188 (+  3720us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.222822 28883 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.226953 28922 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:03.203254 28885 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:03.247812 28934 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.295326 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.296185 21983 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:08:03.296597 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3194) took 1183 ms. Trace:
I20260709 13:08:03.246496 28971 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:03.298523 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.299499 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.296983 21827 rpcz_store.cc:276] 0709 13:08:02.113095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.117152 (+  4057us) service_pool.cc:224] Handling call
0709 13:08:02.117423 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.188467 (+ 71044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.188513 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.221728 (+ 33215us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.641565 (+419837us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:02.641610 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.641693 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.296394 (+654701us) raft_consensus.cc:1685] finished
0709 13:08:03.296415 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.296545 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99454,"raft.queue_time_us":71112,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":419478,"threads_started":1,"wal-append.queue_time_us":575968}
I20260709 13:08:03.300508 21983 raft_consensus.cc:2410] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:08:03.271711 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.305932 21982 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
W20260709 13:08:03.225741 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 422893us
I20260709 13:08:03.306998 22548 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEARNER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:03.309674 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.310460 21983 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:08:03.310714 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:03.312769 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.313055 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.315099 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.316531 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.319444 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.320825 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.321532 21829 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:03.322512 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.324015 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.327211 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.320647 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.331248 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:03.301380 28934 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.330972 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:03.332367 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.333127 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.335470 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.335527 21799 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:03.340929 21949 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:03.345014 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.346084 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:03.346760 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.347085 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.348510 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.355705 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.356688 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.357736 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.352869 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:03.359217 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:03.363785 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:03.303387 28885 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.386382 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:03.387104 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.389384 28974 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:03.389636 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:03.389928 28974 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 26 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:03.390825 28974 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:03.317271 28814 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 13:08:03.391956 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.345336 28348 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:08:03.403993 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 63157.8us
I20260709 13:08:03.353631 28945 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:03.301664 28901 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.415184 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 3050) took 1313 ms. Trace:
W20260709 13:08:03.402588 28812 consensus_meta.cc:287] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.070s	user 0.012s	sys 0.006s
I20260709 13:08:03.391809 28755 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:03.396291 28771 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:03.416594 21977 rpcz_store.cc:276] 0709 13:08:02.102131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.103760 (+  1629us) service_pool.cc:224] Handling call
0709 13:08:03.414973 (+1311213us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400225bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:03.415114 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252454144}
I20260709 13:08:03.403502 28348 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:03.392668 28671 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:03.426353 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 535947us
I20260709 13:08:03.418557 28905 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:03.460538 21875 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:03.433431 28348 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:03.425717 28755 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:03.431391 28883 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:03.491828 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:03.493075 21875 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:03.494537 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:08:03.504558 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.452061 28771 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:08:03.467494 28843 consensus_meta.cc:287] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.000s
I20260709 13:08:03.431811 28988 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:08:03.546656 28771 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.429518 28812 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:03.541672 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 47245.8us
I20260709 13:08:03.514778 28755 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:03.513118 28883 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:03.540277 28877 consensus_meta.cc:287] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.799s	user 0.010s	sys 0.001s
I20260709 13:08:03.538141 28734 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:03.539884 28843 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:03.563213 28883 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:03.538604 28919 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:03.513612 28982 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:03.567266 28734 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.538558 28972 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:03.558732 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:08:03.587337 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 405599us
I20260709 13:08:03.591185 21900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2963) took 1330 ms. Trace:
I20260709 13:08:03.591670 21900 rpcz_store.cc:276] 0709 13:08:02.260384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.294845 (+ 34461us) service_pool.cc:224] Handling call
0709 13:08:02.295181 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.464322 (+169141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.590943 (+1126621us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b54002f4ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:03.591115 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93126528}
I20260709 13:08:03.557264 28969 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.587411 28972 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:03.643493 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 84840.1us
I20260709 13:08:03.645723 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:03.587327 28734 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:03.585979 28919 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:08:03.628509 28985 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 13:08:03.630148 28952 consensus_meta.cc:287] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.007s
I20260709 13:08:03.632113 28934 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:03.585763 28877 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:03.628326 28899 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:03.658592 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 293433us
I20260709 13:08:03.643013 28972 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:03.658264 22519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.010s	sys 0.015s
I20260709 13:08:03.655287 28969 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:03.648217 28814 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:03.648475 28849 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:03.655651 28919 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:03.659715 28318 consensus_meta.cc:287] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.879s	user 0.007s	sys 0.004s
W20260709 13:08:03.682067 22519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.010s	sys 0.016s
I20260709 13:08:03.683719 21906 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:03.658399 28995 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:03.654407 28348 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:03.689073 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 709842us
I20260709 13:08:03.695511 22519 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:03.699337 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 301872us
I20260709 13:08:03.706921 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:08:03.709529 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 378584us
I20260709 13:08:03.682963 28969 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:03.716408 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 330073us
I20260709 13:08:03.670554 28952 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.723755 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.719122 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:03.720234 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:03.726058 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:03.728505 21982 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:03.729736 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:03.730679 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.734480 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:03.710880 28885 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.721549 28969 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:03.698627 28318 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.752643 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:03.698221 28814 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:03.766072 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:08:03.768430 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.736717 28681 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:03.767244 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 48553.9us
I20260709 13:08:03.784598 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:03.784971 28993 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:08:03.785264 21825 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:03.791623 28952 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:03.792320 28952 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:08:03.793825 28952 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:03.701960 28849 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:03.764575 28881 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:03.781082 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.800474 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:03.803876 21900 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:08:03.804345 21900 pending_rounds.cc:85] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 15
I20260709 13:08:03.804606 21900 pending_rounds.cc:107] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:08:03.804875 21900 raft_consensus.cc:2889] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.808619 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:03.813076 21948 connection.cc:256] RPC call timeout handler was delayed by -1.8283888050000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:08:03.783037 28934 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:08:03.839135 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:03.840211 21830 raft_consensus.cc:2410] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 25 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:08:03.837565 28348 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.800496 28681 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:03.842729 28681 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.843808 28318 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.844729 28877 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:03.846609 28996 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 13:08:03.855899 28438 consensus_meta.cc:287] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.002s
I20260709 13:08:03.856448 28438 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:03.857571 28831 consensus_meta.cc:287] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.056s	user 0.008s	sys 0.002s
W20260709 13:08:03.858886 28936 consensus_meta.cc:287] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 1.162s	user 0.012s	sys 0.000s
I20260709 13:08:03.859313 28438 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.859261 28936 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.861240 28936 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.783416 28819 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:03.779994 28812 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:03.780596 28870 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:03.857985 28831 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19.
I20260709 13:08:03.861517 28755 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.794142 28952 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:03.957096 21949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.020s	sys 0.019s
W20260709 13:08:03.960956 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 160536us
W20260709 13:08:03.865402 28922 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.000s
I20260709 13:08:03.838536 28988 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:03.962132 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:03.969847 21949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.020s	sys 0.019s
W20260709 13:08:03.989845 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 579227us
I20260709 13:08:03.866729 28870 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:03.981801 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.862931 28819 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:04.008047 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 50282.2us
I20260709 13:08:03.871623 28814 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:03.959287 28971 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.000s
W20260709 13:08:03.961658 28826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.016s
I20260709 13:08:04.017079 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3056) took 1221 ms. Trace:
I20260709 13:08:04.009119 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:03.910984 28992 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:03.960969 28881 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:03.869534 28849 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.027753 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:04.051064 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 89044.4us
W20260709 13:08:04.052462 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 454690us
I20260709 13:08:04.017500 21981 rpcz_store.cc:276] 0709 13:08:02.796011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.796143 (+   132us) service_pool.cc:224] Handling call
0709 13:08:02.839236 (+ 43093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.839461 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:02.895730 (+ 56269us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.391424 (+495694us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b18004ae840. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:08:04.016747 (+625323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.016800 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:04.016847 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.016908 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.017021 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27130,"prepare.queue_time_us":127678,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":58912,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5237,"spinlock_wait_cycles":57718656,"thread_start_us":624867,"threads_started":2}
I20260709 13:08:04.055552 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:03.977974 28952 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:03.862679 28969 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:03.987094 28296 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:04.019388 28826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.006s	sys 0.016s
I20260709 13:08:04.029356 21826 raft_consensus.cc:1217] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Deduplicated request from leader. Original: 18.10->[20.11-24.13]   Dedup: 20.11->[22.12-24.13]
I20260709 13:08:04.069329 21826 pending_rounds.cc:85] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 11
I20260709 13:08:04.069633 21826 pending_rounds.cc:107] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:08:03.870090 28883 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.062296 22548 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:04.062146 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:04.062958 21828 raft_consensus.cc:2368] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22.
I20260709 13:08:04.006755 28870 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:03.989293 28988 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:04.069912 21826 raft_consensus.cc:2889] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:04.161037 21832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.004s	sys 0.031s
W20260709 13:08:04.180543 22555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.024s	sys 0.024s
W20260709 13:08:04.180894 22555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.025s	sys 0.024s
I20260709 13:08:04.067384 28438 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:04.005967 28922 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:04.196967 21829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.004s	sys 0.041s
I20260709 13:08:04.198015 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:08:04.203699 21829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.004s	sys 0.041s
I20260709 13:08:04.012789 28905 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:08:04.046398 28915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.000s	sys 0.027s
I20260709 13:08:04.070449 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:04.019789 28971 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.216885 28971 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.208833 21825 raft_consensus.cc:2368] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
I20260709 13:08:04.107462 28988 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:04.227253 21873 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.016s	sys 0.021s
W20260709 13:08:04.227571 21873 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.016s	sys 0.021s
W20260709 13:08:04.227834 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 591735us
I20260709 13:08:04.197769 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3206) took 2039 ms. Trace:
I20260709 13:08:04.233809 21832 rpcz_store.cc:276] 0709 13:08:02.158201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.183807 (+1025606us) service_pool.cc:224] Handling call
0709 13:08:03.184115 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.184303 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:03.660446 (+476143us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.197292 (+536846us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.197371 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:04.197433 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.197537 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.197701 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16725,"prepare.queue_time_us":622673,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"thread_start_us":994031,"threads_started":2}
W20260709 13:08:04.226225 28915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.006s	sys 0.030s
I20260709 13:08:04.205070 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:04.248522 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 433310us
I20260709 13:08:04.065068 29010 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.163s
I20260709 13:08:04.069334 28881 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.268589 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:04.206430 28884 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.338014 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:04.337050 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:08:04.371037 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 300757us
I20260709 13:08:04.371833 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:04.374938 22521 connection.cc:256] RPC call timeout handler was delayed by -1.1923584639999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:08:04.344630 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:04.328462 21979 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:04.169736 28934 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:08:04.298734 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:04.294572 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:04.380029 21829 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:04.232200 28438 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:04.109720 28819 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.158s
I20260709 13:08:04.356612 21825 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:04.365867 28734 consensus_meta.cc:287] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.002s
I20260709 13:08:04.390007 21829 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:04.377475 28681 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.534s	user 0.016s	sys 0.001s
I20260709 13:08:04.371425 28814 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.390822 28972 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.000s
I20260709 13:08:04.379549 28831 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:04.388883 28438 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:04.452021 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 97319.2us
W20260709 13:08:04.445770 29006 log.cc:927] Time spent T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.427s	user 0.001s	sys 0.000s
I20260709 13:08:04.434051 28755 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.451995 28812 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.395586 28734 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.497366 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:04.459990 29016 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:08:04.480851 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:04.389842 28905 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:04.487193 29018 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:08:04.491415 21949 leader_election.cc:400] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22.
I20260709 13:08:04.449338 29032 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:04.506222 29034 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:08:04.506072 29032 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.508329 29032 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.509364 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 947) took 1620 ms. Trace:
I20260709 13:08:04.479105 28438 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:04.446772 28972 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.502915 21949 leader_election.cc:403] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:04.473594 29021 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:04.509764 21907 rpcz_store.cc:276] 0709 13:08:02.889434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.889601 (+   167us) service_pool.cc:224] Handling call
0709 13:08:02.992046 (+102445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:03.305295 (+313249us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4800261e58. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:08:03.442319 (+137024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.454002 (+ 11683us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:03.454660 (+   658us) log.cc:844] Serialized 52 byte log entry
0709 13:08:03.896931 (+442271us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:03.896984 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.897082 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.509054 (+611972us) raft_consensus.cc:1685] finished
0709 13:08:04.509074 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.509302 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158606,"raft.run_cpu_time_us":1040,"raft.run_wall_time_us":117708,"spinlock_wait_cycles":28038400,"thread_start_us":842522,"threads_started":2,"wal-append.queue_time_us":706540}
I20260709 13:08:04.511334 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:04.493777 29012 log.cc:927] Time spent T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:08:04.482306 28814 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.559686 29021 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:04.560675 29011 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
I20260709 13:08:04.498309 28922 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.563174 28814 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:04.565182 28972 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.497596 28883 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.600005 28987 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:04.601320 29017 log.cc:927] Time spent T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:08:04.497926 28969 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:04.573472 28919 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.857s	user 0.014s	sys 0.002s
I20260709 13:08:04.611034 28919 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.613746 28919 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:04.573240 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 50502.8us
I20260709 13:08:04.616181 29046 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:04.619275 21826 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:08:04.619772 29013 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:04.620265 29013 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:04.502770 28819 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.076s
W20260709 13:08:04.567816 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 56224.1us
I20260709 13:08:04.621151 29013 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.578615 22555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 996) took 1683 ms. Trace:
I20260709 13:08:04.625177 29013 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.624348 22555 rpcz_store.cc:276] 0709 13:08:02.895435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.984673 (+ 89238us) service_pool.cc:224] Handling call
0709 13:08:02.985011 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.985364 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:08:03.024206 (+ 38842us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.200679 (+176473us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4800261858. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:08:03.619002 (+418323us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b18004828c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:08:04.491782 (+872780us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:04.492349 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.492500 (+   151us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:04.492545 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.492627 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.578349 (+ 85722us) raft_consensus.cc:1685] finished
0709 13:08:04.578379 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.578545 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32636,"prepare.queue_time_us":38400,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":377348,"raft.run_cpu_time_us":2494,"raft.run_wall_time_us":41805,"spinlock_wait_cycles":19304576,"thread_start_us":824058,"threads_started":2,"wal-append.queue_time_us":1528356}
I20260709 13:08:04.630759 29015 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:08:04.633733 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3064) took 1278 ms. Trace:
I20260709 13:08:04.475638 28681 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.634145 21975 rpcz_store.cc:276] 0709 13:08:03.355651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.355776 (+   125us) service_pool.cc:224] Handling call
0709 13:08:03.356406 (+   630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.356808 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.356845 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.357948 (+  1103us) log.cc:844] Serialized 564 byte log entry
0709 13:08:03.654582 (+296634us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:03.654631 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.654714 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.633551 (+978837us) raft_consensus.cc:1685] finished
0709 13:08:04.633571 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.633683 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":296319,"threads_started":1,"wal-append.queue_time_us":597404}
W20260709 13:08:04.652941 28870 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:08:04.634531 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:04.655264 21826 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:04.656929 21826 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:04.642220 21825 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:08:04.518549 28934 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:04.666939 28934 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:04.667456 28934 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.598348 28881 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:04.599026 29023 log.cc:927] Time spent T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:08:04.621527 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:04.577155 29021 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:04.670897 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49447.9us
I20260709 13:08:04.671715 29038 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.634752 28814 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:08:04.657876 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:04.672298 29038 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:04.672850 29038 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.674559 28814 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:04.675040 28814 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.675472 28814 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:04.676753 21799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.048s	sys 0.068s
W20260709 13:08:04.677074 21799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.048s	sys 0.068s
W20260709 13:08:04.677621 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 622109us
I20260709 13:08:04.678464 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:04.679090 29047 consensus_queue.cc:1059] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:08:04.680109 29047 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:04.680483 29047 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:04.680572 28987 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:04.589107 28734 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.680361 29040 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 9 to 11, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:04.681490 29047 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.682109 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:04.683475 29047 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:04.683780 21979 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:08:04.685748 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:04.686488 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:04.686887 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:04.687021 21981 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:04.687896 28681 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.688468 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:04.689226 21983 raft_consensus.cc:2368] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
I20260709 13:08:04.689226 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:04.689908 21982 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:04.588943 28988 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.691169 21827 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:04.692142 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:04.692787 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:04.692734 22553 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:08:04.693133 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:04.693145 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:04.694417 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:04.694948 22553 raft_consensus.cc:1240] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:08:04.695271 22547 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:08:04.699887 29038 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.701889 29051 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:04.702955 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:04.706396 29038 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.709707 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:04.709558 28883 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:04.710343 22547 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:08:04.710638 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:04.653549 28870 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:04.712852 28952 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.005s
I20260709 13:08:04.713181 28870 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.713266 28952 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.714876 28438 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.715838 21833 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:04.716135 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:04.720098 28934 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.725375 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:04.723304 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:04.728152 22547 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 24.
I20260709 13:08:04.739964 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:04.742324 21799 connection.cc:256] RPC call timeout handler was delayed by -1.8616525149999461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:08:04.743000 21799 connection.cc:256] RPC call timeout handler was delayed by -1.1513809580000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 13:08:04.743307 21799 connection.cc:256] RPC call timeout handler was delayed by -1.1414809579999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:08:04.743593 21799 connection.cc:256] RPC call timeout handler was delayed by -1.0964809580000292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
I20260709 13:08:04.744576 21826 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:04.743866 21799 connection.cc:256] RPC call timeout handler was delayed by -1.0568809579999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
I20260709 13:08:04.747701 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:04.747851 28681 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.749250 28681 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.702111 28988 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.751040 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:04.751010 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:04.759234 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:04.731340 29021 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:04.790390 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:04.763645 22548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 896) took 1453 ms (client timeout 1690 ms). Trace:
W20260709 13:08:04.791440 22548 rpcz_store.cc:269] 0709 13:08:03.310376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.310505 (+   129us) service_pool.cc:224] Handling call
0709 13:08:04.763467 (+1452962us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b5400680e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:04.763576 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296770816}
I20260709 13:08:04.764393 21978 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:08:04.772927 28905 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:04.732396 28767 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:04.777398 29007 raft_consensus.cc:3055] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:04.774499 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3055) took 2669 ms. Trace:
I20260709 13:08:04.747309 28916 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:04.797741 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:04.795722 28904 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.805259 28904 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.807578 28952 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.794788 28894 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.812566 28894 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.813115 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:04.759238 28870 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:04.813722 22555 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.789433 29051 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:04.798300 28843 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:04.819020 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:04.797930 28767 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:04.814391 28916 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.789495 28883 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:08:04.803150 29007 raft_consensus.cc:740] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:04.803882 29039 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.826534 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:04.802482 21980 rpcz_store.cc:276] 0709 13:08:02.105035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.106208 (+  1173us) service_pool.cc:224] Handling call
0709 13:08:02.119081 (+ 12873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.119305 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:02.770928 (+651623us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.178256 (+407328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.178308 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:03.178363 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.178439 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.773633 (+1595194us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b180048f4c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4
0709 13:08:04.774320 (+   687us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54002c8150. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:04.774443 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10793,"prepare.queue_time_us":729800,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":188,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":21753,"spinlock_wait_cycles":32590208,"thread_start_us":996624,"threads_started":2,"wal-append.queue_time_us":647455,"wal-append.run_cpu_time_us":5087,"wal-append.run_wall_time_us":1247649}
I20260709 13:08:04.822685 28915 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:04.828828 28870 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:04.840689 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:04.841089 28870 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:04.841550 28870 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.829118 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:04.816416 28998 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.834745 28681 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.844825 28998 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.835765 28438 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.839905 28934 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:04.847258 28998 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:08:04.850210 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:04.855026 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:04.802749 28905 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.857596 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:04.861016 22555 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:08:04.861856 21825 raft_consensus.cc:1240] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:08:04.861773 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:04.863062 21834 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:08:04.865558 21834 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:04.865990 28619 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:04.856694 29051 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:04.868439 29051 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:04.868814 29051 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:08:04.869845 21909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45494 (request call id 2966) took 2608 ms (client timeout 1891 ms). Trace:
I20260709 13:08:04.871238 21830 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:04.871364 21909 rpcz_store.cc:269] 0709 13:08:02.261198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.287696 (+ 26498us) service_pool.cc:224] Handling call
0709 13:08:04.869604 (+2581908us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54003c9e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:04.869743 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4473757568}
I20260709 13:08:04.877475 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:04.879137 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:04.815524 28988 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:08:04.796846 28814 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.885970 29015 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22.
I20260709 13:08:04.886497 28905 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.882572 28812 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:04.889827 28812 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.890223 28812 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.891352 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 2971) took 2015 ms. Trace:
I20260709 13:08:04.891712 21903 rpcz_store.cc:276] 0709 13:08:02.875632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.875767 (+   135us) service_pool.cc:224] Handling call
0709 13:08:02.984118 (+108351us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:03.332883 (+348765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.332912 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:03.397049 (+ 64137us) log.cc:844] Serialized 78 byte log entry
0709 13:08:03.749360 (+352311us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:03.767644 (+ 18284us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.784476 (+ 16832us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.800576 (+ 16100us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.780473 (+979897us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b1800368260. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef1522 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:08:04.865993 (+ 85520us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b1800368260. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:08:04.890854 (+ 24861us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b1800368260. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:08:04.891024 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.891108 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.891148 (+    40us) raft_consensus.cc:1685] finished
0709 13:08:04.891172 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.891301 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32115,"prepare.queue_time_us":28107,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":109,"raft.queue_time_us":1254199,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":48450,"spinlock_wait_cycles":479524864,"thread_start_us":649921,"threads_started":2,"wal-append.queue_time_us":1154003}
I20260709 13:08:04.880076 29045 consensus_queue.cc:1059] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:08:04.878376 28989 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:04.895321 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:04.895601 22555 raft_consensus.cc:1240] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:04.895430 28989 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:04.896445 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 887360us
I20260709 13:08:04.897738 28904 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.897800 28826 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:04.902333 28814 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:04.902835 28826 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.903702 28994 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:04.904209 28994 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.905618 28826 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.884298 28979 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:04.894865 28785 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:04.900990 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:04.894855 29045 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:04.901634 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:04.902295 28811 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:04.909552 22555 raft_consensus.cc:2393] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:04.912088 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:04.912273 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:04.913033 21909 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:08:04.913507 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:04.915515 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:04.916003 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:04.916560 21902 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:04.917945 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:04.918690 21904 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.918704 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:04.921640 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.921787 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:04.906926 28785 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:04.923425 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:04.926119 21909 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 24: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:04.926225 21908 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:04.924515 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:04.927407 21900 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.931768 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:04.932471 21909 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:04.933517 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:04.934186 21909 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:04.935892 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.907697 28994 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:04.938271 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:04.908344 28894 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.955904 21907 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:08:04.957049 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:04.956935 28870 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.957681 21907 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:04.958454 29051 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.959054 28870 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.942239 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:04.960120 21908 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:04.961257 21908 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 9 to 11, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:04.910370 28811 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:04.940593 21903 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 24.
I20260709 13:08:04.954499 21900 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:04.965152 21904 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:04.908164 29045 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:04.979630 21902 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:04.979744 21909 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:04.980471 21873 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:04.972509 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:04.982713 21901 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:04.929812 28979 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:08:05.030915 28979 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:05.031309 28979 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:05.031247 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.032310 21905 raft_consensus.cc:2468] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:08:05.032490 28979 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.033402 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.033773 28979 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:04.943717 28914 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.034413 28914 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.036580 28914 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:05.037781 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 123743us
I20260709 13:08:05.038362 21901 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:08:05.038730 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.995967 29024 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.607s	user 0.003s	sys 0.003s
I20260709 13:08:04.996760 29045 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:04.997538 21907 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:05.041790 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.042460 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.043128 21907 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:05.011819 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.011490 29007 consensus_queue.cc:260] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.014063 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.015096 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 948) took 1363 ms. Trace:
I20260709 13:08:05.015363 21875 leader_election.cc:400] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
I20260709 13:08:05.047981 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.017167 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.017823 29051 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:04.978724 28811 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.023597 28989 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:05.024587 28916 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:05.025358 28972 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.026438 21831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 928) took 2342 ms (client timeout 1876 ms). Trace:
I20260709 13:08:05.055930 21979 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:08:05.040493 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.048030 21875 leader_election.cc:403] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:08:05.056336 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.057456 21975 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:08:05.016775 29049 log.cc:927] Time spent T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.438s	user 0.034s	sys 0.034s
I20260709 13:08:05.049540 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.049846 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:05.059072 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 43836.6us
I20260709 13:08:05.058703 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.047394 21906 rpcz_store.cc:276] 0709 13:08:03.651281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.651836 (+   555us) service_pool.cc:224] Handling call
0709 13:08:03.652191 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.688419 (+ 36228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.014796 (+1326377us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54002e6dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:05.015022 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71988608}
I20260709 13:08:05.060657 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.061412 21906 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:08:04.982736 22549 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 9 to 11, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:05.052093 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.054497 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:05.056334 21831 rpcz_store.cc:269] 0709 13:08:02.684157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.684283 (+   126us) service_pool.cc:224] Handling call
0709 13:08:05.026228 (+2341945us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001d79d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:05.026358 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3546991872}
I20260709 13:08:05.057618 21907 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:08:05.064369 21900 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:05.066397 21905 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:05.067691 21905 raft_consensus.cc:1275] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:08:05.068800 21905 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:08:05.069859 21905 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:05.053272 28970 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.070240 28972 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.070859 28970 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.074262 29045 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.075037 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 921) took 2581 ms. Trace:
I20260709 13:08:05.075531 21978 rpcz_store.cc:276] 0709 13:08:02.493717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.500604 (+  6887us) service_pool.cc:224] Handling call
0709 13:08:03.415805 (+915201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.794962 (+1379157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.073859 (+278897us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400225bd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:05.074816 (+   957us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400225bd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:05.074970 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5204470016}
I20260709 13:08:05.076424 21900 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:05.059942 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:05.079398 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.080482 21979 raft_consensus.cc:2410] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:08:05.059464 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.064332 21909 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:05.082858 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.086556 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:05.103489 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 43614.6us
I20260709 13:08:05.104439 22520 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:05.051559 28901 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:05.103833 29063 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
I20260709 13:08:05.117509 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.117764 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:08:05.118868 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 59526.4us
I20260709 13:08:05.119737 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:05.108105 29066 log.cc:927] Time spent T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:08:05.122368 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.085978 21983 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:08:05.125177 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.126777 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.130719 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.131482 21975 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:05.133277 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.133659 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.134267 28877 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.133982 21980 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 23: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:05.135385 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.135823 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.136785 21902 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:05.137830 21983 raft_consensus.cc:1240] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:05.053949 28812 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:05.138499 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.112340 28734 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:05.114997 28560 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:05.173677 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47111.2us
I20260709 13:08:05.174624 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.120352 29007 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:05.176872 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.178347 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.170277 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.115219 28831 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:05.143172 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.179659 21982 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:05.135406 28919 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:05.181619 22547 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:05.182014 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.176342 28914 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:05.137991 28974 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:08:05.177335 28899 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:05.186452 28995 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:05.186902 28995 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:05.187309 28995 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.195703 21873 leader_election.cc:400] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
I20260709 13:08:05.140235 28901 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:05.196705 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.176985 28982 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 13:08:05.181133 29063 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:05.203697 28811 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.209607 28767 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.210021 28811 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:05.210681 22553 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:05.211712 28767 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:05.207899 28619 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:05.212381 28619 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.212759 28619 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.213349 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:05.214085 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 210733us
I20260709 13:08:05.216686 28785 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:05.218870 21829 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
W20260709 13:08:05.219022 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 180405us
I20260709 13:08:05.222244 29051 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:05.223308 21833 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:05.226143 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:05.227334 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:05.227874 22552 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:05.228600 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:05.234673 22554 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:05.234800 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.180702 28734 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:05.235327 21826 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:05.182147 28905 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:08:05.243505 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:05.250799 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 48696.3us
W20260709 13:08:05.265750 21948 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.555s (SENT) [suppressed 23 similar messages]
I20260709 13:08:05.261656 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:05.270188 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.270890 21980 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:05.271529 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.272295 21978 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:05.277827 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.278852 21977 raft_consensus.cc:2393] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:05.283432 22552 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 25.
I20260709 13:08:05.284791 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.285091 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.285562 21982 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:05.285840 21981 raft_consensus.cc:2410] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:08:05.286818 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.287559 21798 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:05.288391 21798 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:05.289258 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:05.286021 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.290680 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.284824 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.294661 21983 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:08:05.298398 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:05.292522 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:05.267452 29063 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:05.237178 28824 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:08:05.305203 21873 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:05.273075 28901 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:05.307811 21905 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:05.307870 21826 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:05.308189 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.309486 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.249639 29033 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:08:05.311225 21978 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:05.311477 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.311677 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.314759 21798 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:05.315596 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.316861 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:05.319761 21909 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:05.302788 28952 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:05.274933 28814 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:05.290818 29047 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:08:05.319181 21873 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.307034 28916 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:05.323763 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.306826 28945 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:05.302240 28771 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:05.307317 28894 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:05.328569 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.316452 29063 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:05.324860 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.328860 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.329092 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.325798 28952 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:05.336274 29072 log.cc:927] Time spent T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:08:05.341282 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:05.319653 29051 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:05.348907 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.349085 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.324728 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.314224 29019 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.331941 21832 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:05.351545 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.328860 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.352959 21828 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 24: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:05.333314 21978 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 22: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:05.343014 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.330904 28945 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.321717 28919 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:05.348145 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.316253 28681 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:05.350726 21826 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 20: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:05.356169 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:05.365329 21829 raft_consensus.cc:2393] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:05.329782 28971 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.363780 28945 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.366914 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.367467 21830 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.359483 28916 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:05.372686 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:05.364305 29051 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:05.382938 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.332520 28296 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:05.357774 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:05.315236 28901 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.381608 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.388458 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.382093 21830 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:05.342572 29063 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:05.354837 28811 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.387230 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.396077 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:05.390730 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:05.365753 28914 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:05.355185 28812 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:08:05.400738 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.402549 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.273300 29039 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:08:05.249441 29025 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.150s
I20260709 13:08:05.323392 28734 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.398614 28947 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:05.414047 28901 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:05.421131 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.380666 28952 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:05.345093 28915 consensus_queue.cc:1059] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:08:05.423133 28870 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:05.423558 28870 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:05.424491 28870 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.387007 28560 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:05.426494 28785 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:05.426678 29070 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:05.400218 28990 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:05.402707 29004 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:05.428406 29004 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:05.429529 29004 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.401264 28296 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:05.432452 28296 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.434758 28995 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.436904 28995 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:05.445367 29051 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.447777 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.448693 21981 raft_consensus.cc:2368] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
W20260709 13:08:05.450423 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.405515 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:05.422057 21976 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:08:05.457450 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 116252us
W20260709 13:08:05.463819 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.394369 28771 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:05.470495 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.394255 29063 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:05.362605 29019 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.475394 21834 raft_consensus.cc:2410] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:08:05.470032 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.405519 28914 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:05.479234 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:05.482029 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.480516 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:05.483917 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.484496 21976 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:08:05.488448 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:05.491065 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.465191 28870 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.497932 21975 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 26.
I20260709 13:08:05.498162 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.441938 28619 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.472325 28947 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:05.503583 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:05.507748 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:05.504542 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.465590 28877 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:05.512238 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:05.514118 21828 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:05.486397 28767 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:05.488130 28914 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.511394 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.509547 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.515414 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.517158 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.536273 21976 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 18: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:05.510766 28671 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:05.541126 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.498515 28970 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:05.480166 28771 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.540772 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.541941 21900 raft_consensus.cc:2410] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:08:05.540119 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:05.545969 21828 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:05.514847 28812 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:05.517235 28982 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:05.553504 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.564342 28922 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:05.564746 28922 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:05.489590 28916 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.575457 28945 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.578485 28771 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:05.580108 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.580534 28971 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.581276 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.584081 21909 raft_consensus.cc:1240] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:05.584638 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:05.585237 21827 raft_consensus.cc:2368] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20.
I20260709 13:08:05.585659 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.585748 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.584654 28982 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:05.586567 28982 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:05.587275 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:05.529945 29032 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:05.587775 21904 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:05.590600 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:05.592860 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:05.594605 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.598439 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:05.542456 29015 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.603654 28947 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:05.607385 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.632408 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:05.633780 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.634352 21976 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.636310 21974 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:05.638043 21900 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:05.606665 21798 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:05.645944 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:05.647852 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:05.608557 21981 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 9 to 11, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:05.658352 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 51768.7us
W20260709 13:08:05.607123 29045 consensus_meta.cc:287] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.001s
I20260709 13:08:05.648072 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:05.565678 28922 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.599448 29032 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:05.677570 21907 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:05.601980 28812 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:05.660808 28894 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.662181 29015 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:05.679659 28771 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:05.685393 29032 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.709474 29019 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:05.701079 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.682928 28919 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:05.719841 21904 raft_consensus.cc:2410] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:08:05.689136 28811 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:05.727918 21976 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:05.718622 28922 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:05.717098 28771 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:05.736192 21831 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:05.743352 21826 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:05.730819 28945 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:05.750839 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:05.753094 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.717269 29015 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.739864 28771 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.752804 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:05.758878 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.755003 29083 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:05.748054 28619 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:05.757227 21976 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.761428 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.766127 21909 raft_consensus.cc:2468] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:08:05.770519 28681 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:05.776247 29015 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:05.777369 28914 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.778496 21901 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 18: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:05.778777 22552 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:05.780692 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:05.787859 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:05.790349 28904 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:05.790777 28904 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:05.791134 28904 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:05.792164 21976 raft_consensus.cc:2468] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:05.793375 21976 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:05.794343 29046 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:05.795069 29089 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:05.768255 28905 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:05.796329 28681 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:05.796815 28905 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.797228 28905 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.798367 29079 consensus_queue.cc:1048] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:05.799842 29079 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:05.800819 29079 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:05.801178 29079 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:05.802911 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:05.806923 29013 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:05.807343 29013 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:05.808305 29013 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.809367 29013 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.750968 29019 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:08:05.817036 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:05.829053 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:05.813642 28979 consensus_meta.cc:287] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.766s	user 0.000s	sys 0.007s
I20260709 13:08:05.830757 29084 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:05.820768 29046 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:05.833760 29047 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:05.839852 21948 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:05.802081 29079 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:05.839207 28945 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:05.850782 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:05.846527 28914 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:05.866255 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:05.860608 29047 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:05.851080 29084 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:05.841845 29015 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:08:05.864223 28755 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:05.869524 29084 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:05.849210 29063 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:05.866075 29033 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:05.870054 29047 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:05.878103 29079 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:06.058873 21906 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:05.873360 28811 consensus_queue.cc:1059] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.167s
I20260709 13:08:05.882436 28915 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:08:06.078716 29090 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
W20260709 13:08:06.091168 29092 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:08:06.092459 29093 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:08:06.105284 28982 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.003s
I20260709 13:08:06.115669 29063 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:05.859346 28916 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.212s
W20260709 13:08:06.122005 28870 consensus_meta.cc:287] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.000s
I20260709 13:08:06.240360 21829 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 14.
W20260709 13:08:06.250974 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 411171us
I20260709 13:08:06.082995 28915 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:06.237682 28767 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:06.251784 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:06.126130 28771 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.102154 28904 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.257504 28915 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:06.287492 21980 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:06.239297 28982 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:06.308511 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.264729 28947 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.390578 22549 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:06.364571 29100 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:06.363781 28870 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:06.285389 28767 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.381361 28947 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:06.430251 29099 log.cc:927] Time spent T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:08:06.482120 28947 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:06.485723 28767 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.504107 28767 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.524732 28767 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.401863 28870 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.558008 28870 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.519461 28982 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.559228 28982 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:06.559917 28982 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:06.445895 28905 consensus_meta.cc:287] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.001s
I20260709 13:08:06.564543 28905 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.567287 28905 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:06.517850 28904 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:06.538892 28894 consensus_meta.cc:287] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.000s
I20260709 13:08:06.568804 28894 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:06.569644 21830 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:06.295445 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:06.449054 28771 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.588685 28884 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 10 to 12, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:06.594252 29038 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:06.594671 29038 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:06.595435 29038 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.596400 29038 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.598766 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:06.599359 21979 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:06.600148 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:06.600991 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:06.601758 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:08:06.523671 29032 consensus_meta.cc:287] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.794s	user 0.010s	sys 0.000s
I20260709 13:08:05.881167 21799 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:06.602149 21979 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:06.628961 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:06.603241 29032 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.633563 29032 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:06.634671 21981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.010s	sys 0.002s
W20260709 13:08:06.634837 21827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2820) took 1313 ms (client timeout 1537 ms). Trace:
W20260709 13:08:06.635257 21827 rpcz_store.cc:269] 0709 13:08:05.321873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.321975 (+   102us) service_pool.cc:224] Handling call
0709 13:08:06.634638 (+1312663us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540011e754. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:06.634780 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592228224}
I20260709 13:08:06.635841 28982 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.638559 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:06.640030 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:06.641489 21983 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:06.644564 21983 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20. Ops: []
W20260709 13:08:06.634997 21981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.010s	sys 0.002s
I20260709 13:08:06.644748 21979 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:08:06.646595 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3093) took 1328 ms. Trace:
I20260709 13:08:06.647617 21979 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:08:06.646941 21981 rpcz_store.cc:276] 0709 13:08:05.317881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.607957 (+290076us) service_pool.cc:224] Handling call
0709 13:08:05.608227 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.608425 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:05.763322 (+154897us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.646296 (+882974us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.646355 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:06.646392 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.646455 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.646540 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":801,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":882606,"threads_started":1,"wal-append.queue_time_us":871474}
I20260709 13:08:06.648862 21979 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:06.649026 29038 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:06.606839 29047 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
I20260709 13:08:06.650507 29047 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.652745 29047 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:06.658771 21978 raft_consensus.cc:1240] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:06.658213 21983 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:06.645089 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 958) took 1449 ms. Trace:
I20260709 13:08:06.649096 28972 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.662518 21908 rpcz_store.cc:276] 0709 13:08:05.195642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.195919 (+   277us) service_pool.cc:224] Handling call
0709 13:08:05.196189 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.196374 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:08:05.299135 (+102761us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.300009 (+   874us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.644593 (+1344584us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b180022f120. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75eb94d70 00007fb75eb88293 00007fb75eb7dcea 00007fb75eb7e23a 00007fb75efe8a2a 00007fb75eff80bf 00007fb75eff8038
0709 13:08:06.644788 (+   195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.644831 (+    43us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:06.644876 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.644942 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.645039 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2171,"prepare.queue_time_us":274938,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3400,"raft.queue_time_us":9744,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":6809,"spinlock_wait_cycles":28808960,"thread_start_us":100478,"threads_started":1}
I20260709 13:08:06.664064 22553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60024 (request call id 1022) took 1919 ms. Trace:
I20260709 13:08:06.614897 28438 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:06.665042 28438 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:08:06.665454 21829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52674 (request call id 949) took 1212 ms (client timeout 1577 ms). Trace:
I20260709 13:08:06.665827 28438 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.618993 28811 raft_consensus.cc:3055] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:06.668231 28811 raft_consensus.cc:740] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:06.620520 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 742707us
I20260709 13:08:06.668668 29051 consensus_queue.cc:1059] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:06.668998 28811 consensus_queue.cc:260] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.669628 29051 consensus_queue.cc:1059] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:06.679664 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 2994) took 1455 ms. Trace:
I20260709 13:08:06.680029 21905 rpcz_store.cc:276] 0709 13:08:05.224193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.224306 (+   113us) service_pool.cc:224] Handling call
0709 13:08:05.242938 (+ 18632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.312538 (+ 69600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.679454 (+1366916us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b54002e86d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:06.679614 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148762496}
W20260709 13:08:06.673107 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.611696 28767 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:06.611246 29013 consensus_meta.cc:287] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.003s
I20260709 13:08:06.683112 28681 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:06.684659 28989 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:06.685075 28989 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:06.685925 28989 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.687160 28989 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.671038 28785 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:06.688571 29036 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:06.688758 29063 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:06.688898 28785 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:06.689515 28785 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:06.690011 21875 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:06.609161 29007 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:06.690896 28971 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:06.691223 29007 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:08:06.627072 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 331699us
I20260709 13:08:06.692085 29007 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.690349 28785 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.695322 29013 consensus_queue.cc:1059] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:06.694185 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:06.696372 29013 raft_consensus.cc:3055] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:06.696712 29013 raft_consensus.cc:740] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:06.697316 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:06.697789 28915 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.698424 29032 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:06.697451 29013 consensus_queue.cc:260] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.699398 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:06.699975 28915 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:06.700344 22547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60034 (request call id 905) took 1785 ms (client timeout 1910 ms). Trace:
I20260709 13:08:06.701411 29013 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.703626 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:06.701911 22551 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:06.705717 21975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2882) took 1408 ms. Trace:
I20260709 13:08:06.706190 21975 rpcz_store.cc:276] 0709 13:08:05.297593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.298739 (+  1146us) service_pool.cc:224] Handling call
0709 13:08:06.705556 (+1406817us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54003a52d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:06.705662 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427396864}
I20260709 13:08:06.706974 22551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 1010) took 1054 ms. Trace:
I20260709 13:08:06.707341 22551 rpcz_store.cc:276] 0709 13:08:05.652730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.652883 (+   153us) service_pool.cc:224] Handling call
0709 13:08:06.701635 (+1048752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.705396 (+  3761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.706792 (+  1396us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540043cbd0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:06.706919 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411235200}
I20260709 13:08:06.708588 29046 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:06.708909 21976 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:08:06.710150 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 928) took 1250 ms. Trace:
I20260709 13:08:06.710481 21976 rpcz_store.cc:276] 0709 13:08:05.461816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.796145 (+334329us) service_pool.cc:224] Handling call
0709 13:08:06.708573 (+912428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.709310 (+   737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.709947 (+   637us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54003a52d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:06.710085 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097799424}
I20260709 13:08:06.712793 21830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2832) took 1006 ms. Trace:
I20260709 13:08:06.713151 21830 rpcz_store.cc:276] 0709 13:08:05.706504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.706830 (+   326us) service_pool.cc:224] Handling call
0709 13:08:05.707092 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.570091 (+862999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.712592 (+142501us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54001d6ad4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:06.712740 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983212416}
W20260709 13:08:06.700809 22547 rpcz_store.cc:269] 0709 13:08:04.915132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.915272 (+   140us) service_pool.cc:224] Handling call
0709 13:08:06.700145 (+1784873us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540043cbd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:06.700291 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610137344}
I20260709 13:08:06.717253 28919 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:08:06.717486 29084 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260709 13:08:06.717973 28934 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:06.718611 28934 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:06.718051 29084 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.645293 21980 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:06.719376 28934 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.720296 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2889) took 1002 ms. Trace:
I20260709 13:08:06.720553 28934 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.720850 29084 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:06.627271 21947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.003s	sys 0.006s
W20260709 13:08:06.722328 21947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.003s	sys 0.007s
I20260709 13:08:06.672510 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:06.610836 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 964) took 1226 ms. Trace:
W20260709 13:08:06.723999 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.724582 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.673144 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:06.636554 28982 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.664490 22553 rpcz_store.cc:276] 0709 13:08:04.744304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.744478 (+   174us) service_pool.cc:224] Handling call
0709 13:08:04.744712 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.211012 (+466300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.663841 (+1452829us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54007044d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:06.663997 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071254912}
W20260709 13:08:06.665850 21829 rpcz_store.cc:269] 0709 13:08:05.453205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.455066 (+  1861us) service_pool.cc:224] Handling call
0709 13:08:06.665299 (+1210233us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54001d74d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:06.665398 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727725824}
I20260709 13:08:06.670411 28771 raft_consensus.cc:3055] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:06.670157 28811 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:06.681414 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 3009) took 1096 ms. Trace:
I20260709 13:08:06.725611 28771 raft_consensus.cc:740] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:06.725736 28982 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.726485 28771 consensus_queue.cc:260] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.727633 28771 raft_consensus.cc:3060] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.727921 28982 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:06.689005 29036 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:06.729451 29036 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.730566 29036 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.717890 28919 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:06.725805 21909 rpcz_store.cc:276] 0709 13:08:05.584980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.590407 (+  5427us) service_pool.cc:224] Handling call
0709 13:08:06.681228 (+1090821us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54003ca354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:06.681358 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343426944}
I20260709 13:08:06.728411 28982 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:06.731659 28982 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:06.734083 21833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2818) took 1413 ms (client timeout 1811 ms). Trace:
I20260709 13:08:06.733721 28982 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.723727 21906 rpcz_store.cc:276] 0709 13:08:05.384780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.384908 (+   128us) service_pool.cc:224] Handling call
0709 13:08:05.385157 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.059460 (+674303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.610619 (+551159us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540020bcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:06.610776 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548954368}
I20260709 13:08:06.680408 29051 raft_consensus.cc:3055] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:06.731107 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:06.731119 28919 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.737469 28990 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:06.670559 28972 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.006s
W20260709 13:08:06.734465 21833 rpcz_store.cc:269] 0709 13:08:05.320461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.320587 (+   126us) service_pool.cc:224] Handling call
0709 13:08:06.733919 (+1413332us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540011d354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:06.734033 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936953088}
I20260709 13:08:06.738816 28919 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:06.739038 28972 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:06.739395 28972 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:06.739984 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2823) took 1413 ms. Trace:
I20260709 13:08:06.740176 28972 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.740394 21831 rpcz_store.cc:276] 0709 13:08:05.326801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.326895 (+    94us) service_pool.cc:224] Handling call
0709 13:08:05.327133 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.737946 (+410813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.739770 (+1001824us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540009db54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:06.739928 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940246272}
I20260709 13:08:06.742020 21901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 3015) took 1097 ms. Trace:
I20260709 13:08:06.720623 21980 rpcz_store.cc:276] 0709 13:08:05.718115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.367541 (+649426us) service_pool.cc:224] Handling call
0709 13:08:06.393342 (+ 25801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.719570 (+326228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.720091 (+   521us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540005afd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:06.720247 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579013504}
I20260709 13:08:06.750715 21901 rpcz_store.cc:276] 0709 13:08:05.644816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.645706 (+   890us) service_pool.cc:224] Handling call
0709 13:08:06.741839 (+1096133us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002f53d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:06.741965 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302754688}
I20260709 13:08:06.751236 22519 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:06.751924 21904 raft_consensus.cc:1240] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:06.749349 28812 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:08:06.719352 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:06.752434 28767 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:06.754079 28767 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:06.746989 21873 leader_election.cc:400] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 18. Current term is 19.
I20260709 13:08:06.755079 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:06.754921 28767 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.755779 29063 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:06.752990 28819 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:06.753193 28812 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:06.758479 28812 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:06.759141 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:06.759263 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:06.735203 29051 raft_consensus.cc:740] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:06.759505 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:06.759315 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:06.760986 28812 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.763659 29051 consensus_queue.cc:260] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.764200 28812 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:06.764897 29051 raft_consensus.cc:3060] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.765447 22547 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:08:06.766462 22547 pending_rounds.cc:85] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 13
I20260709 13:08:06.767357 22547 pending_rounds.cc:107] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:08:06.768615 22547 raft_consensus.cc:2889] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.741899 28915 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:06.769639 22549 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:06.766533 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.769758 28915 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.624329 29103 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:06.771304 29103 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.772080 29007 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.773993 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:06.743479 29046 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:06.778402 21873 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:06.778761 22549 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:06.778954 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:06.779299 28971 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:06.779683 22548 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
W20260709 13:08:06.780495 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 61209.5us
W20260709 13:08:06.764281 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.782475 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.786116 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:06.782332 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:06.789592 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.781543 28785 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:06.799785 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:06.772089 28915 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.789218 28811 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.806543 29103 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.814070 28972 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:08:06.850762 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 168145us
I20260709 13:08:06.392987 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:06.615193 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 734051us
I20260709 13:08:06.876932 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:06.879819 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:06.882405 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:06.911320 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:06.929975 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:06.930867 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:06.935433 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:06.937163 21976 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:06.937461 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:06.938719 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:06.939725 21975 raft_consensus.cc:1240] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:06.940446 21977 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:06.941920 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:06.944617 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 166195us
I20260709 13:08:06.947023 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:06.947988 21981 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:06.949527 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:06.949563 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:06.955142 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:06.956043 21904 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.958684 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:06.958822 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:06.960038 21907 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:06.970537 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 930) took 1508 ms. Trace:
I20260709 13:08:06.972472 28877 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:06.973421 28877 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:06.973539 28812 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:06.974406 28877 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.974679 28812 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:06.980291 28824 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.981175 28824 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:06.960810 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:06.984630 28824 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:06.985471 28824 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.978147 28812 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:06.986841 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:06.963575 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.966426 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:06.971145 21974 rpcz_store.cc:276] 0709 13:08:05.462358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.882317 (+419959us) service_pool.cc:224] Handling call
0709 13:08:05.887073 (+  4756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.887388 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:08:06.659239 (+771851us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b180042b0e0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef13f3 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:08:06.694261 (+ 35022us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b180042b0e0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75beee455 00007fb7629d63c7 00007fb75efe89a7 00007fb75eff80bf 00007fb75eff8038
0709 13:08:06.927222 (+232961us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.949643 (+ 22421us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.950422 (+   779us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.950621 (+   199us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:06.950653 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.950761 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.954629 (+  3868us) raft_consensus.cc:1685] finished
0709 13:08:06.954643 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.970341 (+ 15698us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200865,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":173105,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":18825,"spinlock_wait_cycles":319789696,"thread_start_us":254056,"threads_started":2,"wal-append.queue_time_us":22170}
I20260709 13:08:06.988672 28811 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:08:06.948011 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 165928us
I20260709 13:08:07.009670 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.011071 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:07.012189 28843 consensus_queue.cc:1059] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:07.013221 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:07.014480 21829 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:07.014350 21825 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
W20260709 13:08:07.015094 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 104045us
I20260709 13:08:07.015944 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:07.016464 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:07.017313 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.013935 28843 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:08:07.018713 21825 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:07.020692 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.021019 28843 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.026633 28771 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:07.027550 28584 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:07.027868 28870 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:07.028139 28584 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:07.028396 28870 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:07.031802 28881 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:07.032467 28881 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:07.034682 28884 raft_consensus.cc:3055] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:07.035080 28884 raft_consensus.cc:740] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:07.035699 28894 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:07.036171 28894 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:07.036391 28884 consensus_queue.cc:260] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.037268 28894 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.026779 28438 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:07.044144 28934 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.044756 28947 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.044866 28934 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.045581 28947 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.038024 28884 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:06.986850 28824 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.007550 28877 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.021732 28843 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.029718 28584 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.062880 28843 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.063014 29032 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:07.099617 21833 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20. Ops: []
W20260709 13:08:07.065114 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.101212 21833 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:07.101456 29103 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.102365 21798 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:07.103291 28894 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:07.065599 28438 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:07.105188 29051 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:07.105690 29051 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:07.106262 29051 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:07.066583 29063 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:07.106782 29063 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.107196 29063 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:07.068034 28947 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.076440 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:07.110497 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.110739 21902 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 14.
I20260709 13:08:07.111907 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.113529 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.118883 21902 raft_consensus.cc:2410] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:08:07.078629 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.124531 21906 raft_consensus.cc:2410] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:08:07.062902 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51983us
I20260709 13:08:07.127350 21875 leader_election.cc:400] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20.
I20260709 13:08:07.127682 21875 leader_election.cc:403] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:08:07.130143 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:07.084847 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 138709us
I20260709 13:08:07.131601 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.133651 28901 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.027558 28771 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.087621 21827 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:07.090723 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.090907 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.091630 28992 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:07.092393 28877 consensus_queue.cc:1059] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:07.142930 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 87341.1us
I20260709 13:08:07.093413 28934 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.093575 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.094784 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.102185 29103 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:07.114504 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49169.6us
I20260709 13:08:07.145560 21834 raft_consensus.cc:2393] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 22: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:07.033795 28881 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:07.116878 22521 leader_election.cc:336] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.577s (SENT)
I20260709 13:08:07.117398 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.078051 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.075410 21832 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:07.077068 21831 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:07.147823 21974 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:07.150883 28771 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.134454 28971 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:08:07.151511 28296 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:07.152350 21900 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:07.157747 28681 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:07.158537 28681 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.159601 29103 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.160825 21948 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.161928 28811 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.162612 28934 raft_consensus.cc:2804] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:07.162978 28877 raft_consensus.cc:3055] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:07.163239 28934 raft_consensus.cc:697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:07.163427 28877 raft_consensus.cc:740] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:07.164439 28934 consensus_queue.cc:237] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.164654 28877 consensus_queue.cc:260] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.152401 28296 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.166538 28971 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:07.166958 28971 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:07.167217 28970 consensus_queue.cc:1175] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "479255846c5141b584b16aa253f587c7" responder_term: 18 status { last_received { term: 17 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:07.168224 28296 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.168130 28971 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:07.168975 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.171667 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.172564 21829 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:07.172883 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:07.173849 22521 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.174965 29103 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:07.175388 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58677.3us
I20260709 13:08:07.170077 28971 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:07.176558 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.160826 28681 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.178143 28819 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:07.180076 28819 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:07.180790 28819 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:07.181849 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.029820 28870 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.121778 21983 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 10 to 12, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:07.105733 28438 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.084187 28824 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.137535 21904 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:07.142544 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.116678 21982 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:07.146471 21907 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
W20260709 13:08:07.204856 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57099.5us
I20260709 13:08:07.203586 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.210469 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:07.214813 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.220112 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.144898 29051 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.216331 28584 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:07.219192 28992 consensus_queue.cc:1243] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 0157b4f0725d4f92a53938c921db9efc log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:07.225023 28584 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.225530 28584 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.230655 28877 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.223476 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.213939 28619 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:07.247184 28824 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:07.246202 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 83028.4us
W20260709 13:08:07.239033 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 96627.7us
I20260709 13:08:07.249873 21873 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.252688 28919 raft_consensus.cc:2804] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:07.253290 28919 raft_consensus.cc:697] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:07.253716 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 48212.8us
I20260709 13:08:07.200853 28843 consensus_queue.cc:1059] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:08:07.234441 28972 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:07.262220 28972 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:07.263334 28972 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.221438 28811 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:08:07.225029 28990 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20.
I20260709 13:08:07.254177 28819 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.254391 28919 consensus_queue.cc:237] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.269111 28819 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:07.251788 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:07.269801 28819 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.273411 28990 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:08:07.273669 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.274420 28811 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:07.275701 28811 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:07.276072 28811 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:07.276618 21723 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 130) took 14845 ms (client timeout 15000 ms). Trace:
I20260709 13:08:07.276973 28811 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.273881 28990 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:07.278965 28990 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:07.283954 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.285286 29103 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:07.277069 21723 rpcz_store.cc:269] 0709 13:07:52.431355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.474503 (+ 43148us) service_pool.cc:224] Handling call
0709 13:08:07.276391 (+14801888us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:01.268238 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:01.446123 (+177885us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:01.463062 (+ 16939us) write_op.cc:435] Acquired schema lock
0709 13:08:01.464586 (+  1524us) tablet.cc:662] Decoding operations
0709 13:08:01.544154 (+ 79568us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:01.544256 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:01.544285 (+    29us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:08:01.545492 (+  1207us) tablet.cc:701] Row locks acquired
0709 13:08:01.545548 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:08:01.545755 (+   207us) write_op.cc:270] Start()
0709 13:08:01.545904 (+   149us) write_op.cc:276] Timestamp: P: 1783602481545667 usec, L: 0
0709 13:08:01.545926 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:01.678544 (+132618us) log.cc:844] Serialized 6050 byte log entry
0709 13:08:03.515026 (+1836482us) op_driver.cc:464] REPLICATION: finished
0709 13:08:04.582307 (+1067281us) write_op.cc:301] APPLY: starting
0709 13:08:04.582432 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:04.723959 (+141527us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:04.724084 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:04.906353 (+182269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:04.906612 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:08:04.906654 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:04.906982 (+   328us) log.cc:844] Serialized 139 byte log entry
0709 13:08:04.927604 (+ 20622us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:04.927773 (+   169us) write_op.cc:454] Released schema lock
0709 13:08:04.927827 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:04.972896 (+ 45069us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:04.979495 (+  6599us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1010437,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":1040890,"apply.run_cpu_time_us":28729,"apply.run_wall_time_us":354567,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66737,"num_ops":15,"prepare.queue_time_us":1047972,"prepare.run_cpu_time_us":35591,"prepare.run_wall_time_us":564839,"raft.queue_time_us":839435,"raft.run_cpu_time_us":23099,"raft.run_wall_time_us":584765,"replication_time_us":1911372,"thread_start_us":1270178,"threads_started":5,"wal-append.queue_time_us":288055,"wal-append.run_cpu_time_us":29571,"wal-append.run_wall_time_us":3296740}]]}
I20260709 13:08:07.286429 29103 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:07.286875 29103 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:07.287798 28584 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:07.289247 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.288378 29103 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.242090 21903 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:07.290478 21903 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:07.241647 21905 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:08:07.257853 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:07.290759 21726 catalog_manager.cc:5697] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:07.225662 29010 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:08:07.292798 21726 catalog_manager.cc:5697] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 5 to 14, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 14 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:07.294422 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.294492 28989 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.297317 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.297683 28989 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.298650 29051 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.298106 21909 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:07.324101 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:07.330210 21906 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
W20260709 13:08:07.333216 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.333261 28584 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.341423 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:07.343302 21980 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:07.343912 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.340371 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.331441 28819 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.341991 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.299917 28989 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.299816 29063 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.306967 28843 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:07.347642 21831 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:07.349871 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.345608 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.341889 29103 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:07.351682 21828 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:07.296113 21726 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 reported cstate change: config changed from index 9 to -1, term changed from 14 to 12, leader changed from <none> to 479255846c5141b584b16aa253f587c7 (127.20.53.129), NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) evicted. New cstate: current_term: 12 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.360675 28785 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:07.361227 28785 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.367692 28824 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.368526 28824 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:07.370110 28811 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.371886 29063 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.352814 28843 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:07.373860 21829 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:08:07.374490 28843 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.375094 21948 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.376147 28843 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.385488 21974 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:07.386706 21798 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:07.388057 28904 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 24.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:08:07.388260 21726 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:07.388932 29036 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:07.390311 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.359844 21903 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.358863 28971 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:07.398269 21906 raft_consensus.cc:1240] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:07.401280 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 58908.8us
I20260709 13:08:07.402921 28989 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.403035 28904 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:07.403496 28904 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:07.403789 28785 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.403456 28989 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.404553 28904 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.405632 28989 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.384671 28992 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.406854 21905 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:07.386706 28619 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:07.409368 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:07.412369 21902 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:08:07.410008 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.412781 21902 pending_rounds.cc:85] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 13
I20260709 13:08:07.414033 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.415328 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.416092 21974 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 24.
I20260709 13:08:07.405836 28904 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:07.418872 21909 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:07.420603 21980 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:07.390439 21726 catalog_manager.cc:5697] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 12 to 18, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 18 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:07.429174 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.398226 28884 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:07.413106 21902 pending_rounds.cc:107] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:08:07.434633 21902 raft_consensus.cc:2889] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.436571 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:07.432277 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:07.436594 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.438266 21832 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:08:07.439965 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:07.441368 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:07.444842 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:07.446069 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.446827 21901 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:07.451642 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.457396 21825 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:07.455933 21798 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:07.464632 29010 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:07.465314 29010 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:07.466519 29010 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.471002 21905 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:07.447682 28884 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:07.449421 28584 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:07.443344 29063 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.476313 21907 raft_consensus.cc:1240] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:08:07.455224 28901 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:07.482306 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:07.483050 29047 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:08:07.455895 29051 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.482945 29007 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:08:07.500289 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.483799 29046 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.093s
I20260709 13:08:07.485235 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.486220 28922 consensus_queue.cc:1059] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.093s
W20260709 13:08:07.483794 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 88645.4us
I20260709 13:08:07.431869 28992 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.437309 28971 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.472249 28947 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:07.491907 21904 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:07.492307 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:07.504716 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 94118.6us
I20260709 13:08:07.463373 28296 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:07.436256 28619 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
W20260709 13:08:07.499414 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.507081 21900 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
W20260709 13:08:07.500356 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 80521.9us
I20260709 13:08:07.505316 21983 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:07.511293 28584 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.492364 28901 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:08:07.508001 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 72423.4us
I20260709 13:08:07.509446 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:07.506808 28824 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.522650 21906 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:07.522130 28824 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.526407 21833 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:07.527451 28992 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.527559 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.517112 28901 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:07.529258 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.530381 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.531383 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.531522 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.532375 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.533304 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.534466 28934 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:07.534963 28934 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.535344 28934 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:07.536441 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.537961 29013 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:07.538380 29013 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:07.539431 28971 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.539270 29013 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.495481 28990 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.540566 29013 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:07.534816 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.541661 28990 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 27 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.517434 28584 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.507669 28296 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.556156 21909 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:07.559420 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.559898 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.516569 28870 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:07.562484 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.565512 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.561321 28296 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:07.574282 29132 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:07.574746 29132 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:07.575183 29132 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.581002 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.582191 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.585955 21901 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 25.
I20260709 13:08:07.509662 29063 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.509764 29051 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.589833 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.517072 28947 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.595691 21831 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:07.600286 21833 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
I20260709 13:08:07.609625 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.593061 28438 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:07.611020 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:07.612385 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:07.614347 29138 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.617575 22553 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:08:07.563601 28990 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:08:07.632005 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.632015 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.632965 21981 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:07.592697 28884 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.625780 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:07.619028 22549 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 10 to 12, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:07.637481 28901 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.620719 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.639971 21908 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:07.641144 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.646306 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:07.647006 21976 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:07.639060 29032 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.652827 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:07.653851 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.642246 28989 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:07.648705 28811 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.674655 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.685019 21908 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:07.675659 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.672398 21873 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:08:07.698892 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.650466 28971 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.674054 29051 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.674150 29136 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.676661 29135 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:08:07.711102 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.677861 28619 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:07.713975 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.722977 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:07.725682 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 126643us
I20260709 13:08:07.644874 29138 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.706050 29063 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.672094 29032 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.725234 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.727571 21908 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:07.731086 28296 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:07.733198 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57675.4us
I20260709 13:08:07.733706 28296 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.734021 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.735785 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.737039 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.738467 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:07.739089 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 86780.2us
I20260709 13:08:07.739877 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:07.718248 28919 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:07.740489 22552 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 24.
I20260709 13:08:07.740756 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:07.714298 28971 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.738544 28824 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.747815 21976 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:07.753401 21905 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:08:07.744403 21979 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:07.756595 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.729400 29135 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.757294 21908 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:07.762552 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.769963 28824 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:07.774936 28901 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.776646 22520 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:07.777674 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:07.779928 29138 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.780925 28934 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.782279 21903 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.782886 28934 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.767405 28904 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.787237 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:07.788209 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:07.747673 29047 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.795379 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.728375 28619 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.723372 29136 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.805938 21905 raft_consensus.cc:2410] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 23 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:08:07.807585 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.808894 21907 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:08:07.812633 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 56852.4us
W20260709 13:08:07.812976 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 76028.5us
I20260709 13:08:07.803134 28438 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:07.815675 28767 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:07.816080 28767 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.816445 28767 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:07.822160 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.822947 21908 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:07.799633 29010 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:08:07.831085 28438 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.835798 29132 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.825858 28819 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.840157 28819 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.845744 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:07.867414 21905 raft_consensus.cc:1240] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 26. Current term is 27. Ops: []
I20260709 13:08:07.867853 21908 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:07.843883 29136 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.871197 29135 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.871627 29135 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:07.871974 29135 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.876518 28922 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:07.876935 28922 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:07.842700 28901 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.879930 28819 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.879839 29135 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.879858 28901 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.881494 28947 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.877760 28922 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.883337 28901 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.883494 28922 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.842474 29132 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.886299 28901 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.897112 28619 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.898289 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:08:07.898756 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.899024 21981 raft_consensus.cc:2368] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19.
I20260709 13:08:07.899101 28771 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.899784 28771 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.900202 28843 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.900658 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.900763 28843 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.901432 21981 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:07.901809 28771 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.902290 29010 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.902736 29010 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.903488 28843 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.903537 28767 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.904157 28843 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.904567 29010 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.904661 28843 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.906819 22519 leader_election.cc:400] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19.
I20260709 13:08:07.907133 22519 leader_election.cc:403] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:08:07.907671 29132 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.890241 29046 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:07.910316 29046 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:07.911223 29046 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.912253 29046 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:07.890875 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3282) took 1009 ms. Trace:
I20260709 13:08:07.914388 21825 rpcz_store.cc:276] 0709 13:08:06.881784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.034329 (+152545us) service_pool.cc:224] Handling call
0709 13:08:07.034748 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.460951 (+426203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.890655 (+429704us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54002896d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:07.890820 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971020032}
I20260709 13:08:07.891700 29007 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.915560 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:07.915673 29007 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.917578 28812 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:07.917742 29007 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:07.917991 28812 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:07.918473 28812 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.893646 21979 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:07.894603 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:07.887799 21717 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3d76b2c4699e43fba10eeb81a91e4913 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:07.919747 21976 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
W20260709 13:08:07.894071 29144 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:08:07.915902 29103 consensus_queue.cc:1059] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:08:07.846473 29032 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.921204 29103 raft_consensus.cc:3055] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:08:07.921612 28971 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.921799 29103 raft_consensus.cc:740] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:07.922855 29103 consensus_queue.cc:260] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.924190 29103 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:07.924306 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:07.924896 21982 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:07.925652 29138 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:07.926196 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:07.926800 22548 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 13.
I20260709 13:08:07.927249 21983 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:07.928189 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:07.928735 21974 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:07.928757 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:07.929543 21906 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:07.930598 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.931219 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:07.931818 21906 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:07.932237 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.933794 21976 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:07.931233 21980 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:07.895756 28901 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.932852 21982 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:07.935256 22520 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:07.937501 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:07.944427 21905 raft_consensus.cc:1240] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
W20260709 13:08:07.945060 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 125748us
I20260709 13:08:07.882056 29135 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:07.965653 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.965766 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.951109 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 125173us
I20260709 13:08:07.951702 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:07.953167 21903 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:08:07.954702 29138 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:07.954813 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.955781 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.956095 29137 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:07.956342 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:07.973393 21831 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:07.957827 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.967391 21903 pending_rounds.cc:85] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 12
I20260709 13:08:07.958467 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.974033 21832 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:07.975095 21833 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:07.958617 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:07.958663 28812 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:07.959820 21830 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:07.978688 21903 pending_rounds.cc:107] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:08:07.979015 21903 raft_consensus.cc:2889] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.960538 21906 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:08:07.960827 21826 raft_consensus.cc:1240] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:07.961637 21829 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:07.980667 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.980773 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:07.981815 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.983886 21829 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:08:07.984401 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.984701 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.969892 21974 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 25.
I20260709 13:08:07.977795 21828 raft_consensus.cc:2410] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:08:07.973402 29007 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.986833 21833 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:07.987097 21828 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 9. (term mismatch)
I20260709 13:08:07.987447 21828 pending_rounds.cc:85] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 8
I20260709 13:08:07.987694 21828 pending_rounds.cc:107] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 19.9
I20260709 13:08:07.987915 21828 raft_consensus.cc:2889] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.964650 28843 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:07.984822 21981 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:08:07.986606 29007 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.965055 21798 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:07.983263 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:07.988790 21829 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:08:07.995677 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:07.970774 29138 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.976531 29137 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.002329 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:07.965124 28771 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:08.007166 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:08.021687 21974 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:08.005959 28843 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:08.010340 28971 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:08.022969 28971 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.023367 28971 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.024319 29007 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:07.997802 28989 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:08:07.995406 28296 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:08:07.976161 28884 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:08:07.995697 28970 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:08:08.005683 29137 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:08.034322 28843 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.034749 28843 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.038450 28972 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:08.039996 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:08.040688 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:08.041006 28884 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:08.041302 22555 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 25.
I20260709 13:08:08.041529 28884 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:08.042331 28884 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:08.042775 21874 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:08.016770 28901 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:08.043720 28901 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:08.044071 28901 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.044385 28901 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:08.044845 29132 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19.
I20260709 13:08:07.975374 28438 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:08:08.017104 29010 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:08.046463 29010 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:08.046542 28438 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:08.047055 28438 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:08.047379 29010 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:07.989419 28819 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 13:08:08.018059 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:08.050918 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:08.019224 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.001981 29138 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:08.052490 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:08:08.052445 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.053525 21831 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 25.
I20260709 13:08:08.020668 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:08.060491 29151 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:08.063058 29135 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:08.060515 28877 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:08.062409 21798 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:08.063482 29135 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.064148 29032 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:08.077602 29135 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.077915 29032 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.078351 29032 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.081223 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:08:08.071105 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 75589.5us
I20260709 13:08:08.081841 21980 raft_consensus.cc:3060] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:08.067687 28767 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.082515 21948 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.083786 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.084870 28438 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.085747 29019 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:08.086452 29019 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:08.087249 28812 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.067462 28771 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:08.088069 28771 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.088403 28771 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:08.089283 28438 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.067308 29007 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:08:08.071290 28819 consensus_queue.cc:1059] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:08:08.092144 29103 raft_consensus.cc:3055] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:08.092533 29103 raft_consensus.cc:740] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:08.094897 29103 consensus_queue.cc:260] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:08.096956 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57052.6us
I20260709 13:08:08.097669 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.098551 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:08.106719 21980 raft_consensus.cc:2468] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:08:08.110432 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:08.111411 21980 raft_consensus.cc:2393] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 19: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:08.109094 22519 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:08.116668 28915 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:08:08.117558 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49937.7us
I20260709 13:08:08.115607 21798 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:08.123821 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:08.126888 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.133426 21974 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:08.134037 28812 raft_consensus.cc:2804] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:08.136227 28812 raft_consensus.cc:697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:08.136770 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.137065 28812 consensus_queue.cc:237] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.138211 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.141522 21982 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:08.143368 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.144107 21901 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:08.148168 21901 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:08.102691 28881 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:08.119809 21906 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 10 to 12, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:08.150961 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.150472 21901 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:08.158100 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.159968 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.153745 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:08.067834 28972 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:08:08.139351 28870 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:08.155298 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:08.156183 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.154487 22521 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.168339 21903 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:08:08.175546 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:08.176012 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:08.169107 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.177485 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.169528 29160 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:08.154759 29019 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:08.139093 28947 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:08.179628 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:08.159062 29151 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:08.219736 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:08.188197 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:08.221951 22549 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:08:08.215818 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.158361 28584 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:08.176344 29103 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:08.175213 28870 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.177139 29046 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:08.188010 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:08.219344 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:08.237098 22547 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 13.
I20260709 13:08:08.174039 28881 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:08.182657 29007 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:08.181519 29036 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:08.230068 22554 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:08.181670 28989 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:08.225183 29132 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:08.226495 29137 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.185844 28296 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:08:08.187601 29136 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:08.187755 28819 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:08.230350 22548 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:08.227133 29019 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:08.267987 21900 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:08:08.242679 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.255874 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:08.243831 29141 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:08.236052 28870 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.272279 21901 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:08.247911 29007 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.273222 28584 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:08.270004 21980 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:08.244405 29046 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.276162 21900 pending_rounds.cc:85] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 12
I20260709 13:08:08.293552 21900 pending_rounds.cc:107] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:08:08.293917 21900 raft_consensus.cc:2889] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.295336 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.296109 21900 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:08:08.297189 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:08.298983 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:08.300160 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:08.269196 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 127506us
I20260709 13:08:08.241353 22549 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 25.
I20260709 13:08:08.236600 29013 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:08.301311 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.272598 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.302115 21903 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:08.258374 29036 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.284989 21974 raft_consensus.cc:1275] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:08:08.284976 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:08.304710 21976 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:08:08.287468 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.288640 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:08.306120 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.274936 29132 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:08.275525 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.261660 29151 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:08.315174 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:08.303345 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:08.218133 21982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:08.299561 22551 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:08:08.316319 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.277882 28877 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:08.276402 28947 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:08.278745 29167 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.286562 29007 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:08.317286 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.280819 29136 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:08.323341 21901 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 25.
I20260709 13:08:08.292996 28584 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:08.299525 29046 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:08.324054 21979 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:08.307910 29036 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:08.354487 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.356556 28877 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:08.323879 28619 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:08.358400 29151 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.359799 28843 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.328302 29160 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:08.354398 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 92749us
I20260709 13:08:08.306083 28904 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:08:08.367254 21908 raft_consensus.cc:1275] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:08.308460 29135 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.370962 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.329272 28947 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.373020 28619 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:08.378182 29019 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:08.390586 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 73399us
I20260709 13:08:08.373714 29147 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.379069 28972 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:08.381886 28767 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:08.394969 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.404968 29032 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.407428 29135 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:08.371636 28877 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.423918 28877 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.392729 28619 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:08.392889 29132 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.407308 29136 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.419070 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:08.353602 28881 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.440110 28843 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.430745 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.438876 21978 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:08.388615 28584 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.452677 21833 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 21: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:08:08.410781 29163 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:08:08.333030 29167 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:08.461479 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59598.3us
I20260709 13:08:08.392210 29138 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.469209 29177 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:08.470896 29147 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:08.471649 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 76782.9us
I20260709 13:08:08.472294 28584 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.487424 28970 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.491760 29013 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:08.492472 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:08.493175 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:08.499187 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:08.510061 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:08.515774 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 199530us
I20260709 13:08:08.518880 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.465610 28812 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:08.521296 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:08.515136 29047 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:08.524595 28771 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:08.525557 28971 consensus_meta.cc:287] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.001s
I20260709 13:08:08.531462 29167 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.499254 29176 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:08.540506 29032 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:08.540645 29046 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.499900 28877 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:08.520825 21830 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:08.555251 21873 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.566295 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:08.571419 21907 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.569635 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:08.542748 29013 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:08.577162 21875 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:08.560459 28904 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:08.562881 28972 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:08:08.562922 29160 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:08.598552 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:08:08.599978 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 134510us
I20260709 13:08:08.601202 22521 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.602007 28812 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:08.602376 29187 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:08.601214 28771 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:08.516445 29177 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.604979 29177 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.551869 28970 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.607192 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:08.610961 22547 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:08.578815 28438 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.607201 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.591207 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.562978 28824 consensus_queue.cc:1048] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:08:08.626536 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.614856 21830 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 24: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:08.616943 21907 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:08.591542 28843 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.579120 29147 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:08.590727 29167 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.577198 28877 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.567137 28971 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.652068 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:08.652951 21976 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:08.640362 29036 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.641794 21979 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:08.643397 29046 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:08.624351 28992 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:08.644492 28947 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:08.631259 28884 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
I20260709 13:08:08.645543 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.647349 29138 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:08.705229 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59733.6us
I20260709 13:08:08.650509 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:08.638706 29177 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:08.643169 28619 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.651453 28970 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.631747 29136 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:08.614493 29187 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:08.686123 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59686.2us
I20260709 13:08:08.689260 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:08.734580 21980 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 24: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:08:08.692417 29190 log.cc:927] Time spent T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:08.654605 28843 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.656415 28992 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:08.642078 29007 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.637595 29160 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:08.744304 29160 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:08.744728 29160 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:08.745817 29007 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:08.746417 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:08:08.663168 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 86073.2us
I20260709 13:08:08.747455 28992 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.748356 21982 raft_consensus.cc:606] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.748759 21982 raft_consensus.cc:614] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:08.749418 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:08.637558 29137 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.647492 28870 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.752312 28870 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.722517 21974 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:08.630314 28438 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:08.721314 28901 consensus_meta.cc:287] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 13:08:08.651734 28767 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
W20260709 13:08:08.759373 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 132057us
I20260709 13:08:08.723753 29032 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:08.720582 21902 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 15: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:08.688030 28884 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.725175 29177 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:08.754638 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:08.755095 21832 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:08:08.756743 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:08.816449 21830 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 14: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:08.816212 29184 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:08:08.656311 29167 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.817559 28619 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.818643 29167 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.819383 28438 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.821100 28884 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.822340 21828 raft_consensus.cc:1240] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:08.737061 28970 consensus_queue.cc:1048] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:08:08.833199 28971 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:08.834702 28877 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:08.836567 29187 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.836934 29013 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.842546 21975 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:08.845055 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.846338 29019 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:08.763939 28901 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.846891 29019 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:08.847834 29019 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.848793 28901 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:08.853446 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:08.853585 28843 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:08.854221 22554 raft_consensus.cc:2368] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:08.846122 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.736975 29136 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.859854 29136 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:08.859962 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.812057 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:08.861053 21979 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:08.864567 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:08.865139 22553 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:08:08.868387 29198 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:08.869550 29047 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:08.869966 29047 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:08.870343 29007 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:08.871495 28992 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.873510 28992 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.875016 29160 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.860364 29136 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:08.877579 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:08.881105 22549 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:08.878072 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:08.882296 21902 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:08.879284 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:08.883071 22554 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:08.877530 21874 leader_election.cc:400] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:08.886678 21874 leader_election.cc:403] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:08.887403 29197 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:08:08.891355 29013 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:08.911080 22547 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:08:08.761179 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.894004 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:08.913002 21902 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:08.914289 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 143025us
I20260709 13:08:08.916940 29047 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:08.902138 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.813246 21798 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:08.656054 29147 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:08.941526 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:08.942148 21906 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:08.907068 29036 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:08.906082 29177 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:08.898921 22548 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:08.913160 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 152063us
I20260709 13:08:08.913414 28901 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:08.952605 21907 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:08.899228 29160 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:08.920017 29051 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:08.920343 21902 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
W20260709 13:08:08.921422 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 69603.3us
I20260709 13:08:08.955731 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:08.931730 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:08.933166 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:08.956930 21832 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:08:08.943565 28992 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.989943 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:08.990845 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:08.949450 29013 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.941219 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:08.997471 21904 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:08.947893 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:08.948875 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 135719us
I20260709 13:08:08.951789 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.987398 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:08.891480 22554 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 26.
I20260709 13:08:08.988068 21906 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:08:08.999502 21874 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:08.909068 22553 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:08:08.995568 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:09.003082 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:09.003700 21982 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:09.006139 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:09.006678 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:09.004297 29188 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:09.007992 29188 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.008334 29188 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:09.010321 29191 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:09.011353 29146 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:09.011754 29146 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:09.012115 29146 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:09.000629 29013 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.014328 29149 consensus_queue.cc:1059] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:08:09.033574 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:09.034915 21975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:09.035456 21975 raft_consensus.cc:606] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:09.037451 21977 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:09.039001 28901 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:09.039574 28901 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 26 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:09.040372 29197 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:09.041276 29147 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:09.049659 21982 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:08:09.050607 29047 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:09.050875 21982 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:08.992600 29103 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:08:08.992874 28992 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.055737 28992 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:08.996333 28843 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:09.056816 28296 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:09.058830 29032 raft_consensus.cc:3055] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:08:09.059237 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 107528us
I20260709 13:08:09.060135 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:09.061347 28971 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:09.062328 28877 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:09.059295 29032 raft_consensus.cc:740] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:09.067391 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:09.068645 21980 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:09.031329 29013 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:09.063143 28877 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:09.073892 21976 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
W20260709 13:08:09.075660 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 88350.5us
W20260709 13:08:09.007085 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 47117.9us
I20260709 13:08:09.078387 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:09.061997 28971 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:09.079730 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:09.086876 21828 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.081395 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:09.087514 21980 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:09.081835 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.090400 21907 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 25.
W20260709 13:08:09.083050 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 76994.5us
I20260709 13:08:09.084141 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:09.085547 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.094630 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:09.097962 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:09.099879 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:09.100028 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:09.101524 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 72500.6us
I20260709 13:08:09.080205 28877 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:09.093889 28971 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.103910 28970 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.086352 29136 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:09.108902 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:09.118995 21982 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:09.101033 28915 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:08:09.095700 29063 consensus_queue.cc:1059] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:08:09.095850 28584 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:09.119419 21977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:09.127872 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:09.128979 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:09.144593 21830 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:09.147053 21977 raft_consensus.cc:606] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:09.151204 21977 raft_consensus.cc:614] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:09.155898 21904 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:09.148116 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:09.153337 21900 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
I20260709 13:08:09.143802 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:09.159531 21976 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:08:09.138937 21980 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:08:09.160333 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:09.160848 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:09.105867 28992 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:08:09.144413 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 46551.5us
I20260709 13:08:09.202518 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:09.112181 28971 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:09.166150 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:09.118525 28970 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.205195 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:09.040578 28901 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.200621 21980 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.118839 29167 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:09.204664 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:09.206696 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 53052.4us
I20260709 13:08:09.232815 21974 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:09.210842 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:09.211783 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:09.233814 21830 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:09.238207 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:09.239141 21825 raft_consensus.cc:3060] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:09.239480 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:09.240325 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:09.217518 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:09.104498 29197 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:09.163704 29051 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:08:09.199622 29198 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:09.230715 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:09.240077 21834 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:09.243541 22547 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 13:08:09.131170 28884 consensus_queue.cc:1059] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:08:09.245621 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:09.256503 22553 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 24: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:09.247614 22548 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:09.222740 28296 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.202399 29132 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.249466 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:09.257076 21900 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:09.257772 21978 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:09.248812 22554 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:08:09.130343 28438 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.090s
W20260709 13:08:09.249553 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44450.9us
I20260709 13:08:09.162948 28989 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:08:09.273377 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:09.161993 28771 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:08:09.230670 28922 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:08:09.222515 28992 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:09.273463 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 170891us
I20260709 13:08:09.372355 21828 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
W20260709 13:08:09.300843 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 60624.6us
I20260709 13:08:09.312638 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:09.445381 21832 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:09.234515 29167 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.245151 29051 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:08:09.445875 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 133297us
I20260709 13:08:09.238735 29136 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:09.447506 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:09.452463 21907 raft_consensus.cc:2393] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:08:09.452679 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 179367us
W20260709 13:08:09.428577 29202 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
W20260709 13:08:09.430146 29205 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:08:09.367389 29211 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:08:09.366829 29206 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:08:09.274767 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:09.345922 29172 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:09.367745 29179 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:09.254349 29197 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.490379 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:09.271670 29184 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:09.493417 21908 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:09.567747 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.368884 29103 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.496902 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:09.313246 29187 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:09.445111 29176 raft_consensus.cc:2764] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:09.498638 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.450271 29167 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:09.495448 29046 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:09.522558 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:09.248782 28881 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.222s
I20260709 13:08:09.249944 29146 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.559137 21982 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
I20260709 13:08:09.504765 22521 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:09.368415 28970 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.496623 28884 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.342000 29201 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.393s
I20260709 13:08:09.394498 29177 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.301810 28296 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:09.564224 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 57323.6us
I20260709 13:08:09.568544 21902 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:09.569525 21906 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:08:09.343530 29169 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.265s
I20260709 13:08:09.495067 28934 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:09.303220 29132 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.604609 28934 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.605122 28934 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:09.606755 29132 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.584307 28922 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:09.574237 21905 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:09.456552 21980 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 15.
I20260709 13:08:09.455467 28843 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:08:09.500471 29216 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:09.435072 28870 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:08:09.345216 29032 consensus_queue.cc:260] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.588299 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3144) took 1013 ms. Trace:
I20260709 13:08:09.575380 28915 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.579026 29221 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.588531 29046 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.580766 29187 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.594992 21875 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:09.573436 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.609716 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:09.619243 21906 raft_consensus.cc:1240] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:09.621704 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.576483 29103 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.631906 21905 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:09.621654 21825 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:08:09.620020 21983 rpcz_store.cc:276] 0709 13:08:08.574888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.574997 (+   109us) service_pool.cc:224] Handling call
0709 13:08:08.575271 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.582262 (+  6991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.582291 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.597863 (+ 15572us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.806078 (+208215us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:08.812976 (+  6898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.813060 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.588119 (+775059us) raft_consensus.cc:1685] finished
0709 13:08:09.588138 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.588247 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11674,"raft.queue_time_us":22357,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":23594,"thread_start_us":116120,"threads_started":1,"wal-append.queue_time_us":468195}
I20260709 13:08:09.594296 28767 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:09.599520 28970 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:09.633776 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:09.629305 21908 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:09.644814 21906 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:09.640463 21903 raft_consensus.cc:2393] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 19: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:08:09.641634 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 46753.4us
W20260709 13:08:09.624291 29208 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:08:09.628218 28915 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:09.642807 29188 consensus_meta.cc:287] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 13:08:09.596083 28884 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.663365 28915 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.665354 29046 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:09.644531 29063 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:09.691231 21906 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:09.630093 29221 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:09.694675 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 190013us
I20260709 13:08:09.695006 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:09.617296 29136 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.681161 28972 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.627071 29216 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.692694 28992 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.722647 22521 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:09.730067 29187 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.730772 29197 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.731612 29146 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:09.732919 28296 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:09.738425 29229 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:09.737941 28877 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.744634 28877 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:09.746869 29222 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:08:09.680248 29188 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.752005 29191 raft_consensus.cc:3055] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:09.752435 29191 raft_consensus.cc:740] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:09.753150 29188 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.753228 29191 consensus_queue.cc:260] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.754372 29226 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.754761 21829 raft_consensus.cc:2368] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22.
I20260709 13:08:09.754877 29226 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.756866 29191 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:09.757987 21907 raft_consensus.cc:2410] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:08:09.758208 28884 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.697245 28971 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.760394 28971 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.762046 29175 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:09.762450 29175 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:09.762800 21829 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:08:09.763132 21829 pending_rounds.cc:85] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 10
I20260709 13:08:09.763556 21829 pending_rounds.cc:107] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:08:09.763170 29175 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.763877 28934 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.766316 28934 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:09.763867 21829 raft_consensus.cc:2889] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:09.727698 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:09.728833 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:09.770030 21875 leader_election.cc:400] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22.
I20260709 13:08:09.770309 21875 leader_election.cc:403] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260709 13:08:09.776608 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 286317us
I20260709 13:08:09.776605 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:09.778416 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:08:09.778479 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 55956us
I20260709 13:08:09.709813 28767 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:09.780982 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53348us
W20260709 13:08:09.731086 29209 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:08:09.692528 29063 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.781848 21979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:09.787240 21979 raft_consensus.cc:606] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:09.787709 21979 raft_consensus.cc:614] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:09.756928 29226 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.774598 28934 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:09.793045 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 64322.9us
I20260709 13:08:09.793929 21799 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:09.775627 29149 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.776170 29175 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:09.726624 29179 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:09.796056 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:09.783154 29188 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:09.728291 28972 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.807185 21904 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 26 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 13:08:09.791675 28922 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.795720 28971 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:09.811255 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:09.822296 29238 raft_consensus.cc:2804] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:09.822947 29238 raft_consensus.cc:697] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:09.823321 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:09.824680 29215 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:09.825393 21983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90821f4436f045a0a3847b276293f36f"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:09.813113 29230 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:09.826326 29192 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:09.826978 29191 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:09.813654 29237 consensus_queue.cc:1059] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:09.828217 29237 raft_consensus.cc:3055] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:09.828531 29237 raft_consensus.cc:740] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:09.796409 28934 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.828838 29063 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.795446 29229 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:09.830446 28934 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:09.786324 28767 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.832927 28767 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.826637 29188 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:09.836818 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:09.840327 29188 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:09.841490 28584 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:08:09.841862 28584 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:09.842020 29188 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:09.843304 29221 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:09.844059 29103 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:09.844797 28843 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:09.846450 29232 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:09.846992 29232 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.847393 29232 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:09.850428 21829 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:08:09.799540 29177 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:09.833196 29213 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.503s	user 0.000s	sys 0.005s
I20260709 13:08:09.875628 29223 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:09.876067 29223 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:09.876456 29223 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.876717 29229 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:09.878746 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 567842us
I20260709 13:08:09.872090 29217 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:09.883460 21831 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:08:09.885332 21833 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:09.801295 29197 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:08:09.837427 29051 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.890419 29051 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:09.807946 29231 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 13:08:09.823925 29238 consensus_queue.cc:237] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.870733 29192 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:09.902890 28970 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.903582 28970 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:09.903030 29192 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.800256 29149 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:09.852020 28922 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:09.915000 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:09.920571 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:09.925774 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:09.935561 21981 raft_consensus.cc:1240] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:08:09.934688 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:09.971278 21907 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:09.971592 21982 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:08:09.974184 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.974913 21907 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 27: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:09.975440 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:09.915598 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:09.979631 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:09.980044 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.980396 21909 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:09.980767 21900 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:09.983366 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.983958 21907 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:09.985864 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:09.986492 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.987581 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.988130 21907 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:08:09.926146 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:08:09.990581 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 75124.8us
I20260709 13:08:09.996469 21901 raft_consensus.cc:2393] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:09.989566 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.000563 21828 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:10.001091 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:10.001734 21981 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:10.002449 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76378.5us
I20260709 13:08:10.005581 28922 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:10.009488 21908 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:10.011201 21978 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 25. Current term is 26. Ops: [25.12-25.12]
I20260709 13:08:10.014128 21979 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:10.014922 21799 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:10.016655 28843 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:10.025913 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:09.888906 29217 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.032194 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:10.035454 21905 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260709 13:08:10.037150 21946 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.979676 29063 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.981712 29177 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:10.045883 29217 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.052112 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.051551 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.053630 21979 raft_consensus.cc:1275] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:09.915973 29179 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.060233 21974 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 26.
I20260709 13:08:10.054644 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:09.998198 29169 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:10.021229 28819 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:10.055378 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:10.055653 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:09.990577 28901 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:08:10.065732 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.068964 22553 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:10.071038 21982 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:08:10.076069 22547 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 27.
I20260709 13:08:10.066642 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:10.084187 21799 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:10.081465 21975 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:10.081431 22519 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:10.089704 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.090550 21825 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
W20260709 13:08:10.093770 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 46707.2us
I20260709 13:08:10.055025 28767 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:08:10.089349 29169 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:10.087111 29047 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:10.088798 29221 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:10.104532 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:10.059636 29063 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.097873 29051 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:08:10.101190 28884 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:08:10.106331 29242 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:08:10.113914 28972 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:10.114248 29240 log.cc:927] Time spent T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:08:10.042841 29237 consensus_queue.cc:260] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.072335 29177 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.086047 28901 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.119561 29237 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:10.110821 29169 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.111102 29221 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.113065 29047 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.143795 28901 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.144865 29250 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:08:10.145356 29250 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.145758 29250 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:10.131551 29168 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:10.153024 28619 raft_consensus.cc:3055] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:10.153460 28619 raft_consensus.cc:740] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:10.154264 28619 consensus_queue.cc:260] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.155215 28619 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:10.160674 29215 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22.
W20260709 13:08:10.161190 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.161496 29215 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.168352 21902 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:08:10.175484 21909 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 26.
I20260709 13:08:10.200263 21905 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 25. Current term is 26. Ops: [25.12-25.12]
W20260709 13:08:10.212081 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 130710us
I20260709 13:08:10.213465 28970 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.214478 29181 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:10.215660 28970 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.213832 21949 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:10.138933 29169 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:10.168882 29221 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.224164 21949 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:10.223338 28922 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:10.228297 28922 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.228662 28922 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:10.229238 28584 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.230289 28584 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:10.224821 28812 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:10.235286 28812 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.199126 29201 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.199911 28901 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:10.263424 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:10.263679 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.218235 29216 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:10.225270 29149 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:10.206312 29215 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.221588 29007 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:08:10.304526 29216 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.246455 29201 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.252589 29203 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:10.252120 28812 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.268693 28819 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:10.326138 21981 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:08:10.262882 29232 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.247920 28901 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.256872 29223 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.338389 21977 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:10.315505 29203 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.318384 29251 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:10.343408 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.347409 29063 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:10.354473 21901 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:08:10.355705 21834 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:08:10.344626 29203 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:10.312824 29216 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.363242 22547 raft_consensus.cc:1240] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:10.352002 29251 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.373238 29251 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.382897 22547 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 13:08:10.386394 29007 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.386958 29007 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.389151 29007 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:10.366243 28922 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.391196 29215 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:10.396323 28438 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:08:10.398850 29247 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:10.398928 29177 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:10.399858 29220 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:10.430514 29220 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.432514 29220 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.371212 28819 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.432714 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:10.433785 21903 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:10.433957 29216 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:10.400892 29223 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.401543 21729 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:10.403575 29232 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:10.405055 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.438019 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.438531 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.439333 29188 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:10.439759 29188 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:08:10.404331 29167 consensus_meta.cc:287] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.000s
I20260709 13:08:10.440402 29167 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.440599 29188 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.442756 29167 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.411495 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:10.444001 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.444324 21833 raft_consensus.cc:2410] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:08:10.444836 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.445564 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.441892 29188 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:10.426370 28922 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:10.428982 29250 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.399876 29201 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:10.438091 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:10.476611 21901 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 27.
I20260709 13:08:10.422217 28901 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.424011 29032 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:10.468256 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:10.423774 21726 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33508 (request call id 203) took 44913 ms (client timeout 15000 ms). Trace:
I20260709 13:08:10.478984 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.480001 21979 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:08:10.480564 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.481232 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.488336 21982 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:08:10.481876 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:10.420194 28438 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:10.489315 21978 raft_consensus.cc:2368] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23.
I20260709 13:08:10.489833 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.492493 21981 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 15: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:10.490727 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:10.493731 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:10.503377 28438 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.503660 21729 catalog_manager.cc:5697] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.504724 28438 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:10.490084 29175 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.000s
I20260709 13:08:10.477643 29223 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:10.559767 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.560467 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:10.475737 28934 consensus_queue.cc:1059] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:08:10.565227 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:10.568497 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 59899.6us
I20260709 13:08:10.570688 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.478252 29255 consensus_queue.cc:1048] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:08:10.575102 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.575529 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.576345 21827 raft_consensus.cc:2393] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:10.577482 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:10.579562 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.493257 29167 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 24.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:08:10.580411 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.562490 29251 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:08:10.658733 21729 catalog_manager.cc:5697] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:10.660352 21904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 3041) took 1214 ms. Trace:
W20260709 13:08:10.660481 29267 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:08:10.674212 21904 rpcz_store.cc:276] 0709 13:08:09.446090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.446227 (+   137us) service_pool.cc:224] Handling call
0709 13:08:09.488642 (+ 42415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.807924 (+319282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.660018 (+852094us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54000fa854. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:10.660273 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731973888}
W20260709 13:08:10.658660 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.661782 28619 consensus_meta.cc:287] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.001s
I20260709 13:08:10.583349 21978 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 23: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:10.679181 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.580080 29147 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:10.712112 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.709008 28934 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:10.722714 28934 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:10.723790 28934 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.725097 28934 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:10.726703 28584 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:08:10.727196 28584 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:10.728089 28584 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.729450 28584 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:10.730422 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.731853 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.574633 29203 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.576787 29175 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:10.709491 29019 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:10.721758 29167 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.721856 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.581492 28812 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:10.658933 29265 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:08:10.706307 29224 log.cc:927] Time spent T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:08:10.889128 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.889621 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.572068 29223 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.890290 29168 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:10.890841 29168 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:10.891469 29169 consensus_meta.cc:287] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.652s	user 0.005s	sys 0.009s
I20260709 13:08:10.753458 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:10.892596 21979 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:10.892138 29169 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.893083 29168 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:10.893922 21829 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:08:10.896314 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.750936 21729 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 13 to 14, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 14 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:10.905032 21799 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:10.706549 28767 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:10.872867 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:10.714367 29260 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:10.883590 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.885193 29271 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
I20260709 13:08:10.921461 21799 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:10.881883 21827 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:10.757599 29181 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:10.745486 28843 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:10.908394 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.912739 21979 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:10.906455 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.886747 28812 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.934533 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.939741 21978 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 14.
I20260709 13:08:10.935719 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:10.941602 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.941396 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:10.942109 21902 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:10.942203 21904 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:10.745834 29147 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.892171 29223 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:10.967206 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.908228 29176 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:10.970893 21974 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:08:10.804490 29175 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.976435 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:10.979910 21827 raft_consensus.cc:2393] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 22: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:10.939316 29215 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:10.944799 29221 consensus_meta.cc:287] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.701s	user 0.009s	sys 0.000s
I20260709 13:08:10.988794 21978 raft_consensus.cc:1240] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:10.980322 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.990291 29169 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.966075 29255 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.991261 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.991146 29255 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.991981 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.992336 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:10.992636 21827 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:10.993111 29221 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.993528 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:10.994498 29250 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:10.995282 21830 raft_consensus.cc:2368] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 15. Current term is 16.
I20260709 13:08:10.944532 29251 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:10.996119 29251 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:10.998677 22548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60034 (request call id 936) took 1016 ms. Trace:
I20260709 13:08:10.999037 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:10.487888 21726 rpcz_store.cc:269] 0709 13:07:25.510512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.510770 (+   258us) service_pool.cc:224] Handling call
0709 13:08:10.423635 (+44912865us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:07.785065 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:07.785726 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:07.785776 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:08:07.785795 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:07.786532 (+   737us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:07.786638 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:07.786672 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:07.787330 (+   658us) tablet.cc:701] Row locks acquired
0709 13:08:07.787375 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:08:07.787552 (+   177us) write_op.cc:270] Start()
0709 13:08:07.787715 (+   163us) write_op.cc:276] Timestamp: P: 1783602487787474 usec, L: 0
0709 13:08:07.787751 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:08:07.788399 (+   648us) log.cc:844] Serialized 2089 byte log entry
0709 13:08:08.138615 (+350216us) op_driver.cc:464] REPLICATION: finished
0709 13:08:08.190185 (+ 51570us) write_op.cc:301] APPLY: starting
0709 13:08:08.190310 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:08.194723 (+  4413us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:08.194822 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:08.197859 (+  3037us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:08.198199 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:08:08.198266 (+    67us) write_op.cc:312] APPLY: finished
0709 13:08:08.198574 (+   308us) log.cc:844] Serialized 57 byte log entry
0709 13:08:08.199584 (+  1010us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:08.199729 (+   145us) write_op.cc:454] Released schema lock
0709 13:08:08.199803 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:08.203026 (+  3223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:08.203056 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":249,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":51264,"apply.run_cpu_time_us":9259,"apply.run_wall_time_us":12850,"cfile_cache_hit":22,"cfile_cache_hit_bytes":24997,"num_ops":5,"prepare.queue_time_us":79936,"prepare.run_cpu_time_us":14415,"prepare.run_wall_time_us":189632,"raft.queue_time_us":113861,"raft.run_cpu_time_us":3957,"raft.run_wall_time_us":51428,"replication_time_us":350708,"thread_start_us":362301,"threads_started":4,"wal-append.queue_time_us":230174,"wal-append.run_cpu_time_us":15575,"wal-append.run_wall_time_us":1187766}]]}
I20260709 13:08:10.965327 29216 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:10.973197 29176 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.006731 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:11.006790 21832 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 17. (term mismatch)
I20260709 13:08:11.001693 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:11.007443 21832 pending_rounds.cc:85] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 16
I20260709 13:08:10.947896 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.007865 21832 pending_rounds.cc:107] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 25.17
I20260709 13:08:11.008257 21832 raft_consensus.cc:2889] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:11.008980 21904 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:10.924016 29167 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:10.913367 29019 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.013001 21827 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:11.012245 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:10.999075 22548 rpcz_store.cc:276] 0709 13:08:09.982466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.982593 (+   127us) service_pool.cc:224] Handling call
0709 13:08:09.982924 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.983272 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.983301 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.997830 (+ 14529us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.430076 (+432246us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b18003910c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:08:10.705958 (+275882us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:10.706020 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.706119 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.998387 (+292268us) raft_consensus.cc:1685] finished
0709 13:08:10.998410 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.998623 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4796,"raft.queue_time_us":5975,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":19623,"spinlock_wait_cycles":7881472,"thread_start_us":275666,"threads_started":1,"wal-append.queue_time_us":979818}
I20260709 13:08:11.016012 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.016829 21974 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:10.938871 29232 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:11.032720 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:11.036146 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 300347us
I20260709 13:08:10.964938 28843 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.009959 29176 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.038352 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:11.001060 29216 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.049695 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:10.930508 29260 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.037676 28619 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:11.055162 21974 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:11.051113 28843 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:11.037097 29221 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.007006 29215 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.071141 29251 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.065615 28619 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.075071 28812 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.077567 29216 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:11.085788 21982 raft_consensus.cc:2410] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:08:10.945111 29181 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.066906 29253 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:08:11.078946 29032 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.000s
W20260709 13:08:11.082705 29188 consensus_meta.cc:287] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.000s
I20260709 13:08:11.038219 29232 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 22 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:11.098466 21833 raft_consensus.cc:2410] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:08:11.085299 28619 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:11.088642 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 284299us
I20260709 13:08:11.089421 21909 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:11.084286 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.056766 28901 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.054360 29255 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.093600 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:11.078063 29238 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.104761 21904 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:11.105291 21983 raft_consensus.cc:606] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:11.109452 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.109673 21983 raft_consensus.cc:614] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:11.107465 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:11.092646 29253 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.094002 29019 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:11.097031 29221 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.120255 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.091053 29201 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:08:11.133147 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:11.134665 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:11.111065 29179 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.141165 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.141954 22548 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:11.121441 29253 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:11.136339 21904 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 28.
I20260709 13:08:11.146209 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.149134 21832 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:11.147169 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.151206 21875 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:11.156692 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.156821 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.107993 28901 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.126226 29216 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:08:11.150573 28438 consensus_meta.cc:287] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.001s
I20260709 13:08:11.138266 29277 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:11.136025 29221 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.144917 29251 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:11.118901 29238 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.186408 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.187971 22549 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:11.163501 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.160959 29187 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:11.173331 29175 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:11.148952 29179 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.195966 22548 raft_consensus.cc:2393] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 28: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:08:11.182243 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 217333us
I20260709 13:08:11.207296 22520 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:11.209417 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.210003 29132 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:11.211570 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.181072 29167 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.178717 29215 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.214386 22547 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:08:11.218684 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:11.202090 21800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.193305 29223 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:11.191057 29047 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:11.231667 29221 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.233335 29181 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:11.221431 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.242611 21832 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:11.243556 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.244633 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.246131 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:11.246778 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41278 (request call id 17) took 1425 ms. Trace:
I20260709 13:08:11.247200 21983 rpcz_store.cc:276] 0709 13:08:09.821518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.825253 (+  3735us) service_pool.cc:224] Handling call
0709 13:08:11.246591 (+1421338us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002c8b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efd8853 00007fb763fa660a 00007fb75d52c7d4 00007fb75d52c762 00007fb75d52c691 00007fb75d52c60c 00007fb75d52b8c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:11.246695 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2941825408}
I20260709 13:08:11.248448 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.248773 28438 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.251371 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:11.253199 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:11.253129 29197 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:11.253933 29197 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.249478 28438 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.255125 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.255789 21826 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:08:11.256270 29197 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.256623 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.257619 28901 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.220377 29132 raft_consensus.cc:2804] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:08:11.259128 28438 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.260011 29132 raft_consensus.cc:697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 28 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:11.261020 29132 consensus_queue.cc:237] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.257619 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3169) took 1860 ms. Trace:
I20260709 13:08:11.262416 21977 rpcz_store.cc:276] 0709 13:08:09.397243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.397354 (+   111us) service_pool.cc:224] Handling call
0709 13:08:09.427996 (+ 30642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.341202 (+913206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.257384 (+916182us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54003a57d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:11.257560 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088703744}
I20260709 13:08:11.223263 21974 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 14.
I20260709 13:08:11.223887 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.192654 29187 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:11.226007 29276 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:08:11.227775 29278 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:11.157466 29232 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.271067 29181 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.257730 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.273739 28619 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:11.277246 29254 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.973s	user 0.004s	sys 0.003s
I20260709 13:08:11.249557 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.287027 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.289737 21834 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:11.224563 29215 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.287868 29275 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:08:11.268575 29187 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:11.338294 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.324857 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.343518 21799 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:11.365751 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:11.367792 21977 raft_consensus.cc:3060] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:08:11.379307 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:11.377846 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 182718us
I20260709 13:08:11.394716 21902 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:11.395141 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.400197 21909 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:08:11.401722 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:11.402226 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.402505 21900 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:08:11.403712 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.409040 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:11.409936 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 141374us
I20260709 13:08:11.324056 29181 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.341068 29215 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.404493 21983 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:11.423017 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.425258 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.409608 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:11.437472 21974 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.377538 29221 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:11.436853 21826 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:08:11.439671 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:11.438925 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.445837 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 3069) took 1381 ms. Trace:
I20260709 13:08:11.449276 21983 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 23: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:11.445111 21900 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:08:11.452128 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.454732 29250 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:11.455314 29250 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.414574 29151 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:11.457118 29151 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.457612 29250 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:11.458274 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.459012 21874 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:11.459299 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:11.445562 29019 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:11.459935 21826 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 24: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:11.460157 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:11.446334 21908 rpcz_store.cc:276] 0709 13:08:10.064873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.064994 (+   121us) service_pool.cc:224] Handling call
0709 13:08:10.079194 (+ 14200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.092047 (+ 12853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.092100 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.095944 (+  3844us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.268938 (+172994us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:10.268972 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.269061 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.166862 (+897801us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:08:11.439840 (+272978us) raft_consensus.cc:1685] finished
0709 13:08:11.439862 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.445763 (+  5901us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1838,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7830,"spinlock_wait_cycles":5827456,"thread_start_us":132944,"threads_started":1,"wal-append.queue_time_us":192552}
I20260709 13:08:11.460969 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.461102 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:11.459452 29236 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.461856 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.463075 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:11.464283 21874 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:11.472146 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.472558 21826 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:11.474332 29289 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:11.474282 29236 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.475459 29279 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:11.476699 29192 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:11.476801 29236 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:11.477248 29192 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.478744 29151 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:11.460937 28584 consensus_meta.cc:287] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.000s
I20260709 13:08:11.479288 29192 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:11.479808 29216 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:11.480587 28901 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:11.473965 28922 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:11.470147 29221 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:11.488039 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.493711 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40638 (request call id 3367) took 1026 ms. Trace:
I20260709 13:08:11.482139 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:11.509747 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.442296 29290 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.514909 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:11.507299 21829 rpcz_store.cc:276] 0709 13:08:10.467228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.467461 (+   233us) service_pool.cc:224] Handling call
0709 13:08:11.493469 (+1026008us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540017fcd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:11.493640 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921733504}
I20260709 13:08:11.516693 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.517562 21833 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:11.524046 21974 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
W20260709 13:08:11.531698 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 49640us
W20260709 13:08:11.507586 29281 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:08:11.545928 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.461313 29047 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.556725 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.557580 21900 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:08:11.559266 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:11.560060 21833 raft_consensus.cc:3060] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:08:11.550539 21907 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:08:11.482584 28922 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:11.460026 29019 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:11.563022 21875 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.129:39085 timed out after 1.638s (SENT) [suppressed 7 similar messages]
I20260709 13:08:11.575145 22555 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:11.489185 29296 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:11.535650 29192 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:11.529922 29188 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:11.571039 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.582417 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.594517 21900 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:11.595677 21902 raft_consensus.cc:2393] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:11.592442 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.547289 29238 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:11.483310 29151 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:08:11.545708 29297 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.606766 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:11.531080 29176 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.579140 29181 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:11.620038 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:11.729527 21907 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.580144 29296 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.578773 29191 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.631837 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.574460 29279 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:08:11.636893 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 103011us
I20260709 13:08:11.483218 29221 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.641803 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:11.536538 29290 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.736722 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.764235 21902 raft_consensus.cc:2393] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 23: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:11.604710 29192 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:11.573014 29047 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:11.735241 29265 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:08:11.764374 21825 raft_consensus.cc:2368] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 14. Current term is 15.
I20260709 13:08:11.639433 28619 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:11.605304 29188 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:11.746939 29266 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 13:08:11.776443 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 213436us
I20260709 13:08:11.748525 29296 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:11.760114 28901 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:11.760229 29280 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.802919 21900 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:11.759958 29294 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:11.767174 29283 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.630946 29297 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.821367 21977 raft_consensus.cc:2468] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 28.
I20260709 13:08:11.822687 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:11.765306 29191 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.816471 21980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3187) took 1064 ms. Trace:
I20260709 13:08:11.830021 21948 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:11.831099 21907 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:08:11.812542 29318 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:11.850330 21980 rpcz_store.cc:276] 0709 13:08:10.752380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.752703 (+   323us) service_pool.cc:224] Handling call
0709 13:08:10.752984 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.753189 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:10.809048 (+ 55859us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.456484 (+647436us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b18003665e0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:08:11.815995 (+359511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.816075 (+    80us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:11.816142 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.816237 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.816398 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63305,"prepare.queue_time_us":151184,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":214353,"raft.run_wall_time_us":15777,"spinlock_wait_cycles":13647104,"thread_start_us":358742,"threads_started":2}
I20260709 13:08:11.833853 29215 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.867676 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:11.832103 29282 raft_consensus.cc:2764] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 13:08:11.821995 28901 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.862501 29314 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:11.809983 28922 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.878436 29176 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:11.880786 29290 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:11.882908 29302 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:08:11.883239 29315 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:11.883430 29047 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:11.883302 29301 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:08:11.883626 29298 log.cc:927] Time spent T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:08:11.826810 29280 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.861945 29279 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.834013 29283 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.863394 29192 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.886085 29314 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.883955 29188 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:11.829646 29294 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:11.920140 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.920816 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.921612 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.944787 21901 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 25.
I20260709 13:08:11.944984 21900 raft_consensus.cc:2393] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:11.945770 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.923188 29297 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:11.928965 29253 consensus_meta.cc:287] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.000s
W20260709 13:08:11.910332 29292 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:08:11.962854 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.885761 29305 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:11.907912 29315 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.864892 29318 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.931519 29311 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:11.888676 29151 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:11.935637 21833 raft_consensus.cc:2468] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:11.937120 22551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.940392 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.908565 29019 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:11.956405 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.960148 29329 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:11.965947 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.966593 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:11.885516 29321 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:08:11.967320 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:11.978796 21900 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.966885 29290 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:08:11.973869 29300 log.cc:927] Time spent T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 13:08:11.974862 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 3185) took 1223 ms. Trace:
I20260709 13:08:11.975955 28901 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:11.980662 21982 rpcz_store.cc:276] 0709 13:08:10.751785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.753170 (+  1385us) service_pool.cc:224] Handling call
0709 13:08:11.974648 (+1221478us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002c7c54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:11.974785 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392018304}
I20260709 13:08:11.985994 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:11.986652 21904 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:11.987442 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:11.999001 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.008793 21904 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:11.987373 29323 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:11.979873 29215 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:11.980986 29329 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.029124 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.030634 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.030979 29313 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:12.031493 21975 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
W20260709 13:08:12.032209 21830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2879) took 1468 ms (client timeout 1638 ms). Trace:
I20260709 13:08:12.032946 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.033411 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2886) took 1281 ms. Trace:
I20260709 13:08:12.035317 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.033785 21974 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:12.034855 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.050423 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.045485 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:12.032618 21830 rpcz_store.cc:269] 0709 13:08:10.563681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.563913 (+   232us) service_pool.cc:224] Handling call
0709 13:08:12.032006 (+1468093us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540017f7d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:12.032126 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743464192}
I20260709 13:08:12.018397 21900 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:08:11.965363 29253 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:11.983034 29151 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:08:12.014281 29187 consensus_meta.cc:287] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 13:08:12.019965 29147 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:12.020511 29323 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.021534 29322 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.021896 29283 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.009459 28843 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.033842 21828 rpcz_store.cc:276] 0709 13:08:10.751785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.803521 (+ 51736us) service_pool.cc:224] Handling call
0709 13:08:10.884644 (+ 81123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.011855 (+127211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.011891 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.011939 (+    48us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:11.011983 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.033179 (+1021196us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400336b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:12.033223 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.033333 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292080000}
I20260709 13:08:12.059692 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:12.073204 21834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2878) took 1513 ms (client timeout 1871 ms). Trace:
I20260709 13:08:12.073558 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.074141 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 1020) took 1708 ms. Trace:
W20260709 13:08:12.073549 21834 rpcz_store.cc:269] 0709 13:08:10.559813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.560189 (+   376us) service_pool.cc:224] Handling call
0709 13:08:12.073084 (+1512895us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54002882d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:12.073162 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407082368}
I20260709 13:08:12.077301 21978 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:12.074525 21903 rpcz_store.cc:276] 0709 13:08:10.365266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.487744 (+122478us) service_pool.cc:224] Handling call
0709 13:08:10.501694 (+ 13950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.904667 (+402973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.904698 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.904744 (+    46us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:08:10.904781 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.073878 (+1169097us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b5400237dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:12.073934 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.074072 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926275328}
I20260709 13:08:11.978289 29311 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.035382 29329 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:12.086935 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.057637 29188 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:11.984170 29290 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.088626 22554 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 24: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:12.052351 28619 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:12.092300 28767 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:12.093046 28767 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.093770 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.062474 29295 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:12.100886 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:12.101152 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.102223 21978 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.061955 29216 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:08:12.103149 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.034927 29215 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.108124 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.108927 21900 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:12.070865 29187 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:12.110739 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 50602.5us
I20260709 13:08:12.113692 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.114459 29151 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.099682 28767 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.074811 28843 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.077069 29322 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.128958 22545 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bde6ac1d042400fbc88831c01b9fdda with delete_type TABLET_DATA_TOMBSTONED (TS 0157b4f0725d4f92a53938c921db9efc not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:34122
I20260709 13:08:12.097719 28619 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.131469 21909 raft_consensus.cc:2393] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:12.138911 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.145220 21977 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:08:12.159598 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:12.160112 29330 log.cc:927] Time spent T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:12.160737 29337 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:08:12.164390 29287 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.729s	user 0.002s	sys 0.009s
I20260709 13:08:12.145565 29181 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.130715 29338 raft_consensus.cc:2764] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:08:12.167208 29181 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.167958 29280 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.169553 29181 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:12.170332 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.171037 21900 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:12.171762 28619 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.173359 21978 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:08:12.176463 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.177259 21982 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:12.179425 21875 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:12.186975 29314 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.136444 29318 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.189141 29294 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.142922 29203 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:12.219976 29253 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:12.217975 29337 raft_consensus.cc:2804] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:12.133462 29223 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:12.231834 29215 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.232067 29223 raft_consensus.cc:3060] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:12.232381 29340 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:12.222570 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.232939 29340 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.236006 21902 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:08:12.224128 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.236876 21900 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:12.236974 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.234966 29296 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.238458 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.238842 29290 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.240018 29223 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.231853 29337 raft_consensus.cc:697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:12.241700 29179 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:12.242136 29337 consensus_queue.cc:237] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.226284 29187 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.227926 29323 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:12.228459 29315 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.248492 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.283342 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:12.285845 29340 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.286638 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.287371 21900 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 17.
I20260709 13:08:12.266496 29315 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.255669 29323 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:12.288614 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:12.280906 28884 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:12.289333 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.307567 21904 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:12.295511 29293 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:12.295956 29296 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.291703 29251 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.009s
W20260709 13:08:12.316587 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 202956us
I20260709 13:08:12.317952 21873 leader_election.cc:400] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23.
I20260709 13:08:12.318334 21873 leader_election.cc:403] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.318562 22520 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:12.293084 29323 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.323206 29311 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.324054 29323 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:12.324530 29187 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23.
I20260709 13:08:12.325439 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2894) took 1337 ms. Trace:
I20260709 13:08:12.325939 21825 rpcz_store.cc:276] 0709 13:08:10.987674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.992099 (+  4425us) service_pool.cc:224] Handling call
0709 13:08:12.325185 (+1333086us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54000e97d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:12.325366 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773866880}
I20260709 13:08:12.326598 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.327391 29296 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.328800 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 3057) took 2351 ms. Trace:
I20260709 13:08:12.329598 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.331169 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.332077 29340 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:12.332463 29340 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:12.332825 29340 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:12.334003 29307 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.571s	user 0.001s	sys 0.000s
I20260709 13:08:12.338528 29322 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.341240 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.341511 29239 consensus_queue.cc:1059] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:12.342422 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:12.329133 21906 rpcz_store.cc:276] 0709 13:08:09.977128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.977241 (+   113us) service_pool.cc:224] Handling call
0709 13:08:09.977497 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.034114 (+ 56617us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:08:10.072795 (+ 38681us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.755111 (+682316us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b180022f240. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:08:11.187911 (+432800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.187959 (+    48us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:11.188018 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.328571 (+1140553us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54003c9e54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:12.328617 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.328718 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6233,"prepare.queue_time_us":38469,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":5224,"raft.queue_time_us":35708,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":133725312,"thread_start_us":426260,"threads_started":2,"wal-append.queue_time_us":1063579,"wal-append.run_cpu_time_us":1861,"wal-append.run_wall_time_us":1168382}
I20260709 13:08:12.345835 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.347270 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:12.348894 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.349769 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.342015 29290 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:12.319003 29223 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.320719 29338 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.359716 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.355571 21873 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.342339 29201 raft_consensus.cc:3055] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:12.361620 29201 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:12.364240 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.365439 29337 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.367377 29337 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:08:12.367962 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.371299 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.372046 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.372764 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:12.373356 21982 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:12.373525 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.374078 21978 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:12.374979 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:12.375703 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:12.376605 21975 raft_consensus.cc:2393] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 23: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:12.378661 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.378729 29322 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:12.379370 29322 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.381735 29322 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.307432 29315 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.348053 28819 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:12.348276 29239 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:12.316138 28884 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:12.388586 29336 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:08:12.388902 28819 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.385399 29338 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:12.389989 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.353093 28619 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:12.391348 29315 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.402877 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.354945 29216 raft_consensus.cc:2764] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:08:12.356382 29215 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:12.407373 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.430299 21902 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:12.407750 28843 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.408145 29191 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.448930 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.404830 29223 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:12.429136 21904 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 26.
I20260709 13:08:12.382920 29296 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:12.405021 29239 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:12.448173 28884 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.412217 21982 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:12.424304 28819 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.453370 29239 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:12.468693 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2885) took 1722 ms. Trace:
I20260709 13:08:12.469208 21831 rpcz_store.cc:276] 0709 13:08:10.746750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.747123 (+   373us) service_pool.cc:224] Handling call
0709 13:08:10.747514 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.747928 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.747970 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.748521 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.986232 (+237711us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b1800441b80. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bef1522 00007fb75bef37c1 00007fb75bef3779 00007fb75bef3709 00007fb75bef36d1 00007fb75bef29cd 000000000038f354 000000000038f199 00007fb75bed483a
0709 13:08:11.157828 (+171596us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:11.157868 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.157926 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.455311 (+1297385us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b2400120c68. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf2ffb0 00007fb75eba6488 00007fb75eba6be8 00007fb75eb7e398 00007fb75eb7976a 00007fb75eb78bb6
0709 13:08:12.468433 (+ 13122us) raft_consensus.cc:1685] finished
0709 13:08:12.468464 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.468622 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":916,"raft.run_cpu_time_us":7632,"raft.run_wall_time_us":135367,"spinlock_wait_cycles":43788416,"thread_start_us":240055,"threads_started":1,"wal-append.queue_time_us":473552}
I20260709 13:08:12.454510 29340 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.468298 29232 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:12.482599 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 3086) took 1077 ms. Trace:
I20260709 13:08:12.482926 21909 rpcz_store.cc:276] 0709 13:08:11.402910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.414106 (+ 11196us) service_pool.cc:224] Handling call
0709 13:08:12.480182 (+1066076us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54002387d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:12.480280 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597488512}
I20260709 13:08:12.476812 29232 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.491956 28438 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:12.495298 28438 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.497552 28438 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.501255 29239 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.509526 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.515659 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:12.514663 29319 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.516566 29319 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.518676 29319 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.520782 29338 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.522868 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 27 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.523075 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.524449 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:12.527119 29239 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.534247 29203 raft_consensus.cc:2764] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:08:12.536453 29340 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.536990 29151 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.539649 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:12.540076 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.540367 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.540766 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.540971 21975 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:12.541185 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.541994 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.542379 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.542573 21979 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 24.
I20260709 13:08:12.541365 21978 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:12.544480 22554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57008 (request call id 1047) took 1388 ms. Trace:
I20260709 13:08:12.544828 22554 rpcz_store.cc:276] 0709 13:08:11.156309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.156423 (+   114us) service_pool.cc:224] Handling call
0709 13:08:12.544284 (+1387861us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540053a7d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:12.544404 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136880512}
I20260709 13:08:12.549101 28819 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.543336 29232 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.541882 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.555362 29201 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.556602 29201 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:12.557219 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.551731 29232 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:12.559989 29232 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.560672 29260 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:12.569311 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:12.571480 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.571632 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.573196 22554 raft_consensus.cc:2368] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:08:12.573386 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.573974 21829 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:12.574826 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.575284 21799 leader_election.cc:400] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:08:12.575591 21799 leader_election.cc:403] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.576341 21976 raft_consensus.cc:1275] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:12.577322 21829 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:12.578013 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.578615 21909 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
W20260709 13:08:12.580334 21718 catalog_manager.cc:5002] TS 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): delete failed for tablet 6bde6ac1d042400fbc88831c01b9fdda because of a CAS failure. No further retry: Illegal state: Request specified cas_config_opid_index_less_or_equal of 9 but the committed config has opid_index of 11
I20260709 13:08:12.580236 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.581341 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.581923 21981 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:12.582794 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.584585 29179 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:12.585086 29179 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.587582 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.588256 21829 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:12.590862 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.591600 21978 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:08:12.587113 29179 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:12.596238 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.596297 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.596860 28819 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:12.597061 21825 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:12.577487 29232 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.601570 22519 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:12.603109 29250 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:12.603524 29250 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:12.603901 29250 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:12.608635 29277 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:08:12.576290 29175 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.611203 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:12.612725 29322 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:12.613214 29322 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:12.597783 29051 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:12.614017 29322 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.614537 29051 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.617966 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:12.618548 21906 raft_consensus.cc:3060] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.622486 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.622803 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.623258 29239 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:12.623605 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.623462 21834 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:12.624753 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.624814 29239 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:12.625483 29239 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:12.626116 29239 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:12.626354 29260 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:12.625603 28619 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.630518 29051 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:12.630784 28619 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:12.631785 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.632372 21903 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:12.633193 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.634336 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.634936 21902 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:12.636823 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.637691 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.639513 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.662969 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.663486 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.640854 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.646390 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.664805 21825 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:08:12.647584 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.654042 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.654690 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.654814 21834 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:08:12.667233 21831 raft_consensus.cc:2468] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:08:12.668574 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:12.669257 21831 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 24: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:12.656000 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:12.672477 21873 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:12.673024 29187 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:12.673156 29293 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:12.673470 29187 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:12.657203 21798 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.673890 29187 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:12.674585 29329 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:12.674870 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.658607 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.676456 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.659631 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.677857 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.677452 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.662503 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.678726 21906 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:12.678764 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:12.680066 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.682538 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:12.685110 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.687381 22550 raft_consensus.cc:2393] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 24: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:12.687325 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.689738 28767 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:12.684245 21798 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:12.690441 28767 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:12.690558 29329 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.690927 28767 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:12.691016 29326 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:12.689672 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.691903 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:12.688932 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.692531 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.692034 22555 raft_consensus.cc:2393] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 18: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:12.696274 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.696759 21904 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:08:12.698024 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.698891 21906 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:12.699667 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:12.704360 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.698566 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.700587 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.706257 29179 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:12.700224 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:12.700907 29326 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:12.709692 22555 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:12.701896 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.673883 29293 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:12.694255 29260 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:12.747035 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 45204.6us
I20260709 13:08:12.699023 28819 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.701694 29007 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:12.751051 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:12.753957 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:12.701568 29329 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:12.707435 29151 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:12.706955 29179 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:12.706935 29277 consensus_queue.cc:1048] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:12.721903 21798 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:08:12.777225 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55416.5us
I20260709 13:08:12.767628 29175 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 17. Current term is 18.
I20260709 13:08:12.779428 29232 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:12.779853 29232 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.780170 29232 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:12.780488 29239 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.781525 21909 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:08:12.783846 29239 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.784585 29293 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.787994 29232 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.789944 29232 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.778401 21798 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:12.801132 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:12.801427 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.802359 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.801723 21827 raft_consensus.cc:2376] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20. Re-sending same reply.
W20260709 13:08:12.803687 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 101246us
I20260709 13:08:12.758912 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:12.806128 21832 raft_consensus.cc:2468] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
W20260709 13:08:12.806341 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 47500.8us
I20260709 13:08:12.748492 28915 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:12.751878 29283 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:12.771044 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.746025 29313 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:08:12.775223 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.761538 29314 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:08:12.804414 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.805037 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:12.815246 21827 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:12.815943 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44978.8us
I20260709 13:08:12.816785 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.817021 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:12.762213 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:12.806991 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.822046 21949 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.822252 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.823638 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.766911 29326 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.833681 29320 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:12.826210 29203 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:12.828111 29179 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:08:12.828189 29175 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:12.838028 29282 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:12.838389 29175 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.838812 29175 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:12.840070 21827 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:12.840354 29282 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:12.840830 29282 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:12.831267 29322 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.842834 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 27 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.843098 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:12.843672 21827 raft_consensus.cc:2410] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 27 because replica has last-logged OpId of term: 25 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 11.
I20260709 13:08:12.809738 29251 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:12.825246 28915 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:12.846112 28915 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.846475 28915 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:12.847930 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:08:12.851042 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 150864us
I20260709 13:08:12.856638 21833 raft_consensus.cc:2468] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:12.819746 29151 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:12.852142 22520 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:12.853507 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.807138 29232 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:12.807740 29309 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:12.776015 29329 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.810748 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.812500 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.813294 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.814029 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:12.844218 29319 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:12.873114 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 60671.2us
W20260709 13:08:12.873175 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 59956.2us
I20260709 13:08:12.874365 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.875479 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.876438 29132 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:12.884958 29051 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.885598 29251 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:12.886047 21829 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:12.886977 29274 raft_consensus.cc:2804] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:12.887741 29274 raft_consensus.cc:697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:12.886044 29251 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:12.892859 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.893210 29187 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.893733 29283 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:12.894665 29255 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:12.894565 29274 consensus_queue.cc:237] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.895275 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:12.896025 29283 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:12.895967 29251 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.896499 29283 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:12.896874 29283 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:12.900444 21729 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 223) took 48069 ms (client timeout 15000 ms). Trace:
I20260709 13:08:12.900609 29251 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:12.902359 29151 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.903390 21726 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 14 to 18, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 18 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:12.905215 21726 catalog_manager.cc:5697] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index -1 to 12, term changed from 16 to 18, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129), VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 18 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:12.864850 29250 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.907313 21726 catalog_manager.cc:5697] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:12.908435 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:12.912571 21874 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.913653 29239 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:12.914091 21981 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:12.912612 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:12.916543 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.920642 22555 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:12.918080 21874 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.923513 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.925034 21909 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
W20260709 13:08:12.926710 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51307.6us
I20260709 13:08:12.927678 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:12.928644 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.930112 29201 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:12.926736 29313 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:08:12.932219 29239 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:12.932348 21874 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.930358 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:12.864737 29232 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.872452 29329 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:12.869858 29309 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:12.921571 21799 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:12.938077 21875 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.921607 29322 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.952633 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:08:12.900832 21729 rpcz_store.cc:269] 0709 13:07:24.830699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.851177 (+ 20478us) service_pool.cc:224] Handling call
0709 13:08:12.900360 (+48049183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:11.414214 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:11.428814 (+ 14600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:11.428849 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:11.428867 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:11.429603 (+   736us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:11.429689 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:11.429734 (+    45us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:11.430316 (+   582us) tablet.cc:701] Row locks acquired
0709 13:08:11.430338 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:11.430540 (+   202us) write_op.cc:270] Start()
0709 13:08:11.430683 (+   143us) write_op.cc:276] Timestamp: P: 1783602491430470 usec, L: 0
0709 13:08:11.430717 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:08:11.433030 (+  2313us) log.cc:844] Serialized 1701 byte log entry
0709 13:08:11.961671 (+528641us) op_driver.cc:464] REPLICATION: finished
0709 13:08:12.110081 (+148410us) write_op.cc:301] APPLY: starting
0709 13:08:12.119124 (+  9043us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:12.171033 (+ 51909us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:12.171126 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:12.353672 (+182546us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:12.402771 (+ 49099us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:08:12.402817 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:12.403039 (+   222us) log.cc:844] Serialized 49 byte log entry
0709 13:08:12.403195 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.403304 (+   109us) write_op.cc:454] Released schema lock
0709 13:08:12.403341 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:12.403735 (+   394us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.403771 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":680600,"reported_tablets":51,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":129234,"apply.run_cpu_time_us":7889,"apply.run_wall_time_us":303009,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20823,"num_ops":4,"prepare.queue_time_us":333308,"prepare.run_cpu_time_us":4752,"prepare.run_wall_time_us":120875,"raft.queue_time_us":57818,"raft.run_cpu_time_us":4920,"raft.run_wall_time_us":24106,"replication_time_us":530773,"thread_start_us":299678,"threads_started":4,"wal-append.queue_time_us":293209}]]}
I20260709 13:08:12.956739 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.927475 29296 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.960609 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.961500 29314 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:12.981490 29314 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.981421 29203 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:12.982100 29314 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:12.975457 21872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.964107 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.984433 29103 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:12.937150 29201 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:12.935029 29007 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:12.950899 29232 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:12.950278 29239 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:12.955480 29309 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:12.998131 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.961807 29167 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:12.961560 29293 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:12.993582 29103 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:12.997887 29201 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:12.992678 29337 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:08:12.907343 29175 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:12.985139 29340 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:13.019541 21875 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.985250 29168 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:08:12.996869 29319 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:13.031097 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:12.957860 29179 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:08:13.033509 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 72984.7us
I20260709 13:08:13.034957 21875 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:13.023080 29359 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:13.037642 29167 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:13.016624 28915 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.032692 29293 raft_consensus.cc:2804] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:13.041448 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:13.024338 29239 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:13.045400 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.022907 29176 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:08:13.053680 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 231709us
I20260709 13:08:13.043366 29051 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.038036 29296 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.085934 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.044080 29184 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.081700 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.088555 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:13.088990 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.046243 29167 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:13.093784 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.092531 29201 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.095165 29371 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:08:13.092511 29167 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:13.083636 29221 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:13.091071 29187 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:13.099309 29184 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.101351 29184 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:13.090377 28915 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.103528 29103 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:13.084232 29255 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:08:13.104323 29314 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.085934 29293 raft_consensus.cc:697] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:13.037531 29319 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.050086 29179 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:13.106753 29179 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:13.108259 29319 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:13.044597 29374 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:13.105943 29239 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.112731 29374 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.107980 29314 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:13.115306 29374 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.106031 29293 consensus_queue.cc:237] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.122021 29151 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:13.124007 29151 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:13.124481 29179 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.127664 29179 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:13.129673 29283 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.131901 29283 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:13.132750 29329 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.090945 29323 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:08:13.140146 29282 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.143895 29175 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.039925 28767 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.052431 29340 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:13.152613 22548 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:08:13.158331 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 64606.1us
I20260709 13:08:13.159122 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:12.957592 21726 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 15 to 18, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 18 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.151080 29007 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.165724 28915 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:13.159714 29320 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:13.170909 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.181185 21909 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.172487 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.172617 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.083040 29176 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.150802 29051 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:13.166612 22555 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:13.174904 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.200911 21902 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.177366 21904 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:13.178946 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:13.182317 21908 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:13.198694 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.202519 21905 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.199441 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:13.209825 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.210487 21903 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:13.209895 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 247500us
I20260709 13:08:13.216651 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:13.218384 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:13.228765 21909 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:13.180018 28915 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.234622 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.236220 21832 raft_consensus.cc:1275] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:13.245548 21904 raft_consensus.cc:1240] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:13.246236 29329 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.245869 21902 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:13.182771 29007 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.267481 29007 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:13.269317 21908 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
W20260709 13:08:13.272161 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 52802.6us
I20260709 13:08:13.275103 21948 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.275941 29323 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:13.277608 21948 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.284332 29323 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:13.285440 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.285957 29282 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:13.287902 28767 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:13.288959 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:13.290074 29250 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.253420 29176 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:13.301349 29167 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.260669 29309 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.232993 29313 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:13.232492 29315 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:13.231663 29283 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.244197 28915 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:13.329245 21903 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:13.335378 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:13.338093 21902 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:13.235378 29359 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.093s
I20260709 13:08:13.322043 29313 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:13.345182 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 256217us
W20260709 13:08:13.345947 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 60571.3us
I20260709 13:08:13.352854 21975 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.364506 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:13.354370 29313 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:13.333847 29283 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.368985 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:13.369837 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:13.370102 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:13.351809 29323 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:13.372584 21982 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:13.375875 21977 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.377813 21976 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:13.331652 29315 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.382390 21908 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: [21.12-22.13]
I20260709 13:08:13.386336 21902 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: [20.12-22.13]
I20260709 13:08:13.387924 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:13.389488 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:13.390398 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:13.391952 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:13.395424 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.395958 21909 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:13.402156 21909 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:08:13.405090 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.406596 21909 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:13.416290 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:13.365444 29201 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:13.424882 21873 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:13.426183 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:13.427598 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.433276 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:13.433805 21830 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:13.434854 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:13.437424 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:13.438043 21901 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:08:13.432027 21799 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:13.439900 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.442771 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:13.443087 22520 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.445283 22550 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:13.363533 29293 consensus_queue.cc:1048] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:08:13.454634 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.463943 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:13.509016 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:13.513764 21907 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:13.394619 29176 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:13.473719 21799 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:13.526773 28767 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:13.530680 29385 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:08:13.521628 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 81606us
W20260709 13:08:13.524521 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 69980.9us
I20260709 13:08:13.537252 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.391992 29179 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.128s
I20260709 13:08:13.439774 29340 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:08:13.526072 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 131534us
I20260709 13:08:13.540879 21977 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:13.463433 29374 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:13.352144 21726 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:13.516140 28438 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:13.564905 21827 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:08:13.547595 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:13.449105 29167 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.552937 29282 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:13.533099 29176 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.558611 29329 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:13.559741 21830 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
I20260709 13:08:13.585721 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:13.566418 21827 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:08:13.587755 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:13.588369 21825 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:08:13.566479 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:13.590829 21826 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:13.594383 29007 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:13.594786 29007 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:08:13.594827 29384 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:13.595582 28884 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:13.595692 29007 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.569180 21828 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:13.597039 29007 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.600288 29283 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.517023 29221 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:08:13.509197 29277 consensus_queue.cc:1059] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:08:13.603901 29277 raft_consensus.cc:3055] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:13.604061 29315 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:13.604270 29277 raft_consensus.cc:740] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:13.605224 29277 consensus_queue.cc:260] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.611449 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:13.611642 29277 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:13.610759 21828 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:13.581493 21726 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 20 to 22, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 22 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:13.582717 28438 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:13.583318 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:13.583827 29176 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.567981 29314 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.605862 29309 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:13.548614 29103 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.058s
I20260709 13:08:13.606711 29320 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:13.607781 29383 log.cc:927] Time spent T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
W20260709 13:08:13.609357 29232 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 13:08:13.544083 29326 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:13.609779 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:13.609992 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:13.610738 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:13.618141 21826 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:08:13.629316 29232 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.631942 29232 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.632037 28438 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.632925 29326 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:13.634114 29326 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.620220 29314 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.638264 21829 raft_consensus.cc:2368] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:13.640074 29314 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:13.628685 29216 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:08:13.602034 29151 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:13.657015 21905 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:13.661010 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:13.653671 21975 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:13.665669 28619 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:13.680003 28619 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.691049 21726 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:13.693686 28619 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:13.698413 21726 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.701221 21726 catalog_manager.cc:5697] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 14 to 18, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 18 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.708081 21982 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:13.450271 29201 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:13.722294 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 248671us
I20260709 13:08:13.723744 21799 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:13.724690 21904 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:08:13.689713 28915 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:13.755625 21799 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:13.761142 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.762212 21909 raft_consensus.cc:2368] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21.
I20260709 13:08:13.763348 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:13.703436 21726 catalog_manager.cc:5697] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 19 to 24, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 24 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:13.771031 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 210785us
I20260709 13:08:13.771612 21974 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:13.774081 21906 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:13.770087 21726 catalog_manager.cc:5697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 10 to 19. New cstate: current_term: 19 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.775148 21799 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.776216 21726 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.783460 29151 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:13.787609 22555 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:13.788360 21726 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index -1 to 11, term changed from 12 to 16, VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 16 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:13.770335 29329 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:13.785987 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:13.794934 21905 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 26 index: 12. (index mismatch)
I20260709 13:08:13.798780 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:13.802680 21981 raft_consensus.cc:3055] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:13.803057 21981 raft_consensus.cc:740] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:13.791602 21726 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 16 to 18, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 18 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:13.781042 29184 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:13.784952 29283 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:13.817263 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.819016 21979 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:08:13.824291 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:13.781834 29296 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 13:08:13.828800 21948 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:13.831945 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 51894.5us
I20260709 13:08:13.825043 21981 consensus_queue.cc:260] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.836387 21799 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:13.818245 29378 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:13.841195 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:13.821969 29329 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:13.870932 22521 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.872843 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:13.828047 29387 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:13.802106 29396 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:13.879819 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:13.823596 29323 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:13.878619 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:13.884989 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:13.827641 29283 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:13.902664 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:13.903286 21908 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:13.903637 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:13.907372 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:13.916937 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2926) took 1009 ms. Trace:
I20260709 13:08:13.917542 21829 rpcz_store.cc:276] 0709 13:08:12.907969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.908109 (+   140us) service_pool.cc:224] Handling call
0709 13:08:13.916698 (+1008589us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54001d7ed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:13.916861 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676276480}
I20260709 13:08:13.923892 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:13.927161 21982 raft_consensus.cc:1275] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:08:13.920924 21829 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:13.880131 29184 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:13.929752 21799 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:14.211505 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:14.220026 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:14.233752 21908 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 25.
I20260709 13:08:13.881053 29309 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:14.273644 28915 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.275846 29410 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:14.277603 29201 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:14.281373 29405 log.cc:927] Time spent T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.380s	user 0.000s	sys 0.000s
I20260709 13:08:14.243023 29132 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:14.284350 21830 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 26. Current term is 27. Ops: []
I20260709 13:08:14.211218 29320 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:14.316118 21900 raft_consensus.cc:1240] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:13.882433 29239 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.383s
I20260709 13:08:14.317777 21832 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:13.929270 29404 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:08:13.883910 29378 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:13.823567 29397 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:08:14.349642 21909 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:14.351408 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.929670 21974 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:08:14.359287 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 429558us
W20260709 13:08:14.359355 29313 consensus_meta.cc:287] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.967s	user 0.006s	sys 0.003s
W20260709 13:08:14.436003 22521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.003s	sys 0.011s
I20260709 13:08:14.402685 29184 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:08:14.460232 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.001s	sys 0.016s
W20260709 13:08:14.460611 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.001s	sys 0.016s
I20260709 13:08:14.460350 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:08:14.460954 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 624446us
I20260709 13:08:14.463217 22549 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:14.464078 29410 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:14.435664 29167 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:14.440692 29216 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.335829 29329 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.463665 29429 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.442751 29274 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:14.458583 29320 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:08:14.442776 22521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.003s	sys 0.012s
W20260709 13:08:14.477921 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 586492us
I20260709 13:08:14.407296 29283 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.444242 29313 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.484134 22521 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:14.476678 29320 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:14.505460 21978 raft_consensus.cc:2368] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:14.472366 29216 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.515408 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:14.520236 21900 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:14.478510 29396 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.479619 29274 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.527823 29378 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:14.528787 29430 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:14.529322 29420 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:14.529611 29426 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:14.478205 29429 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:14.631072 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 129268us
W20260709 13:08:14.525394 29400 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 13:08:14.653448 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 150149us
I20260709 13:08:14.505631 29401 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:14.529915 29007 consensus_meta.cc:287] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.932s	user 0.010s	sys 0.000s
I20260709 13:08:14.635762 21900 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 27.
I20260709 13:08:14.505587 29428 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:14.677145 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:14.677584 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:14.685724 21900 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:14.489943 29184 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.669679 29404 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.690074 21900 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:08:14.705695 29419 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:08:14.675258 29430 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:14.744606 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 235756us
I20260709 13:08:14.711565 29438 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:14.713428 29420 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:14.668960 28819 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.721619 29274 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.630745 29396 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.687580 29418 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:14.731389 29428 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:14.735898 29423 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:14.747359 29277 consensus_meta.cc:287] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 1.135s	user 0.009s	sys 0.003s
I20260709 13:08:14.732949 29250 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:14.691442 29323 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:08:14.750155 29400 log.cc:927] Time spent T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:14.722802 29007 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:08:14.749660 29402 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:14.688529 29401 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.746466 29404 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.754881 29424 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.751667 29420 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.755347 29176 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:14.804749 21908 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:14.752275 28819 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.806947 21900 raft_consensus.cc:1275] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:14.776866 29322 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.745059 29320 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.802012 29410 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.803375 29425 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:14.801932 29007 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:14.817332 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:14.825565 21908 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 25: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:14.818490 29313 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:14.826278 29434 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:08:14.827700 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2935) took 1116 ms. Trace:
I20260709 13:08:14.828068 21825 rpcz_store.cc:276] 0709 13:08:13.712485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.914788 (+202303us) service_pool.cc:224] Handling call
0709 13:08:13.915257 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:14.437332 (+522075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.437364 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:14.440055 (+  2691us) log.cc:844] Serialized 52 byte log entry
0709 13:08:14.522226 (+ 82171us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:14.522291 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.522432 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.827462 (+305030us) raft_consensus.cc:1685] finished
0709 13:08:14.827485 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.827640 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23754,"raft.queue_time_us":372539,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6255,"thread_start_us":548805,"threads_started":2,"wal-append.queue_time_us":70560}
I20260709 13:08:14.766438 29250 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.757462 29418 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.834275 29445 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:14.835729 29445 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.760480 29423 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.776062 29402 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.829526 29007 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:14.814719 29176 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.861367 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:14.863155 22554 raft_consensus.cc:1240] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:14.814531 29424 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.824486 29322 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.846804 29320 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:14.854501 29402 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.830983 29410 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.852485 29445 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:14.887041 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 84717.9us
I20260709 13:08:14.847640 29277 consensus_queue.cc:1059] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:08:14.831248 29425 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.832824 29323 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.898286 29448 consensus_queue.cc:1048] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:08:14.891023 29444 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:14.909628 21982 raft_consensus.cc:1240] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
W20260709 13:08:14.906798 29437 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:08:14.907178 29443 log.cc:927] Time spent T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:08:14.908459 29387 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:14.938675 29309 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:14.939245 29309 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.911816 29401 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.934788 29418 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.900043 29442 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:14.938489 29387 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.901618 29322 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:14.924587 29439 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:14.908663 29410 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.907394 29424 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:14.910737 29404 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:14.933022 29433 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:14.846331 29428 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.945938 29442 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.944159 29216 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.911262 29444 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.940518 29438 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:08:14.963784 29446 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:14.943054 29396 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:14.964403 29423 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:14.965366 22519 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.976677 28819 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.966464 29176 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:14.937729 29430 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.967013 29425 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:14.952339 29309 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.981140 29438 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:14.984395 29309 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:14.982591 29404 consensus_queue.cc:1059] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:14.973420 29387 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:14.898989 29007 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.975737 21829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40638 (request call id 3415) took 1099 ms. Trace:
I20260709 13:08:14.976118 29420 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.973949 29433 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:14.980029 29442 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:14.965456 29250 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.976658 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 3122) took 1104 ms. Trace:
I20260709 13:08:14.987129 21829 rpcz_store.cc:276] 0709 13:08:13.876821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.928194 (+ 51373us) service_pool.cc:224] Handling call
0709 13:08:13.928460 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.441221 (+512761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.441265 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.477316 (+ 36051us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.628024 (+150708us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:14.628080 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.628181 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.975513 (+347332us) raft_consensus.cc:1685] finished
0709 13:08:14.975533 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.975678 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282829,"raft.queue_time_us":359532,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":18976,"spinlock_wait_cycles":1986944,"thread_start_us":360360,"threads_started":2,"wal-append.queue_time_us":316896}
I20260709 13:08:14.988771 21949 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:14.991976 21905 rpcz_store.cc:276] 0709 13:08:13.872100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.872254 (+   154us) service_pool.cc:224] Handling call
0709 13:08:13.905360 (+ 33106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.905541 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.905563 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.904122 (+998559us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b2c00010828. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:08:14.904554 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.945189 (+ 40635us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:14.945232 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.945307 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.974923 (+ 29616us) raft_consensus.cc:1685] finished
0709 13:08:14.974950 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.976547 (+  1597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17137536,"thread_start_us":32302,"threads_started":1,"wal-append.queue_time_us":67305}
I20260709 13:08:14.994630 21828 raft_consensus.cc:1275] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:08:14.994702 29442 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:14.995282 21828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2933) took 1378 ms. Trace:
I20260709 13:08:14.985450 29438 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:14.995618 21828 rpcz_store.cc:276] 0709 13:08:13.617050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.993014 (+1375964us) service_pool.cc:224] Handling call
0709 13:08:14.994334 (+  1320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.995057 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.995233 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:14.993791 29260 raft_consensus.cc:3055] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:14.996740 29007 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:14.962316 29439 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.004263 22519 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.006556 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:15.007437 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.008160 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.009222 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.009755 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:15.009791 21834 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
W20260709 13:08:15.010344 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.991887 29387 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:08:15.010926 21831 raft_consensus.cc:2393] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 25: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:15.011405 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.012658 29250 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:15.002607 29260 raft_consensus.cc:740] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:15.012960 28819 consensus_queue.cc:1048] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:08:15.014843 29433 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:15.014927 29399 log.cc:927] Time spent T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.127s	user 0.002s	sys 0.013s
I20260709 13:08:15.012729 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.022502 21983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3243) took 1311 ms. Trace:
I20260709 13:08:15.022871 21983 rpcz_store.cc:276] 0709 13:08:13.710852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.712721 (+  1869us) service_pool.cc:224] Handling call
0709 13:08:13.722746 (+ 10025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.723141 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.723179 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.726034 (+  2855us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.855414 (+129380us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:13.855473 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.855576 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.021612 (+1166036us) spinlock_profiling.cc:243] Waited 878 us on lock 0x7b24001ea2f8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf2ffb0 00007fb75eba6488 00007fb75eba6be8 00007fb75eb7e398 00007fb75eb7976a 00007fb75eb78bb6
0709 13:08:15.022234 (+   622us) raft_consensus.cc:1685] finished
0709 13:08:15.022253 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.022447 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":795,"raft.queue_time_us":473,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":1956,"spinlock_wait_cycles":2019072,"thread_start_us":87088,"threads_started":1,"wal-append.queue_time_us":86499}
I20260709 13:08:14.986577 29323 consensus_queue.cc:1059] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 13:08:15.025134 21975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39186 (request call id 3217) took 2109 ms (client timeout 2039 ms). Trace:
I20260709 13:08:15.015199 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.025583 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:08:15.025528 21975 rpcz_store.cc:269] 0709 13:08:12.915655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.915816 (+   161us) service_pool.cc:224] Handling call
0709 13:08:15.024958 (+2109142us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b5400273b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:15.025046 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963407104}
I20260709 13:08:15.031889 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.033425 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.035439 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.034432 28843 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:15.029770 29260 consensus_queue.cc:260] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.037052 28843 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.037532 21975 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:15.037803 21974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2962) took 1259 ms. Trace:
I20260709 13:08:15.038051 29260 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:15.038213 21974 rpcz_store.cc:276] 0709 13:08:13.778634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.778741 (+   107us) service_pool.cc:224] Handling call
0709 13:08:13.922393 (+143652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.441526 (+519133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.037635 (+596109us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54002260d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdd8ad 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:15.037753 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329728256}
I20260709 13:08:15.039099 28843 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:15.040274 21832 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:15.033634 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:15.018326 29438 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.042672 21975 raft_consensus.cc:1240] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 25. Current term is 26. Ops: []
I20260709 13:08:15.043272 29420 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.044435 29340 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:15.032382 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.048990 21831 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:15.049242 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.049515 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.047250 29315 raft_consensus.cc:3055] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:15.050912 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.051908 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.041145 29309 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:15.047518 29396 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.051237 29438 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.053339 29309 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.053671 29396 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.047565 28843 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:15.054654 28843 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.054989 28843 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:15.055469 29309 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:15.056967 21903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55690 (request call id 1053) took 1724 ms. Trace:
I20260709 13:08:15.057355 21903 rpcz_store.cc:276] 0709 13:08:13.334227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.342456 (+  8229us) service_pool.cc:224] Handling call
0709 13:08:13.360137 (+ 17681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.367185 (+  7048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.367219 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.394297 (+ 27078us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.721383 (+327086us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:08:13.721451 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.721537 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.014407 (+1292870us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:08:15.056687 (+ 42280us) raft_consensus.cc:1685] finished
0709 13:08:15.056709 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.056911 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44074,"raft.queue_time_us":7285,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6475,"spinlock_wait_cycles":42626816,"thread_start_us":181494,"threads_started":1,"wal-append.queue_time_us":290823}
W20260709 13:08:15.060308 29450 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:15.061702 29151 raft_consensus.cc:3055] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:15.062099 29151 raft_consensus.cc:740] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:15.052758 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:15.062904 29151 consensus_queue.cc:260] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.064179 29151 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:15.055709 29396 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:15.047888 29430 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:15.073611 29430 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.087785 28819 consensus_queue.cc:1059] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:15.088737 29250 raft_consensus.cc:3055] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:08:15.089107 29250 raft_consensus.cc:740] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:15.089695 29439 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:15.089910 29250 consensus_queue.cc:260] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.090553 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:15.091106 29406 log.cc:927] Time spent T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.870s	user 0.001s	sys 0.000s
I20260709 13:08:15.091413 29250 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:15.091776 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:15.092221 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3237) took 1483 ms. Trace:
I20260709 13:08:15.092790 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.093467 21980 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 15.
I20260709 13:08:15.092564 21976 rpcz_store.cc:276] 0709 13:08:13.608959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.609092 (+   133us) service_pool.cc:224] Handling call
0709 13:08:13.609387 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.640931 (+ 31544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.640974 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.641462 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.803164 (+161702us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:13.803199 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.906590 (+1103391us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54003a48d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:14.906652 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.090578 (+183926us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:08:15.092031 (+  1453us) raft_consensus.cc:1685] finished
0709 13:08:15.092052 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.092163 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25220,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8467,"spinlock_wait_cycles":121121408,"thread_start_us":161226,"threads_started":1,"wal-append.queue_time_us":192223}
I20260709 13:08:15.051348 29315 raft_consensus.cc:740] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:15.094862 29315 consensus_queue.cc:260] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.051561 29420 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.098088 29420 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.099848 29438 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.100054 29429 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.045893 29432 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:15.101119 29432 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.076700 29340 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.102829 29313 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:15.103113 29432 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:15.103404 29340 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:15.103421 29313 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:15.106622 29313 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.107785 29313 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:15.108754 29282 raft_consensus.cc:3055] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:15.109283 29282 raft_consensus.cc:740] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:08:15.109835 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 90720.8us
I20260709 13:08:15.110219 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.085794 21977 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
I20260709 13:08:15.112607 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.119361 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.121384 21975 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:15.127601 21980 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:15.128851 29340 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:15.129532 29438 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:15.121038 29390 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:08:15.076059 29430 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.131810 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.139424 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:08:15.143642 21904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45488 (request call id 3117) took 1754 ms (client timeout 1703 ms). Trace:
W20260709 13:08:15.144040 21904 rpcz_store.cc:269] 0709 13:08:13.389118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.389261 (+   143us) service_pool.cc:224] Handling call
0709 13:08:15.143465 (+1754204us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54002f5dd4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:15.143581 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769437056}
I20260709 13:08:15.146764 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.148027 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.150712 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.151690 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.155882 21875 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.157310 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.160722 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.129518 28843 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.161573 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:15.147547 29179 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:15.147053 29390 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:15.120883 29382 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:08:15.164273 29216 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:15.163236 29215 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:15.194587 29216 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.199162 29216 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:15.159358 29429 consensus_queue.cc:1048] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:08:15.204447 21828 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:08:15.153462 29397 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:08:15.163040 29421 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:08:15.150863 29282 consensus_queue.cc:260] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.203751 29382 consensus_queue.cc:1243] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer 479255846c5141b584b16aa253f587c7 log is divergent from this leader: its last log entry 25.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:15.195179 29390 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.266752 29416 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:15.255657 29282 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:15.267367 29416 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.262840 29420 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:15.276321 28767 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:15.290809 29460 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:08:15.291038 28767 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.293749 28767 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.284621 29430 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:15.294997 29430 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.295266 29216 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.299620 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.305205 29216 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.306512 29438 consensus_queue.cc:1059] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:15.308701 29416 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.319149 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.295941 29378 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:08:15.309311 29420 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.322000 29378 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:15.323375 28901 raft_consensus.cc:3055] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:15.343060 28901 raft_consensus.cc:740] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:15.342900 29378 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.12, Last appended by leader: 12, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.344120 29378 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:15.343902 28901 consensus_queue.cc:260] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.345052 28901 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:15.340583 29390 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.348207 29430 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.330549 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.331791 21827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2932) took 1721 ms. Trace:
I20260709 13:08:15.356220 21827 rpcz_store.cc:276] 0709 13:08:13.610161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.323353 (+1713192us) service_pool.cc:224] Handling call
0709 13:08:15.331061 (+  7708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.331329 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.331372 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:15.331434 (+    62us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:15.331491 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.331568 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.331720 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.362048 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.368503 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.377844 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:15.378508 21829 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:08:15.379359 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.381037 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:15.381845 21827 raft_consensus.cc:2368] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:15.383731 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.380231 21832 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:15.388242 21875 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:15.389364 21875 leader_election.cc:400] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:15.389667 21875 leader_election.cc:403] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.339378 28843 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.360282 29260 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:15.401780 29440 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:15.409952 22520 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:15.394052 29477 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:08:15.395172 29337 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:15.397488 28767 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:15.406453 29429 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:15.398950 29296 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:15.412237 29251 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:15.417277 29337 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:15.445044 29277 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.445629 29277 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.413165 29260 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:15.450021 22520 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.452796 21975 raft_consensus.cc:1240] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:15.454326 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.459610 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:15.446820 29337 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:15.460337 21980 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:15.424906 28767 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.427322 29429 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.468230 29260 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.468357 29429 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.423393 29420 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.454761 29296 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.470346 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.470768 29296 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.471328 28767 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.474805 29296 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:15.479214 29277 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.456827 29430 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:15.480377 29430 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.480786 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.481459 21907 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:08:15.482702 29430 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:15.482151 21978 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 2958) took 2264 ms (client timeout 2130 ms). Trace:
W20260709 13:08:15.483448 21978 rpcz_store.cc:269] 0709 13:08:13.217799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.218686 (+   887us) service_pool.cc:224] Handling call
0709 13:08:15.481946 (+2263260us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002c8b54. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:15.482071 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795702528}
I20260709 13:08:15.459798 29435 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:15.490097 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.490623 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.491248 21901 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:15.493727 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.494831 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.496093 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.498154 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.498433 21908 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:15.498797 21901 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:08:15.499518 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.500597 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:15.487753 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:15.503911 21901 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:08:15.505700 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:15.506423 22548 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 26.
I20260709 13:08:15.507622 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:15.410589 29440 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.485344 29435 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.517587 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:15.518548 22549 raft_consensus.cc:2393] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 22: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:15.518517 21799 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:15.520961 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.518594 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.534420 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:15.534554 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:15.537191 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:15.537968 22550 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:08:15.539055 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:15.539979 22553 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:15.541347 21901 raft_consensus.cc:1240] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: [20.12-22.13]
I20260709 13:08:15.542562 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.543597 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.546373 21980 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:15.548548 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.553191 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:15.522598 29371 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:15.561484 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.562147 21900 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
I20260709 13:08:15.562631 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.563624 21799 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:15.558291 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:15.552062 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.568377 21908 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
I20260709 13:08:15.550479 28843 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:15.574316 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:15.575770 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.577215 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:15.577256 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.554893 29401 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.581866 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.582507 21978 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:15.561698 29371 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.567011 29404 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:15.588610 21908 raft_consensus.cc:1240] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: [21.12-22.13]
I20260709 13:08:15.576289 29326 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:15.575246 29309 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.586720 21829 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:15.596037 21799 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:15.594799 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.607613 21975 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:15.608680 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.595148 29232 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:08:15.561424 29239 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:08:15.590758 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:15.598446 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.615796 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.617830 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.618952 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.592651 29371 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:15.621389 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.575935 29051 consensus_queue.cc:1059] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:08:15.622699 21908 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:15.626989 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.632872 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.619055 29326 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:15.634732 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.635517 29326 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.629844 29390 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:15.631570 29395 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:08:15.644253 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.644991 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.645378 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.645838 29435 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:15.646638 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.646960 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.647107 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.683939 21828 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:15.646528 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.648028 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.650453 22521 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.652905 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:15.662825 29440 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.599304 29404 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.688000 21975 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:08:15.630131 29421 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:08:15.688604 29390 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 27 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:15.666563 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.689560 29390 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.12, Last appended by leader: 12, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:15.690781 29394 log.cc:927] Time spent T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 1.250s	user 0.006s	sys 0.011s
I20260709 13:08:15.692303 21902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45488 (request call id 3116) took 2304 ms. Trace:
I20260709 13:08:15.592839 29401 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.695951 29401 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.671852 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.696856 21974 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
W20260709 13:08:15.698479 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48120.4us
I20260709 13:08:15.675351 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:15.699955 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:15.700548 21948 leader_election.cc:400] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21.
I20260709 13:08:15.700850 21948 leader_election.cc:403] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.612942 29309 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.676011 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:15.698480 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 45659.1us
I20260709 13:08:15.698654 29433 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:15.701123 22521 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:15.679260 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:15.674497 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.692736 21902 rpcz_store.cc:276] 0709 13:08:13.387928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.388070 (+   142us) service_pool.cc:224] Handling call
0709 13:08:13.388370 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.432180 (+ 43810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.432210 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.432605 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.786423 (+353818us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:13.786462 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.786535 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.690141 (+1903606us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:08:15.691954 (+  1813us) raft_consensus.cc:1685] finished
0709 13:08:15.691996 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.692238 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31553,"raft.queue_time_us":46487,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":17630,"spinlock_wait_cycles":6659968,"thread_start_us":353553,"threads_started":1,"wal-append.queue_time_us":926331}
I20260709 13:08:15.717124 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.718696 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.725251 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.726910 22521 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.728982 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.729900 21834 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:08:15.733049 22521 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:15.742538 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.669713 29337 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.749490 21980 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:15.752974 22521 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.754637 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.703677 29239 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.760620 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.761487 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.762962 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:15.749280 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 48853.2us
I20260709 13:08:15.724067 29433 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:15.723418 29432 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:15.711540 29375 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:15.711779 29440 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:08:15.768081 22521 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.729046 29424 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.770848 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.732875 29435 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:15.756989 29151 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21.
I20260709 13:08:15.741428 28767 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:15.736073 29401 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:15.757743 29426 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:15.779289 21903 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:15.773360 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:15.773556 29433 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:15.795370 29404 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:15.728936 29314 consensus_queue.cc:1059] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:08:15.773684 29260 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:15.821251 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.747730 29255 consensus_queue.cc:1059] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:08:15.800827 21975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:15.829964 21975 raft_consensus.cc:606] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.830327 21975 raft_consensus.cc:614] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:15.831966 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:15.764458 29251 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:15.805037 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:15.813709 21978 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:08:15.826154 29309 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:15.828454 21830 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:08:15.806604 29103 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:15.833801 21904 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 18.
I20260709 13:08:15.840147 21834 raft_consensus.cc:2393] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:15.772590 29239 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.858541 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54264 (request call id 996) took 2029 ms. Trace:
I20260709 13:08:15.858942 21982 rpcz_store.cc:276] 0709 13:08:13.829188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.383368 (+554180us) service_pool.cc:224] Handling call
0709 13:08:14.383664 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.925258 (+541594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.858320 (+933062us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54002265d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:15.858487 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209148160}
I20260709 13:08:15.805923 29435 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:15.841038 29314 consensus_queue.cc:1243] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Peer ac1dd8ad9fc44263932ec57d9376a271 log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:08:15.865234 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 99693us
W20260709 13:08:15.895572 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 85349.9us
I20260709 13:08:15.902350 22546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57008 (request call id 1071) took 2111 ms. Trace:
I20260709 13:08:15.902774 22546 rpcz_store.cc:276] 0709 13:08:13.787098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.787205 (+   107us) service_pool.cc:224] Handling call
0709 13:08:13.802205 (+ 15000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.155255 (+1353050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.155285 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:15.155324 (+    39us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:15.155353 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.898594 (+743241us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54006743d4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efdee01 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2 00007fb75d31948c 00007fb75d3188c6
0709 13:08:15.898639 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.898759 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3111253888}
I20260709 13:08:15.851024 29426 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 13:08:15.907938 29382 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:15.908581 21979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:15.910607 21979 raft_consensus.cc:606] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:15.910951 21979 raft_consensus.cc:614] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:15.909744 29382 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.913719 29382 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:15.918877 29489 log.cc:927] Time spent T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:15.947392 29433 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:15.952850 29239 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:15.956132 21875 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:15.956755 21979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:15.956933 29429 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:15.957012 29401 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:08:15.960319 21798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.961827 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 99546.8us
I20260709 13:08:15.964128 21979 raft_consensus.cc:606] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.006568 21979 raft_consensus.cc:614] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:15.961908 22520 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:15.964977 29255 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:08:15.990269 29337 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:15.990746 29429 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:15.989748 29371 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:15.982266 29490 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:08:15.965083 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 65165.3us
I20260709 13:08:16.111634 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:16.112911 29488 log.cc:927] Time spent T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 13:08:16.113471 29151 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:08:16.115967 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.091166 29239 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:16.094997 29429 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:16.118651 29429 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.120421 29429 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:16.064486 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 102681us
I20260709 13:08:16.120846 29435 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.124823 22520 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:08:16.091576 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 73993.7us
I20260709 13:08:16.108081 21976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90821f4436f045a0a3847b276293f36f"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:16.120910 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:16.132031 21976 raft_consensus.cc:606] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:16.132508 21976 raft_consensus.cc:614] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:16.010900 29186 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:16.108672 29444 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:16.149298 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:16.108956 29371 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.109750 29315 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.117483 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.065383 29277 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:16.068928 29485 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.455s	user 0.000s	sys 0.003s
I20260709 13:08:16.127660 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:16.092103 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 84577.3us
I20260709 13:08:16.166443 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:16.166579 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49182us
I20260709 13:08:16.133711 21983 raft_consensus.cc:2368] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:16.170351 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:16.170778 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:16.166481 21905 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:16.173040 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:16.135265 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:16.148589 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:16.174484 21982 raft_consensus.cc:3060] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:08:16.150914 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:16.007642 29401 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:16.106741 29390 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:16.182052 22546 raft_consensus.cc:2368] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21.
I20260709 13:08:16.183085 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.182224 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:16.185344 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:16.176338 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:16.178565 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:16.189299 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.183533 21827 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 26. Current term is 27. Ops: []
I20260709 13:08:16.191952 21904 raft_consensus.cc:2393] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 19: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:16.156714 29239 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.190527 29326 consensus_queue.cc:1059] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:16.194396 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:16.195106 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:16.196005 29326 raft_consensus.cc:3055] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:16.196472 29326 raft_consensus.cc:740] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:16.196650 21873 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.166046 29255 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:16.197335 29255 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.197736 29255 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:16.197818 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.198385 21976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:16.198592 29201 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:16.198928 21976 raft_consensus.cc:606] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.199292 29201 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:16.199530 29216 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:16.156987 29186 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.200552 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.201961 29186 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.150820 29432 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.204834 29432 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.207366 29432 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:16.208966 21905 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:08:16.195695 29239 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.197396 29326 consensus_queue.cc:260] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.208216 29401 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.192116 29444 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:16.220486 29444 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:16.220878 29444 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.222424 29255 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.224946 21978 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:08:16.225313 21978 pending_rounds.cc:85] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 12
I20260709 13:08:16.225529 21978 pending_rounds.cc:107] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:08:16.225741 21978 raft_consensus.cc:2889] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.227386 21874 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:16.228117 29239 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:16.225658 29255 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.230901 21874 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:16.231770 21975 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:08:16.232234 21975 pending_rounds.cc:85] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 12
I20260709 13:08:16.232497 21975 pending_rounds.cc:107] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:08:16.232769 21975 raft_consensus.cc:2889] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.239070 21904 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:08:16.215873 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.240283 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:16.209367 29433 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:16.209781 29435 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:16.195730 22552 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:16.251717 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:16.212096 22520 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:16.217129 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:16.256371 29440 raft_consensus.cc:2804] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:16.256910 29440 raft_consensus.cc:697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:16.257778 29440 consensus_queue.cc:237] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.259065 21982 raft_consensus.cc:2468] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:08:16.247920 29239 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:16.247704 29201 raft_consensus.cc:493] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:16.260249 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:16.160123 29293 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:16.216715 29337 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:16.247344 29375 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.260586 29201 raft_consensus.cc:515] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.261387 29435 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:16.261633 29293 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:16.261861 29435 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:16.262835 29201 leader_election.cc:290] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.262626 29293 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.219563 29326 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.244511 21975 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:08:16.249596 21875 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.247437 29430 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:16.217533 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:16.266222 21975 pending_rounds.cc:85] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 12
I20260709 13:08:16.273471 21975 pending_rounds.cc:107] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:08:16.273936 21975 raft_consensus.cc:2889] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.268915 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:16.251343 21798 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:16.278815 29430 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.286211 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:16.286891 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.286904 21909 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:08:16.288897 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 73109.9us
I20260709 13:08:16.297878 21875 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.299423 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.289556 21873 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:16.304498 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:16.266587 29201 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:16.317247 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 65970us
I20260709 13:08:16.261155 29375 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.301218 29337 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:16.301227 29216 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:16.323966 29216 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:16.324266 29375 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.324457 29216 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.324893 29216 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:16.325340 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:16.326110 21982 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 26.
I20260709 13:08:16.328364 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:16.288015 29401 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.337364 21909 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:08:16.327543 22519 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:16.211076 29390 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.347184 29499 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:16.351959 21833 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:16.361008 29499 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.361490 29499 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:16.362497 29390 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:16.363103 29390 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:16.305351 29420 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:16.356899 28901 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:16.301680 29239 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:16.339861 28843 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.342007 29186 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:16.341676 29176 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:16.339677 29423 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:16.373853 28901 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.351974 29315 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:08:16.381402 29186 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:16.436225 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 302975us
I20260709 13:08:16.437229 29186 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:16.403628 28901 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:16.402410 29176 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:16.385953 28843 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:16.452543 21948 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.396145 29423 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.458406 21825 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:08:16.471635 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.445490 29444 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.463781 29439 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:16.487042 21981 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:16.491725 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 222890us
I20260709 13:08:16.494271 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:16.483632 29387 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:16.484650 29426 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.514117 21948 leader_election.cc:400] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21.
I20260709 13:08:16.517248 21948 leader_election.cc:403] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:16.491192 29430 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:16.517899 21981 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:08:16.529624 21981 pending_rounds.cc:85] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 15
I20260709 13:08:16.530689 21981 pending_rounds.cc:107] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:08:16.531533 21981 raft_consensus.cc:2889] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:16.552635 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.568374 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:16.567662 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 228596us
I20260709 13:08:16.570801 21981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2963) took 2754 ms. Trace:
I20260709 13:08:16.571274 21981 rpcz_store.cc:276] 0709 13:08:13.779319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.780358 (+  1039us) service_pool.cc:224] Handling call
0709 13:08:13.802547 (+ 22189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.649667 (+1847120us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b1800350d00. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75f019646 00007fb75ef5358e 00007fb75efd4f9e 00007fb75efd67de 00007fb75efe0b49 00007fb75efe1416 00007fb75efddd8f 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4
0709 13:08:16.486535 (+836868us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b58005549d0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75ef3a0aa 00007fb75efbc447 00007fb75efd4fe7 00007fb75efd67de 00007fb75efe0b49 00007fb75efe1416 00007fb75efddd8f 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4
0709 13:08:16.532924 (+ 46389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.533925 (+  1001us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4395674240}
W20260709 13:08:16.568553 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 267821us
I20260709 13:08:16.533056 29007 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.583189 29487 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.644s	user 0.004s	sys 0.003s
I20260709 13:08:16.584206 29515 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:16.585844 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 3134) took 1103 ms. Trace:
I20260709 13:08:16.586258 21907 rpcz_store.cc:276] 0709 13:08:15.482522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.494518 (+ 11996us) service_pool.cc:224] Handling call
0709 13:08:15.515467 (+ 20949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.515797 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.515827 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.516283 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.756000 (+239717us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:15.756061 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.756171 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.465954 (+709783us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:08:16.585556 (+119602us) raft_consensus.cc:1685] finished
0709 13:08:16.585591 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.585785 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1499,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":27905,"spinlock_wait_cycles":46129408,"thread_start_us":239306,"threads_started":1,"wal-append.queue_time_us":314415}
I20260709 13:08:16.591302 29444 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.600395 21979 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:08:16.488293 29176 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.605598 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40626 (request call id 2949) took 1456 ms. Trace:
I20260709 13:08:16.606335 21833 rpcz_store.cc:276] 0709 13:08:15.149103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.149226 (+   123us) service_pool.cc:224] Handling call
0709 13:08:16.605441 (+1456215us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540011d354. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef47571 00007fb75efe22fa 00007fb763fa3b17 00007fb75d51e6d4 00007fb75d51e662 00007fb75d51e591 00007fb75d51e50c 00007fb75d51d7c2 00007fb75d31948c 00007fb75d3188c6 00007fb75d31826f
0709 13:08:16.605537 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2745906048}
I20260709 13:08:16.521351 29426 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.618003 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:16.621672 21907 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
W20260709 13:08:16.619365 29503 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:08:16.633548 29500 log.cc:927] Time spent T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:08:16.608191 28843 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.599977 29007 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:16.640852 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 351333us
I20260709 13:08:16.646266 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:16.653435 29239 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:16.680025 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 351721us
I20260709 13:08:16.683768 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:16.671816 29423 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:16.652204 28843 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 13:08:16.702519 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.713078 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:16.678987 29216 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.715443 29426 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:16.718354 29507 log.cc:927] Time spent T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:08:16.721179 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:16.723292 21799 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:16.726652 21902 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 22.
I20260709 13:08:16.728726 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:16.732600 21977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2990) took 1057 ms. Trace:
I20260709 13:08:16.708848 29397 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:16.733064 21977 rpcz_store.cc:276] 0709 13:08:15.675068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.778629 (+103561us) service_pool.cc:224] Handling call
0709 13:08:15.811188 (+ 32559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.811416 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:16.274489 (+463073us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.573148 (+298659us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.732049 (+158901us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b1800164560. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75be6bc0a 00007fb7655ab219 00007fb75bef3a40 00007fb75beee4e4 00007fb75beee455 00007fb75efd6060 00007fb75efe8716 00007fb75eff9287 00007fb75eff9208
0709 13:08:16.732197 (+   148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.732263 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:16.732323 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.732409 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.732541 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61774,"prepare.queue_time_us":621475,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":61427,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":17486,"spinlock_wait_cycles":17404160,"thread_start_us":680941,"threads_started":2,"wal-append.queue_time_us":386845}
I20260709 13:08:16.736740 29426 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:16.737243 29426 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.737660 29426 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:16.742293 29151 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21.
I20260709 13:08:16.713887 29186 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.765857 29421 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:16.765940 29397 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:16.774406 29397 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:16.774799 29397 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:16.775275 29186 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.767459 29326 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:08:16.777915 29216 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:16.779515 21908 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:16.779852 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:16.780578 22548 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:16.780810 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 266792us
W20260709 13:08:16.784332 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 186508us
I20260709 13:08:16.786080 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:16.786836 21979 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:16.788803 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:16.789834 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:16.788069 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:16.784726 29132 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:08:16.791620 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:16.792936 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:16.793563 21979 raft_consensus.cc:2393] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 26: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:16.790689 29326 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:16.795012 21978 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:08:16.796424 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:16.803817 22550 raft_consensus.cc:1240] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:16.796373 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:16.805342 21979 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:16.797827 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:16.806809 21902 raft_consensus.cc:2393] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 24: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:16.798333 29216 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:16.808136 29216 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:08:16.808557 29216 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:16.809703 21981 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:16.799805 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:16.810772 21909 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:08:16.809553 29216 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.814013 29216 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:16.819576 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:16.820174 21980 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:16.815953 29499 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.822849 22553 raft_consensus.cc:2368] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 26. Current term is 27.
I20260709 13:08:16.802578 22548 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:16.825621 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:16.825809 29499 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.826241 21902 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:08:16.828466 21874 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:16.768246 29517 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:08:16.835283 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:16.843971 21902 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 27.
I20260709 13:08:16.845588 22520 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:16.832204 29420 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:16.856503 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:16.861101 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:16.851778 21979 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:16.866460 21873 leader_election.cc:400] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 24. Current term is 25.
I20260709 13:08:16.877590 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:16.879908 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bca2c885e084ef9af7344b6abb486aa" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:16.859736 29420 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:16.880486 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:08:16.892797 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 310314us
I20260709 13:08:16.854102 29274 raft_consensus.cc:2804] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:16.883683 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.850119 29186 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:16.880404 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 146406us
I20260709 13:08:16.896332 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.898494 21799 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:16.899547 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.901118 21873 leader_election.cc:304] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.858834 29239 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
W20260709 13:08:16.906378 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.906898 21949 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.889117 29529 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:16.915602 21979 raft_consensus.cc:1275] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:16.917955 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:16.918704 21983 raft_consensus.cc:3060] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:16.904642 29514 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:16.920951 21833 raft_consensus.cc:2393] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:16.921393 29535 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:16.904341 29274 raft_consensus.cc:697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 27 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:16.898002 29522 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:16.887804 28901 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.902572 29430 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:16.943749 29432 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.944316 29495 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.889258 29426 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.908114 29444 raft_consensus.cc:2749] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:16.923645 29529 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:16.958750 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 50723.9us
I20260709 13:08:16.924772 29404 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.956796 21830 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:08:16.961738 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:16.904683 29186 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:16.961386 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 57868.3us
I20260709 13:08:16.971498 28901 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.959175 29432 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.972988 29426 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:16.959805 29495 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:16.984548 29525 log.cc:927] Time spent T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:16.977717 29387 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:08:16.977913 29435 consensus_meta.cc:287] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.006s
I20260709 13:08:16.985834 29495 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:16.974890 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:16.985955 29435 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:16.986686 21830 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:16.988150 29435 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:16.976742 21948 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:16.983289 29430 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:16.959909 29529 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:16.973371 29176 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:16.991838 21983 raft_consensus.cc:2468] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 27.
W20260709 13:08:16.980844 29521 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:08:16.991091 29430 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.994427 29430 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:16.997534 29274 consensus_queue.cc:237] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:16.998842 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:17.000027 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:16.983759 29432 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:16.975135 29404 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.004433 29404 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:17.001674 29545 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:17.005199 29526 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.080s	user 0.001s	sys 0.002s
I20260709 13:08:17.002089 29388 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.006340 29495 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:17.006714 29495 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:17.007051 29495 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.009229 21948 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:17.011776 29186 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.012882 29388 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:08:17.012956 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:16.975474 29420 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.013825 21829 raft_consensus.cc:2393] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 19: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:17.013859 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:17.014333 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:17.017699 21976 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 26 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:08:17.018622 21830 raft_consensus.cc:2468] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:17.023689 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:17.027143 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:17.028012 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:17.032027 21828 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:17.035266 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:17.035820 21832 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:17.036724 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:17.044476 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:17.038465 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:17.046221 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:17.046829 21902 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:17.047305 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:17.049784 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:17.023135 29239 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:17.053859 21875 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:17.058318 21829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff74442193fb468c966c8842f014e361"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54066
I20260709 13:08:16.971518 29397 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.064114 21948 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:17.066385 21902 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:17.034780 29535 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.044250 29203 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:17.029757 29201 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:08:17.078625 29201 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:17.079099 29201 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.081009 29201 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:17.087431 29203 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:17.087877 29203 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:17.091048 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:17.091570 29397 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.062037 29388 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:17.096828 29529 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.098838 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:17.099539 21827 raft_consensus.cc:3060] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:17.044780 29007 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.050380 29546 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:17.112986 21873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.112855 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:17.117707 21981 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:17.037483 29315 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:08:17.069242 29444 raft_consensus.cc:2804] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:17.075871 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:17.124511 21832 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:08:17.125437 21829 raft_consensus.cc:606] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Received request to transfer leadership
I20260709 13:08:17.125557 21827 raft_consensus.cc:2468] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:17.125888 21829 raft_consensus.cc:614] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:17.112397 29529 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:17.127200 22521 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:17.072625 29432 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:17.150916 29007 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:17.153427 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 83032.9us
I20260709 13:08:17.166122 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:17.160040 21981 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:17.122315 29315 consensus_queue.cc:1243] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 26.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:17.172832 21798 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:08:17.174372 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 112888us
I20260709 13:08:17.184927 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:17.185591 22548 raft_consensus.cc:2368] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 22. Current term is 23.
I20260709 13:08:17.185518 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:17.071924 29239 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.186753 22550 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:17.186137 22520 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:17.199875 21799 leader_election.cc:400] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 22. Current term is 23.
I20260709 13:08:17.200278 21799 leader_election.cc:403] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:08:17.164760 29444 raft_consensus.cc:697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:17.211149 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:17.174553 29319 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:17.101954 29535 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.170253 29513 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:17.186368 29517 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:17.248588 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:17.250064 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:17.252859 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:17.255215 21826 raft_consensus.cc:1240] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:17.184381 29411 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:17.240248 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.244196 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:17.198436 29186 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:17.186651 29435 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.269965 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.268146 21873 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:17.266522 21909 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:08:17.245704 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:17.213828 29255 raft_consensus.cc:2804] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:17.173359 29546 consensus_queue.cc:1059] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:08:17.182639 29387 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:08:17.274180 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:17.274528 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:17.279578 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.215042 29390 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 22. Current term is 23.
I20260709 13:08:17.273942 29542 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:17.277938 21873 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:17.263204 28901 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:17.285765 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:17.246815 29420 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:17.264272 29323 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:17.281955 29435 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.296905 29495 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:17.299986 29550 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:17.301591 21908 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:08:17.276135 29186 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.309330 29444 consensus_queue.cc:237] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.309691 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:17.310253 29255 raft_consensus.cc:697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 23 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:17.310580 22548 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:17.311425 29255 consensus_queue.cc:237] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.312567 29542 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:17.315062 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:17.316094 21983 raft_consensus.cc:2410] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 28 because replica has last-logged OpId of term: 26 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 11.
I20260709 13:08:17.267474 29517 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
W20260709 13:08:17.320659 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 193504us
I20260709 13:08:17.316577 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.277833 29411 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:17.328118 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:17.330785 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:17.293996 29435 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:17.300021 29535 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.391616 21907 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 27.
I20260709 13:08:17.266541 29513 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.316799 28901 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:17.319155 29432 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:17.407622 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 163756us
I20260709 13:08:17.316458 29420 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.393208 29314 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.395352 29542 raft_consensus.cc:493] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:17.434830 29239 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.434314 29411 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.407033 29432 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.424911 29517 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.424219 29542 raft_consensus.cc:515] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.499926 29432 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:17.501629 29420 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:17.492799 29495 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:17.515273 29513 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:17.508931 29542 leader_election.cc:290] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:17.588917 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 274273us
W20260709 13:08:17.592033 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 276484us
I20260709 13:08:17.593189 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:17.687005 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:17.689311 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.692075 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:17.693132 21907 raft_consensus.cc:2368] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 22. Current term is 23.
I20260709 13:08:17.688133 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.696604 21901 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:17.704463 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:17.704501 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:17.708228 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:17.717239 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:17.728015 21904 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 25.
I20260709 13:08:17.749627 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:17.420439 29314 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.811046 28901 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.812083 29559 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:17.813401 29314 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:17.813235 29559 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.415843 29132 consensus_queue.cc:1048] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:08:17.814553 29420 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:17.814606 29565 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:17.815155 29411 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
W20260709 13:08:17.830155 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 57769.2us
I20260709 13:08:17.835444 29411 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.835685 29546 consensus_queue.cc:1059] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:17.836815 29151 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:17.837512 29546 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:17.845898 29432 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:17.846987 29432 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.848065 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:08:17.850508 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 66168us
I20260709 13:08:17.856742 29517 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:17.857230 29517 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.857616 29517 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:17.886904 29432 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.889081 29546 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.890726 29565 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.891705 29513 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:17.892128 29546 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.892400 29513 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.893206 29565 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:17.893572 29559 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:17.894814 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:17.895121 29513 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:17.839501 29411 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:17.937032 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 97955.5us
I20260709 13:08:17.902333 29314 raft_consensus.cc:3055] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:17.940258 29314 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:17.940770 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:17.839869 29420 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.944141 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:17.944854 29420 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:17.949102 29530 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:17.837954 29151 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.950160 29530 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.972414 29186 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:17.958081 29151 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.959412 29315 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:17.990682 29315 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:17.993224 29315 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.986617 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.983088 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.954202 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:17.983126 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.985496 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.988910 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:17.974133 29530 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:17.977779 29337 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.026814 29201 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:17.982596 29435 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.941659 29314 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:17.987767 29388 raft_consensus.cc:3055] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:08:17.967381 29203 consensus_meta.cc:287] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.879s	user 0.004s	sys 0.017s
I20260709 13:08:18.039361 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:18.039654 21874 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.042892 29314 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:18.043431 29566 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:08:18.045014 29203 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.048110 29203 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:18.054270 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 217547us
I20260709 13:08:18.055361 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.056643 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.042817 21904 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 27.
I20260709 13:08:18.064380 21904 raft_consensus.cc:1240] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:18.076649 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:18.035032 29388 raft_consensus.cc:740] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:18.079438 21982 pending_rounds.cc:85] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 11
I20260709 13:08:18.079026 29337 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.079852 29201 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.030773 29315 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:18.083087 29255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.010s	sys 0.006s
I20260709 13:08:18.084203 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.091595 21901 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.097882 29239 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:18.098382 29239 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:18.098850 29239 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:18.081521 21982 pending_rounds.cc:107] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 26.12
I20260709 13:08:18.102234 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:18.094511 29255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.010s	sys 0.007s
I20260709 13:08:18.118989 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:18.118736 29315 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.116937 21974 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 25.
I20260709 13:08:18.099428 21982 raft_consensus.cc:2889] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.068590 29435 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:18.139341 29319 consensus_meta.cc:287] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 0.903s	user 0.013s	sys 0.012s
I20260709 13:08:18.139986 29319 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:18.141462 21979 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:08:18.135785 29435 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:18.141990 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 63868.5us
I20260709 13:08:18.143584 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.145481 29560 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:18.146365 29560 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.147921 29315 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:18.154053 21726 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 131) took 8405 ms. Trace:
W20260709 13:08:18.158938 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 125298us
I20260709 13:08:18.159960 21874 leader_election.cc:400] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 26. Current term is 27.
I20260709 13:08:18.160271 21874 leader_election.cc:403] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:18.127574 21906 raft_consensus.cc:2410] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:08:18.161934 29560 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:18.170004 29388 consensus_queue.cc:260] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.171346 29388 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.172730 29432 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.173312 29432 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.154620 21726 rpcz_store.cc:276] 0709 13:08:09.748108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.051780 (+1303672us) service_pool.cc:224] Handling call
0709 13:08:18.153832 (+7102052us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:14.274421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:14.274987 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:14.275026 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:08:14.275043 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:14.276231 (+  1188us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:14.276292 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:14.276325 (+    33us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:08:14.277499 (+  1174us) tablet.cc:701] Row locks acquired
0709 13:08:14.277518 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:14.277661 (+   143us) write_op.cc:270] Start()
0709 13:08:14.277784 (+   123us) write_op.cc:276] Timestamp: P: 1783602494277613 usec, L: 0
0709 13:08:14.277804 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:14.319398 (+ 41594us) log.cc:844] Serialized 5638 byte log entry
0709 13:08:14.963463 (+644065us) op_driver.cc:464] REPLICATION: finished
0709 13:08:15.019775 (+ 56312us) write_op.cc:301] APPLY: starting
0709 13:08:15.019873 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:15.056472 (+ 36599us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:15.056574 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:15.066039 (+  9465us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:15.066335 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 13:08:15.066379 (+    44us) write_op.cc:312] APPLY: finished
0709 13:08:15.066672 (+   293us) log.cc:844] Serialized 129 byte log entry
0709 13:08:15.072257 (+  5585us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.072393 (+   136us) write_op.cc:454] Released schema lock
0709 13:08:15.072440 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:15.074210 (+  1770us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.074239 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11788,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":54723,"apply.run_cpu_time_us":18264,"apply.run_wall_time_us":55652,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62563,"num_ops":14,"prepare.queue_time_us":432563,"prepare.run_cpu_time_us":16197,"prepare.run_wall_time_us":249713,"raft.queue_time_us":108328,"raft.run_cpu_time_us":6478,"raft.run_wall_time_us":25276,"replication_time_us":685508,"thread_start_us":432838,"threads_started":4,"wal-append.queue_time_us":508456,"wal-append.run_cpu_time_us":15640,"wal-append.run_wall_time_us":1262789}]]}
I20260709 13:08:18.177480 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.177935 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.178342 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.178079 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.189172 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:18.192713 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.167886 29513 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783) with higher term. Message: Invalid argument: T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 26. Current term is 27.
I20260709 13:08:18.176564 29591 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.200542 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.203120 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.201748 29404 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:18.204761 29545 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:18.197108 28901 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.214998 21979 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:18.224891 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.224953 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.219159 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.250473 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.254313 29522 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.254953 29522 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.255908 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.257153 29522 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:18.260286 21901 raft_consensus.cc:2468] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
I20260709 13:08:18.261940 29337 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:18.213447 29420 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:18.263381 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.268713 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:18.280824 29201 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:18.283344 29239 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:18.287036 29557 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:18.288599 21978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3282) took 1472 ms. Trace:
W20260709 13:08:18.288784 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 233679us
I20260709 13:08:18.289001 21978 rpcz_store.cc:276] 0709 13:08:16.816179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.816326 (+   147us) service_pool.cc:224] Handling call
0709 13:08:16.816605 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.823270 (+  6665us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:16.829169 (+  5899us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.975463 (+146294us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b18004402c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e23a 00007fb75efe8a2a
0709 13:08:17.317101 (+341638us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.171768 (+854667us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b18004402c0. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bebf2a6 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a
0709 13:08:18.172258 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.172469 (+   211us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:18.172501 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.172593 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.288234 (+115641us) raft_consensus.cc:1685] finished
0709 13:08:18.288255 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.288399 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":671,"prepare.queue_time_us":4760,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":1200,"raft.queue_time_us":5624,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":8313,"spinlock_wait_cycles":31007616,"thread_start_us":340719,"threads_started":1,"wal-append.queue_time_us":569145}
I20260709 13:08:18.295507 29239 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:18.285862 21832 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:18.212414 29591 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.266106 29404 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:18.309051 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.311587 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 3164) took 1016 ms. Trace:
I20260709 13:08:18.313205 29591 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:18.312007 21905 rpcz_store.cc:276] 0709 13:08:17.286017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.286380 (+   363us) service_pool.cc:224] Handling call
0709 13:08:17.327687 (+ 41307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:17.841358 (+513671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.841407 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:17.842304 (+   897us) log.cc:844] Serialized 52 byte log entry
0709 13:08:17.908844 (+ 66540us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:17.994653 (+ 85809us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.011398 (+ 16745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.019062 (+  7664us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.291812 (+272750us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b24001cd6d8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75bd779c4 00007fb75bd75acb 00007fb75bf30dc9 00007fb75bf30a55 00007fb75bf2ffb0 00007fb75eba6488 00007fb75eba6be8 00007fb75eb7e398 00007fb75eb7976a 00007fb75eb78bb6
0709 13:08:18.299113 (+  7301us) raft_consensus.cc:1685] finished
0709 13:08:18.302070 (+  2957us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.302258 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57301,"prepare.queue_time_us":24647,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":87352,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":18302,"spinlock_wait_cycles":5924736,"thread_start_us":506780,"threads_started":2,"wal-append.queue_time_us":333185}
I20260709 13:08:18.313648 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45494 (request call id 3165) took 1024 ms. Trace:
I20260709 13:08:18.314025 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.315589 21978 raft_consensus.cc:2393] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:18.316531 29587 raft_consensus.cc:493] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:18.314073 21909 rpcz_store.cc:276] 0709 13:08:17.289492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.289707 (+   215us) service_pool.cc:224] Handling call
0709 13:08:17.290040 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:17.313912 (+ 23872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.313944 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:17.321923 (+  7979us) log.cc:844] Serialized 52 byte log entry
0709 13:08:17.852018 (+530095us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b4800261e58. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb763f07aa1 00007fb763efeb37 00007fb763efe9ca 00007fb763ff626f 00007fb763ff5f37 00007fb76400a55c 00007fb76400a508 00007fb76400a488 00007fb76400a443 00007fb7640096ec 00007fb762f33a96
0709 13:08:17.855160 (+  3142us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:17.855842 (+   682us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.856190 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.856309 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.313187 (+456878us) raft_consensus.cc:1685] finished
0709 13:08:18.313306 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.313479 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23357,"prepare.queue_time_us":271,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":29855,"raft.run_cpu_time_us":12191,"raft.run_wall_time_us":523409,"spinlock_wait_cycles":100372352,"thread_start_us":93151,"threads_started":1,"wal-append.queue_time_us":642249}
I20260709 13:08:18.315620 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.317234 29587 raft_consensus.cc:515] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:18.320036 21947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.320653 29587 leader_election.cc:290] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:18.321230 29548 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:18.321981 29548 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:18.326613 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.327144 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.328749 21906 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:18.329348 21974 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:18.331553 21909 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:08:18.331879 21909 pending_rounds.cc:85] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 12
I20260709 13:08:18.325749 29517 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.332157 21909 pending_rounds.cc:107] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:08:18.332528 21909 raft_consensus.cc:2889] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.333738 29517 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:18.334610 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:18.336620 21905 raft_consensus.cc:1240] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:18.338208 29545 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.338568 29560 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:18.309685 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.298681 29514 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 13:08:18.341439 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:18.338697 29545 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.346516 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.347203 21983 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:18.348752 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.350536 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.351187 22550 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 15.
I20260709 13:08:18.351642 29595 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:18.352752 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:18.353508 21977 raft_consensus.cc:2393] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 16: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:08:18.353912 29007 consensus_meta.cc:287] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: Time spent flushing consensus metadata: real 1.186s	user 0.018s	sys 0.003s
I20260709 13:08:18.354434 29007 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:18.355847 21980 raft_consensus.cc:3060] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:18.355631 29595 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:18.356676 29432 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:18.357316 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.306808 28901 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.358822 29314 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.358930 29595 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:18.359568 29314 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.360561 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.361140 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.362109 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.362474 29314 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:18.362661 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.339334 29560 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.363795 29535 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:18.364705 29535 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:18.364970 29591 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.365463 29560 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:18.365577 29591 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.366974 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:18.367975 29591 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:18.368072 29581 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:18.368847 29581 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 27 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:18.370059 29581 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.371948 21978 raft_consensus.cc:1240] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:18.375069 21980 raft_consensus.cc:1275] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:18.378716 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:18.360594 28901 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:18.345854 29517 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.382769 29517 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.385136 29517 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:18.377915 21948 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.393178 21798 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:18.405647 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.406247 21875 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.412436 29382 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:08:18.412894 29591 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:18.413583 29591 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.401013 29388 raft_consensus.cc:2749] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:18.415140 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.417088 21906 raft_consensus.cc:2368] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20.
I20260709 13:08:18.417897 28901 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:18.418635 28901 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.421576 28901 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:18.421684 29544 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:18.427385 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53070.9us
I20260709 13:08:18.429803 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.431396 21981 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 17.
I20260709 13:08:18.449760 21948 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.439919 28901 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:08:18.448661 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 81838.6us
I20260709 13:08:18.442180 29382 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.433112 29535 consensus_queue.cc:1059] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:18.460351 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.456908 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.460963 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.466841 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:18.469153 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.461357 29382 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:18.474630 21977 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:08:18.475042 29591 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:18.478014 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 79010.8us
I20260709 13:08:18.478917 21875 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.477041 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.480090 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.484445 21830 raft_consensus.cc:2368] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20.
I20260709 13:08:18.466969 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:18.480791 21832 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:08:18.487164 21948 leader_election.cc:400] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20.
I20260709 13:08:18.487548 21948 leader_election.cc:403] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:08:18.489878 21833 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:18.494048 21977 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:18.464362 29432 raft_consensus.cc:2804] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:18.499027 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:18.499114 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:18.500041 21905 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:18.501467 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:18.501780 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.502508 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.503268 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.504103 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:18.504438 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:18.504689 21905 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:18.505102 21982 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:18.505496 21948 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:18.511791 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:18.517927 29522 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:18.518335 29522 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.518697 29522 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.512728 29513 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:18.520892 29513 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:18.522606 29382 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.526053 29561 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.526713 21825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40626 (request call id 2981) took 1350 ms. Trace:
I20260709 13:08:18.526783 29561 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.527321 21825 rpcz_store.cc:276] 0709 13:08:17.090037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.100957 (+ 10920us) service_pool.cc:224] Handling call
0709 13:08:17.101407 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.103891 (+  2484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.103922 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.177010 (+1073088us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b2c000014c8. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75d8d7a11 00007fb75d8e7372 00007fb75f019a01 00007fb75efde43a 00007fb75efdd83e 00007fb763fa2419 00007fb75d519bd4 00007fb75d519b62 00007fb75d519a91 00007fb75d519a0c 00007fb75d518cc2
0709 13:08:18.250605 (+ 73595us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.397672 (+147067us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:18.397725 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.423779 (+ 26054us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.423826 (+    47us) raft_consensus.cc:1685] finished
0709 13:08:18.423841 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.440456 (+ 16615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38703,"raft.queue_time_us":2490,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":16575,"spinlock_wait_cycles":3370368,"thread_start_us":146510,"threads_started":1,"wal-append.queue_time_us":129045}
I20260709 13:08:18.528828 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.530366 21875 leader_election.cc:304] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:18.543174 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76282.7us
I20260709 13:08:18.534375 21948 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.547458 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.538797 22555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864ca05a434d488c83f87f71e27dfa63" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.495508 29007 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:18.552436 21799 leader_election.cc:400] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 for earlier term 22. Current term is 23.
I20260709 13:08:18.552649 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:18.553645 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.553817 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.555893 29326 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:18.539664 29432 raft_consensus.cc:697] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:18.559340 22549 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:18.560835 29375 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:08:18.542925 29595 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:18.566680 21874 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:18.577068 21980 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 27. Current term is 28. Ops: []
I20260709 13:08:18.568682 21875 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.555397 29382 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:18.543041 29548 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:18.566262 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:18.571286 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57103.4us
I20260709 13:08:18.581012 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.583091 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:18.578729 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a451fba336b41e5954a827976c17a50" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.586885 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.585006 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:18.589319 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:18.597514 21977 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:18.569681 29513 raft_consensus.cc:2749] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:18.573526 29326 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.607944 29426 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.588907 29151 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:18.608848 29151 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:18.608587 29426 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.609295 29151 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:18.610509 21976 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:18.611137 29426 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:18.610510 29432 consensus_queue.cc:237] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.605577 29404 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20.
I20260709 13:08:18.614321 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:18.612171 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 59965.4us
I20260709 13:08:18.617452 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:18.618446 21829 raft_consensus.cc:2368] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20.
I20260709 13:08:18.581614 29548 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.619861 29548 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.619871 29516 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:18.622663 29516 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:18.623049 29516 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:18.626816 29556 raft_consensus.cc:3055] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:18.627485 29556 raft_consensus.cc:740] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:18.589323 28901 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.628695 29556 consensus_queue.cc:260] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.630570 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:18.620996 29579 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:08:18.600667 29514 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:18.632673 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:18.633213 21905 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:18.633428 21981 raft_consensus.cc:1240] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:18.639103 29561 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:18.606094 29326 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:18.647091 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 78527.8us
I20260709 13:08:18.649497 21905 raft_consensus.cc:2468] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 28.
I20260709 13:08:18.655298 29513 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.651451 29545 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.657730 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.681383 21875 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.657948 29556 raft_consensus.cc:3060] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.688407 29595 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:18.643929 29375 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:08:18.693106 21975 raft_consensus.cc:1240] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:18.695814 21874 leader_election.cc:304] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:18.698321 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.702394 29514 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:08:18.688972 29595 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:18.685673 29201 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:18.714154 21875 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.715234 21949 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.721550 21949 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.693585 28901 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:18.761065 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 47809.3us
I20260709 13:08:18.713114 29514 raft_consensus.cc:493] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:18.764555 21949 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:18.682431 29513 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.727154 29587 raft_consensus.cc:2749] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:18.769923 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 91125.7us
I20260709 13:08:18.723747 29239 consensus_queue.cc:1048] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:08:18.726715 29517 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:08:18.777745 29314 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:18.784969 29513 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:18.786444 29495 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:18.725755 29522 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.804615 29522 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:18.810273 29514 raft_consensus.cc:515] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.727314 29544 consensus_queue.cc:1059] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 27.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:08:18.768702 29388 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:18.824676 29387 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:18.833730 29426 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.834504 29426 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:18.837118 29426 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:18.840255 29615 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:08:18.848590 21799 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:18.859126 29430 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.859750 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.860239 29239 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:18.859747 29430 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:18.875670 29430 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:18.921270 22546 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
I20260709 13:08:18.859143 29535 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:18.896356 29514 leader_election.cc:290] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:18.898375 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:18.849869 29517 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:18.878626 29612 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.269s	user 0.004s	sys 0.000s
I20260709 13:08:18.944157 29547 raft_consensus.cc:3055] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 27 LEADER]: Stepping down as leader of term 27
W20260709 13:08:18.963745 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 115224us
W20260709 13:08:18.970907 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 66327.8us
I20260709 13:08:18.978188 29587 raft_consensus.cc:493] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:18.979068 29201 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:18.979601 29337 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.979811 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:18.991341 29421 consensus_queue.cc:1059] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:19.012526 29323 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:19.021175 21874 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:19.039131 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:19.046743 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:19.047571 21901 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
W20260709 13:08:19.048882 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 69194.1us
I20260709 13:08:19.019268 29547 raft_consensus.cc:740] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:19.051868 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:19.058539 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:19.059280 22546 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:19.033545 29581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.025s	sys 0.055s
I20260709 13:08:19.067355 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:19.064568 22521 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:19.062352 29421 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:19.054900 29201 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.060757 29151 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.070024 29421 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:19.071187 29421 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.071805 29201 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.072399 29421 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:19.072477 29151 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.054806 29514 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:19.079149 21903 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 27. Current term is 28. Ops: [25.12-27.13]
I20260709 13:08:19.057339 29435 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:19.082052 29435 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:19.082659 29435 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:19.092386 29548 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.093703 21981 raft_consensus.cc:1240] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:19.095310 29375 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:19.098546 29581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.025s	sys 0.056s
I20260709 13:08:19.098758 29580 consensus_queue.cc:1059] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:19.063277 29337 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.099987 29580 raft_consensus.cc:3055] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:19.100464 29580 raft_consensus.cc:740] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:19.101258 29580 consensus_queue.cc:260] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.019124 29516 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.105664 21981 raft_consensus.cc:1240] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 27. Current term is 28. Ops: []
W20260709 13:08:19.135141 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 70675.2us
I20260709 13:08:19.025132 29315 consensus_queue.cc:1059] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
W20260709 13:08:19.169585 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 407597us
I20260709 13:08:19.159051 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:19.101910 29337 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.170439 21948 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:19.059562 29545 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:19.176344 29580 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:19.188980 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:19.189581 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:19.134066 29514 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:19.201071 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:19.186921 29274 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:19.184355 29432 raft_consensus.cc:2804] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:08:19.255861 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:19.130810 29513 consensus_queue.cc:1059] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:08:19.169003 29435 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.173472 29326 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.254379 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.104086 29587 raft_consensus.cc:515] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.256783 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:19.257078 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 492583us
I20260709 13:08:19.261654 22546 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 20.
I20260709 13:08:19.283478 21983 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
W20260709 13:08:19.294696 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 580566us
I20260709 13:08:19.254667 29548 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:19.311205 29435 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.311787 21904 raft_consensus.cc:2393] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:19.311770 29432 raft_consensus.cc:697] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:19.312543 21908 raft_consensus.cc:3055] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:19.313020 21908 raft_consensus.cc:740] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:19.313182 29432 consensus_queue.cc:237] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 27.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.313510 29514 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.311918 29587 leader_election.cc:290] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.333618 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:19.338338 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 176604us
W20260709 13:08:19.372674 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 86642.2us
I20260709 13:08:19.373595 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:19.195039 29547 consensus_queue.cc:260] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.13, Last appended by leader: 13, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.378320 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:19.384203 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535de8a48bb34b5f9976321c2d08b8d6" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.391463 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.393003 29326 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.397488 21949 leader_election.cc:400] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 19. Current term is 20.
I20260709 13:08:19.412209 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:19.414031 21982 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:19.400179 29432 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:19.398705 29547 raft_consensus.cc:3060] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:19.421831 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.439765 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.443106 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:19.444231 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.428193 29515 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:19.452165 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:19.452335 21833 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 25. Current term is 26. Ops: []
I20260709 13:08:19.429124 29516 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.463744 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:19.446062 29421 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:19.466142 29609 log.cc:927] Time spent T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:08:19.473083 29622 log.cc:927] Time spent T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:08:19.480562 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.481485 21799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.482551 21797 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.457545 29625 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:19.486259 29633 log.cc:927] Time spent T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:08:19.398350 29535 consensus_queue.cc:1175] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3d76b2c4699e43fba10eeb81a91e4913" responder_term: 28 status { last_received { term: 27 index: 13 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 27. Current term is 28. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:08:19.484928 29595 consensus_meta.cc:287] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.002s
I20260709 13:08:19.491209 29595 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.493628 29595 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.464517 29515 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:19.498569 29624 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:08:19.480212 29556 consensus_meta.cc:287] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.001s
I20260709 13:08:19.504019 21833 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:19.499719 29621 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:08:19.472321 29421 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.509788 29421 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.502462 29625 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.511718 21827 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
W20260709 13:08:19.515964 29611 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 13:08:19.516584 29625 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.515990 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:19.518491 21982 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:19.520872 21979 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:19.526360 29201 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.526960 29201 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.529356 29201 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.530228 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:19.530376 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 341289us
I20260709 13:08:19.531355 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.534890 29337 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.535406 29337 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.537606 29337 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:19.538407 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 232392us
I20260709 13:08:19.539096 21875 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:19.540459 29430 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:19.540791 21875 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:19.541940 21875 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:19.543944 29239 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:19.544664 29239 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.545223 29239 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:19.543967 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 83401.4us
I20260709 13:08:19.546865 29420 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:19.547430 29420 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.549595 29420 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.551430 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:19.554327 29560 consensus_queue.cc:1059] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:08:19.555459 29274 raft_consensus.cc:3055] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:19.555938 29515 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.556007 29274 raft_consensus.cc:740] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:19.558806 29239 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.561285 29579 raft_consensus.cc:3055] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:19.561738 29579 raft_consensus.cc:740] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:19.564028 21949 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:19.565215 29435 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:19.595793 29435 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.565915 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:19.566745 21902 raft_consensus.cc:1275] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:19.560837 29151 consensus_queue.cc:1059] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:19.567175 29420 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:19.557454 29274 consensus_queue.cc:260] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.582792 21908 consensus_queue.cc:260] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.597575 22553 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 26.
I20260709 13:08:19.600962 21908 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:19.580852 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:19.587388 29623 log.cc:927] Time spent T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.298s	user 0.003s	sys 0.000s
I20260709 13:08:19.591888 21829 raft_consensus.cc:2468] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:19.592895 29579 consensus_queue.cc:260] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.589851 21798 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:19.612488 21874 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:08:19.613809 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49854.1us
I20260709 13:08:19.603010 29420 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:19.617269 29421 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:19.638929 29544 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:19.645591 21799 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:19.626258 29201 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:08:19.648666 29439 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:19.638296 29420 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.661425 21949 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:08:19.665721 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 123857us
I20260709 13:08:19.669620 21875 leader_election.cc:400] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20.
I20260709 13:08:19.650642 29274 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:19.671798 21799 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:19.669648 29439 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:19.673628 29435 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.674288 29439 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.649263 29495 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:19.652096 29201 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.679370 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.679569 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.654057 29579 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:19.654223 29515 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:19.662128 29421 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:19.695309 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.672506 29595 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:19.677332 29151 raft_consensus.cc:2804] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:19.685343 29201 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:19.713513 21827 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:19.718406 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.709678 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.704382 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:19.710769 29421 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.711992 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.704051 21873 leader_election.cc:304] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:19.713138 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4225b745e54206b600f5380ed664be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.685016 29581 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:19.720088 21979 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:19.724329 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:19.731000 22521 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:19.741554 22521 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:19.671100 29544 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.746686 21832 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 25. Current term is 26. Ops: []
I20260709 13:08:19.746186 21948 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:19.754127 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.754777 21978 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:19.743600 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:19.734989 29151 raft_consensus.cc:697] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:19.771492 29151 consensus_queue.cc:237] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.751497 29596 consensus_queue.cc:1048] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:08:19.779021 29255 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:19.782743 29514 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:19.783314 29514 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.785408 29514 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.790592 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:19.790864 29629 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:19.743290 29560 raft_consensus.cc:2749] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:19.792346 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:19.698995 29515 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.744079 29426 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:19.748196 29581 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:19.795163 29515 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.794922 29581 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.764928 21905 raft_consensus.cc:1240] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:08:19.765445 29630 raft_consensus.cc:2749] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:19.766517 21780 auto_rebalancer.cc:893] Removing replace marker failed: Replica 479255846c5141b584b16aa253f587c7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:19.799662 21780 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:08:19.799530 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.768013 21900 raft_consensus.cc:1275] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:08:19.790637 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:19.804087 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:19.807299 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:19.800159 21780 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:08:19.811849 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:19.795169 29388 raft_consensus.cc:3055] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:08:19.798255 29544 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.824486 21904 raft_consensus.cc:1240] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:19.825277 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:19.814646 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:19.832850 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 89380.1us
I20260709 13:08:19.834455 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:19.835089 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:19.835691 21901 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:08:19.836552 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:19.837576 21799 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:19.839301 21873 leader_election.cc:304] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:19.822104 29388 raft_consensus.cc:740] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:19.842311 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:19.848212 21903 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:19.857030 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:19.859256 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.838820 29515 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:08:19.841656 28901 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:19.844132 29514 raft_consensus.cc:2749] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:19.867234 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.874341 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.872875 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.875648 21832 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:19.872767 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.873642 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
W20260709 13:08:19.876288 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.854822 29337 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:19.848850 29516 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:19.893936 21834 raft_consensus.cc:1240] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 25. Current term is 26. Ops: []
I20260709 13:08:19.856980 29560 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.020s
W20260709 13:08:19.877897 29649 log.cc:927] Time spent T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:08:19.879851 29388 consensus_queue.cc:260] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:19.880441 22520 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.53.130:43149 timed out after 1.769s (SENT) [suppressed 7 similar messages]
I20260709 13:08:19.881604 29650 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:19.856515 29421 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.874604 21833 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:19.904207 21828 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:08:19.854393 29593 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:19.936302 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.871394 28901 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:19.886262 29654 log.cc:927] Time spent T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:19.936405 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.886543 29337 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:19.950145 29337 raft_consensus.cc:3060] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:19.875376 29435 raft_consensus.cc:493] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.952535 29421 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:19.952838 29435 raft_consensus.cc:515] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.954773 29421 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:19.955114 29435 leader_election.cc:290] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:19.873498 29522 raft_consensus.cc:493] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:19.941951 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.943910 29201 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.944501 29388 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:19.947345 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.947954 29593 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:19.961315 21908 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:08:19.966807 21908 pending_rounds.cc:85] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 11
I20260709 13:08:19.967163 21908 pending_rounds.cc:107] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:08:19.967448 21908 raft_consensus.cc:2889] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.958968 28901 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:19.969864 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:19.971045 21833 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:19.989869 21907 raft_consensus.cc:2368] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 27. Current term is 28.
W20260709 13:08:19.980327 29513 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:08:20.005448 29314 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:20.006042 29314 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.008126 29314 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:20.009919 28901 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.012071 28901 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:20.013262 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:20.014159 21976 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:20.017530 29314 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:20.018266 29314 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.028859 29314 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:20.030856 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 135749us
I20260709 13:08:20.032375 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:19.980086 29522 raft_consensus.cc:515] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.036374 29201 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:20.038553 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:20.044973 21905 raft_consensus.cc:1275] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
W20260709 13:08:20.039542 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 227625us
I20260709 13:08:20.045763 21976 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:20.045951 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:20.040323 29662 log.cc:927] Time spent T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:20.049468 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.050837 21873 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:20.039538 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.042706 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.063052 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:20.063827 22546 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 15.
W20260709 13:08:20.044546 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 211086us
I20260709 13:08:20.054495 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.066398 21875 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.074713 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:20.076220 21875 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.077639 21875 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.079270 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.078675 29435 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:20.082002 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:20.106539 21834 raft_consensus.cc:3060] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:08:20.079604 21799 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:20.101575 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.070456 29514 raft_consensus.cc:2804] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:20.105607 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.079614 29639 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:08:20.079514 29239 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:20.047230 29581 consensus_queue.cc:1059] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:08:20.082396 29587 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:20.081817 29201 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:20.092502 29627 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:20.092916 29421 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:20.091854 29548 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:20.081995 29420 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.136160 29634 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:20.136767 29420 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:20.137655 21900 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:20.140669 21799 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.146857 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:20.152920 21900 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 18.
I20260709 13:08:20.153501 21834 raft_consensus.cc:2468] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:20.154489 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:20.155053 21832 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:20.156312 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:20.157385 29439 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:20.157872 29439 raft_consensus.cc:493] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:20.158356 29439 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:20.158757 29421 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.161084 29421 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:20.162497 29337 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.163167 29593 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:20.164676 29337 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:20.128849 29625 raft_consensus.cc:3055] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:20.165593 29625 raft_consensus.cc:740] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:20.166371 29625 consensus_queue.cc:260] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.167644 29625 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:20.168591 29439 raft_consensus.cc:515] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.119959 29515 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:20.170560 29515 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:20.170964 29515 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:20.171521 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:20.146438 29548 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.122366 29587 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.174408 29587 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:20.175014 29548 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:20.179232 29595 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:20.180051 29595 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:20.145740 29627 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.188020 29627 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:20.121266 29514 raft_consensus.cc:697] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:20.189389 29514 consensus_queue.cc:237] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:20.193193 29274 consensus_meta.cc:287] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Time spent flushing consensus metadata: real 0.510s	user 0.002s	sys 0.006s
I20260709 13:08:20.184903 21831 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:20.197127 29439 leader_election.cc:290] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:20.201005 21828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:20.201575 21828 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:20.205938 29516 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:20.208860 21828 raft_consensus.cc:2468] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:08:20.210018 21949 leader_election.cc:304] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:20.211956 29580 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.212419 29580 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.213557 29007 raft_consensus.cc:2804] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:20.214074 29007 raft_consensus.cc:697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:20.215026 29007 consensus_queue.cc:237] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.215929 28901 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:20.217110 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:20.218786 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:20.222369 21981 raft_consensus.cc:2368] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18.
I20260709 13:08:20.214576 29580 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:20.219274 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:20.228495 21909 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 27. Current term is 28. Ops: []
I20260709 13:08:20.219302 29151 consensus_queue.cc:1048] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:20.219636 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 142098us
I20260709 13:08:20.220420 29516 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.228442 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:20.231714 21875 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.209952 29522 leader_election.cc:290] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:20.221524 21798 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.230026 21982 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:20.219337 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.239390 21873 leader_election.cc:400] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18.
I20260709 13:08:20.239456 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:20.240006 21873 leader_election.cc:403] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:20.242508 22521 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.253087 22552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:20.266887 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:20.267542 22553 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:08:20.270962 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503591d3d16047368f003bcc9f73d8a2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:20.237437 29421 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:20.231972 29516 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:20.279889 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:20.243868 29522 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:20.251799 29561 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:20.251246 29629 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:20.289964 29426 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:08:20.284968 29420 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) with higher term. Message: Invalid argument: T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for earlier term 17. Current term is 18.
W20260709 13:08:20.326597 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 53435.7us
I20260709 13:08:20.318140 29426 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:20.364670 29515 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:20.372418 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 86015.7us
I20260709 13:08:20.374099 21873 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:20.374893 22553 raft_consensus.cc:2468] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 28.
I20260709 13:08:20.447572 21904 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:20.409695 21825 raft_consensus.cc:1240] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:20.380273 29587 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.450453 29151 consensus_queue.cc:1059] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:20.451118 29587 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:20.451542 29151 raft_consensus.cc:3055] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:20.446890 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.388145 29426 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:20.453101 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 58925.4us
I20260709 13:08:20.454013 29426 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:20.411650 21830 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:20.454332 29421 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:20.455317 29421 consensus_queue.cc:1059] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:20.380306 29435 raft_consensus.cc:2804] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:20.455835 29548 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:20.456090 29544 raft_consensus.cc:3055] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:08:20.456394 29435 raft_consensus.cc:697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:20.456583 29544 raft_consensus.cc:740] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:20.396617 21831 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 25. Current term is 26. Ops: []
I20260709 13:08:20.457496 29544 consensus_queue.cc:260] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.439878 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552d2504e5364dfe94b59ccc5d4bf3f7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:20.458921 29544 raft_consensus.cc:3060] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:20.389616 21978 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:20.452034 29151 raft_consensus.cc:740] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:20.467875 29151 consensus_queue.cc:260] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.469173 29151 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:20.412014 22521 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.481622 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.481639 21908 raft_consensus.cc:3060] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:20.435660 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.457418 29435 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.499718 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.510883 29239 consensus_queue.cc:1059] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:20.511682 29239 consensus_queue.cc:1243] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Peer 3d76b2c4699e43fba10eeb81a91e4913 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:20.512900 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.513110 29239 raft_consensus.cc:3055] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:20.513548 29239 raft_consensus.cc:740] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:20.514135 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:20.517375 21903 raft_consensus.cc:3055] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:20.517856 21903 raft_consensus.cc:740] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:20.518810 21903 consensus_queue.cc:260] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.519797 21903 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:20.517423 21906 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:20.521183 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:20.518132 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.523326 29239 consensus_queue.cc:260] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.524709 21908 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:20.524760 29239 raft_consensus.cc:3060] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:20.528676 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.530355 29319 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:20.497686 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 153969us
I20260709 13:08:20.546372 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.546703 21903 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:08:20.386998 29515 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:20.547106 21903 pending_rounds.cc:85] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Aborting all ops after (but not including) 13
I20260709 13:08:20.548359 21903 pending_rounds.cc:107] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:08:20.548900 21903 raft_consensus.cc:2889] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:20.549547 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:20.549911 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:20.550305 21825 raft_consensus.cc:2393] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 21: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:20.552521 29439 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:20.553153 29439 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.554382 29684 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:20.555238 29684 consensus_queue.cc:1048] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:20.555579 29439 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:20.557765 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:20.562126 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:20.565390 21832 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:20.567065 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:20.567723 22553 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:08:20.569681 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:20.570039 21904 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:20.567905 21833 raft_consensus.cc:1240] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:20.573338 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:20.579293 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:20.580747 29587 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:20.581137 29587 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.581480 29587 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:20.584343 21798 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:20.590242 21730 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33528 (request call id 225) took 71853 ms (client timeout 15000 ms). Trace:
W20260709 13:08:20.590735 21730 rpcz_store.cc:269] 0709 13:07:08.736230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.745086 (+  8856us) service_pool.cc:224] Handling call
0709 13:07:10.001257 (+1256171us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540037bed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef48090 00007fb75efe6f3a 00007fb764d9d1cc 00007fb764e9b37e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc 00007fb76335b392 00007fb75d31948c 00007fb75d3188c6
0709 13:08:20.589953 (+70588696us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6998,"reported_tablets":51,"spinlock_wait_cycles":330513664}
I20260709 13:08:20.572196 29667 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:08:20.598464 21977 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:20.602722 29580 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:20.604826 29580 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:20.608126 29548 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:20.601390 21799 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.613201 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:20.584137 21728 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 21 to 22, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 22 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.618831 29544 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:08:20.614274 29535 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:20.614845 29548 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:08:20.633793 21728 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 13 to 16, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 16 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:20.646196 21978 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:20.649607 21948 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:20.659464 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.660316 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 103983us
I20260709 13:08:20.662009 22520 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.662220 21825 raft_consensus.cc:1275] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:20.663152 22520 leader_election.cc:400] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 pre-election: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 27. Current term is 28.
I20260709 13:08:20.663445 22520 leader_election.cc:403] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:20.645828 29239 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.667150 21798 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.669332 22553 raft_consensus.cc:1240] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 27. Current term is 28. Ops: []
I20260709 13:08:20.669512 22549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:20.670509 29596 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:20.671111 29596 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:20.670908 21728 catalog_manager.cc:5697] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:20.671653 29596 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:20.672335 21728 catalog_manager.cc:5697] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 14 to 15, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 15 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:20.662050 29683 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:20.680771 29683 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:20.681257 29683 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:20.676973 29239 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.677150 29561 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149) with higher term. Message: Invalid argument: T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 27. Current term is 28.
I20260709 13:08:20.683109 21832 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:08:20.702215 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.704907 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:20.719269 21728 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 18 to 19, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 19 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:20.723389 21833 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:08:20.691649 29239 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:20.729686 21728 catalog_manager.cc:5697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.732005 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:20.706461 29650 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:20.675536 29691 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:20.743893 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.748690 21874 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.691766 29388 consensus_queue.cc:1048] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:08:20.747094 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.756335 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef872609f3d4b9ab42d0ccec83ae647" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:20.758760 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:20.759315 22552 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:08:20.759970 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 79754.2us
I20260709 13:08:20.760334 22550 raft_consensus.cc:1240] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Rejecting Update request from peer ac1dd8ad9fc44263932ec57d9376a271 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:20.760514 22546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:20.761920 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:20.762708 21874 leader_election.cc:304] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:20.764709 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.765511 21728 catalog_manager.cc:5697] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 20 to 21, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 21 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:20.766074 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:20.764581 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.764918 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:20.776150 21901 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:08:20.778251 29426 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:20.782963 21874 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.682142 29683 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.792464 21874 leader_election.cc:304] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:20.733377 29435 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:08:20.792932 21728 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 10 to 15, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 15 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.794955 29522 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:20.881740 21728 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:08:20.889945 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 93448us
I20260709 13:08:20.764712 29650 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:20.797812 29669 raft_consensus.cc:2804] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:08:20.797190 29579 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:20.906919 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:20.895993 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 104752us
I20260709 13:08:20.914260 29561 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:08:20.914754 29639 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:20.915474 29639 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:20.916085 29587 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.896797 29239 raft_consensus.cc:2749] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:20.922394 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 126771us
I20260709 13:08:20.921289 29596 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.953239 21976 raft_consensus.cc:1240] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting Update request from peer 479255846c5141b584b16aa253f587c7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:20.955111 29596 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:20.956682 29587 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:20.947924 29669 raft_consensus.cc:697] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 28 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:20.965716 29669 consensus_queue.cc:237] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:20.969852 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:20.970463 21833 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:20.977140 21833 raft_consensus.cc:2468] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 25.
I20260709 13:08:20.926110 29274 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.985713 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:20.978319 21875 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:20.990259 29420 raft_consensus.cc:2804] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:20.990902 29420 raft_consensus.cc:697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:20.991992 29420 consensus_queue.cc:237] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:20.996805 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:21.001886 21728 catalog_manager.cc:5697] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 15 to 17, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 17 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:21.014973 21728 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 16 to 18, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 18 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:21.016424 21875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.989624 29274 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.073431 21728 catalog_manager.cc:5697] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 14 to 17, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 17 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.085844 29665 raft_consensus.cc:2749] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:08:21.102442 21728 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:21.112525 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 189103us
I20260709 13:08:21.121315 21728 catalog_manager.cc:5697] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 17 to 18, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 18 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:21.122879 21728 catalog_manager.cc:5697] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 4 to 14, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 14 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:21.135408 29274 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:08:21.124305 21728 catalog_manager.cc:5697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 13 to 18, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 18 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:21.139436 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:21.142818 29439 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:21.214977 29439 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:21.235896 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 116100us
I20260709 13:08:21.236804 21728 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 16 to 18, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 18 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.233145 29684 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.251612 21902 raft_consensus.cc:1240] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:08:21.250603 29319 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:21.256738 29684 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.262455 29667 consensus_queue.cc:1059] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:08:21.296911 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:21.271199 21728 catalog_manager.cc:5697] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:21.300648 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:21.354813 21830 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:21.309155 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:21.312062 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:21.357977 21902 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:21.314867 29625 consensus_queue.cc:1059] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:08:21.359285 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:21.330386 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:21.361199 29315 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:21.308588 29684 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:21.296672 29319 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.273401 29439 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:21.364107 29684 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:21.364552 29684 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.364943 29684 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:21.365224 29319 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:21.366233 22521 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:21.367142 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:21.367740 22547 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 26.
I20260709 13:08:21.368788 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:21.369611 29319 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:21.369987 29319 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:21.351992 29628 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:21.289877 29314 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:08:21.370987 29628 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:21.360086 29625 raft_consensus.cc:3055] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:21.372625 29625 raft_consensus.cc:740] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:21.372417 29684 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.373055 29628 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:21.373531 29625 consensus_queue.cc:260] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.354066 21728 catalog_manager.cc:5697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 13 to 14, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 14 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:21.375136 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:21.375682 21902 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:21.324956 29661 raft_consensus.cc:3055] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:21.378717 29661 raft_consensus.cc:740] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:21.380159 29661 consensus_queue.cc:260] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.381923 29661 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:21.384328 21902 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
W20260709 13:08:21.388636 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 86939.2us
I20260709 13:08:21.389662 29426 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:21.370436 29319 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:21.393401 22520 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:21.394564 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:21.394984 29426 raft_consensus.cc:2804] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:21.396688 21976 raft_consensus.cc:1275] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:08:21.375154 29625 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:21.396785 29426 raft_consensus.cc:697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:21.397938 29684 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:21.398376 29426 consensus_queue.cc:237] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.396750 29596 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:21.403180 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:21.404065 29596 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:21.404616 29596 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:21.404860 21906 raft_consensus.cc:1275] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:08:21.405112 29596 raft_consensus.cc:3060] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:21.407004 21833 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:21.408329 29587 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:21.410643 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:21.411299 21827 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 26: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:21.417016 29319 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.424948 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:21.425680 21907 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:21.425777 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:21.426580 21827 raft_consensus.cc:2368] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 24. Current term is 25.
I20260709 13:08:21.427814 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:21.430487 29319 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:21.431584 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:21.441532 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:21.442533 21976 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:21.445143 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:21.445654 21976 raft_consensus.cc:3060] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:21.448137 21833 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:08:21.452139 22547 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 26.
I20260709 13:08:21.457280 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:21.453866 29712 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:21.460943 21949 leader_election.cc:400] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 24. Current term is 25.
I20260709 13:08:21.464021 21949 leader_election.cc:403] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:21.465454 29314 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:21.465957 29314 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:21.466890 29314 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.467531 29548 raft_consensus.cc:3060] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:08:21.481161 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:21.482270 21833 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 26: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:21.462980 21976 raft_consensus.cc:2468] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:08:21.489977 21904 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:21.536127 21976 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:08:21.471609 29711 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:21.484905 29630 consensus_queue.cc:1048] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:08:21.572270 21904 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:08:21.558002 29722 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:21.487454 29628 consensus_queue.cc:1048] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
W20260709 13:08:21.585443 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 48887.2us
I20260709 13:08:21.586643 29632 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.587095 29632 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.587582 21976 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:08:21.589195 29632 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:21.594484 21976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:21.594790 21830 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 18. (term mismatch)
I20260709 13:08:21.595322 21830 pending_rounds.cc:85] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting all ops after (but not including) 17
I20260709 13:08:21.595623 21830 pending_rounds.cc:107] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Aborting uncommitted NO_OP operation due to leader change: 27.18
I20260709 13:08:21.595961 21830 raft_consensus.cc:2889] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.597849 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:21.598240 29681 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:21.598621 22550 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 26.
I20260709 13:08:21.600011 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
W20260709 13:08:21.600410 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 60548.1us
I20260709 13:08:21.600821 29581 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:21.601385 29421 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:21.601893 29421 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.621304 22550 raft_consensus.cc:1275] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:08:21.610276 29580 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:08:21.614823 29435 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:08:21.635912 29596 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:21.611111 29421 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:21.638159 29596 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:21.670365 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:21.671003 21904 raft_consensus.cc:2393] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 22: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:21.553743 29711 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:21.676246 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 183514us
I20260709 13:08:21.685142 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:21.645349 29548 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 24. Current term is 25.
I20260709 13:08:21.688905 21829 raft_consensus.cc:2393] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 26: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:21.684167 29711 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:21.697034 29513 consensus_queue.cc:1048] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:08:21.713413 29730 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.713915 29730 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:21.715904 29730 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:21.719364 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:21.725332 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:21.725926 21830 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 26.
I20260709 13:08:21.741055 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:21.747855 21832 raft_consensus.cc:2468] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:21.754196 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:21.754865 21904 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 25.
I20260709 13:08:21.672981 29421 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:21.759454 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:21.760318 21978 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 26.
I20260709 13:08:21.763950 21949 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:21.767311 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:21.773209 21977 raft_consensus.cc:1275] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:08:21.775082 29730 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:21.777447 29717 raft_consensus.cc:2804] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:21.777104 29681 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:21.753386 21980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0533e3146ff14445bcdca10aa4432f4b"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:21.848768 21980 raft_consensus.cc:606] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:21.849139 21980 raft_consensus.cc:614] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:21.842849 29733 log.cc:927] Time spent T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:21.837260 29730 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.848398 29681 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:21.853979 29717 raft_consensus.cc:697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:21.904629 29730 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:08:21.925990 29731 log.cc:927] Time spent T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:21.917541 29681 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:21.993548 21904 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:22.008904 29561 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:08:22.012194 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 189543us
W20260709 13:08:22.068682 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 205743us
W20260709 13:08:22.062644 29727 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: Append to log took a long time: real 0.214s	user 0.000s	sys 0.003s
W20260709 13:08:22.086493 29729 log.cc:927] Time spent T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
W20260709 13:08:22.095393 29734 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:22.068149 28901 consensus_queue.cc:1048] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:08:22.065481 29717 consensus_queue.cc:237] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:22.066856 29421 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:22.182538 29735 log.cc:927] Time spent T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:08:22.242790 21827 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 26. Current term is 27. Ops: []
I20260709 13:08:22.275745 21982 raft_consensus.cc:1275] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:22.287320 21980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:22.287942 21980 raft_consensus.cc:606] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:22.293058 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:22.297890 22554 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:22.264776 29748 raft_consensus.cc:493] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:22.275065 29681 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:22.314615 29326 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:22.418311 21980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
W20260709 13:08:22.418084 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 106256us
W20260709 13:08:22.425201 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 102429us
I20260709 13:08:22.439975 29326 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:22.315666 29748 raft_consensus.cc:515] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:22.426975 21980 raft_consensus.cc:606] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:22.418073 29514 raft_consensus.cc:493] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.494585 21980 raft_consensus.cc:614] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:22.449193 22554 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 27.
W20260709 13:08:22.462962 29737 log.cc:927] Time spent T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:08:22.502357 22550 raft_consensus.cc:1240] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 26. Current term is 27. Ops: []
I20260709 13:08:22.503252 29514 raft_consensus.cc:515] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:22.505421 29514 leader_election.cc:290] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:22.430874 29730 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:22.512719 21977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "865ede4842b04242930bf2619bb09d16"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:22.528261 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:22.530697 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:22.531281 21831 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:22.523692 21977 raft_consensus.cc:606] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:22.533589 21830 raft_consensus.cc:2410] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:08:22.534641 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:22.560599 21831 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 27.
I20260709 13:08:22.547061 21980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:22.573417 21980 raft_consensus.cc:606] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:22.507262 29681 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:22.574530 21949 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:22.546777 29744 raft_consensus.cc:993] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:22.508980 29748 leader_election.cc:290] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:22.507266 29730 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:22.591109 29746 raft_consensus.cc:2804] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:22.530913 29739 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.071s
W20260709 13:08:22.605582 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 264398us
I20260709 13:08:22.552410 29676 consensus_queue.cc:1048] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.052s
I20260709 13:08:22.611514 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:22.612221 22550 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 21.
I20260709 13:08:22.602734 29730 raft_consensus.cc:1081] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Signalling peer 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:22.594542 29326 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:22.604275 29746 raft_consensus.cc:697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:22.624851 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:22.630849 21799 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:22.652122 29632 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:22.652912 29632 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 27 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:22.653889 29632 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:22.671183 29746 consensus_queue.cc:237] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:22.622300 29681 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.696795 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 57337.4us
I20260709 13:08:22.706490 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:22.736858 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 204432us
I20260709 13:08:22.634985 29726 consensus_queue.cc:1059] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.078s
I20260709 13:08:22.704538 21827 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "865ede4842b04242930bf2619bb09d16"
dest_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:40638
I20260709 13:08:22.754863 21827 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:22.755316 21827 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:22.752909 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 49391.7us
I20260709 13:08:22.771438 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:22.703245 29681 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:22.790621 21831 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:08:22.823074 29760 log.cc:927] Time spent T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:22.790148 29740 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:22.816906 21827 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:22.848356 21831 raft_consensus.cc:1240] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:22.790992 29547 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.853453 21902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:22.854028 21902 raft_consensus.cc:3060] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:22.855755 21905 raft_consensus.cc:1275] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:22.861006 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:22.861824 21904 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 21: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:22.863294 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b63bdc0c16e46fe907a6ef4f7f26653" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:22.887436 29746 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:22.888387 29746 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:22.897763 29746 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:22.898512 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:22.901783 29515 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:22.902482 29515 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:22.905134 29515 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:22.913045 21902 raft_consensus.cc:2468] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 27.
I20260709 13:08:22.847087 29426 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:22.919173 21827 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:22.919837 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:22.846771 29739 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:08:22.826670 29740 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:22.935575 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 178602us
I20260709 13:08:22.856838 29547 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:22.931499 29632 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:22.945727 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 126036us
I20260709 13:08:22.931684 29426 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:22.962055 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 59301.8us
I20260709 13:08:22.963814 21981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:22.964389 21981 raft_consensus.cc:3055] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:22.964668 21981 raft_consensus.cc:740] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:22.961429 21799 leader_election.cc:304] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:22.965276 29732 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 1.115s	user 0.035s	sys 0.049s
I20260709 13:08:22.963510 29435 raft_consensus.cc:493] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
W20260709 13:08:22.983693 29767 log.cc:927] Time spent T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.003s
I20260709 13:08:22.985255 29426 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:22.988037 29717 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:22.988615 29717 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:22.993362 29547 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:22.994287 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:22.995752 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:22.996723 21974 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 20: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:22.998440 29627 raft_consensus.cc:2749] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:22.982197 21981 consensus_queue.cc:260] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.001158 21981 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:23.004477 29778 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:23.005048 29778 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.005802 21976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39186 (request call id 3405) took 1403 ms. Trace:
I20260709 13:08:23.007323 29778 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:23.006242 21976 rpcz_store.cc:276] 0709 13:08:21.602803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.602984 (+   181us) service_pool.cc:224] Handling call
0709 13:08:21.603386 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.605300 (+  1914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.605342 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.605858 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:08:21.709269 (+103411us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:21.709310 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.709378 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.834608 (+1125230us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75be17c85 00007fb75be186a2 00007fb75eb8a1db 00007fb75eb85aaf 00007fb75eb7986e 00007fb75eb78bb6 00007fb75eb787d8 00007fb75eb82221 00007fb75eb821d9 00007fb75eb82169
0709 13:08:23.005453 (+170845us) raft_consensus.cc:1685] finished
0709 13:08:23.005483 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.005730 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1485,"raft.queue_time_us":13567,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4575,"spinlock_wait_cycles":6298368,"thread_start_us":46565,"threads_started":1,"wal-append.queue_time_us":156056}
I20260709 13:08:23.010150 29740 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:23.011914 29681 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:23.017652 29717 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:22.995747 29435 raft_consensus.cc:515] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.026026 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.026019 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:23.027163 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 51010us
I20260709 13:08:23.030745 29435 leader_election.cc:290] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:23.036329 21981 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:23.065047 29744 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.065554 29744 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.074219 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:23.076635 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:23.092875 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.093585 21830 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:23.098222 29744 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:23.099164 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:23.104089 29730 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:23.104611 29730 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.105023 29730 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:23.105345 22547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:23.106194 22547 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:08:23.106606 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:23.109762 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:23.114008 21934 heartbeater.cc:646] Failed to heartbeat to 127.20.53.190:38207 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.53.190:38207 timed out after 15.000s (SENT)
I20260709 13:08:23.114046 29749 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:23.114919 29749 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.117503 29749 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:23.118556 29712 raft_consensus.cc:493] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:23.119055 29712 raft_consensus.cc:515] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.120999 29712 leader_election.cc:290] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:23.125245 21830 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:08:23.125464 29751 raft_consensus.cc:3055] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:08:23.125859 29751 raft_consensus.cc:740] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:23.126665 29751 consensus_queue.cc:260] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.129247 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.131348 29751 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:23.140389 29596 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:23.147145 29632 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:23.147965 21827 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:23.150537 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.150662 29730 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.152278 21983 raft_consensus.cc:2393] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479255846c5141b584b16aa253f587c7 in current term 21: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:23.159471 21798 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
W20260709 13:08:23.175906 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 214583us
I20260709 13:08:23.176510 29712 raft_consensus.cc:493] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:23.177057 29712 raft_consensus.cc:515] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.178820 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:23.179137 29712 leader_election.cc:290] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:23.179433 22548 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:23.180262 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:23.180853 22554 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 22.
I20260709 13:08:23.181643 29712 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:23.182996 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:23.182320 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:23.183696 22554 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:23.182824 29712 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.184098 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:23.186211 29712 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:23.186794 22548 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:23.198278 29625 raft_consensus.cc:493] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:23.202256 29625 raft_consensus.cc:515] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.204164 29625 leader_election.cc:290] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:23.220978 21829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.221647 21829 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:08:23.228742 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.229534 21827 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:08:23.230063 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.206449 29517 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:23.237432 29517 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:23.237715 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:23.238303 29517 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.239540 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:23.240074 21827 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:23.231640 29681 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:23.242961 29681 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.244947 29681 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:23.235028 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.249867 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed07e2d846e24b06abb770ea1376b9fb" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:23.236526 29730 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:23.257053 22553 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:08:23.259538 22521 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:23.261552 29691 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:23.261917 29691 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:23.262290 29691 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:23.269302 21799 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:23.270903 29625 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:23.271292 29625 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:23.271657 29625 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:23.275238 29514 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:23.275904 29514 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.248291 21827 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:23.284178 21949 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:23.284934 29730 raft_consensus.cc:2804] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:23.285563 29730 raft_consensus.cc:697] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:23.286393 29730 consensus_queue.cc:237] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.281916 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.304656 29435 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:23.318051 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 48821us
I20260709 13:08:23.262465 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.322513 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:23.344527 21827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.342705 21726 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:23.355183 21726 catalog_manager.cc:5697] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 16 to 27. New cstate: current_term: 27 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.360303 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:23.361141 29632 raft_consensus.cc:2764] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:08:23.387921 21799 leader_election.cc:304] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:23.359506 29630 raft_consensus.cc:493] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:23.390126 21726 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 21 to 25, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 25 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.405130 29515 raft_consensus.cc:2749] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:23.420082 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.420269 29741 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:23.420868 29741 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.420943 29630 raft_consensus.cc:515] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.422952 29741 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:23.424319 29630 leader_election.cc:290] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:23.426347 29514 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:23.431121 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.395675 29775 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:23.439150 29773 raft_consensus.cc:993] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:23.439652 29773 raft_consensus.cc:1081] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Signalling peer 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:23.441207 21948 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:23.441413 29773 consensus_queue.cc:1048] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:23.441965 29439 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:23.442677 21826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:23.445155 21830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9"
dest_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:40638
I20260709 13:08:23.445785 21830 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.446242 21830 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:23.459703 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:23.459282 21726 catalog_manager.cc:5697] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 18 to 20, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 20 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.460322 22553 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:23.460896 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:23.461146 21726 catalog_manager.cc:5697] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 24 to 28. New cstate: current_term: 28 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.462024 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:23.464187 29625 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.466398 21726 catalog_manager.cc:5697] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:23.467629 21726 catalog_manager.cc:5697] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 21 to 23, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 23 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.469019 21726 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 19 to 23, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 23 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:23.470752 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:23.474699 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:23.475069 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705e36077094db8a03a8b3e606284be" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.471091 21830 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.478013 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:23.470265 21726 catalog_manager.cc:5697] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.484719 21830 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:23.401088 29759 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.102s
I20260709 13:08:23.490779 29625 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:23.503980 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.504988 21980 raft_consensus.cc:2410] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:08:23.510336 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb7f62b920e42349d56d878295176b2" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.510568 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:23.515343 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91268f1f8ef64ef4b455bead2f60e2ff" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.516741 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b6cb205984b78bafd3ecdcc02ef3c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.521288 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:23.525025 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:23.525557 21977 raft_consensus.cc:3055] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:23.525853 21977 raft_consensus.cc:740] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:23.527552 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.526513 21977 consensus_queue.cc:260] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.545475 21977 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:23.548219 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:23.549446 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.550501 21906 raft_consensus.cc:1275] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:08:23.550730 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9206e3439eb54425a3de6b25e0d8b36a" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.551908 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:23.552241 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:23.552963 21904 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 21: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:23.556146 21873 leader_election.cc:304] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.559258 21873 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.559536 21726 catalog_manager.cc:5697] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.561273 21726 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 16 to 25, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 25 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:23.530894 29777 raft_consensus.cc:2749] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:23.562753 21948 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:23.562709 21726 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 15 to 19, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 19 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:23.567921 21982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 3092) took 1287 ms. Trace:
I20260709 13:08:23.568073 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:23.568291 21982 rpcz_store.cc:276] 0709 13:08:22.281005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.281114 (+   109us) service_pool.cc:224] Handling call
0709 13:08:22.281407 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.311519 (+ 30112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.311547 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.314650 (+  3103us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.050750 (+736100us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b18004a6260. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb764db9de1 00007fb764dc65b1 00007fb75bed3e07 00007fb764d2eab9 00007fb75bef069b 00007fb75beee93f 00007fb75bef0c02 00007fb75eb7820b 00007fb75eb7dd23 00007fb75eb7e0d1 00007fb75ef99a0f
0709 13:08:23.211049 (+160299us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:23.211325 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.211405 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.566206 (+354801us) raft_consensus.cc:1685] finished
0709 13:08:23.566226 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.567859 (+  1633us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98421,"raft.queue_time_us":40363,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":97397,"spinlock_wait_cycles":8054144,"thread_start_us":156558,"threads_started":1,"wal-append.queue_time_us":1130960}
I20260709 13:08:23.570843 21873 leader_election.cc:304] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:23.526474 29691 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.572870 21873 leader_election.cc:304] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.574679 29711 raft_consensus.cc:2749] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:08:23.561903 29766 raft_consensus.cc:2749] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:23.565140 29435 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:08:23.578848 21904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:23.581146 21873 leader_election.cc:304] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.586221 21948 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.587131 29743 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:23.591708 22550 raft_consensus.cc:2468] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 20.
I20260709 13:08:23.581707 29730 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:23.582134 29681 raft_consensus.cc:2749] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:23.596681 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.596863 21977 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:23.598480 29730 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:23.599810 21798 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:23.605177 21873 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.594583 29796 raft_consensus.cc:2749] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:08:23.602416 29769 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:23.604807 29516 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:23.615759 21873 leader_election.cc:304] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.603912 29730 raft_consensus.cc:3060] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:23.608597 29630 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:23.633958 21873 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:23.648790 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:23.635597 28901 raft_consensus.cc:2749] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:23.659972 21825 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:23.656970 21900 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:23.635957 29516 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:23.664003 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:23.681571 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:23.682551 21830 raft_consensus.cc:2368] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21.
I20260709 13:08:23.685124 22521 leader_election.cc:400] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21.
I20260709 13:08:23.685442 22521 leader_election.cc:403] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:23.658632 29630 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:23.689980 21726 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 13 to 15, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 15 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:23.691730 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:23.691756 21726 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 22 to 24, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:23.699062 21900 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:23.682411 29783 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:23.692317 29684 raft_consensus.cc:3060] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:23.670435 29388 consensus_queue.cc:1048] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:08:23.709625 21977 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 18. (term mismatch)
I20260709 13:08:23.708362 21978 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:23.727085 21977 pending_rounds.cc:85] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting all ops after (but not including) 17
I20260709 13:08:23.727582 21977 pending_rounds.cc:107] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: Aborting uncommitted NO_OP operation due to leader change: 26.18
I20260709 13:08:23.727949 21977 raft_consensus.cc:2889] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:23.703183 29743 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:23.742671 29779 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 13:08:23.752410 29739 raft_consensus.cc:993] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:08:23.752882 29739 raft_consensus.cc:1081] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Signalling peer ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:08:23.737206 29315 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:08:23.721256 29516 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.765884 21905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:45488
I20260709 13:08:23.766412 21905 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.766744 21905 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:23.768991 29684 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085) with higher term. Message: Invalid argument: T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc for earlier term 20. Current term is 21.
I20260709 13:08:23.786971 21905 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.731935 29691 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:23.733896 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:23.806022 21905 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:23.806375 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:23.807426 21978 raft_consensus.cc:3055] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:23.905804 21978 raft_consensus.cc:740] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:23.807152 29596 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 13:08:23.913192 21825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16eb6999a3524d59835c31e2b76d09da" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:23.913890 21825 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:23.930727 21825 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:23.955819 22550 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:23.953750 21875 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:23.967172 21978 consensus_queue.cc:260] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.970526 21978 raft_consensus.cc:3060] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:23.966416 28901 raft_consensus.cc:2804] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:23.971591 28901 raft_consensus.cc:697] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:23.972373 28901 consensus_queue.cc:237] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:23.938632 29730 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.977499 29730 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:23.968492 29775 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:08:23.992091 29628 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:23.992415 29628 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:23.993150 29628 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:23.994068 29628 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:24.009150 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:24.018862 21978 raft_consensus.cc:2468] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:24.024220 22550 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:08:24.025343 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 55729.4us
I20260709 13:08:24.037583 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:24.038429 21900 raft_consensus.cc:2393] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 21: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:24.033794 22548 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:24.039690 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:24.066152 21832 raft_consensus.cc:2468] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:24.075345 21825 raft_consensus.cc:1275] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:24.107535 29791 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:08:24.135617 21906 raft_consensus.cc:1240] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Rejecting Update request from peer 3d76b2c4699e43fba10eeb81a91e4913 for earlier term 23. Current term is 24. Ops: []
W20260709 13:08:24.165393 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 54271.9us
I20260709 13:08:24.166426 21949 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:24.174546 29808 raft_consensus.cc:2804] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:24.187244 29388 consensus_queue.cc:1048] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:24.208056 29808 raft_consensus.cc:697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:24.220849 29808 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:24.222280 29807 log.cc:927] Time spent T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:08:24.325508 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 157118us
I20260709 13:08:24.363101 21982 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:08:24.449710 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76670us
W20260709 13:08:24.461529 29816 log.cc:927] Time spent T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.163s	user 0.000s	sys 0.002s
I20260709 13:08:24.463738 21982 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:08:24.483142 29775 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:08:24.483254 29650 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
W20260709 13:08:24.573374 21717 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 864ca05a434d488c83f87f71e27dfa63 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3d76b2c4699e43fba10eeb81a91e4913 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:24.582297 21726 catalog_manager.cc:5697] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 15 to 19, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 19 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.077854 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:24.633656 21908 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:08:24.658638 21728 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 224) took 36506 ms (client timeout 15000 ms). Trace:
W20260709 13:08:24.659153 21728 rpcz_store.cc:269] 0709 13:07:48.152116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.169529 (+ 17413us) service_pool.cc:224] Handling call
0709 13:08:24.658547 (+36489018us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:21.432741 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:21.433423 (+   682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:21.433468 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:08:21.433486 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:21.444418 (+ 10932us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:21.444526 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:21.444556 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:08:21.445923 (+  1367us) tablet.cc:701] Row locks acquired
0709 13:08:21.445970 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:08:21.446123 (+   153us) write_op.cc:270] Start()
0709 13:08:21.446283 (+   160us) write_op.cc:276] Timestamp: P: 1783602501446065 usec, L: 0
0709 13:08:21.446313 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:08:21.446999 (+   686us) log.cc:844] Serialized 7516 byte log entry
0709 13:08:22.602588 (+1155589us) op_driver.cc:464] REPLICATION: finished
0709 13:08:22.950683 (+348095us) write_op.cc:301] APPLY: starting
0709 13:08:22.961134 (+ 10451us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:23.023940 (+ 62806us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:23.035044 (+ 11104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:23.242822 (+207778us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:23.243226 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 13:08:23.243283 (+    57us) write_op.cc:312] APPLY: finished
0709 13:08:23.243680 (+   397us) log.cc:844] Serialized 172 byte log entry
0709 13:08:23.288471 (+ 44791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.288699 (+   228us) write_op.cc:454] Released schema lock
0709 13:08:23.288796 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:23.305407 (+ 16611us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.305438 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":130655,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":312921,"apply.run_cpu_time_us":25278,"apply.run_wall_time_us":365582,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83433,"num_ops":19,"prepare.queue_time_us":35438,"prepare.run_cpu_time_us":30785,"prepare.run_wall_time_us":213643,"raft.queue_time_us":267082,"raft.run_cpu_time_us":12204,"raft.run_wall_time_us":269506,"replication_time_us":1119447,"thread_start_us":325196,"threads_started":4,"wal-append.queue_time_us":304374,"wal-append.run_cpu_time_us":22374,"wal-append.run_wall_time_us":2488078}]]}
I20260709 13:08:24.695331 29745 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:08:24.765786 29828 log.cc:927] Time spent T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: Append to log took a long time: real 0.114s	user 0.005s	sys 0.000s
I20260709 13:08:24.805079 21825 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:24.818833 21833 raft_consensus.cc:1275] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:08:24.832545 29814 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:24.866216 29766 consensus_queue.cc:1048] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:24.870414 29809 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.871150 29809 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:24.874536 29809 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:24.888021 22548 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:24.903550 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:24.921890 21905 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:24.925114 29814 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:24.932288 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
W20260709 13:08:25.042443 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 105430us
I20260709 13:08:25.055986 29799 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:25.057152 29799 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.060951 29799 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:25.066200 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7" is_pre_election: true
I20260709 13:08:25.069038 21833 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 23: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
I20260709 13:08:25.076149 21875 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:25.080686 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:25.081105 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:25.081301 21980 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:25.087486 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:25.093636 29829 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:25.094020 29829 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:25.094398 29829 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:25.101969 29829 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.104643 29829 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:25.105237 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:25.086265 29681 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:25.110268 21977 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:25.115962 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:25.116819 29786 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:25.117278 29786 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 23 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:25.118078 29786 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.134858 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:25.135619 21833 raft_consensus.cc:2393] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 23: Already voted for candidate 479255846c5141b584b16aa253f587c7 in this term.
W20260709 13:08:25.148823 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 57265.4us
I20260709 13:08:25.202798 29743 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:08:25.246752 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 81820.9us
I20260709 13:08:25.396255 29811 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.396996 29811 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.407455 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:25.407652 29811 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:25.408113 21982 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 23.
I20260709 13:08:25.409005 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:25.411054 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:25.412655 29811 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:25.413067 29811 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.413518 29811 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:25.421245 29811 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.436592 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:25.437165 21982 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:25.457124 21907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46324
I20260709 13:08:25.457767 21907 raft_consensus.cc:606] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Received request to transfer leadership
I20260709 13:08:25.466643 29809 raft_consensus.cc:993] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: : Instructing follower 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:25.467088 29809 raft_consensus.cc:1081] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Signalling peer 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:25.468930 21907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46324
I20260709 13:08:25.469472 21907 raft_consensus.cc:606] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Received request to transfer leadership
W20260709 13:08:25.470818 21718 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for ad9d9c562d2d411db01a7eaf4427d325 already in progress [suppressed 1 similar messages]
I20260709 13:08:25.471189 21830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325"
dest_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:40626
I20260709 13:08:25.471781 21830 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.472115 21830 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.479167 21830 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.491505 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:25.492080 21907 raft_consensus.cc:3055] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:25.492360 21907 raft_consensus.cc:740] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:25.493148 21907 consensus_queue.cc:260] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.494762 21907 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.494978 21982 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 24.
I20260709 13:08:25.500690 29811 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:25.501709 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:25.502664 21798 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:25.509343 29748 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:25.509861 29748 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 24 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:25.510723 29748 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.518380 21830 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:25.478078 21726 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52738 (request call id 132) took 5928 ms. Trace:
I20260709 13:08:25.507773 21907 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:08:25.524886 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:25.530105 22548 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.530710 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:25.531884 21982 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.529793 21726 rpcz_store.cc:276] 0709 13:08:19.549871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.550076 (+   205us) service_pool.cc:224] Handling call
0709 13:08:25.478018 (+5927942us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:24.829172 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:24.829685 (+   513us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:24.829720 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:24.829748 (+    28us) tablet.cc:662] Decoding operations
0709 13:08:24.842801 (+ 13053us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:24.842865 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:24.842895 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:08:24.844069 (+  1174us) tablet.cc:701] Row locks acquired
0709 13:08:24.844085 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:24.844262 (+   177us) write_op.cc:270] Start()
0709 13:08:24.844391 (+   129us) write_op.cc:276] Timestamp: P: 1783602504844210 usec, L: 0
0709 13:08:24.844412 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:24.845324 (+   912us) log.cc:844] Serialized 6088 byte log entry
0709 13:08:25.245936 (+400612us) op_driver.cc:464] REPLICATION: finished
0709 13:08:25.352087 (+106151us) write_op.cc:301] APPLY: starting
0709 13:08:25.352176 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:25.396779 (+ 44603us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:25.396866 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:25.439905 (+ 43039us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:25.440178 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:08:25.440221 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:25.440529 (+   308us) log.cc:844] Serialized 139 byte log entry
0709 13:08:25.440699 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.440842 (+   143us) write_op.cc:454] Released schema lock
0709 13:08:25.440894 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:25.441283 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.441311 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1183670,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":105895,"apply.run_cpu_time_us":19218,"apply.run_wall_time_us":89180,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66737,"num_ops":15,"prepare.queue_time_us":137225,"prepare.run_cpu_time_us":10727,"prepare.run_wall_time_us":224284,"raft.queue_time_us":153063,"raft.run_cpu_time_us":49704,"raft.run_wall_time_us":84039,"replication_time_us":401372,"spinlock_wait_cycles":18176,"thread_start_us":355727,"threads_started":4,"wal-append.queue_time_us":193080}]]}
I20260709 13:08:25.539335 21982 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
W20260709 13:08:25.530717 21718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 60035.3us
I20260709 13:08:25.551704 22548 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 16.
I20260709 13:08:25.551779 21798 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:25.554636 21982 raft_consensus.cc:1240] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Rejecting Update request from peer 0157b4f0725d4f92a53938c921db9efc for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:25.556062 21907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46324
I20260709 13:08:25.556597 21907 raft_consensus.cc:606] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Received request to transfer leadership
I20260709 13:08:25.556864 21907 raft_consensus.cc:614] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:25.557840 29811 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:25.558346 29811 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:25.559206 29811 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.561172 29843 consensus_queue.cc:1059] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:25.562860 29843 raft_consensus.cc:3055] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:25.563179 29843 raft_consensus.cc:740] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:25.563910 29843 consensus_queue.cc:260] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:25.565006 29843 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:25.741688 21732 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33508 (request call id 202) took 82149 ms (client timeout 15000 ms). Trace:
W20260709 13:08:25.742091 21732 rpcz_store.cc:269] 0709 13:07:03.592181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.592454 (+   273us) service_pool.cc:224] Handling call
0709 13:08:25.741487 (+82149033us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10000,"reported_tablets":51}
I20260709 13:08:25.756831 21723 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:08:25.758379 21780 auto_rebalancer.cc:893] Removing replace marker failed: Replica ac1dd8ad9fc44263932ec57d9376a271 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:25.758795 21780 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:08:25.759075 21780 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:08:25.759141 21723 catalog_manager.cc:5697] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:25.760782 21723 catalog_manager.cc:5697] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 18 to 20, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 20 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.775687 21723 catalog_manager.cc:5697] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 21 to 23, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 23 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:25.777568 21723 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 15 to 19, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 19 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:25.779664 21723 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 19 to 20, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 20 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:25.783008 21723 catalog_manager.cc:5697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 17 to 23, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 23 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:25.807973 21723 catalog_manager.cc:5697] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 15 to 20, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 20 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:25.809439 21723 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 18 to 21, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 21 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:25.811714 21723 catalog_manager.cc:5697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 13 to 20, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 20 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.980226 21726 catalog_manager.cc:5697] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:25.993443 21726 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 25 to 27, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 27 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.011175 21726 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 18 to 19, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 19 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.019637 21726 catalog_manager.cc:5697] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 20 to 21, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 21 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.023396 22548 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:26.024912 29811 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:26.031930 21726 catalog_manager.cc:5697] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.046389 21906 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:26.049047 29811 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:26.057961 21980 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:08:26.059408 29811 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:26.101300 21726 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 18 to 20, leader changed from 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 20 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.102965 21726 catalog_manager.cc:5697] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 19 to 21, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 21 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.121047 21977 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:26.123009 29581 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:26.136396 22548 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 13:08:26.136747 22548 pending_rounds.cc:85] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Aborting all ops after (but not including) 17
I20260709 13:08:26.137037 22548 pending_rounds.cc:107] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 13:08:26.137297 22548 raft_consensus.cc:2889] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:26.180321 21723 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 225) took 18089 ms (client timeout 15000 ms). Trace:
W20260709 13:08:26.180757 21723 rpcz_store.cc:269] 0709 13:08:08.091339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.091565 (+   226us) service_pool.cc:224] Handling call
0709 13:08:26.180232 (+18088667us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:25.848127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:25.848794 (+   667us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:25.848839 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:08:25.848863 (+    24us) tablet.cc:662] Decoding operations
0709 13:08:25.850157 (+  1294us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:25.858276 (+  8119us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:25.858326 (+    50us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:08:25.859333 (+  1007us) tablet.cc:701] Row locks acquired
0709 13:08:25.859351 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:25.859520 (+   169us) write_op.cc:270] Start()
0709 13:08:25.859675 (+   155us) write_op.cc:276] Timestamp: P: 1783602505859464 usec, L: 0
0709 13:08:25.859698 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:25.860450 (+   752us) log.cc:844] Serialized 4034 byte log entry
0709 13:08:25.936163 (+ 75713us) op_driver.cc:464] REPLICATION: finished
0709 13:08:25.936526 (+   363us) write_op.cc:301] APPLY: starting
0709 13:08:25.936610 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:25.941812 (+  5202us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:25.941898 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:25.963625 (+ 21727us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:25.963825 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:08:25.963867 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:25.964141 (+   274us) log.cc:844] Serialized 97 byte log entry
0709 13:08:25.964894 (+   753us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.965022 (+   128us) write_op.cc:454] Released schema lock
0709 13:08:25.965065 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:25.971539 (+  6474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.971566 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87098,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":125,"apply.run_cpu_time_us":12316,"apply.run_wall_time_us":34963,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41740,"num_ops":10,"prepare.queue_time_us":18270,"prepare.run_cpu_time_us":4725,"prepare.run_wall_time_us":12709,"replication_time_us":76313,"thread_start_us":21247,"threads_started":1}]]}
I20260709 13:08:26.147755 29748 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 13:08:26.206940 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:26.372988 21977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:26.373616 21977 raft_consensus.cc:606] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Received request to transfer leadership to TS 479255846c5141b584b16aa253f587c7
I20260709 13:08:26.378623 21825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e"
dest_uuid: "479255846c5141b584b16aa253f587c7"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:34370
I20260709 13:08:26.379166 21825 raft_consensus.cc:606] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:26.384143 21977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:26.384724 21977 raft_consensus.cc:606] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:26.385044 21977 raft_consensus.cc:614] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:26.385671 21724 catalog_manager.cc:5697] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:26.390203 21977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d"
dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
mode: GRACEFUL
new_leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:41278
I20260709 13:08:26.390780 21977 raft_consensus.cc:606] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Received request to transfer leadership to TS ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:26.392123 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:26.393805 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:26.411967 21726 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 22 to 24, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 24 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.413578 21726 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 15 to 16, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 16 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.603271 21725 catalog_manager.cc:5697] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 13 to 18, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 18 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:26.607015 21725 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.621836 21725 catalog_manager.cc:5697] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:26.648550 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 73814.5us
W20260709 13:08:26.649158 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 77989us
I20260709 13:08:26.661255 29863 raft_consensus.cc:993] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: : Instructing follower ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:08:26.662607 29863 raft_consensus.cc:1081] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Signalling peer ac1dd8ad9fc44263932ec57d9376a271 to start an election
W20260709 13:08:26.663920 21799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 52283.5us
W20260709 13:08:26.665735 21724 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33508 (request call id 204) took 37315 ms (client timeout 15000 ms). Trace:
W20260709 13:08:26.666203 21724 rpcz_store.cc:269] 0709 13:07:49.350340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.350617 (+   277us) service_pool.cc:224] Handling call
0709 13:08:26.399838 (+37049221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:26.399872 (+    34us) write_op.cc:454] Released schema lock
0709 13:08:26.665643 (+265771us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:26.391930 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:26.392527 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:26.392569 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:08:26.392590 (+    21us) tablet.cc:662] Decoding operations
0709 13:08:26.392968 (+   378us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:26.393015 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:26.393044 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:26.393213 (+   169us) tablet.cc:701] Row locks acquired
0709 13:08:26.393230 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:26.393356 (+   126us) write_op.cc:270] Start()
0709 13:08:26.393465 (+   109us) write_op.cc:276] Timestamp: P: 1783602506393320 usec, L: 0
0709 13:08:26.393489 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:26.394066 (+   577us) log.cc:844] Serialized 541 byte log entry
0709 13:08:26.396102 (+  2036us) op_driver.cc:464] REPLICATION: finished
0709 13:08:26.396549 (+   447us) write_op.cc:301] APPLY: starting
0709 13:08:26.396627 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:26.397412 (+   785us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:26.397504 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:26.398217 (+   713us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:26.398380 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:08:26.398430 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:26.398602 (+   172us) log.cc:844] Serialized 25 byte log entry
0709 13:08:26.398762 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:26.398844 (+    82us) write_op.cc:454] Released schema lock
0709 13:08:26.398884 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":492560,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":225,"apply.run_cpu_time_us":2600,"apply.run_wall_time_us":2600,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":2430,"prepare.run_wall_time_us":2430,"replication_time_us":2484}]]}
I20260709 13:08:26.670337 21725 catalog_manager.cc:5697] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 22 to 24, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 24 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.667048 21906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:08:26.673081 21906 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.673432 21906 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:26.685045 29869 raft_consensus.cc:993] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:26.685544 29869 raft_consensus.cc:1081] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Signalling peer 479255846c5141b584b16aa253f587c7 to start an election
I20260709 13:08:26.687476 21825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee"
dest_uuid: "479255846c5141b584b16aa253f587c7"
 from {username='slave'} at 127.0.0.1:40638
I20260709 13:08:26.688050 21825 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.688409 21825 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:26.696152 21833 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:26.724689 21983 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:26.729388 29517 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:26.701865 21906 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:26.736920 29863 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 10 to 13, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.731434 21825 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:26.738487 22553 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:26.752137 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:26.752825 21983 raft_consensus.cc:3055] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:26.753122 21983 raft_consensus.cc:740] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:26.753880 21983 consensus_queue.cc:260] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:26.754977 21983 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:26.758844 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:26.759455 21830 raft_consensus.cc:3055] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:26.760248 21830 raft_consensus.cc:740] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:26.760921 21830 consensus_queue.cc:260] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:26.761716 21906 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:26.761981 21830 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:26.763469 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:26.764043 21980 raft_consensus.cc:3060] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:26.740027 21825 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Requested vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:26.774924 21980 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:26.776096 21873 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:26.776896 29809 raft_consensus.cc:2804] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:26.777395 29809 raft_consensus.cc:697] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:26.778232 29809 consensus_queue.cc:237] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:26.779461 21727 catalog_manager.cc:5697] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:26.781037 21725 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33528 (request call id 228) took 17773 ms (client timeout 15000 ms). Trace:
I20260709 13:08:26.781322 29814 raft_consensus.cc:993] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: : Instructing follower ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:08:26.790669 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:08:26.781497 21725 rpcz_store.cc:269] 0709 13:08:09.007755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.008015 (+   260us) service_pool.cc:224] Handling call
0709 13:08:26.780973 (+17772958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:26.675519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:26.676014 (+   495us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:26.676048 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:08:26.676060 (+    12us) tablet.cc:662] Decoding operations
0709 13:08:26.676599 (+   539us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:26.676662 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:26.676692 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:26.677052 (+   360us) tablet.cc:701] Row locks acquired
0709 13:08:26.677065 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:08:26.677220 (+   155us) write_op.cc:270] Start()
0709 13:08:26.677327 (+   107us) write_op.cc:276] Timestamp: P: 1783602506677171 usec, L: 0
0709 13:08:26.677343 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:08:26.677933 (+   590us) log.cc:844] Serialized 1706 byte log entry
0709 13:08:26.679665 (+  1732us) op_driver.cc:464] REPLICATION: finished
0709 13:08:26.680071 (+   406us) write_op.cc:301] APPLY: starting
0709 13:08:26.680163 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:26.690562 (+ 10399us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:26.690656 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:26.708896 (+ 18240us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:26.709054 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:08:26.709099 (+    45us) write_op.cc:312] APPLY: finished
0709 13:08:26.712597 (+  3498us) log.cc:844] Serialized 49 byte log entry
0709 13:08:26.714316 (+  1719us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:26.714417 (+   101us) write_op.cc:454] Released schema lock
0709 13:08:26.714464 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:26.729980 (+ 15516us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:26.730012 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":587963,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":222,"apply.run_cpu_time_us":6111,"apply.run_wall_time_us":34688,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16696,"num_ops":4,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":2668,"prepare.run_wall_time_us":2669,"replication_time_us":2213}]]}
I20260709 13:08:26.791292 22554 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:26.791306 21727 catalog_manager.cc:5697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:26.781961 29814 raft_consensus.cc:1081] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Signalling peer ac1dd8ad9fc44263932ec57d9376a271 to start an election
I20260709 13:08:26.795320 21906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d"
dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
 from {username='slave'} at 127.0.0.1:45488
I20260709 13:08:26.795840 21906 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.796208 21906 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:26.796151 21727 catalog_manager.cc:5697] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 14 to 20, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 20 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.798076 21727 catalog_manager.cc:5697] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 15 to 19, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 19 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.803229 21977 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 10 to 13, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.805228 21727 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 18 to 20, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 20 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.806768 21727 catalog_manager.cc:5697] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 17 to 19, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 19 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.814106 22554 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:26.816959 21906 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:26.817143 29865 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:26.818794 21830 raft_consensus.cc:2468] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:26.819290 21906 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:26.820493 21727 catalog_manager.cc:5697] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 16 to 22, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 22 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.823050 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:26.823571 21980 raft_consensus.cc:3055] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:26.823505 21983 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479255846c5141b584b16aa253f587c7 in term 19.
I20260709 13:08:26.824146 21980 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:26.829666 21719 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad9d9c562d2d411db01a7eaf4427d325 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:26.830636 21798 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7; no voters: 
I20260709 13:08:26.832942 21727 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 reported cstate change: term changed from 14 to 19, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 19 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.835105 21830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "479255846c5141b584b16aa253f587c7"
I20260709 13:08:26.835623 21830 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:26.830838 21980 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:26.839825 29865 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:26.839936 22554 raft_consensus.cc:2955] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 10 to 13, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.841583 29865 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Becoming Leader. State: Replica: 479255846c5141b584b16aa253f587c7, State: Running, Role: LEADER
I20260709 13:08:26.842481 29865 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:26.855705 21830 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:26.856858 21980 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:26.862540 21875 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:26.863281 29867 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:26.863762 29867 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:26.864588 29867 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:26.877431 21980 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:26.912724 21725 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 10 to 13, VOTER ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) evicted. New cstate: current_term: 16 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:26.946641 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet ad9d9c562d2d411db01a7eaf4427d325 with delete_type TABLET_DATA_TOMBSTONED (TS ac1dd8ad9fc44263932ec57d9376a271 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:46324
I20260709 13:08:27.009078 21830 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:27.010630 29876 tablet_replica.cc:333] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:27.026644 22554 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:27.028191 29517 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:27.033573 29876 raft_consensus.cc:2243] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.034489 29876 raft_consensus.cc:2272] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.037863 21906 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:27.038406 29876 ts_tablet_manager.cc:1916] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:27.039531 29517 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:27.046747 29865 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:27.062350 22554 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:27.076534 21719 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bde6ac1d042400fbc88831c01b9fdda with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:27.077217 21908 raft_consensus.cc:2955] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:27.115939 21727 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33508 (request call id 205) took 17464 ms (client timeout 15000 ms). Trace:
I20260709 13:08:27.116154 21725 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 11 to 12, VOTER 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) evicted. New cstate: current_term: 16 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:27.116390 21727 rpcz_store.cc:269] 0709 13:08:09.655943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.683572 (+ 27629us) service_pool.cc:224] Handling call
0709 13:08:27.115590 (+17432018us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:26.861970 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:26.862487 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:26.862519 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:26.862539 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:26.863320 (+   781us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:26.863373 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:26.863399 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:08:26.864040 (+   641us) tablet.cc:701] Row locks acquired
0709 13:08:26.864057 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:26.864184 (+   127us) write_op.cc:270] Start()
0709 13:08:26.864288 (+   104us) write_op.cc:276] Timestamp: P: 1783602506864136 usec, L: 0
0709 13:08:26.864312 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:26.864995 (+   683us) log.cc:844] Serialized 3254 byte log entry
0709 13:08:26.878247 (+ 13252us) op_driver.cc:464] REPLICATION: finished
0709 13:08:26.878539 (+   292us) write_op.cc:301] APPLY: starting
0709 13:08:26.878617 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:26.892847 (+ 14230us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:26.892945 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:26.899050 (+  6105us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:26.906106 (+  7056us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:08:26.906188 (+    82us) write_op.cc:312] APPLY: finished
0709 13:08:26.906464 (+   276us) log.cc:844] Serialized 81 byte log entry
0709 13:08:26.907633 (+  1169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:26.907751 (+   118us) write_op.cc:454] Released schema lock
0709 13:08:26.907797 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:26.908138 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:26.908171 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42622,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":10498,"apply.run_wall_time_us":29542,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33392,"num_ops":8,"prepare.queue_time_us":1115,"prepare.run_cpu_time_us":3246,"prepare.run_wall_time_us":3278,"replication_time_us":10173}]]}
I20260709 13:08:27.136243 29876 ts_tablet_manager.cc:1929] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:08:27.136890 29876 log.cc:1199] T ad9d9c562d2d411db01a7eaf4427d325 P ac1dd8ad9fc44263932ec57d9376a271: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/wals/ad9d9c562d2d411db01a7eaf4427d325
I20260709 13:08:27.139117 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet ad9d9c562d2d411db01a7eaf4427d325 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:08:27.146670 21730 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 18 to 20, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 20 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.148936 21730 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 22 to 23, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 23 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.152464 21970 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bde6ac1d042400fbc88831c01b9fdda with delete_type TABLET_DATA_TOMBSTONED (TS 3d76b2c4699e43fba10eeb81a91e4913 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41274
I20260709 13:08:27.174602 21827 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:27.176316 29867 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:27.196470 21730 catalog_manager.cc:5697] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 24 to 28. New cstate: current_term: 28 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.198274 21730 catalog_manager.cc:5697] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 23 to 25, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 25 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.199599 21730 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.201179 21730 catalog_manager.cc:5697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 20 to 23, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 23 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.223986 21730 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.225975 21730 catalog_manager.cc:5697] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.227133 21980 raft_consensus.cc:1275] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:27.227859 21730 catalog_manager.cc:5697] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 23 to 25, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 25 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.228772 29650 consensus_queue.cc:1048] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:27.229511 21730 catalog_manager.cc:5697] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 17 to 23, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 23 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.231256 21730 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 20 to 23, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 23 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.232753 21730 catalog_manager.cc:5697] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 19 to 22, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 22 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
W20260709 13:08:27.234678 21731 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33528 (request call id 227) took 38732 ms (client timeout 15000 ms). Trace:
W20260709 13:08:27.235070 21731 rpcz_store.cc:269] 0709 13:07:48.502252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.546461 (+ 44209us) service_pool.cc:224] Handling call
0709 13:08:27.234495 (+38688034us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":782897,"reported_tablets":47}
I20260709 13:08:27.233981 21730 catalog_manager.cc:5697] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 22 to 23, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 23 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.256325 21730 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 19 to 22, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 22 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.258739 21730 catalog_manager.cc:5697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 18 to 21, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 21 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.270679 21730 catalog_manager.cc:5697] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.271992 21730 catalog_manager.cc:5697] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.273418 21730 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.275039 21730 catalog_manager.cc:5697] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 18 to 20, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 20 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.276538 21730 catalog_manager.cc:5697] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 20 to 23, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 23 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.277976 21730 catalog_manager.cc:5697] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.279212 21730 catalog_manager.cc:5697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.295181 29880 tablet_replica.cc:333] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:27.347131 29880 raft_consensus.cc:2243] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.348177 29880 raft_consensus.cc:2272] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.351052 29880 ts_tablet_manager.cc:1916] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:27.368217 29880 ts_tablet_manager.cc:1929] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:08:27.368609 29880 log.cc:1199] T 6bde6ac1d042400fbc88831c01b9fdda P 3d76b2c4699e43fba10eeb81a91e4913: Deleting WAL directory at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/wals/6bde6ac1d042400fbc88831c01b9fdda
I20260709 13:08:27.372046 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet 6bde6ac1d042400fbc88831c01b9fdda (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:08:27.377588 22553 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:27.379184 29865 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:27.393074 21731 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 18 to 19, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 19 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:27.395423 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:27.394685 21980 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer 479255846c5141b584b16aa253f587c7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:27.397039 29865 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:27.470088 21827 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:27.472292 29650 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:27.492292 21977 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:27.493804 29809 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:27.508257 21728 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 22 to 23, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to 479255846c5141b584b16aa253f587c7 (127.20.53.129). New cstate: current_term: 23 leader_uuid: "479255846c5141b584b16aa253f587c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.535050 21896 tablet_service.cc:1558] Processing DeleteTablet for tablet ad9d9c562d2d411db01a7eaf4427d325 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 10 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:46324
I20260709 13:08:27.535085 21728 catalog_manager.cc:5697] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 19 to 22, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 22 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.536701 21718 catalog_manager.cc:5028] TS ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): tablet ad9d9c562d2d411db01a7eaf4427d325 (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
I20260709 13:08:27.535073 21730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33520 (request call id 226) took 4316 ms. Trace:
I20260709 13:08:27.538501 21728 catalog_manager.cc:5697] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 23 to 24, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } }
I20260709 13:08:27.537231 21730 rpcz_store.cc:276] 0709 13:08:23.218912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.219060 (+   148us) service_pool.cc:224] Handling call
0709 13:08:27.535017 (+4315957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:27.291311 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:27.291850 (+   539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:27.291890 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:08:27.291909 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:27.293568 (+  1659us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:27.293628 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:27.293656 (+    28us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:08:27.295294 (+  1638us) tablet.cc:701] Row locks acquired
0709 13:08:27.295315 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:27.295466 (+   151us) write_op.cc:270] Start()
0709 13:08:27.295573 (+   107us) write_op.cc:276] Timestamp: P: 1783602507295421 usec, L: 0
0709 13:08:27.295592 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:27.296400 (+   808us) log.cc:844] Serialized 8686 byte log entry
0709 13:08:27.299554 (+  3154us) op_driver.cc:464] REPLICATION: finished
0709 13:08:27.299984 (+   430us) write_op.cc:301] APPLY: starting
0709 13:08:27.300062 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:27.327159 (+ 27097us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:27.327262 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:27.373491 (+ 46229us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:27.373754 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 13:08:27.373794 (+    40us) write_op.cc:312] APPLY: finished
0709 13:08:27.397859 (+ 24065us) log.cc:844] Serialized 196 byte log entry
0709 13:08:27.398046 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.398258 (+   212us) write_op.cc:454] Released schema lock
0709 13:08:27.398315 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:27.398612 (+   297us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.398637 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21039,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":248,"apply.run_cpu_time_us":24752,"apply.run_wall_time_us":98592,"cfile_cache_hit":88,"cfile_cache_hit_bytes":91828,"num_ops":22,"prepare.queue_time_us":124,"prepare.run_cpu_time_us":5310,"prepare.run_wall_time_us":14994,"replication_time_us":3853}]]}
I20260709 13:08:27.542944 21728 catalog_manager.cc:5697] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 17 to 27. New cstate: current_term: 27 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:08:27.614396 20694 tablet_server.cc:179] TabletServer@127.20.53.129:0 shutting down...
I20260709 13:08:27.663339 21970 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bde6ac1d042400fbc88831c01b9fdda with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 11 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:41274
I20260709 13:08:27.664153 21728 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33528 (request call id 229) took 2776 ms. Trace:
I20260709 13:08:27.664665 21728 rpcz_store.cc:276] 0709 13:08:24.887750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.888828 (+  1078us) service_pool.cc:224] Handling call
0709 13:08:25.084370 (+195542us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b540037bed4. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75ef48090 00007fb75efe6f3a 00007fb764d9d1cc 00007fb764e9b37e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc 00007fb76335b392 00007fb75d31948c 00007fb75d3188c6
0709 13:08:27.664066 (+2579696us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:27.564860 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:27.565410 (+   550us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:27.565464 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:08:27.565487 (+    23us) tablet.cc:662] Decoding operations
0709 13:08:27.566109 (+   622us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:27.566189 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:27.566226 (+    37us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:27.566670 (+   444us) tablet.cc:701] Row locks acquired
0709 13:08:27.566687 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:27.566832 (+   145us) write_op.cc:270] Start()
0709 13:08:27.566967 (+   135us) write_op.cc:276] Timestamp: P: 1783602507566786 usec, L: 0
0709 13:08:27.566987 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:27.567610 (+   623us) log.cc:844] Serialized 1706 byte log entry
0709 13:08:27.569973 (+  2363us) op_driver.cc:464] REPLICATION: finished
0709 13:08:27.570434 (+   461us) write_op.cc:301] APPLY: starting
0709 13:08:27.570518 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:27.572935 (+  2417us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:27.573048 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:27.575334 (+  2286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:27.575508 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:08:27.575558 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:27.575904 (+   346us) log.cc:844] Serialized 49 byte log entry
0709 13:08:27.576730 (+   826us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.576838 (+   108us) write_op.cc:454] Released schema lock
0709 13:08:27.576888 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:27.577260 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.577293 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32526,"reported_tablets":51,"spinlock_wait_cycles":108429568,"child_traces":[["op",{"apply.queue_time_us":271,"apply.run_cpu_time_us":6169,"apply.run_wall_time_us":6788,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16696,"num_ops":4,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":3039,"prepare.run_wall_time_us":4798,"replication_time_us":2784}]]}
I20260709 13:08:27.664314 21731 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 23 to 24, leader changed from 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.672760 21731 catalog_manager.cc:5697] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 19 to 20, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 20 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.686708 21717 catalog_manager.cc:5028] TS 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): tablet 6bde6ac1d042400fbc88831c01b9fdda (table test-workload [id=7d695e017c694a9c91caa34686eaea7e]) successfully deleted
W20260709 13:08:27.693038 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.696852 21729 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 6bde6ac1d042400fbc88831c01b9fdda with cas_config_opid_index 11: aborting the task: latest config opid_index 12; task opid_index 11
I20260709 13:08:27.705142 21729 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33508 (request call id 206) took 2506 ms. Trace:
I20260709 13:08:27.705852 21729 rpcz_store.cc:276] 0709 13:08:25.198568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.199068 (+   500us) service_pool.cc:224] Handling call
0709 13:08:25.234069 (+ 35001us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b54001e0690. stack: 00007fb75bebf343 00007fb75bebf240 00007fb75b84e1d4 00007fb76558c304 00007fb76558c299 00007fb75bd79db1 00007fb75beb9b71 00007fb75beba0b2 00007fb764e33a89 00007fb764dcbda6 00007fb764d9d088 00007fb764e9b37e 00007fb76335c2a4 00007fb76335c232 00007fb76335c161 00007fb76335c0dc
0709 13:08:27.705079 (+2471010us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37424,"reported_tablets":51,"spinlock_wait_cycles":19946240}
I20260709 13:08:27.759117 21977 consensus_queue.cc:237] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:27.816665 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.833133 21798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 73116.3us
W20260709 13:08:27.841650 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.851557 22521 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 86286.4us
W20260709 13:08:27.844252 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.858578 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.873317 22554 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:27.874794 21907 raft_consensus.cc:1275] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:08:27.878958 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.883584 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.897469 29869 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:08:27.902597 29892 consensus_queue.cc:1048] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:08:28.003979 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.005456 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.025779 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.056177 29869 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 12 to 15, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:28.087126 22554 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 12 to 15, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:28.100630 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.106456 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.117246 21717 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff74442193fb468c966c8842f014e361 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:28.119267 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.134331 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 257624us
W20260709 13:08:28.150899 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.164924 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.165278 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.225351 21905 raft_consensus.cc:2955] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 12 to 15, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:28.242766 21731 catalog_manager.cc:5697] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 12 to 15, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 21 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:28.261605 21875 consensus_peers.cc:597] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.277047 21875 consensus_peers.cc:597] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.277771 21875 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.279089 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:08:28.281313 21875 consensus_peers.cc:597] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.307716 20694 tablet_replica.cc:333] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.314244 20694 raft_consensus.cc:2243] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:08:28.314450 21875 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.315201 21875 consensus_peers.cc:597] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.315570 20694 raft_consensus.cc:2272] T 6e964a7ca2a54491a72482e75917bd10 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.315788 21875 consensus_peers.cc:597] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.316511 21875 consensus_peers.cc:597] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.317154 21875 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.317806 21875 consensus_peers.cc:597] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.325026 20694 tablet_replica.cc:333] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.338402 20694 raft_consensus.cc:2243] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:08:28.322130 21875 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.339532 21875 consensus_peers.cc:597] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.340134 21875 consensus_peers.cc:597] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.340145 20694 raft_consensus.cc:2272] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.350266 20694 tablet_replica.cc:333] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.351583 20694 raft_consensus.cc:2243] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.352595 20694 raft_consensus.cc:2272] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 479255846c5141b584b16aa253f587c7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.369059 20694 tablet_replica.cc:333] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.369937 20694 raft_consensus.cc:2243] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.375689 20694 raft_consensus.cc:2272] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.379078 20694 tablet_replica.cc:333] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.383929 20694 raft_consensus.cc:2243] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.385138 20694 raft_consensus.cc:2272] T fa248ef2ee9049c9a1f86b77185b86a3 P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.393836 20694 tablet_replica.cc:333] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.394822 20694 raft_consensus.cc:2243] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.423082 20694 raft_consensus.cc:2272] T 90821f4436f045a0a3847b276293f36f P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.438227 20694 tablet_replica.cc:333] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.439345 20694 raft_consensus.cc:2243] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.440598 20694 raft_consensus.cc:2272] T 9a439d1de6924cf49dda5333182516bb P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.455612 20694 tablet_replica.cc:333] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.456665 20694 raft_consensus.cc:2243] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.457587 20694 raft_consensus.cc:2272] T 0cd0981f0f71482b83434dddd7e49dc4 P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.483503 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff74442193fb468c966c8842f014e361: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:08:28.488524 20694 tablet_replica.cc:333] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.489552 20694 raft_consensus.cc:2243] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.490263 20694 raft_consensus.cc:2272] T 0ef872609f3d4b9ab42d0ccec83ae647 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.494371 20694 tablet_replica.cc:333] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.495308 20694 raft_consensus.cc:2243] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.496013 20694 raft_consensus.cc:2272] T 0bca2c885e084ef9af7344b6abb486aa P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.498983 20694 tablet_replica.cc:333] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.499768 20694 raft_consensus.cc:2243] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.500469 20694 raft_consensus.cc:2272] T 91268f1f8ef64ef4b455bead2f60e2ff P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.539609 20694 tablet_replica.cc:333] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.546763 20694 raft_consensus.cc:2243] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.547967 20694 raft_consensus.cc:2272] T ed83b85c2e96457c82a5beb8aa8c18f3 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.557302 20694 tablet_replica.cc:333] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.570780 20694 raft_consensus.cc:2243] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.571802 20694 raft_consensus.cc:2272] T 16eb6999a3524d59835c31e2b76d09da P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.574572 21908 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:28.587440 20694 tablet_replica.cc:333] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.588792 20694 raft_consensus.cc:2243] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.589546 20694 raft_consensus.cc:2272] T 373c4d5502fd42dca6f9cbb5a894ee0b P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.593230 21874 consensus_peers.cc:597] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 691d4cf0a1ef4f689413711647c88f75. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.593672 21983 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:08:28.595683 29650 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:28.603597 20694 tablet_replica.cc:333] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.604835 20694 raft_consensus.cc:2243] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.605955 20694 raft_consensus.cc:2272] T dbb4eb8dd14248918867a27aa6d9bac9 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.608841 21875 consensus_peers.cc:597] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.609233 20694 tablet_replica.cc:333] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7: stopping tablet replica
W20260709 13:08:28.646456 29914 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:28.650501 29901 raft_consensus.cc:493] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:28.651212 29901 raft_consensus.cc:515] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:28.657711 20694 raft_consensus.cc:2243] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.658540 20694 raft_consensus.cc:2272] T 2705e36077094db8a03a8b3e606284be P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.660509 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.661711 20694 tablet_replica.cc:333] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.676600 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:28.677865 29901 leader_election.cc:290] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:28.681784 20694 raft_consensus.cc:2243] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.683003 20694 raft_consensus.cc:2272] T 6bde6ac1d042400fbc88831c01b9fdda P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.684399 21799 leader_election.cc:304] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:28.685658 20694 tablet_replica.cc:333] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.686266 29903 raft_consensus.cc:2749] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:28.688993 29903 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:28.689500 29903 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:28.689244 21977 raft_consensus.cc:2955] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:08:28.691612 29903 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:28.649682 29809 raft_consensus.cc:2955] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:08:28.700030 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.709391 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff74442193fb468c966c8842f014e361" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.717883 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.719791 21799 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.721629 29517 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:28.715483 20694 raft_consensus.cc:2243] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.734947 20694 raft_consensus.cc:2272] T 9206e3439eb54425a3de6b25e0d8b36a P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.743467 20694 tablet_replica.cc:333] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.744343 20694 raft_consensus.cc:2243] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.745266 20694 raft_consensus.cc:2272] T ed07e2d846e24b06abb770ea1376b9fb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.754320 20694 tablet_replica.cc:333] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.755084 29811 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:28.755687 29811 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:28.760771 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.761436 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79240f02176941bdb28ac4ee2d3f446e" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.763200 21798 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.764747 29901 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:28.765925 21728 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index -1 to 13, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 23 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:08:28.758076 29811 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:28.778728 29901 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:28.779276 29901 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:28.781411 29901 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:28.755223 20694 raft_consensus.cc:2243] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.782923 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:28.783967 20694 raft_consensus.cc:2272] T ad9d9c562d2d411db01a7eaf4427d325 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.782923 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.785804 21799 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.786495 29811 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:28.790220 20694 tablet_replica.cc:333] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.791350 29811 raft_consensus.cc:493] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
W20260709 13:08:28.791604 21780 auto_rebalancer.cc:629] Failed to schedule move for tablet dbb4eb8dd14248918867a27aa6d9bac9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:28.793565 29901 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:28.794100 29901 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:28.797978 21905 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:28.793030 29811 raft_consensus.cc:515] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:28.804054 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.805675 29901 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:28.806129 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:28.807497 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da242efa5849aab4168785047cff48" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.809144 21798 leader_election.cc:304] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.809995 29901 raft_consensus.cc:2749] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:28.810201 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.811940 21799 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.807497 29811 leader_election.cc:290] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:28.812994 29904 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:28.815953 20694 raft_consensus.cc:2243] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.818524 29904 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:28.819181 29904 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:28.821556 29904 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:28.822458 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.822901 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.824100 21799 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.825470 29904 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:28.827301 21874 consensus_peers.cc:597] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3bbb48eaef64910973105f716cf813d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.828382 21980 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:28.830551 29650 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:08:28.832568 21875 consensus_peers.cc:597] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.833370 29901 raft_consensus.cc:493] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:28.833947 29901 raft_consensus.cc:515] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:28.836956 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:28.838492 29901 leader_election.cc:290] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:28.822278 20694 raft_consensus.cc:2272] T 0533e3146ff14445bcdca10aa4432f4b P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.840960 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4dac7f6b7b440d84e044b62b559aae" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.842814 21798 leader_election.cc:304] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:28.843858 29904 raft_consensus.cc:2749] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:28.845194 20694 tablet_replica.cc:333] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.846065 20694 raft_consensus.cc:2243] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.846977 20694 raft_consensus.cc:2272] T dd50c9e5c9a94fbb940c4168747744ab P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.852854 29904 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:28.853441 29904 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:28.856484 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.857115 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0e6a6fba594f8db28b949dbce488c7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:28.858464 21799 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.859315 29811 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:28.862568 29904 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:28.866277 20694 tablet_replica.cc:333] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.867185 20694 raft_consensus.cc:2243] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.874778 29904 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:28.875561 29811 raft_consensus.cc:493] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:28.876139 29811 raft_consensus.cc:515] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:28.878273 29811 leader_election.cc:290] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:28.879446 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.879665 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8aeca641b1d407488c25c7e1e347adc" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.882062 21799 leader_election.cc:304] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.882651 29811 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:28.883183 29901 raft_consensus.cc:2749] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:08:28.883255 29811 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:28.885368 29901 raft_consensus.cc:493] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3d76b2c4699e43fba10eeb81a91e4913)
I20260709 13:08:28.885982 29901 raft_consensus.cc:515] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:28.888281 29901 leader_election.cc:290] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:28.888680 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.889853 29811 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:28.882546 20694 raft_consensus.cc:2272] T 24f26969ffdf4e1eb377ceacb0750ca5 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.890996 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.896697 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b605ab81240b687b2fd4857aee3c3" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:28.898324 20694 tablet_replica.cc:333] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.898226 29904 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:28.899260 20694 raft_consensus.cc:2243] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.899922 20694 raft_consensus.cc:2272] T ff74442193fb468c966c8842f014e361 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.900633 29904 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:28.901939 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:28.902245 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cad01af8fd4976ba77658d6a8e31b7" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.907200 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:28.908835 20694 tablet_replica.cc:333] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.909168 21799 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.909680 20694 raft_consensus.cc:2243] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.910382 29904 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:28.912510 21799 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:28.913395 29901 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:28.916896 21799 leader_election.cc:304] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:28.917367 20694 raft_consensus.cc:2272] T edb7f62b920e42349d56d878295176b2 P 479255846c5141b584b16aa253f587c7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.918556 29901 raft_consensus.cc:2749] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:28.920624 20694 tablet_replica.cc:333] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.921563 20694 raft_consensus.cc:2243] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.922358 20694 raft_consensus.cc:2272] T bccfbbc2aaa5423fb599eeb56b38121c P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.922994 29650 raft_consensus.cc:2955] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index -1 to 17, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:08:28.926800 21983 raft_consensus.cc:2955] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index -1 to 17, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:08:28.927956 20694 tablet_replica.cc:333] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.928817 20694 raft_consensus.cc:2243] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.929828 20694 raft_consensus.cc:2272] T 864ca05a434d488c83f87f71e27dfa63 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.932714 20694 tablet_replica.cc:333] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.933399 20694 raft_consensus.cc:2243] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.933974 20694 raft_consensus.cc:2272] T 79240f02176941bdb28ac4ee2d3f446e P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.943912 21908 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:28.944379 21728 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 17, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.950963 20694 tablet_replica.cc:333] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.951900 20694 raft_consensus.cc:2243] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.953018 20694 raft_consensus.cc:2272] T b51a2766379a4c6195da185ed192fd0d P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.973853 20694 tablet_replica.cc:333] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.974745 20694 raft_consensus.cc:2243] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.975093 21983 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:28.975888 20694 raft_consensus.cc:2272] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.976542 29809 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:28.978750 21875 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.978874 20694 tablet_replica.cc:333] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.979753 20694 raft_consensus.cc:2243] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:08:28.980773 21874 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): Couldn't send request to peer 0157b4f0725d4f92a53938c921db9efc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 373c4d5502fd42dca6f9cbb5a894ee0b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.980932 20694 raft_consensus.cc:2272] T 32a7f60c55ae4cc99c25348a1d82e6de P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.983898 20694 tablet_replica.cc:333] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.984586 20694 raft_consensus.cc:2243] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.985661 20694 raft_consensus.cc:2272] T 402a4aa48c774bb6919a83e05b1a61ee P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.988351 20694 tablet_replica.cc:333] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:28.989136 20694 raft_consensus.cc:2243] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.989895 20694 raft_consensus.cc:2272] T 9f4dac7f6b7b440d84e044b62b559aae P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.046957 29517 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:29.047533 29517 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.049453 29517 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.049974 20694 tablet_replica.cc:333] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.050937 20694 raft_consensus.cc:2243] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.051584 20694 raft_consensus.cc:2272] T 48cad01af8fd4976ba77658d6a8e31b7 P 479255846c5141b584b16aa253f587c7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.057255 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:29.057355 29904 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:29.057792 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:29.058126 29904 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:29.060588 29904 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:29.061901 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:29.063633 29901 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:29.064246 29901 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:29.067662 29901 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:29.067332 29650 raft_consensus.cc:2955] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:08:29.081681 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:29.063118 21798 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:29.082998 29904 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:29.083807 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bdbae418d5246588152f31784da5bec" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:29.075624 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e3ce132d8a443eb412d1816ffc7579" candidate_uuid: "479255846c5141b584b16aa253f587c7" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:29.086733 20694 tablet_replica.cc:333] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.087898 20694 raft_consensus.cc:2243] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.072542 21983 raft_consensus.cc:2955] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } }
I20260709 13:08:29.088603 20694 raft_consensus.cc:2272] T c8aeca641b1d407488c25c7e1e347adc P 479255846c5141b584b16aa253f587c7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.092406 20694 tablet_replica.cc:333] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.093287 20694 raft_consensus.cc:2243] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.094499 20694 raft_consensus.cc:2272] T add79beae9d04c6983a531c46dc72deb P 479255846c5141b584b16aa253f587c7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.097774 20694 tablet_replica.cc:333] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.098673 20694 raft_consensus.cc:2243] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.099947 20694 raft_consensus.cc:2272] T 865ede4842b04242930bf2619bb09d16 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.103001 20694 tablet_replica.cc:333] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.103255 21799 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:29.103855 20694 raft_consensus.cc:2243] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.106375 29901 raft_consensus.cc:2706] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Received pre-election callback for term 21 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:08:29.111001 21799 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479255846c5141b584b16aa253f587c7; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:29.111719 29901 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:08:29.113168 20694 raft_consensus.cc:2272] T 9bdbae418d5246588152f31784da5bec P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.117166 20694 tablet_replica.cc:333] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.117902 20694 raft_consensus.cc:2243] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.134016 29921 ts_tablet_manager.cc:933] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:29.130714 21729 catalog_manager.cc:5697] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: config changed from index -1 to 12, NON_VOTER 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) added. New cstate: current_term: 21 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.144202 20694 raft_consensus.cc:2272] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.155210 20694 tablet_replica.cc:333] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.156494 20694 raft_consensus.cc:2243] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.161798 20694 raft_consensus.cc:2272] T b3bbb48eaef64910973105f716cf813d P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.165175 20694 tablet_replica.cc:333] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.166133 20694 raft_consensus.cc:2243] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.179244 20694 raft_consensus.cc:2272] T efae0b9ae5b44891a8bd0df1878c7c42 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.192658 20694 tablet_replica.cc:333] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.193475 20694 raft_consensus.cc:2243] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.199781 29921 tablet_copy_client.cc:323] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:08:29.201843 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet 691d4cf0a1ef4f689413711647c88f75 from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
I20260709 13:08:29.202505 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet 691d4cf0a1ef4f689413711647c88f75 from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-691d4cf0a1ef4f689413711647c88f75
I20260709 13:08:29.193982 20694 raft_consensus.cc:2272] T 094b605ab81240b687b2fd4857aee3c3 P 479255846c5141b584b16aa253f587c7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.213763 20694 tablet_replica.cc:333] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.218612 20694 raft_consensus.cc:2243] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.219187 20694 raft_consensus.cc:2272] T 96da242efa5849aab4168785047cff48 P 479255846c5141b584b16aa253f587c7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.220902 21919 tablet_copy_source_session.cc:215] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:29.222925 20694 tablet_replica.cc:333] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.231312 20694 raft_consensus.cc:2243] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.231954 20694 raft_consensus.cc:2272] T 691d4cf0a1ef4f689413711647c88f75 P 479255846c5141b584b16aa253f587c7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.234637 20694 tablet_replica.cc:333] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.235272 20694 raft_consensus.cc:2243] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.255054 29921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691d4cf0a1ef4f689413711647c88f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:29.256708 29923 ts_tablet_manager.cc:933] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:29.257949 20694 raft_consensus.cc:2272] T 14d5f024a39b4860be959c964acb51e6 P 479255846c5141b584b16aa253f587c7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.261162 20694 tablet_replica.cc:333] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.271310 29923 tablet_copy_client.cc:323] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:08:29.273275 20694 raft_consensus.cc:2243] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.274055 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet b3bbb48eaef64910973105f716cf813d from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
I20260709 13:08:29.274709 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet b3bbb48eaef64910973105f716cf813d from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-b3bbb48eaef64910973105f716cf813d
I20260709 13:08:29.280565 20694 raft_consensus.cc:2272] T 6f5da3aecad04fb0982188c37426f599 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.284698 20694 tablet_replica.cc:333] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.288028 20694 raft_consensus.cc:2243] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.289131 20694 raft_consensus.cc:2272] T cc0e6a6fba594f8db28b949dbce488c7 P 479255846c5141b584b16aa253f587c7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.288318 21919 tablet_copy_source_session.cc:215] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:29.298995 29923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bbb48eaef64910973105f716cf813d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:29.311619 20694 tablet_replica.cc:333] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.312547 20694 raft_consensus.cc:2243] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.313685 20694 raft_consensus.cc:2272] T ae693bf6616e4755b822cea96cf12222 P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.316978 29921 tablet_copy_client.cc:806] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:29.317729 29921 tablet_copy_client.cc:670] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:29.318816 20694 tablet_replica.cc:333] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.319671 20694 raft_consensus.cc:2243] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.333997 29921 tablet_copy_client.cc:538] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:29.337256 20694 raft_consensus.cc:2272] T 61e3ce132d8a443eb412d1816ffc7579 P 479255846c5141b584b16aa253f587c7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.338748 29909 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.354498 29909 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.356734 29909 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:29.340072 29892 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.357476 29892 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.359403 29892 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:29.362625 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:29.363828 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:29.365949 20694 tablet_replica.cc:333] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.366727 20694 raft_consensus.cc:2243] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.372995 20694 raft_consensus.cc:2272] T 86489c4c9e90474881f2bd8eb6fa582f P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:29.374210 21949 leader_election.cc:336] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.374718 21949 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:29.375765 21949 leader_election.cc:336] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.376150 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:29.378504 29921 tablet_bootstrap.cc:492] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:08:29.379294 20694 tablet_replica.cc:333] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7: stopping tablet replica
I20260709 13:08:29.380620 20694 raft_consensus.cc:2243] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.381621 29909 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:29.382187 20694 raft_consensus.cc:2272] T 4a225d8f594046389ec56c017df3b70c P 479255846c5141b584b16aa253f587c7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.382689 29892 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:29.346634 29923 tablet_copy_client.cc:806] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:29.423017 29923 tablet_copy_client.cc:670] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:29.440546 29923 tablet_copy_client.cc:538] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:29.498863 29809 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.499477 29809 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.502457 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:29.502705 29650 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.503084 21983 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:29.503196 29650 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.504331 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:29.505081 29650 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.505211 29900 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:29.505666 29900 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.506011 29900 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:29.506090 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:29.506690 21983 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 25.
I20260709 13:08:29.507863 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:29.508584 29650 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:29.508935 29650 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.509243 29650 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:08:29.510897 21875 leader_election.cc:336] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.502032 29809 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:29.512948 21875 leader_election.cc:336] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.514111 29900 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:29.518687 21875 leader_election.cc:336] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.519122 29926 ts_tablet_manager.cc:933] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: Initiating tablet copy from peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:29.546643 29900 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.549049 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d93b81c2ba1474cbbc824b7bbdd72a8" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:29.549644 21983 raft_consensus.cc:3060] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:29.553390 29892 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.553902 29892 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.555979 29892 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:29.556774 29923 tablet_bootstrap.cc:492] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:08:29.558591 29650 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.559933 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:29.562733 29650 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.564942 29925 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.565436 29925 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:29.567447 29925 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:29.576021 21875 leader_election.cc:336] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.577206 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90821f4436f045a0a3847b276293f36f" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:29.577818 21982 raft_consensus.cc:3060] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:29.580042 29926 tablet_copy_client.cc:323] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Beginning tablet copy session from remote peer at address 127.20.53.130:43149
I20260709 13:08:29.580726 21983 raft_consensus.cc:2468] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:29.581681 21919 tablet_copy_service.cc:140] P ac1dd8ad9fc44263932ec57d9376a271: Received BeginTabletCopySession request for tablet 373c4d5502fd42dca6f9cbb5a894ee0b from peer 0157b4f0725d4f92a53938c921db9efc ({username='slave'} at 127.0.0.1:55690)
W20260709 13:08:29.582235 21949 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.582677 21919 tablet_copy_service.cc:161] P ac1dd8ad9fc44263932ec57d9376a271: Beginning new tablet copy session on tablet 373c4d5502fd42dca6f9cbb5a894ee0b from peer 0157b4f0725d4f92a53938c921db9efc at {username='slave'} at 127.0.0.1:55690: session id = 0157b4f0725d4f92a53938c921db9efc-373c4d5502fd42dca6f9cbb5a894ee0b
I20260709 13:08:29.589644 21982 raft_consensus.cc:2468] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 26.
I20260709 13:08:29.594573 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:29.596196 29909 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:29.602090 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:29.598801 21873 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:29.605113 29650 raft_consensus.cc:2804] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:29.605547 29650 raft_consensus.cc:697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:29.606380 29650 consensus_queue.cc:237] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.607842 21919 tablet_copy_source_session.cc:215] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:29.609543 21949 leader_election.cc:336] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.614298 29900 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.635663 29900 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.642602 29900 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.650835 21948 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:29.650096 21729 catalog_manager.cc:5697] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 21 to 22, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 22 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.658210 29929 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.659122 29929 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.657030 29909 raft_consensus.cc:2749] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:29.659739 29926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373c4d5502fd42dca6f9cbb5a894ee0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:29.669744 21873 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:29.670528 29809 raft_consensus.cc:2804] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:08:29.670941 21949 leader_election.cc:336] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.670962 29809 raft_consensus.cc:697] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 26 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:29.664291 21875 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.661895 29929 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:29.683040 29809 consensus_queue.cc:237] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:29.700273 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 44486.6us
I20260709 13:08:29.704008 21900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:29.709177 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:29.710049 21982 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:29.710791 29921 tablet_bootstrap.cc:492] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:29.711694 29921 tablet_bootstrap.cc:492] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:08:29.712368 29921 ts_tablet_manager.cc:1403] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.334s	user 0.043s	sys 0.010s
I20260709 13:08:29.716554 29921 raft_consensus.cc:359] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:29.717592 21948 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:29.730489 29921 raft_consensus.cc:740] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:08:29.740811 29921 consensus_queue.cc:260] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:29.743942 29843 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.744545 29843 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:29.739559 29909 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.747040 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:29.749130 29809 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:29.749487 29809 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.749889 29809 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:29.739868 29929 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:29.752767 22521 leader_election.cc:336] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.746382 29909 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:29.755779 29909 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:29.761286 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:29.762028 22553 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 27.
I20260709 13:08:29.765154 29920 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.765682 29920 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:29.768292 21949 leader_election.cc:336] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.768751 29843 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.769366 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:29.770810 22521 leader_election.cc:336] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.769371 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:29.776507 21983 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 27.
I20260709 13:08:29.782311 29809 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.788522 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:29.790408 29920 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.779488 29909 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:08:29.791115 21875 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.791111 29909 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.791899 29909 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:29.792093 29809 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.793617 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:29.794150 21983 raft_consensus.cc:3060] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:29.798425 29931 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.799098 29931 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.802399 21983 raft_consensus.cc:2468] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:29.803470 21873 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:29.807065 21719 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 48246.2us
I20260709 13:08:29.809177 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:29.809734 21983 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
I20260709 13:08:29.819048 29920 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:08:29.819494 29920 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.819877 29920 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:29.805286 29929 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.833210 29931 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:29.829610 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff74442193fb468c966c8842f014e361: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:08:29.847594 29921 ts_tablet_manager.cc:1434] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.135s	user 0.013s	sys 0.004s
I20260709 13:08:29.831800 29929 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.855695 29929 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:29.855600 29909 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:29.853463 29920 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:29.860234 21949 leader_election.cc:336] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.860245 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:29.867851 29920 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.858980 29926 tablet_copy_client.cc:806] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:29.863837 29809 raft_consensus.cc:2804] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:29.871788 29809 raft_consensus.cc:697] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:29.867802 21948 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:29.873473 29929 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:29.871831 29926 tablet_copy_client.cc:670] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:29.873677 29809 consensus_queue.cc:237] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:29.861994 21875 leader_election.cc:336] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:29.863930 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 60540.5us
I20260709 13:08:29.880899 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:29.893642 21873 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:29.904606 22521 leader_election.cc:336] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.906327 29937 raft_consensus.cc:2749] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:29.910851 29909 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:29.913535 21949 leader_election.cc:336] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:29.925371 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-691d4cf0a1ef4f689413711647c88f75 received from {username='slave'} at 127.0.0.1:55690
I20260709 13:08:29.927426 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-691d4cf0a1ef4f689413711647c88f75 on tablet 691d4cf0a1ef4f689413711647c88f75 with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:29.938230 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:29.938973 21982 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 28: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:29.945955 29900 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.946511 29900 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.947970 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:29.948602 29900 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.948719 22553 raft_consensus.cc:2393] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 28: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:29.949208 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:29.950090 29943 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:29.950484 29943 raft_consensus.cc:493] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.950851 29943 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:29.952651 29926 tablet_copy_client.cc:538] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:29.955449 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:29.956036 21982 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 18.
I20260709 13:08:29.960454 29943 raft_consensus.cc:515] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:29.961885 29926 tablet_bootstrap.cc:492] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: Bootstrap starting.
I20260709 13:08:29.963227 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:29.969489 29900 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:29.967012 22519 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:29.981791 29941 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:08:29.970573 29931 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.982983 29931 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.985291 29931 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:29.970875 29900 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.988632 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:29.995955 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:29.996614 21982 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:29.991652 29925 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:29.999825 29925 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:29.991742 29900 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.004388 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:30.005046 21905 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:08:30.004246 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:30.010650 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:29.994215 29909 raft_consensus.cc:2749] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:08:30.011502 29650 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:30.019389 29650 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.019889 29650 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:30.003130 21949 connection.cc:573] client connection to 127.20.53.129:39085 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:08:30.002075 29925 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:30.036820 29843 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.037830 29932 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:30.038277 29932 raft_consensus.cc:493] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.038647 29932 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:30.037297 29843 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.043015 29843 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:30.026254 29938 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.047600 29943 leader_election.cc:290] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.071461 29938 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.079613 29938 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.105685 29951 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.106281 29951 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.110433 29900 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.105679 29909 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.127149 29909 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.102946 29932 raft_consensus.cc:515] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.129318 29909 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:30.130585 29932 leader_election.cc:290] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:30.134272 29650 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.165369 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:30.166047 22554 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 16.
W20260709 13:08:30.169687 21875 leader_election.cc:336] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.172278 21982 raft_consensus.cc:1275] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:30.172699 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
I20260709 13:08:30.174214 29932 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:30.174309 29953 consensus_queue.cc:1048] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:30.174808 29932 raft_consensus.cc:493] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.175320 29932 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.177399 29900 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.178745 29951 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:30.189970 29650 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.193651 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd0981f0f71482b83434dddd7e49dc4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
W20260709 13:08:30.194258 21875 leader_election.cc:336] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.194360 21983 raft_consensus.cc:3060] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:30.195220 21875 consensus_peers.cc:597] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.198037 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.198655 21980 raft_consensus.cc:3060] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:30.199245 29937 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.199805 29937 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.204115 29937 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:30.210807 21875 leader_election.cc:336] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.211382 21983 raft_consensus.cc:2468] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 19.
W20260709 13:08:30.211917 21875 leader_election.cc:336] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.218901 21980 raft_consensus.cc:2468] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
W20260709 13:08:30.216349 22521 leader_election.cc:336] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.221282 22521 leader_election.cc:336] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.221863 22521 leader_election.cc:336] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.220371 21873 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.230868 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:30.231472 21908 raft_consensus.cc:3060] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:30.231472 21873 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:30.236687 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a439d1de6924cf49dda5333182516bb" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.237231 21980 raft_consensus.cc:3060] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:30.238186 21729 catalog_manager.cc:5697] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 25 to 26, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 26 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.240000 21729 catalog_manager.cc:5697] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 23 to 24, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.256095 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.259642 21908 raft_consensus.cc:2468] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:08:30.262008 21980 raft_consensus.cc:2468] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 26.
I20260709 13:08:30.239974 29953 raft_consensus.cc:2804] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:08:30.279829 21875 leader_election.cc:336] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.281075 21875 leader_election.cc:336] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.235608 29951 raft_consensus.cc:2804] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:30.288465 29951 raft_consensus.cc:697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:30.289724 29951 consensus_queue.cc:237] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.290547 29953 raft_consensus.cc:697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:30.288353 29931 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.299937 21948 leader_election.cc:304] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:30.302469 29929 raft_consensus.cc:2804] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:30.303131 29929 raft_consensus.cc:697] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
W20260709 13:08:30.310336 21949 leader_election.cc:336] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.291940 29953 consensus_queue.cc:237] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.313637 22519 leader_election.cc:304] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.319905 29954 raft_consensus.cc:2804] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:30.320444 29954 raft_consensus.cc:697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 26 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:08:30.320720 22520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 290201us
I20260709 13:08:30.321362 29954 consensus_queue.cc:237] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.308966 29929 consensus_queue.cc:237] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.326014 22553 raft_consensus.cc:1217] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 LEARNER]: Deduplicated request from leader. Original: 23.12->[23.13-23.13]   Dedup: 23.13->[]
I20260709 13:08:30.329057 22554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:30.331634 22554 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 16.
I20260709 13:08:30.304634 29931 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.334278 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
W20260709 13:08:30.341115 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47433.8us
I20260709 13:08:30.341915 21907 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 16.
W20260709 13:08:30.352932 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.356235 29932 raft_consensus.cc:515] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.358466 21977 raft_consensus.cc:2393] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 17: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:30.329777 29900 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.361758 29949 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.362125 29900 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.362365 29949 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.364171 29900 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.364316 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:30.364310 29949 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:30.366510 21874 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.376313 21874 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.377074 29809 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:30.377439 29809 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.377764 29809 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.382726 29935 raft_consensus.cc:2749] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:30.383561 29931 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.397213 29809 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.375211 29932 leader_election.cc:290] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:30.406515 29809 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:30.409192 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bde6ac1d042400fbc88831c01b9fdda" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:30.409785 22548 raft_consensus.cc:3060] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.423628 22548 raft_consensus.cc:2468] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 17.
I20260709 13:08:30.424976 21874 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:30.428997 29923 tablet_bootstrap.cc:492] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:30.430073 29923 tablet_bootstrap.cc:492] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:08:30.430871 29923 ts_tablet_manager.cc:1403] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.874s	user 0.049s	sys 0.027s
W20260709 13:08:30.432368 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 95896.7us
I20260709 13:08:30.432228 29900 raft_consensus.cc:2804] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:30.436436 29900 raft_consensus.cc:697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
I20260709 13:08:30.437297 29900 consensus_queue.cc:237] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.438972 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:30.450940 22520 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:30.452919 21875 consensus_peers.cc:597] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.453253 22519 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
W20260709 13:08:30.453416 21875 consensus_peers.cc:597] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.453979 21875 consensus_peers.cc:597] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.457645 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9d9c562d2d411db01a7eaf4427d325" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
W20260709 13:08:30.464672 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 120857us
I20260709 13:08:30.462299 29954 raft_consensus.cc:3060] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.471750 29892 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.472283 29892 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.472705 29909 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.473256 29909 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.475167 29909 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:30.478050 21949 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111) [suppressed 192 similar messages]
I20260709 13:08:30.478331 29843 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.478844 29843 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.480845 29843 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
W20260709 13:08:30.482146 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.481915 29954 raft_consensus.cc:2749] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:30.482656 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.483471 21949 leader_election.cc:336] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.484422 21949 leader_election.cc:336] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.485247 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.486876 29650 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.487412 29809 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.487870 29809 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.459607 29943 raft_consensus.cc:2764] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:30.493062 21980 raft_consensus.cc:1275] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:08:30.493120 29650 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.494041 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.494253 29843 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.494760 29843 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.498570 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:30.505159 22553 raft_consensus.cc:2468] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 17.
I20260709 13:08:30.499154 21905 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:08:30.506528 29942 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.507108 29942 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.509143 29942 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.467816 29929 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.510412 29929 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.512041 21982 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 22.
I20260709 13:08:30.512346 29929 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:30.512593 22521 leader_election.cc:336] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.513664 29892 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:30.515244 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.514946 29923 raft_consensus.cc:359] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
W20260709 13:08:30.515668 22521 leader_election.cc:336] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.498399 21729 catalog_manager.cc:5697] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 18 to 19, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 19 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.519246 29650 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.518774 21729 catalog_manager.cc:5697] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 23 to 24, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.522460 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.523137 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.524099 29809 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.515619 29966 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.529559 29966 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.530725 21977 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:30.530851 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:30.531692 29843 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.534216 29966 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:30.538358 21731 catalog_manager.cc:5697] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 25 to 26, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 26 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.540336 29953 consensus_queue.cc:1048] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:30.516227 29923 raft_consensus.cc:740] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:08:30.543418 29923 consensus_queue.cc:260] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:30.545337 21728 catalog_manager.cc:5697] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 23 to 24, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 24 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.554834 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:30.555457 21905 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 22.
I20260709 13:08:30.556402 29966 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.556905 29966 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.558039 29967 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.558208 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:30.558629 29967 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.559054 29900 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:30.559449 29900 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.559803 29900 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:30.560743 29967 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:30.562577 22520 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.563874 29943 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:30.564250 29943 raft_consensus.cc:493] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.564610 29943 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:30.570673 29900 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.573788 29943 raft_consensus.cc:515] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.574903 29900 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:30.586931 22521 leader_election.cc:336] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.587574 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.587788 29923 ts_tablet_manager.cc:1434] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.157s	user 0.005s	sys 0.000s
W20260709 13:08:30.588130 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.590114 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.590785 21949 leader_election.cc:336] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.591223 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.591626 21949 leader_election.cc:336] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.591993 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:30.592684 29967 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:30.594465 29900 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.594748 21948 leader_election.cc:304] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.594980 29900 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.595963 29949 raft_consensus.cc:2804] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:30.596431 29949 raft_consensus.cc:697] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:30.597141 29900 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.597630 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:30.597301 29949 consensus_queue.cc:237] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.598222 22553 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
I20260709 13:08:30.598649 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:30.597317 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:30.599714 29953 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:30.600136 29953 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.600530 29953 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:30.601439 29966 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:30.602249 21875 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.602983 21875 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.603350 21875 leader_election.cc:336] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.603690 21875 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.604734 29943 leader_election.cc:290] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085)
I20260709 13:08:30.608150 29943 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.608589 29943 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.609220 29953 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.610342 21905 raft_consensus.cc:2393] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 21: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:30.619056 29964 raft_consensus.cc:2749] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:30.621169 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:30.623131 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:30.626152 29953 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:30.627343 21875 leader_election.cc:336] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.630923 22521 leader_election.cc:336] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.634367 29943 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.624389 29966 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:08:30.637918 22521 leader_election.cc:336] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.650450 29953 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.651010 29953 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.653141 29966 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.653646 29966 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:30.653684 29953 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.659370 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18adc37fa2ee428c9cdcfe76e72e77a4" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
W20260709 13:08:30.592880 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.660509 21908 raft_consensus.cc:3060] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:30.660665 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 67823.6us
W20260709 13:08:30.661437 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.660800 21728 catalog_manager.cc:5697] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 16 to 17, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 17 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:30.661988 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.662448 21949 leader_election.cc:336] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.662925 21949 leader_election.cc:336] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.663323 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:30.666712 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-b3bbb48eaef64910973105f716cf813d received from {username='slave'} at 127.0.0.1:55690
I20260709 13:08:30.667147 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-b3bbb48eaef64910973105f716cf813d on tablet b3bbb48eaef64910973105f716cf813d with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:30.669484 21908 raft_consensus.cc:2468] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:08:30.673038 29949 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:30.673746 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.674373 21983 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 23.
I20260709 13:08:30.679896 21983 raft_consensus.cc:1275] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:08:30.682560 29843 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.683054 29843 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:30.683472 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.684923 29843 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.685305 29909 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.685945 29909 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.687642 29951 raft_consensus.cc:1064] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:08:30.688270 29909 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:30.690085 29951 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 11, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.691983 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.692608 21983 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:08:30.706641 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.707310 21977 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:08:30.707412 22553 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:08:30.708820 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.709440 21977 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 19.
I20260709 13:08:30.709510 29953 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:30.712100 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.712700 21977 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
W20260709 13:08:30.714665 21949 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.716135 29926 tablet_bootstrap.cc:492] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=2 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:30.717159 29926 tablet_bootstrap.cc:492] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: Bootstrap complete.
I20260709 13:08:30.717900 29926 ts_tablet_manager.cc:1403] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: Time spent bootstrapping tablet: real 0.756s	user 0.040s	sys 0.032s
W20260709 13:08:30.718528 22521 leader_election.cc:336] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.720785 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.723120 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.723703 21980 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:30.726614 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:30.728128 21949 leader_election.cc:336] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.728289 21875 consensus_peers.cc:597] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.728530 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:30.728992 21875 leader_election.cc:336] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.729441 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.729835 21949 leader_election.cc:336] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.729835 21875 leader_election.cc:336] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.730696 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:30.731386 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.733120 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:30.733667 21949 leader_election.cc:336] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.734094 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.736235 29843 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:30.736631 29843 raft_consensus.cc:493] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.737049 29843 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.738400 29941 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:30.737432 29949 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:30.738847 29941 raft_consensus.cc:493] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.739274 29941 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:30.741272 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a7f60c55ae4cc99c25348a1d82e6de" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.744508 22520 leader_election.cc:304] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.745301 29843 raft_consensus.cc:515] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.747330 29939 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:30.747769 29939 raft_consensus.cc:493] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.748131 29939 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.749665 29954 raft_consensus.cc:2804] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:30.750136 22553 raft_consensus.cc:1217] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 LEARNER]: Deduplicated request from leader. Original: 24.16->[24.17-24.17]   Dedup: 24.17->[]
I20260709 13:08:30.734644 29909 raft_consensus.cc:3060] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:30.750205 29954 raft_consensus.cc:697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:30.735939 29943 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:30.754737 29943 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.754664 29954 consensus_queue.cc:237] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.755281 29943 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:30.762182 22521 leader_election.cc:336] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.766935 29966 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.768210 21982 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac1dd8ad9fc44263932ec57d9376a271 in current term 23: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
I20260709 13:08:30.769160 29966 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:30.770160 29941 raft_consensus.cc:515] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.772929 29926 raft_consensus.cc:359] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:30.777667 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:30.778491 21977 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:08:30.782862 21974 raft_consensus.cc:1275] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:30.797842 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:30.784243 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:30.828305 21906 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 18.
W20260709 13:08:30.816246 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.820441 21980 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 20.
I20260709 13:08:30.783721 29909 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:30.783880 29943 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:30.834266 22521 leader_election.cc:336] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.834589 29943 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.833102 21728 catalog_manager.cc:5697] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 16 to 17, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 17 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.821436 29941 leader_election.cc:290] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:30.843309 22521 leader_election.cc:336] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.844624 21978 raft_consensus.cc:2468] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:30.820508 29926 raft_consensus.cc:740] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Initialized, Role: LEARNER
I20260709 13:08:30.848448 29926 consensus_queue.cc:260] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } }
I20260709 13:08:30.790853 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
W20260709 13:08:30.851006 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 60246.5us
I20260709 13:08:30.851536 29926 ts_tablet_manager.cc:1434] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.003s
I20260709 13:08:30.851724 29953 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:08:30.827739 21875 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.859099 29951 consensus_queue.cc:1048] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:30.860574 21949 leader_election.cc:336] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.810644 29939 raft_consensus.cc:515] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.862603 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:30.863257 22553 raft_consensus.cc:2393] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
I20260709 13:08:30.852828 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:30.863967 21908 raft_consensus.cc:2393] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 23: Already voted for candidate ac1dd8ad9fc44263932ec57d9376a271 in this term.
I20260709 13:08:30.853063 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.866000 29909 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:30.866436 29909 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.866806 29909 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.825665 29843 leader_election.cc:290] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:30.869658 22521 leader_election.cc:336] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.870301 29951 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:30.869668 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.870872 29951 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.871275 29951 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:30.874377 29929 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:30.874804 29929 raft_consensus.cc:493] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.875165 29929 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.878649 29951 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.880473 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.880759 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d5f024a39b4860be959c964acb51e6" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.881317 21980 raft_consensus.cc:3060] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.882203 21919 tablet_copy_service.cc:342] P ac1dd8ad9fc44263932ec57d9376a271: Request end of tablet copy session 0157b4f0725d4f92a53938c921db9efc-373c4d5502fd42dca6f9cbb5a894ee0b received from {username='slave'} at 127.0.0.1:55690
I20260709 13:08:30.882788 21919 tablet_copy_service.cc:434] P ac1dd8ad9fc44263932ec57d9376a271: ending tablet copy session 0157b4f0725d4f92a53938c921db9efc-373c4d5502fd42dca6f9cbb5a894ee0b on tablet 373c4d5502fd42dca6f9cbb5a894ee0b with peer 0157b4f0725d4f92a53938c921db9efc
I20260709 13:08:30.877933 29909 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:30.884250 21982 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0157b4f0725d4f92a53938c921db9efc in current term 20: Already voted for candidate 3d76b2c4699e43fba10eeb81a91e4913 in this term.
W20260709 13:08:30.885385 21875 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.885988 21875 leader_election.cc:336] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.886500 21875 leader_election.cc:336] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.887112 21875 consensus_peers.cc:597] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.887521 21875 consensus_peers.cc:597] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.888151 21875 consensus_peers.cc:597] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.880722 29951 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:30.888749 21875 leader_election.cc:336] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:30.895169 21949 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.878885 29939 leader_election.cc:290] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.897724 29953 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.899755 22548 raft_consensus.cc:1275] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:30.908012 21949 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:30.887923 21980 raft_consensus.cc:2468] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:08:30.909070 29949 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:30.908864 29953 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:30.910356 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 47822.4us
I20260709 13:08:30.912462 21978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5da3aecad04fb0982188c37426f599" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.913048 21978 raft_consensus.cc:3060] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:30.916706 29951 consensus_queue.cc:1048] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:30.908150 29929 raft_consensus.cc:515] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.917441 21728 catalog_manager.cc:5697] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 20 to 21, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 21 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.919938 29929 leader_election.cc:290] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:30.927098 29650 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:30.928970 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865ede4842b04242930bf2619bb09d16" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.929567 21974 raft_consensus.cc:3060] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.930086 21873 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.930357 29931 consensus_queue.cc:1048] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:30.930907 29650 raft_consensus.cc:2749] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:30.932024 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.932713 29650 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:30.933089 29650 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 479255846c5141b584b16aa253f587c7)
I20260709 13:08:30.933419 29650 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:30.937902 21974 raft_consensus.cc:2468] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:08:30.919965 29909 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:30.940295 29650 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.942833 21873 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.943758 29900 raft_consensus.cc:2804] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:30.946981 29650 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:30.949270 21978 raft_consensus.cc:2468] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
I20260709 13:08:30.905668 22553 raft_consensus.cc:1217] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 LEARNER]: Deduplicated request from leader. Original: 21.11->[21.12-21.12]   Dedup: 21.12->[]
I20260709 13:08:30.902657 21948 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:08:30.954531 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 51947.3us
I20260709 13:08:30.956190 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add79beae9d04c6983a531c46dc72deb" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:30.956714 21906 raft_consensus.cc:3060] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.958421 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae693bf6616e4755b822cea96cf12222" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.958943 21982 raft_consensus.cc:3060] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:30.961091 29929 raft_consensus.cc:2749] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:30.903707 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.949849 21983 raft_consensus.cc:1275] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:08:30.950649 29900 raft_consensus.cc:697] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:30.962679 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 59056.5us
I20260709 13:08:30.963490 29954 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:30.963603 29900 consensus_queue.cc:237] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:30.965065 22519 leader_election.cc:304] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:30.968781 21982 raft_consensus.cc:2468] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:30.969451 21906 raft_consensus.cc:2468] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 19.
W20260709 13:08:30.951553 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.903909 21875 consensus_peers.cc:597] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.974807 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 70917.3us
W20260709 13:08:30.975288 21875 consensus_peers.cc:597] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:30.975999 21875 consensus_peers.cc:597] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.976306 21977 raft_consensus.cc:1275] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:08:30.977480 21948 leader_election.cc:304] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:08:30.977864 21875 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.978366 21875 consensus_peers.cc:597] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.978549 29909 raft_consensus.cc:2804] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:30.979385 29909 raft_consensus.cc:697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:30.980597 29954 raft_consensus.cc:2804] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:30.981217 29954 raft_consensus.cc:697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
W20260709 13:08:30.985178 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff74442193fb468c966c8842f014e361: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.985486 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:30.986236 22553 raft_consensus.cc:2393] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d76b2c4699e43fba10eeb81a91e4913 in current term 20: Already voted for candidate 0157b4f0725d4f92a53938c921db9efc in this term.
W20260709 13:08:30.986629 21949 leader_election.cc:336] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.978364 21982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efae0b9ae5b44891a8bd0df1878c7c42" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:30.990341 21873 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:30.992172 21982 raft_consensus.cc:3060] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:30.993386 21949 leader_election.cc:336] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:30.998988 29650 raft_consensus.cc:2804] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:30.999456 29650 raft_consensus.cc:697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:30.996977 21875 leader_election.cc:336] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:31.000358 29809 consensus_queue.cc:1048] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:31.015250 21982 raft_consensus.cc:2468] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 21.
I20260709 13:08:31.013054 29650 consensus_queue.cc:237] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:31.018528 29909 consensus_queue.cc:237] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:31.024119 22519 leader_election.cc:304] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:31.030400 29843 consensus_queue.cc:1048] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:30.982306 29954 consensus_queue.cc:237] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:31.028702 29939 raft_consensus.cc:2804] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:31.012638 29953 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:31.080876 20694 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:31.123332 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 94190.7us
I20260709 13:08:31.120685 29939 raft_consensus.cc:697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:31.126012 29939 consensus_queue.cc:237] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:31.159643 22519 leader_election.cc:304] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:31.166788 29843 raft_consensus.cc:2804] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:31.167309 29843 raft_consensus.cc:697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:31.127269 29953 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:31.175127 29843 consensus_queue.cc:237] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:31.168879 21728 catalog_manager.cc:5697] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 20 to 21, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 21 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.186921 21948 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:08:31.196827 29977 log.cc:927] Time spent T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:31.212808 29984 raft_consensus.cc:2749] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:31.217442 21907 raft_consensus.cc:1275] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:31.210390 21873 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:08:31.234452 21875 leader_election.cc:336] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:31.235347 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.243314 29951 raft_consensus.cc:2804] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:31.249317 22553 raft_consensus.cc:1275] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:31.268929 21977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e402ca5ed540e5a1c44b9a1dafcf78" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:31.271297 21977 raft_consensus.cc:3060] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:31.271631 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 55176.2us
W20260709 13:08:31.272236 21875 consensus_peers.cc:597] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:31.290051 29964 raft_consensus.cc:2955] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index 13 to 14, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:31.298925 21977 raft_consensus.cc:2468] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac1dd8ad9fc44263932ec57d9376a271 in term 24.
I20260709 13:08:31.313347 21906 raft_consensus.cc:1275] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:31.308646 29951 raft_consensus.cc:697] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:31.329254 21874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 94756.9us
W20260709 13:08:31.352421 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:31.353185 29979 log.cc:927] Time spent T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: Append to log took a long time: real 0.230s	user 0.000s	sys 0.003s
I20260709 13:08:31.353062 29951 consensus_queue.cc:237] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:31.355193 29932 consensus_queue.cc:1048] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:31.356652 29932 consensus_queue.cc:1048] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:31.361454 21728 catalog_manager.cc:5697] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 20 to 21, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 21 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.371423 29993 consensus_queue.cc:1048] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:31.349815 22550 raft_consensus.cc:2955] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:31.373641 21949 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.385887 30000 raft_consensus.cc:1064] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:08:31.388670 30000 consensus_queue.cc:237] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:31.391176 21731 catalog_manager.cc:5697] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 19 to 20, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 20 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.392864 21731 catalog_manager.cc:5697] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 19 to 20, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 20 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:31.400592 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.401244 21873 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
W20260709 13:08:31.410073 21875 consensus_peers.cc:597] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:31.424456 29650 raft_consensus.cc:2804] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:31.425158 29650 raft_consensus.cc:697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Becoming Leader. State: Replica: ac1dd8ad9fc44263932ec57d9376a271, State: Running, Role: LEADER
W20260709 13:08:31.410653 21875 leader_election.cc:336] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:31.426177 29650 consensus_queue.cc:237] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:31.436789 29900 raft_consensus.cc:1064] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: attempting to promote NON_VOTER 0157b4f0725d4f92a53938c921db9efc to VOTER
I20260709 13:08:31.459789 21975 raft_consensus.cc:2955] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:31.505239 21977 raft_consensus.cc:1275] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:31.507961 29953 consensus_queue.cc:1048] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:31.524161 21731 catalog_manager.cc:5697] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 24 to 25, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 25 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.526512 29900 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:31.527295 21731 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 13 to 14, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:31.545532 21977 raft_consensus.cc:1275] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:31.575922 29931 consensus_queue.cc:1048] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
W20260709 13:08:31.641152 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:31.641872 21949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 49425us
I20260709 13:08:31.650774 21977 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:31.654414 29998 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:31.665804 21728 catalog_manager.cc:5697] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 18 to 19, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 19 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.690538 21978 raft_consensus.cc:1275] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:31.693923 29950 consensus_queue.cc:1048] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:31.695924 29892 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.698827 22521 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.696422 29892 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:31.723798 21949 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.733940 21977 raft_consensus.cc:1275] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:08:31.736690 21875 consensus_peers.cc:597] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:31.737582 21875 consensus_peers.cc:597] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.739640 21979 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:08:31.741194 30019 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 13:08:31.749122 22553 raft_consensus.cc:1275] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:08:31.765484 21875 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.773176 21978 raft_consensus.cc:1275] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:08:31.777272 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:31.764662 29920 consensus_queue.cc:1048] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:08:31.777871 22553 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 28.
W20260709 13:08:31.787492 21949 leader_election.cc:336] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:31.790066 22550 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 LEARNER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:08:31.767925 29892 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:31.796336 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.796437 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:31.797125 29920 consensus_queue.cc:1048] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:08:31.798787 29929 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:08:31.799170 29929 raft_consensus.cc:493] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.799512 29929 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:08:31.820293 21731 catalog_manager.cc:5697] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 20 to 21, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 21 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.822000 21731 catalog_manager.cc:5697] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 reported cstate change: term changed from 23 to 24, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130). New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.840441 29650 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:31.821177 29929 raft_consensus.cc:515] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:31.842595 30019 consensus_queue.cc:1048] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
W20260709 13:08:31.865061 21875 consensus_peers.cc:597] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:31.872107 21949 leader_election.cc:336] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:31.873765 21979 raft_consensus.cc:1275] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:31.887375 21906 raft_consensus.cc:1275] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:31.890931 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa248ef2ee9049c9a1f86b77185b86a3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc"
I20260709 13:08:31.891716 22548 raft_consensus.cc:3060] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:08:31.890054 29929 leader_election.cc:290] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 29 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:31.886947 30015 consensus_queue.cc:1048] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:08:31.893669 29892 consensus_queue.cc:1048] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:08:31.929625 22548 raft_consensus.cc:2468] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 29.
I20260709 13:08:31.935554 30014 raft_consensus.cc:2955] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Committing config change with OpId 24.18: config changed from index 17 to 18, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:31.939425 22550 raft_consensus.cc:2955] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:31.956933 21875 consensus_peers.cc:597] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:31.960103 30024 log.cc:927] Time spent T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:31.976922 21948 leader_election.cc:304] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:32.003052 21979 raft_consensus.cc:1275] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:08:31.998726 29966 raft_consensus.cc:2804] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:08:32.013379 29966 raft_consensus.cc:697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 29 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:32.014328 29966 consensus_queue.cc:237] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:32.015700 21875 consensus_peers.cc:597] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.034643 29650 consensus_queue.cc:1048] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:32.031153 29998 raft_consensus.cc:2955] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.042948 22553 raft_consensus.cc:2955] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.053508 21975 raft_consensus.cc:2955] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:32.081809 20694 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21855)
I20260709 13:08:32.084291 21905 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:32.093423 21731 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 17 to 18, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } attrs { replace: true } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.100046 21975 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:08:32.101420 29900 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:32.107183 22553 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:08:32.116000 29650 raft_consensus.cc:2955] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.117396 29900 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:32.119815 21977 raft_consensus.cc:2955] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.133352 21718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 691d4cf0a1ef4f689413711647c88f75 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:32.134684 21975 raft_consensus.cc:2955] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.140018 22553 raft_consensus.cc:2955] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.140875 21728 catalog_manager.cc:5697] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 12 to 13, 0157b4f0725d4f92a53938c921db9efc (127.20.53.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.161473 21729 catalog_manager.cc:5697] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 27 to 29, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 29 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.162755 21906 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:32.170745 22554 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:08:32.172693 21979 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer ac1dd8ad9fc44263932ec57d9376a271: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:08:32.176729 29900 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:08:32.179399 29900 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:08:32.187892 30014 raft_consensus.cc:2955] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Committing config change with OpId 24.19: config changed from index 18 to 19, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.196234 21983 raft_consensus.cc:2955] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Committing config change with OpId 24.19: config changed from index 18 to 19, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.237692 22554 raft_consensus.cc:2955] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Committing config change with OpId 24.19: config changed from index 18 to 19, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.247412 21718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3bbb48eaef64910973105f716cf813d with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:32.269575 21729 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: config changed from index 14 to 15, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 23 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
I20260709 13:08:32.305871 21731 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc reported cstate change: config changed from index 18 to 19, VOTER 479255846c5141b584b16aa253f587c7 (127.20.53.129) evicted. New cstate: current_term: 24 leader_uuid: "ac1dd8ad9fc44263932ec57d9376a271" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } } }
W20260709 13:08:32.385334 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b3bbb48eaef64910973105f716cf813d: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:32.399077 21949 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:32.570375 29920 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.570967 29920 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:32.573199 29920 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:32.574270 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:32.574914 21983 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 20.
I20260709 13:08:32.576162 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:08:32.578575 22521 leader_election.cc:336] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:32.579572 29920 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:32.579991 29920 raft_consensus.cc:493] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.580413 29920 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:32.589150 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:32.587983 29920 raft_consensus.cc:515] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:32.608057 22521 leader_election.cc:336] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:32.608872 29920 leader_election.cc:290] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:32.614549 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a4aa48c774bb6919a83e05b1a61ee" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:32.615134 21983 raft_consensus.cc:3060] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:32.628944 22554 raft_consensus.cc:1275] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 29 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 13:08:32.629926 21983 raft_consensus.cc:2468] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 21.
I20260709 13:08:32.632138 29966 consensus_queue.cc:1048] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:08:32.656395 22519 leader_election.cc:304] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:32.657470 29920 raft_consensus.cc:2804] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:32.658035 29920 raft_consensus.cc:697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:32.658900 29920 consensus_queue.cc:237] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:32.700131 21729 catalog_manager.cc:5697] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 19 to 21, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 21 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.730597 29929 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.731086 29929 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:32.733299 29929 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:32.734683 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:32.735296 21905 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 23.
I20260709 13:08:32.736867 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 
I20260709 13:08:32.743870 29892 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:32.744293 29892 raft_consensus.cc:493] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.744645 29892 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:32.748206 21949 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:32.760079 21875 consensus_peers.cc:597] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.774668 21875 consensus_peers.cc:597] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:32.782425 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:32.799635 29892 raft_consensus.cc:515] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:32.819072 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a2766379a4c6195da185ed192fd0d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271"
I20260709 13:08:32.819628 21905 raft_consensus.cc:3060] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:32.820744 21949 leader_election.cc:336] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:32.823344 29892 leader_election.cc:290] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Requested vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:32.839407 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:32.841102 21905 raft_consensus.cc:2468] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 24.
I20260709 13:08:32.842284 21948 leader_election.cc:304] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271; no voters: 479255846c5141b584b16aa253f587c7
I20260709 13:08:32.843037 29892 raft_consensus.cc:2804] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:32.845080 29892 raft_consensus.cc:697] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Becoming Leader. State: Replica: 3d76b2c4699e43fba10eeb81a91e4913, State: Running, Role: LEADER
I20260709 13:08:32.846419 29892 consensus_queue.cc:237] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:32.859634 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:32.919325 21731 catalog_manager.cc:5697] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 reported cstate change: term changed from 22 to 24, leader changed from 479255846c5141b584b16aa253f587c7 (127.20.53.129) to 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131). New cstate: current_term: 24 leader_uuid: "3d76b2c4699e43fba10eeb81a91e4913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:32.934890 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.941349 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.946663 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.954450 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.960314 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.982548 21875 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.995605 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.014303 21875 consensus_peers.cc:597] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.037037 21875 consensus_peers.cc:597] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.083154 20694 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:33.112805 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.122030 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.141774 21875 consensus_peers.cc:597] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.160634 21875 consensus_peers.cc:597] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.263703 21875 consensus_peers.cc:597] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.270691 21975 raft_consensus.cc:1275] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:33.273417 29993 consensus_queue.cc:1048] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:33.281119 22521 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:33.313951 21875 consensus_peers.cc:597] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.355139 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.387609 21875 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.400658 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.402858 21949 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:33.424638 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.425657 21875 consensus_peers.cc:597] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.464772 21905 raft_consensus.cc:1275] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Refusing update from remote peer 3d76b2c4699e43fba10eeb81a91e4913: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:08:33.466239 29892 consensus_queue.cc:1048] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:08:33.522387 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.522974 21875 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.530067 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 691d4cf0a1ef4f689413711647c88f75: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:33.546031 21875 consensus_peers.cc:597] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.555931 21875 consensus_peers.cc:597] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.592705 21875 consensus_peers.cc:597] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.654325 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.689611 21875 consensus_peers.cc:597] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.736482 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.762984 21949 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.766392 21875 consensus_peers.cc:597] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.833460 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.991622 21875 consensus_peers.cc:597] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.994082 21875 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:34.083884 20694 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:34.122107 21949 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:34.187736 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:34.306233 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:34.369836 22521 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:34.428653 21875 consensus_peers.cc:597] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:34.455677 21875 consensus_peers.cc:597] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:34.633389 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 691d4cf0a1ef4f689413711647c88f75: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:34.950239 21949 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.084391 20694 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:35.141773 21875 consensus_peers.cc:597] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.219816 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.293937 21875 consensus_peers.cc:597] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.330580 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.335134 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.374037 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.402974 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.479676 22521 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111) [suppressed 499 similar messages]
W20260709 13:08:35.526656 22521 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.554113 21875 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.587191 21875 consensus_peers.cc:597] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.599586 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.609018 21875 consensus_peers.cc:597] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.678915 21875 consensus_peers.cc:597] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:35.679479 21875 consensus_peers.cc:597] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.683413 21875 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.702637 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.709028 21875 consensus_peers.cc:597] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.713135 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.713868 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.714358 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.761164 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.783051 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.881503 21875 consensus_peers.cc:597] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.905448 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.932678 21949 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:35.937170 21875 consensus_peers.cc:597] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.956265 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.017071 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:36.045774 21875 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:36.061519 21875 consensus_peers.cc:597] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:36.083972 21875 consensus_peers.cc:597] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.085438 20694 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:36.088848 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.091609 21875 consensus_peers.cc:597] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.151283 21875 consensus_peers.cc:597] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.181177 21875 consensus_peers.cc:597] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:36.256769 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:36.317072 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:36.327244 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.359761 21949 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.598938 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.648051 21875 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.747346 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 691d4cf0a1ef4f689413711647c88f75: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:36.758379 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.841096 21875 consensus_peers.cc:597] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.847359 22521 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.852576 21949 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.957770 21875 consensus_peers.cc:597] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:37.078986 21875 consensus_peers.cc:597] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:37.085858 20694 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:37.246542 21949 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:37.565830 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 60805.9us
W20260709 13:08:37.722631 21875 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:37.728689 21875 consensus_peers.cc:597] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:37.791854 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:37.825464 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:37.904747 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:37.987242 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.033109 21875 consensus_peers.cc:597] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.037963 21875 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.039441 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.081967 21875 consensus_peers.cc:597] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.086340 20694 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:38.119349 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.166221 22521 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:38.177512 21875 consensus_peers.cc:597] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.179783 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.213732 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.221760 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.229622 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.325938 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.362372 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 60394.1us
W20260709 13:08:38.408223 21875 consensus_peers.cc:597] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.410889 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.413491 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.443964 21875 consensus_peers.cc:597] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.448199 21875 consensus_peers.cc:597] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.452517 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.466866 21875 consensus_peers.cc:597] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.504751 21875 consensus_peers.cc:597] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.505329 21875 consensus_peers.cc:597] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.546901 21875 consensus_peers.cc:597] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.567239 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.587863 21949 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:38.622478 21875 consensus_peers.cc:597] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.626187 21875 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.643132 21875 consensus_peers.cc:597] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.682045 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.702330 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.761300 21875 consensus_peers.cc:597] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.773914 21949 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.812853 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:38.866341 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.881624 21875 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:39.039258 21949 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:39.086978 20694 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:39.241492 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:39.335249 21875 consensus_peers.cc:597] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:39.337666 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:39.502693 22521 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:39.541946 21875 consensus_peers.cc:597] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:39.555573 21949 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:39.582490 21875 consensus_peers.cc:597] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:39.776485 21875 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.087471 20694 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:40.155108 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.158533 21875 consensus_peers.cc:597] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:40.163980 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:43149, user_credentials={real_user=slave}} blocked reactor thread for 45319.1us
W20260709 13:08:40.204900 21875 consensus_peers.cc:597] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.212687 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.244729 22521 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:40.455077 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.465889 21875 consensus_peers.cc:597] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.498585 21875 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111) [suppressed 482 similar messages]
W20260709 13:08:40.517896 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.574535 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.619763 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.653839 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.690186 21875 consensus_peers.cc:597] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:40.721156 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:40.725411 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.747648 21875 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.763522 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.808785 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.836684 21875 consensus_peers.cc:597] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:40.871879 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 691d4cf0a1ef4f689413711647c88f75: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:40.890573 21875 consensus_peers.cc:597] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:40.903527 21875 consensus_peers.cc:597] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.918728 21875 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.919440 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.935978 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:40.939073 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:41.044034 21875 consensus_peers.cc:597] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:41.048801 21875 consensus_peers.cc:597] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:41.087944 20694 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:41.103518 21875 consensus_peers.cc:597] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:41.122712 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:41.167048 21875 consensus_peers.cc:597] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:41.203038 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:41.220736 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:42.088510 20694 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 21855)
I20260709 13:08:42.162420 30088 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:42.169812 30091 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:42.170512 30091 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:42.168345 30088 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:42.173439 30091 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:42.175853 30088 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:42.179487 30092 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:42.197780 30086 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:42.198580 30086 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:42.200994 30086 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:42.188453 30092 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:42.246592 21983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:42.247581 30092 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:42.222231 30088 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:42.248210 30095 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:42.248623 30100 raft_consensus.cc:493] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:42.249111 30095 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:42.249274 30100 raft_consensus.cc:515] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:42.256744 30073 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:42.257091 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:42.260108 21949 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:42.248768 30088 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:42.268049 30086 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:42.268615 30086 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:42.270690 30086 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:42.271040 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:42.268105 30071 raft_consensus.cc:493] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:42.275907 30071 raft_consensus.cc:515] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:42.257344 30073 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:42.279809 30103 raft_consensus.cc:493] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0157b4f0725d4f92a53938c921db9efc)
I20260709 13:08:42.280342 30103 raft_consensus.cc:515] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:42.321831 21949 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:42.274545 30100 leader_election.cc:290] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:42.326481 21949 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:42.327000 21949 leader_election.cc:336] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:42.327648 21949 leader_election.cc:336] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:42.319545 30088 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:42.338054 21949 leader_election.cc:336] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:42.338861 21949 leader_election.cc:336] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:42.275166 30095 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:42.281226 30073 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:42.354197 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 76929.2us
I20260709 13:08:42.358247 30077 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:42.358816 30077 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:42.360894 30077 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:42.367311 21949 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:42.367458 21875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:39085, user_credentials={real_user=slave}} blocked reactor thread for 96062.3us
I20260709 13:08:42.380362 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:42.385105 21979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:42.391575 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:42.391878 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:42.393694 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:42.394291 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:42.394943 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd50c9e5c9a94fbb940c4168747744ab" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:42.396513 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86489c4c9e90474881f2bd8eb6fa582f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:42.397626 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a225d8f594046389ec56c017df3b70c" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:42.401919 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8957eea5c26d4180a331c4edcb3753b7" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:42.403656 30103 leader_election.cc:290] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:42.410486 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed83b85c2e96457c82a5beb8aa8c18f3" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:42.416509 22550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccfbbc2aaa5423fb599eeb56b38121c" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:42.419099 30071 leader_election.cc:290] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:42.427107 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:42.427320 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f26969ffdf4e1eb377ceacb0750ca5" candidate_uuid: "ac1dd8ad9fc44263932ec57d9376a271" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:42.430481 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:42.431118 22521 leader_election.cc:336] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:42.431550 22521 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, 479255846c5141b584b16aa253f587c7
I20260709 13:08:42.432502 30076 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:42.432708 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:42.439299 21903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e964a7ca2a54491a72482e75917bd10" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac1dd8ad9fc44263932ec57d9376a271" is_pre_election: true
I20260709 13:08:42.444671 22520 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 3d76b2c4699e43fba10eeb81a91e4913, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:42.445885 30104 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:42.451022 21873 leader_election.cc:304] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913
I20260709 13:08:42.452239 30098 raft_consensus.cc:2749] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:42.464761 21875 leader_election.cc:336] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:42.465263 21875 leader_election.cc:304] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
W20260709 13:08:42.466297 21875 leader_election.cc:336] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:42.466727 21875 leader_election.cc:304] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac1dd8ad9fc44263932ec57d9376a271; no voters: 0157b4f0725d4f92a53938c921db9efc, 479255846c5141b584b16aa253f587c7
I20260709 13:08:42.467586 30097 raft_consensus.cc:2749] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:42.468161 21875 consensus_peers.cc:597] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:42.468241 30097 raft_consensus.cc:2749] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:42.468802 21875 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:42.469322 21875 consensus_peers.cc:597] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:42.469435 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:42.470537 21875 consensus_peers.cc:597] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:42.478547 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:42.479367 30092 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:42.485697 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:42.486644 30092 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:42.487987 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:42.491200 30092 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:42.492272 21948 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:42.495510 30092 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:42.497582 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:42.498497 30092 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:42.505445 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:42.506184 30092 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:42.508760 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:42.509471 30092 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:42.636602 21949 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:42.643404 21875 consensus_peers.cc:597] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:42.780634 22521 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:43.043352 21875 consensus_peers.cc:597] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:43.089376 20694 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:43.096240 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3ea0 after lost signal to thread 20697
W20260709 13:08:43.097380 22576 debug-util.cc:398] Leaking SignalData structure 0x7b0800208ba0 after lost signal to thread 21766
W20260709 13:08:43.098716 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08002b03c0 after lost signal to thread 21933
W20260709 13:08:43.100870 22576 debug-util.cc:398] Leaking SignalData structure 0x7b080035e640 after lost signal to thread 22007
W20260709 13:08:43.107985 22576 debug-util.cc:398] Leaking SignalData structure 0x7b08003a39e0 after lost signal to thread 22579
W20260709 13:08:43.118561 21875 consensus_peers.cc:597] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.206485 22521 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:43.330142 21875 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.336144 21875 consensus_peers.cc:597] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:43.470880 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.497632 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:43.566418 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.602830 21875 consensus_peers.cc:597] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:43.648473 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.667845 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.676340 21875 consensus_peers.cc:597] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.680424 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.699165 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.741055 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.881162 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.909439 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.949527 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.971585 21875 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:43.999910 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.004345 21875 consensus_peers.cc:597] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.084426 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.089826 20694 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:44.105477 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.111346 21875 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.124533 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.179759 21875 consensus_peers.cc:597] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.189836 21875 consensus_peers.cc:597] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:44.218235 21875 consensus_peers.cc:597] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:44.294598 21875 consensus_peers.cc:597] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:44.308712 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:44.316059 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.350857 21875 consensus_peers.cc:597] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.360165 21875 consensus_peers.cc:597] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:44.478991 21875 consensus_peers.cc:597] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.502645 21875 consensus_peers.cc:597] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:44.638818 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:44.653182 21949 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:44.741444 21949 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:44.816628 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.924639 21875 consensus_peers.cc:597] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:44.952914 21949 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:44.955717 21875 consensus_peers.cc:597] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:45.090854 20694 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:45.111485 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:45.117014 21875 consensus_peers.cc:597] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:45.131664 21875 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:45.165716 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:45.208066 21949 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:45.246937 22521 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:45.468649 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff74442193fb468c966c8842f014e361: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:45.520795 21949 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111) [suppressed 406 similar messages]
W20260709 13:08:45.732223 22521 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:45.918197 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:45.944993 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.005280 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.091660 20694 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:46.141569 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.154402 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.184438 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.297263 21875 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.298161 21875 consensus_peers.cc:597] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:46.298782 21875 consensus_peers.cc:597] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.531243 21875 consensus_peers.cc:597] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:46.577656 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.582302 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.583043 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.583529 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.584396 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 117201us
W20260709 13:08:46.609310 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.613862 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.671967 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.732662 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.746919 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.750252 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.926585 21875 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:46.983927 21875 consensus_peers.cc:597] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.024600 21875 consensus_peers.cc:597] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:47.037000 21875 consensus_peers.cc:597] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:47.052749 21875 consensus_peers.cc:597] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.091881 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.092387 20694 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:47.114180 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.128298 21875 consensus_peers.cc:597] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.144984 21875 consensus_peers.cc:597] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:47.274263 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:47.309806 21875 consensus_peers.cc:597] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.359922 21875 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:47.389184 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd860 after lost signal to thread 20697
W20260709 13:08:47.390349 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd420 after lost signal to thread 21766
W20260709 13:08:47.391597 22004 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3480 after lost signal to thread 21933
W20260709 13:08:47.392729 22004 debug-util.cc:398] Leaking SignalData structure 0x7b080034d060 after lost signal to thread 22007
W20260709 13:08:47.393852 22004 debug-util.cc:398] Leaking SignalData structure 0x7b080019ab40 after lost signal to thread 22579
W20260709 13:08:47.417656 21949 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.448858 21875 consensus_peers.cc:597] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.544806 21949 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.670841 21875 consensus_peers.cc:597] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.679054 21949 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:47.706027 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.708666 21875 consensus_peers.cc:597] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:47.728541 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.783166 21875 consensus_peers.cc:597] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.883996 21875 consensus_peers.cc:597] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:47.884109 21949 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.942822 21875 consensus_peers.cc:597] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:47.963943 21875 consensus_peers.cc:597] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:48.093060 20694 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 21855)
W20260709 13:08:48.201821 22521 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:48.253791 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.314607 21875 consensus_peers.cc:597] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:48.331327 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:48.461004 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.588312 22521 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:48.739689 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.740249 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.745211 21875 consensus_peers.cc:597] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.769207 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.800625 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.803128 21875 consensus_peers.cc:597] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.830837 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.836279 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.955853 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:48.961028 21875 consensus_peers.cc:597] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:49.040515 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.183732 21875 consensus_peers.cc:597] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:49.212715 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b3bbb48eaef64910973105f716cf813d: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:49.286952 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.343840 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.354637 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.348929 21875 consensus_peers.cc:597] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.364476 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.378407 21873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 55425.4us
I20260709 13:08:49.422565 20694 tablet_server.cc:196] TabletServer@127.20.53.129:0 shutdown complete.
W20260709 13:08:49.437726 21875 consensus_peers.cc:597] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:49.461134 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.526221 21875 consensus_peers.cc:597] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:49.533370 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:49.583921 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.618422 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:49.680414 21875 consensus_peers.cc:597] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:49.693054 20694 tablet_server.cc:179] TabletServer@127.20.53.130:0 shutting down...
W20260709 13:08:49.708994 22520 consensus_peers.cc:597] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:49.736048 21875 consensus_peers.cc:597] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.741745 21948 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:49.770417 21875 consensus_peers.cc:597] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:49.815129 21948 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:49.816251 21875 consensus_peers.cc:597] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:49.829007 22520 consensus_peers.cc:597] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.844982 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:49.846853 20694 tablet_replica.cc:333] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.848670 20694 raft_consensus.cc:2243] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:08:49.854552 22520 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.856492 20694 raft_consensus.cc:2272] T 1f2f8130ad944310bea7f2f3d408309f P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:49.859920 21948 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:49.862843 21948 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:49.863828 21875 consensus_peers.cc:597] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:49.864503 20694 tablet_replica.cc:333] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.865432 20694 raft_consensus.cc:2243] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:49.865725 22520 consensus_peers.cc:597] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.866077 20694 raft_consensus.cc:2272] T 552d2504e5364dfe94b59ccc5d4bf3f7 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:49.866674 21948 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:49.868028 22520 consensus_peers.cc:597] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.869498 20694 tablet_replica.cc:333] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.871421 20694 raft_consensus.cc:2243] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.872995 20694 raft_consensus.cc:2272] T 6e964a7ca2a54491a72482e75917bd10 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.881633 20694 tablet_replica.cc:333] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.882468 20694 raft_consensus.cc:2243] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.884068 20694 raft_consensus.cc:2272] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.887544 20694 tablet_replica.cc:333] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
W20260709 13:08:49.887768 21875 consensus_peers.cc:597] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:49.888482 20694 raft_consensus.cc:2243] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 26 LEADER]: Raft consensus shutting down.
W20260709 13:08:49.889420 22520 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.889710 20694 raft_consensus.cc:2272] T 90821f4436f045a0a3847b276293f36f P ac1dd8ad9fc44263932ec57d9376a271 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.891919 20694 tablet_replica.cc:333] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.892576 20694 raft_consensus.cc:2243] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.893679 20694 raft_consensus.cc:2272] T 5b63bdc0c16e46fe907a6ef4f7f26653 P ac1dd8ad9fc44263932ec57d9376a271 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.897527 20694 tablet_replica.cc:333] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.898690 20694 raft_consensus.cc:2243] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.899829 20694 raft_consensus.cc:2272] T 911b6cb205984b78bafd3ecdcc02ef3c P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:49.901937 21948 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.902419 20694 tablet_replica.cc:333] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
W20260709 13:08:49.902554 21948 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.903517 20694 raft_consensus.cc:2243] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.905043 20694 raft_consensus.cc:2272] T 0cd0981f0f71482b83434dddd7e49dc4 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:49.908819 21948 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.911643 20694 tablet_replica.cc:333] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.912458 20694 raft_consensus.cc:2243] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.913385 20694 raft_consensus.cc:2272] T 0ef872609f3d4b9ab42d0ccec83ae647 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.916115 20694 tablet_replica.cc:333] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.916700 20694 raft_consensus.cc:2243] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.917455 20694 raft_consensus.cc:2272] T 0bca2c885e084ef9af7344b6abb486aa P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.920368 20694 tablet_replica.cc:333] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.920900 20694 raft_consensus.cc:2243] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.921845 20694 raft_consensus.cc:2272] T 91268f1f8ef64ef4b455bead2f60e2ff P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.924925 20694 tablet_replica.cc:333] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.925426 20694 raft_consensus.cc:2243] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.926371 20694 raft_consensus.cc:2272] T ed83b85c2e96457c82a5beb8aa8c18f3 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.928753 20694 tablet_replica.cc:333] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.929991 20694 raft_consensus.cc:2243] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.931104 20694 raft_consensus.cc:2272] T 16eb6999a3524d59835c31e2b76d09da P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.933180 20694 tablet_replica.cc:333] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.934036 20694 raft_consensus.cc:2243] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.936793 20694 raft_consensus.cc:2272] T 373c4d5502fd42dca6f9cbb5a894ee0b P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.939595 20694 tablet_replica.cc:333] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.940441 20694 raft_consensus.cc:2243] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.941534 20694 raft_consensus.cc:2272] T dbb4eb8dd14248918867a27aa6d9bac9 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:49.941751 21948 consensus_peers.cc:597] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.944069 20694 tablet_replica.cc:333] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.944881 20694 raft_consensus.cc:2243] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.946014 20694 raft_consensus.cc:2272] T 554595014abc431286bf4ba1922fc147 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.951109 20694 tablet_replica.cc:333] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.951929 20694 raft_consensus.cc:2243] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.952996 20694 raft_consensus.cc:2272] T c8aeca641b1d407488c25c7e1e347adc P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.956327 20694 tablet_replica.cc:333] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.957069 20694 raft_consensus.cc:2243] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.958226 20694 raft_consensus.cc:2272] T 0533e3146ff14445bcdca10aa4432f4b P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:49.959641 22520 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.960613 20694 tablet_replica.cc:333] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.961246 20694 raft_consensus.cc:2243] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.962378 20694 raft_consensus.cc:2272] T dd50c9e5c9a94fbb940c4168747744ab P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.965056 20694 tablet_replica.cc:333] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.965637 20694 raft_consensus.cc:2243] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.966121 20694 raft_consensus.cc:2272] T 24f26969ffdf4e1eb377ceacb0750ca5 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.968083 20694 tablet_replica.cc:333] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.968824 20694 raft_consensus.cc:2243] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.969528 20694 raft_consensus.cc:2272] T ed07e2d846e24b06abb770ea1376b9fb P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.971695 20694 tablet_replica.cc:333] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.972229 20694 raft_consensus.cc:2243] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.972728 20694 raft_consensus.cc:2272] T dd4225b745e54206b600f5380ed664be P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.975116 20694 tablet_replica.cc:333] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.975958 20694 raft_consensus.cc:2243] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:49.977432 22520 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.978797 20694 raft_consensus.cc:2272] T bccfbbc2aaa5423fb599eeb56b38121c P ac1dd8ad9fc44263932ec57d9376a271 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.982858 20694 tablet_replica.cc:333] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.983440 20694 raft_consensus.cc:2243] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.983999 20694 raft_consensus.cc:2272] T 9a451fba336b41e5954a827976c17a50 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.985824 20694 tablet_replica.cc:333] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.986405 20694 raft_consensus.cc:2243] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.987203 20694 raft_consensus.cc:2272] T edb7f62b920e42349d56d878295176b2 P ac1dd8ad9fc44263932ec57d9376a271 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.989351 20694 tablet_replica.cc:333] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.989919 20694 raft_consensus.cc:2243] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.990916 20694 raft_consensus.cc:2272] T 6bde6ac1d042400fbc88831c01b9fdda P ac1dd8ad9fc44263932ec57d9376a271 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.993165 20694 tablet_replica.cc:333] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:49.993870 20694 raft_consensus.cc:2243] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.994710 20694 raft_consensus.cc:2272] T 2705e36077094db8a03a8b3e606284be P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.997126 20694 tablet_replica.cc:333] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
W20260709 13:08:49.997727 21948 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.997879 20694 raft_consensus.cc:2243] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.998569 20694 raft_consensus.cc:2272] T 864ca05a434d488c83f87f71e27dfa63 P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.000939 20694 tablet_replica.cc:333] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.001757 20694 raft_consensus.cc:2243] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.002939 20694 raft_consensus.cc:2272] T 79240f02176941bdb28ac4ee2d3f446e P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.005388 20694 tablet_replica.cc:333] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.006088 20694 raft_consensus.cc:2243] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.007218 20694 raft_consensus.cc:2272] T 9206e3439eb54425a3de6b25e0d8b36a P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.009814 20694 tablet_replica.cc:333] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.010555 20694 raft_consensus.cc:2243] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.011371 20694 raft_consensus.cc:2272] T ff74442193fb468c966c8842f014e361 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.014068 20694 tablet_replica.cc:333] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.014810 20694 raft_consensus.cc:2243] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.015494 20694 raft_consensus.cc:2272] T 535de8a48bb34b5f9976321c2d08b8d6 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.018301 20694 tablet_replica.cc:333] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.019022 20694 raft_consensus.cc:2243] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.019757 20694 raft_consensus.cc:2272] T 8957eea5c26d4180a331c4edcb3753b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.021420 21948 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:50.022193 20694 tablet_replica.cc:333] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.023084 20694 raft_consensus.cc:2243] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:50.023249 22520 consensus_peers.cc:597] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:50.023869 20694 raft_consensus.cc:2272] T add79beae9d04c6983a531c46dc72deb P ac1dd8ad9fc44263932ec57d9376a271 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.026558 20694 tablet_replica.cc:333] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.027304 20694 raft_consensus.cc:2243] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.029563 20694 raft_consensus.cc:2272] T 86489c4c9e90474881f2bd8eb6fa582f P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.032155 20694 tablet_replica.cc:333] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.032878 20694 raft_consensus.cc:2243] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.034042 20694 raft_consensus.cc:2272] T b3bbb48eaef64910973105f716cf813d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.036530 20694 tablet_replica.cc:333] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.037231 20694 raft_consensus.cc:2243] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.038319 20694 raft_consensus.cc:2272] T efae0b9ae5b44891a8bd0df1878c7c42 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.040696 20694 tablet_replica.cc:333] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.041399 20694 raft_consensus.cc:2243] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.042443 20694 raft_consensus.cc:2272] T 4a225d8f594046389ec56c017df3b70c P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.044909 20694 tablet_replica.cc:333] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.045565 20694 raft_consensus.cc:2243] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.046115 20694 raft_consensus.cc:2272] T b51a2766379a4c6195da185ed192fd0d P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.048497 20694 tablet_replica.cc:333] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.049197 20694 raft_consensus.cc:2243] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.050593 20694 raft_consensus.cc:2272] T a6e402ca5ed540e5a1c44b9a1dafcf78 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.050786 22520 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:50.053654 20694 tablet_replica.cc:333] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.054281 20694 raft_consensus.cc:2243] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.055403 20694 raft_consensus.cc:2272] T 32a7f60c55ae4cc99c25348a1d82e6de P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.057566 20694 tablet_replica.cc:333] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.058400 20694 raft_consensus.cc:2243] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.059619 20694 raft_consensus.cc:2272] T 48cad01af8fd4976ba77658d6a8e31b7 P ac1dd8ad9fc44263932ec57d9376a271 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.062187 20694 tablet_replica.cc:333] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.062932 20694 raft_consensus.cc:2243] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.063608 20694 raft_consensus.cc:2272] T 503591d3d16047368f003bcc9f73d8a2 P ac1dd8ad9fc44263932ec57d9376a271 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.066325 20694 tablet_replica.cc:333] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.068013 20694 raft_consensus.cc:2243] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.069096 20694 raft_consensus.cc:2272] T 9bdbae418d5246588152f31784da5bec P ac1dd8ad9fc44263932ec57d9376a271 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.071610 20694 tablet_replica.cc:333] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.072296 20694 raft_consensus.cc:2243] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.073199 20694 raft_consensus.cc:2272] T 18adc37fa2ee428c9cdcfe76e72e77a4 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.075678 20694 tablet_replica.cc:333] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.076315 20694 raft_consensus.cc:2243] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:08:50.076406 21949 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:50.076988 21949 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:50.077745 20694 raft_consensus.cc:2272] T ae693bf6616e4755b822cea96cf12222 P ac1dd8ad9fc44263932ec57d9376a271 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.081480 20694 tablet_replica.cc:333] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.082157 20694 raft_consensus.cc:2243] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.083711 20694 raft_consensus.cc:2272] T 61e3ce132d8a443eb412d1816ffc7579 P ac1dd8ad9fc44263932ec57d9376a271 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.086053 20694 tablet_replica.cc:333] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.086690 20694 raft_consensus.cc:2243] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.087450 20694 raft_consensus.cc:2272] T 96da242efa5849aab4168785047cff48 P ac1dd8ad9fc44263932ec57d9376a271 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.089804 20694 tablet_replica.cc:333] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.090451 20694 raft_consensus.cc:2243] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.091472 20694 raft_consensus.cc:2272] T 691d4cf0a1ef4f689413711647c88f75 P ac1dd8ad9fc44263932ec57d9376a271 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.093780 20694 tablet_replica.cc:333] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271: stopping tablet replica
I20260709 13:08:50.094352 20694 raft_consensus.cc:2243] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.095489 20694 raft_consensus.cc:2272] T cc0e6a6fba594f8db28b949dbce488c7 P ac1dd8ad9fc44263932ec57d9376a271 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.098153 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:50.111045 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:50.116789 22520 consensus_peers.cc:597] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.128509 22520 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.131614 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08003b85a0 after lost signal to thread 20697
W20260709 13:08:50.132701 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7440 after lost signal to thread 21766
W20260709 13:08:50.134003 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08002610e0 after lost signal to thread 21933
W20260709 13:08:50.135430 21930 debug-util.cc:398] Leaking SignalData structure 0x7b0800094820 after lost signal to thread 22007
W20260709 13:08:50.136852 21930 debug-util.cc:398] Leaking SignalData structure 0x7b08003b99e0 after lost signal to thread 22579
W20260709 13:08:50.150103 21948 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.165683 21948 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:50.254740 21949 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:50.445530 21949 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:50.568816 21948 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111) [suppressed 489 similar messages]
W20260709 13:08:50.728775 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:50.855443 30147 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:50.856118 30147 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:50.872794 22521 leader_election.cc:336] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:50.875766 30147 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:50.892187 30149 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:50.892935 30149 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:50.899120 30149 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:50.902539 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:50.916142 30120 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:50.916697 30120 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:50.919018 30120 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:50.921669 22520 leader_election.cc:336] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:50.923385 22520 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:50.922837 22521 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:50.929575 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
W20260709 13:08:50.948110 21948 leader_election.cc:336] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:50.948858 30129 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:50.953941 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:50.963310 21948 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:50.973963 30120 raft_consensus.cc:2749] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:50.995602 30149 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:50.996343 30149 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:50.998786 30129 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:50.999383 30129 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.002003 30129 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:51.003963 30149 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:50.995191 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:51.005208 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:51.009249 30129 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.010013 30129 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.014480 30129 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:51.019901 22521 leader_election.cc:336] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.025419 30120 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.026234 30120 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.028357 30120 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:51.008322 21948 leader_election.cc:336] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.035943 21948 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.040746 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:51.041440 21980 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:51.046068 30149 raft_consensus.cc:2749] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:51.046838 30120 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.051944 30120 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.054615 30120 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:51.055692 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:51.056237 22520 leader_election.cc:336] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.057974 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.059157 30147 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:51.059540 30147 raft_consensus.cc:493] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.059881 30147 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:51.077562 22520 leader_election.cc:336] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.080381 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:51.083070 22553 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:51.087129 22520 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.090435 30129 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:51.096216 30120 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.096917 30120 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.101538 30120 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.115670 30149 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.116307 30149 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.070147 30147 raft_consensus.cc:515] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.123571 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2f8130ad944310bea7f2f3d408309f" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:51.124194 21980 raft_consensus.cc:3060] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:51.132102 21980 raft_consensus.cc:2468] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:08:51.123111 30149 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:51.140532 30147 leader_election.cc:290] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:51.132804 21949 leader_election.cc:336] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:51.143494 21949 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.158268 30149 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.158995 30149 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.162510 30149 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.171393 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:51.172530 22519 leader_election.cc:304] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 
W20260709 13:08:51.184319 22521 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:51.185613 21949 leader_election.cc:336] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.188289 30147 raft_consensus.cc:2804] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:51.207739 30147 raft_consensus.cc:697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:51.209015 30147 consensus_queue.cc:237] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:51.188810 22520 leader_election.cc:336] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:51.205606 21948 leader_election.cc:336] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:51.211782 20694 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21930)
I20260709 13:08:51.212008 21948 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.214064 30144 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.214664 30144 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.217224 30144 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.218693 30120 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.219364 30120 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.221381 30132 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.221951 30132 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.224112 30132 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.225370 30144 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.226905 30144 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.231093 30120 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:51.236115 22521 leader_election.cc:336] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.229617 30144 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.241183 30144 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:51.243983 30144 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.253312 30144 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.251533 30149 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.263929 30149 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.266538 30149 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:51.242869 21948 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.250998 30120 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.267446 30120 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.269816 30120 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.270413 21948 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:51.276500 22520 leader_election.cc:336] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.277129 22520 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:51.279798 21948 leader_election.cc:336] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.280435 21948 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.272297 30144 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.291304 30149 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:51.290851 30132 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:08:51.290287 30120 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:51.306550 30129 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:51.307119 21948 leader_election.cc:336] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.307060 30129 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.297570 30132 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.303653 30149 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.317255 30129 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:51.312587 30132 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.323907 30132 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.315096 30149 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:51.342935 21949 leader_election.cc:336] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:51.345676 21949 leader_election.cc:336] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.347368 21948 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.354748 30149 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.360767 30154 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.360575 21731 catalog_manager.cc:5697] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 23 to 24, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 24 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.361546 30154 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:51.362533 22520 leader_election.cc:336] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.363762 30154 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
W20260709 13:08:51.365793 22520 leader_election.cc:336] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.368917 30157 raft_consensus.cc:2749] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:51.369338 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:51.371560 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:51.372031 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:51.372845 22521 leader_election.cc:336] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.373324 22521 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.374943 30129 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:51.375638 22519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42795, user_credentials={real_user=slave}} blocked reactor thread for 60096.7us
I20260709 13:08:51.379791 30129 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.380409 30129 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.382331 30129 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:51.387508 21980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:51.387902 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
I20260709 13:08:51.388129 21980 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 23.
I20260709 13:08:51.388515 21975 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
W20260709 13:08:51.390080 22520 leader_election.cc:336] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:51.391146 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 43855us
W20260709 13:08:51.393117 21948 leader_election.cc:336] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.393573 21948 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.394454 30162 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:08:51.395411 21948 leader_election.cc:336] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:51.396036 21948 leader_election.cc:336] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:51.396533 21948 leader_election.cc:336] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:51.397023 21948 leader_election.cc:336] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:51.397507 21948 leader_election.cc:336] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:51.397965 21948 leader_election.cc:336] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:51.398497 21948 leader_election.cc:336] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.398896 21948 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.400645 30162 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:51.403164 30162 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.403609 30162 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:51.404204 21949 leader_election.cc:336] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.404623 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:51.405484 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:51.405447 30160 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:51.406160 21949 leader_election.cc:336] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.406545 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.407231 30160 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:08:51.407382 21949 leader_election.cc:336] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.407868 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.408520 30160 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:51.408691 21949 leader_election.cc:336] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.409164 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.409557 22519 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.409896 30160 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:51.410792 30158 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:51.411286 30158 raft_consensus.cc:493] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.411707 30158 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:51.405555 30162 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:51.414247 21949 leader_election.cc:336] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.414686 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.414774 30129 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:51.415519 21949 leader_election.cc:336] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.415266 30129 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.415920 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.416795 30160 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:51.417214 30129 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.421653 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.415928 30162 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:51.422894 30158 raft_consensus.cc:515] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:51.424878 22521 leader_election.cc:336] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.425693 30158 leader_election.cc:290] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:51.425853 22520 leader_election.cc:336] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.426301 30158 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:51.426297 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.426908 30158 raft_consensus.cc:493] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.427332 30158 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:51.428328 30151 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:51.430135 22520 leader_election.cc:336] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.431854 22553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:51.434296 30158 raft_consensus.cc:515] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:51.436179 21949 leader_election.cc:336] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.436590 30162 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:51.436782 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:51.437139 30160 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.437086 30162 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:51.437649 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:51.437681 30160 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.439028 30162 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.439384 30161 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.440157 30160 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.439894 30161 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.442088 30161 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.445559 30158 leader_election.cc:290] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
W20260709 13:08:51.446138 22520 leader_election.cc:336] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.450577 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d4cf0a1ef4f689413711647c88f75" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:51.451153 21975 raft_consensus.cc:3060] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:51.451447 21974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554595014abc431286bf4ba1922fc147" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:51.452003 21974 raft_consensus.cc:3060] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:51.456343 30162 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.456867 30162 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:51.458726 30162 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:51.459575 21974 raft_consensus.cc:2468] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
I20260709 13:08:51.461072 21975 raft_consensus.cc:2468] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
W20260709 13:08:51.461297 21949 leader_election.cc:336] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:51.462203 21948 leader_election.cc:336] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.468756 21948 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.468917 22519 leader_election.cc:304] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.469726 30129 raft_consensus.cc:2804] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:51.470158 30129 raft_consensus.cc:697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:51.470961 30129 consensus_queue.cc:237] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.474562 30161 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:51.475663 21948 leader_election.cc:336] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.476075 21948 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 0157b4f0725d4f92a53938c921db9efc, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.476758 30161 raft_consensus.cc:2749] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:51.479298 21949 leader_election.cc:336] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.479312 22519 leader_election.cc:304] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.480245 30129 raft_consensus.cc:2804] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:08:51.480669 21949 leader_election.cc:336] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:51.480551 21731 catalog_manager.cc:5697] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 24 to 25, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 25 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.480754 30129 raft_consensus.cc:697] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:51.483881 30129 consensus_queue.cc:237] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:51.490778 21948 leader_election.cc:336] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.491390 21948 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:51.502810 21948 leader_election.cc:336] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.502921 30162 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:51.506819 21949 leader_election.cc:336] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:51.508194 21949 leader_election.cc:336] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:51.521160 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:51.507433 21948 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.523821 30162 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:51.525141 21948 leader_election.cc:336] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.525694 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.526538 30162 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:51.526006 21731 catalog_manager.cc:5697] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 23 to 24, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 24 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:51.527551 21948 leader_election.cc:336] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.528028 21948 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.528808 30162 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:51.529798 30129 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:51.530350 30129 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.532133 30129 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:51.535331 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913" is_pre_election: true
W20260709 13:08:51.535631 22520 leader_election.cc:336] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.535940 21975 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 24.
I20260709 13:08:51.536980 22519 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.537948 30129 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:51.538281 30129 raft_consensus.cc:493] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
W20260709 13:08:51.538555 21948 leader_election.cc:336] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.538595 30129 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:51.546444 30129 raft_consensus.cc:515] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.547387 21948 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.549974 30162 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:51.550122 21975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3bbb48eaef64910973105f716cf813d" candidate_uuid: "0157b4f0725d4f92a53938c921db9efc" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3d76b2c4699e43fba10eeb81a91e4913"
I20260709 13:08:51.550770 21975 raft_consensus.cc:3060] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:08:51.553243 22520 leader_election.cc:336] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:51.554912 30129 leader_election.cc:290] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Requested vote from peers ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795)
I20260709 13:08:51.556938 21975 raft_consensus.cc:2468] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0157b4f0725d4f92a53938c921db9efc in term 25.
I20260709 13:08:51.558041 22519 leader_election.cc:304] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:51.559221 30129 raft_consensus.cc:2804] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:51.559949 30129 raft_consensus.cc:697] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Becoming Leader. State: Replica: 0157b4f0725d4f92a53938c921db9efc, State: Running, Role: LEADER
I20260709 13:08:51.560750 30129 consensus_queue.cc:237] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:51.607611 21731 catalog_manager.cc:5697] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc reported cstate change: term changed from 24 to 25, leader changed from ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130) to 0157b4f0725d4f92a53938c921db9efc (127.20.53.132). New cstate: current_term: 25 leader_uuid: "0157b4f0725d4f92a53938c921db9efc" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.761642 21980 raft_consensus.cc:1275] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:51.813102 30151 consensus_queue.cc:1048] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:08:52.212281 20694 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21930)
I20260709 13:08:52.432801 21980 raft_consensus.cc:1275] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:08:52.436487 30172 consensus_queue.cc:1048] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 13:08:52.444990 21975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.010s
W20260709 13:08:52.445387 21975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.000s	sys 0.012s
W20260709 13:08:52.469148 22520 consensus_peers.cc:597] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:52.469566 22520 consensus_peers.cc:597] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:52.470096 22520 consensus_peers.cc:597] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.478734 22520 consensus_peers.cc:597] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:52.522989 21978 raft_consensus.cc:1275] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:52.533543 30151 consensus_queue.cc:1048] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:52.538444 21949 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:52.538928 21977 raft_consensus.cc:1275] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Refusing update from remote peer 0157b4f0725d4f92a53938c921db9efc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:08:52.539058 21949 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:52.541507 30151 consensus_queue.cc:1048] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:08:52.551067 21948 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:38783, user_credentials={real_user=slave}} blocked reactor thread for 68798.6us
W20260709 13:08:52.554433 22520 consensus_peers.cc:597] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.557067 21948 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.564970 21948 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.577701 22520 consensus_peers.cc:597] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:52.581161 21949 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:52.581957 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:52.582489 21949 consensus_peers.cc:597] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:52.587267 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:52.598464 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:52.798666 21948 consensus_peers.cc:597] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.825809 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:52.850915 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:52.860555 21949 consensus_peers.cc:597] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:52.865144 21763 debug-util.cc:398] Leaking SignalData structure 0x7b08001744a0 after lost signal to thread 20697
W20260709 13:08:52.866221 21763 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1ac0 after lost signal to thread 21766
W20260709 13:08:52.867530 21763 debug-util.cc:398] Leaking SignalData structure 0x7b08003d17a0 after lost signal to thread 22007
W20260709 13:08:52.868736 21763 debug-util.cc:398] Leaking SignalData structure 0x7b0800358480 after lost signal to thread 22579
W20260709 13:08:52.889595 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:52.902398 21948 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.913573 21948 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.949034 22520 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.951105 21948 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.967442 21948 consensus_peers.cc:597] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:52.977293 21948 consensus_peers.cc:597] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:52.991251 30161 raft_consensus.cc:493] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:52.991801 30161 raft_consensus.cc:515] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:52.994154 30161 leader_election.cc:290] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:52.999058 21948 leader_election.cc:336] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.008280 21948 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.012190 21949 leader_election.cc:336] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.012799 21949 leader_election.cc:304] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.013538 30161 raft_consensus.cc:2749] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:53.014397 22520 consensus_peers.cc:597] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.021255 22520 consensus_peers.cc:597] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.021888 22520 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.022383 22520 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.030088 22520 consensus_peers.cc:597] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.035725 22520 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.063567 30178 raft_consensus.cc:493] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.064144 30178 raft_consensus.cc:515] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.066285 30161 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.066380 30178 leader_election.cc:290] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:53.066871 30161 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.068758 30161 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.072202 21949 leader_election.cc:336] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:53.073976 21948 leader_election.cc:336] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.075028 30178 raft_consensus.cc:493] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.076165 30178 raft_consensus.cc:515] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.079272 30178 leader_election.cc:290] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:53.075508 21948 leader_election.cc:304] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:53.080255 21948 leader_election.cc:336] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.083180 21949 leader_election.cc:336] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.085157 30161 raft_consensus.cc:2749] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:53.085335 22520 consensus_peers.cc:597] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.085835 21948 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.087790 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.090610 30161 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:53.093711 30161 raft_consensus.cc:493] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.094234 30161 raft_consensus.cc:515] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:53.095489 21948 consensus_peers.cc:597] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.095944 21948 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.096972 30161 leader_election.cc:290] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149), 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783)
I20260709 13:08:53.099021 22548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373c4d5502fd42dca6f9cbb5a894ee0b" candidate_uuid: "3d76b2c4699e43fba10eeb81a91e4913" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0157b4f0725d4f92a53938c921db9efc" is_pre_election: true
I20260709 13:08:53.099550 30161 raft_consensus.cc:493] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.099640 22548 raft_consensus.cc:2468] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d76b2c4699e43fba10eeb81a91e4913 in term 21.
I20260709 13:08:53.100212 30161 raft_consensus.cc:515] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.102108 30161 leader_election.cc:290] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:53.102469 30181 raft_consensus.cc:493] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.104437 30181 raft_consensus.cc:515] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:53.106477 30181 leader_election.cc:290] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.103905 21948 leader_election.cc:336] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.110510 21949 leader_election.cc:336] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.110965 21949 leader_election.cc:304] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:53.113688 22521 leader_election.cc:336] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:53.114624 22520 leader_election.cc:336] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.118098 22520 leader_election.cc:304] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:53.118590 21948 leader_election.cc:336] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.118871 30181 raft_consensus.cc:2749] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:53.117026 30161 raft_consensus.cc:2749] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:53.121423 21949 leader_election.cc:336] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.121976 21949 leader_election.cc:304] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc, 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.123795 30161 raft_consensus.cc:2749] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:53.123062 21949 leader_election.cc:336] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.124449 21949 leader_election.cc:304] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.126302 30161 raft_consensus.cc:2749] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:53.128208 22520 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.135679 30161 raft_consensus.cc:493] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.136242 30161 raft_consensus.cc:515] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.138605 30161 leader_election.cc:290] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.150918 21948 leader_election.cc:336] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.160889 21949 leader_election.cc:336] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.161476 21949 leader_election.cc:304] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.162341 30161 raft_consensus.cc:2749] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:53.195312 30161 raft_consensus.cc:493] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.195883 30161 raft_consensus.cc:515] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.198004 30161 leader_election.cc:290] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.202927 21948 leader_election.cc:336] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.205955 30161 raft_consensus.cc:493] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.206527 30161 raft_consensus.cc:515] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.208622 30161 leader_election.cc:290] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.214236 21948 leader_election.cc:336] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.223945 30181 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.226128 30181 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:53.234654 22521 leader_election.cc:336] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.236138 30181 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.240487 22520 leader_election.cc:336] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.240967 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.242542 30181 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:53.218616 21949 leader_election.cc:336] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.243929 21949 leader_election.cc:304] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.244871 30161 raft_consensus.cc:2749] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:53.251263 21949 leader_election.cc:336] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.251729 21949 leader_election.cc:304] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.252460 30161 raft_consensus.cc:2749] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:53.268332 30161 raft_consensus.cc:493] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.268934 30161 raft_consensus.cc:515] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
W20260709 13:08:53.278103 21948 leader_election.cc:336] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.278997 30161 leader_election.cc:290] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.292860 21949 leader_election.cc:336] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.294661 21949 leader_election.cc:304] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.295470 30161 raft_consensus.cc:2749] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:53.323444 30161 raft_consensus.cc:493] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.323998 30161 raft_consensus.cc:515] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.325592 30178 raft_consensus.cc:493] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.326133 30161 leader_election.cc:290] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:53.326095 30178 raft_consensus.cc:515] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.332015 30178 leader_election.cc:290] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.335858 21948 leader_election.cc:336] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.339602 21948 leader_election.cc:336] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.340359 21949 leader_election.cc:336] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.340873 21949 leader_election.cc:304] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.341631 30161 raft_consensus.cc:2749] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:53.343039 21949 leader_election.cc:336] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.343506 21949 leader_election.cc:304] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.344221 30161 raft_consensus.cc:2749] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:53.357393 21949 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:53.391429 30161 raft_consensus.cc:493] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.392010 30161 raft_consensus.cc:515] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.394596 30178 raft_consensus.cc:493] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.395219 30178 raft_consensus.cc:515] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.413576 30178 leader_election.cc:290] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.416653 21948 leader_election.cc:336] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.447408 30161 leader_election.cc:290] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:53.452200 30129 raft_consensus.cc:493] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.452754 30129 raft_consensus.cc:515] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:53.454900 30129 leader_election.cc:290] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.470420 21948 leader_election.cc:336] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.475688 22520 leader_election.cc:336] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.490778 22521 leader_election.cc:336] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.493747 22521 leader_election.cc:304] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.501994 30181 raft_consensus.cc:2749] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:08:53.500715 21948 consensus_peers.cc:597] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.529911 21948 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.574842 30181 raft_consensus.cc:493] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.575519 30181 raft_consensus.cc:515] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
W20260709 13:08:53.582311 22521 leader_election.cc:336] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.585383 30181 leader_election.cc:290] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:53.601796 30161 raft_consensus.cc:493] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.602484 30161 raft_consensus.cc:515] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.604594 30161 leader_election.cc:290] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:53.627226 30178 raft_consensus.cc:493] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.657539 30178 raft_consensus.cc:515] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.660079 30178 leader_election.cc:290] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.683262 21949 leader_election.cc:336] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.684221 21949 leader_election.cc:304] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.685201 30161 raft_consensus.cc:2749] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:53.694489 22520 leader_election.cc:336] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.695286 22520 leader_election.cc:304] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.697521 30129 raft_consensus.cc:2749] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:53.699139 22521 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:53.700765 21948 leader_election.cc:336] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.701647 21949 leader_election.cc:336] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.706590 21949 leader_election.cc:304] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
W20260709 13:08:53.707589 21949 consensus_peers.cc:597] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:53.708052 30153 raft_consensus.cc:2749] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:53.727414 21948 leader_election.cc:336] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:53.739763 30153 raft_consensus.cc:493] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:53.740410 30153 raft_consensus.cc:515] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:53.742609 30153 leader_election.cc:290] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:53.756752 22521 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:53.763603 22520 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:53.767807 21949 consensus_peers.cc:597] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:53.761828 21948 leader_election.cc:336] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
W20260709 13:08:53.791970 21949 consensus_peers.cc:597] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:53.792776 21949 leader_election.cc:336] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.793335 21949 leader_election.cc:304] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.794195 30153 raft_consensus.cc:2749] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:08:53.795275 21949 consensus_peers.cc:597] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:53.795728 21949 leader_election.cc:336] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.801930 21949 leader_election.cc:304] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.802978 30153 raft_consensus.cc:2749] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:53.808830 21949 leader_election.cc:336] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:53.809312 21949 leader_election.cc:304] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:53.810078 30153 raft_consensus.cc:2749] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:08:53.986277 21949 consensus_peers.cc:597] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:53.998759 21949 consensus_peers.cc:597] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:54.094894 21949 consensus_peers.cc:597] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:54.110724 22521 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:54.192327 22521 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:54.220594 22521 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:08:54.369267 22521 consensus_peers.cc:597] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:54.436604 20694 tablet_server.cc:196] TabletServer@127.20.53.130:0 shutdown complete.
W20260709 13:08:54.443867 21949 consensus_peers.cc:597] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:08:54.540668 21949 consensus_peers.cc:597] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:54.557477 20694 tablet_server.cc:179] TabletServer@127.20.53.131:0 shutting down...
I20260709 13:08:54.648741 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:54.651769 20694 tablet_replica.cc:333] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.652834 20694 raft_consensus.cc:2243] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.654039 20694 raft_consensus.cc:2272] T 552d2504e5364dfe94b59ccc5d4bf3f7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.657034 20694 tablet_replica.cc:333] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.657958 20694 raft_consensus.cc:2243] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.658735 20694 raft_consensus.cc:2272] T 6e964a7ca2a54491a72482e75917bd10 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.661232 22520 consensus_peers.cc:597] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.661803 20694 tablet_replica.cc:333] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.662602 20694 raft_consensus.cc:2243] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.663452 20694 raft_consensus.cc:2272] T 5b63bdc0c16e46fe907a6ef4f7f26653 P 3d76b2c4699e43fba10eeb81a91e4913 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.665524 20694 tablet_replica.cc:333] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.666157 20694 raft_consensus.cc:2243] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:54.666353 22519 consensus_peers.cc:597] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.666822 20694 raft_consensus.cc:2272] T 1f2f8130ad944310bea7f2f3d408309f P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.669458 20694 tablet_replica.cc:333] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.670432 20694 raft_consensus.cc:2243] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.671135 20694 raft_consensus.cc:2272] T 90821f4436f045a0a3847b276293f36f P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.674186 20694 tablet_replica.cc:333] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.675158 20694 raft_consensus.cc:2243] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.675963 20694 raft_consensus.cc:2272] T 6d93b81c2ba1474cbbc824b7bbdd72a8 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.678990 20694 tablet_replica.cc:333] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.679951 20694 raft_consensus.cc:2243] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.680881 20694 raft_consensus.cc:2272] T 911b6cb205984b78bafd3ecdcc02ef3c P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.683290 20694 tablet_replica.cc:333] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.683911 20694 raft_consensus.cc:2243] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.684484 20694 raft_consensus.cc:2272] T 8957eea5c26d4180a331c4edcb3753b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.686326 22519 consensus_peers.cc:597] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.686890 20694 tablet_replica.cc:333] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.687985 20694 raft_consensus.cc:2243] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.689479 20694 raft_consensus.cc:2272] T 535de8a48bb34b5f9976321c2d08b8d6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.692907 20694 tablet_replica.cc:333] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.693958 20694 raft_consensus.cc:2243] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.694682 20694 raft_consensus.cc:2272] T 691d4cf0a1ef4f689413711647c88f75 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.697921 20694 tablet_replica.cc:333] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.698890 20694 raft_consensus.cc:2243] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.700086 20694 raft_consensus.cc:2272] T 96da242efa5849aab4168785047cff48 P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.703068 20694 tablet_replica.cc:333] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.704166 20694 raft_consensus.cc:2243] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.705353 20694 raft_consensus.cc:2272] T 9a439d1de6924cf49dda5333182516bb P 3d76b2c4699e43fba10eeb81a91e4913 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.708112 20694 tablet_replica.cc:333] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.708710 20694 raft_consensus.cc:2243] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.709260 20694 raft_consensus.cc:2272] T 0cd0981f0f71482b83434dddd7e49dc4 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.711710 20694 tablet_replica.cc:333] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
W20260709 13:08:54.712201 22519 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.712538 20694 raft_consensus.cc:2243] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.713521 20694 raft_consensus.cc:2272] T 0533e3146ff14445bcdca10aa4432f4b P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.715350 22519 consensus_peers.cc:597] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.716171 20694 tablet_replica.cc:333] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.716835 20694 raft_consensus.cc:2243] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.717841 20694 raft_consensus.cc:2272] T 91268f1f8ef64ef4b455bead2f60e2ff P 3d76b2c4699e43fba10eeb81a91e4913 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.720512 20694 tablet_replica.cc:333] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.721418 20694 raft_consensus.cc:2243] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.722144 20694 raft_consensus.cc:2272] T ed83b85c2e96457c82a5beb8aa8c18f3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.724773 20694 tablet_replica.cc:333] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.725636 20694 raft_consensus.cc:2243] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.726382 20694 raft_consensus.cc:2272] T 16eb6999a3524d59835c31e2b76d09da P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.729188 20694 tablet_replica.cc:333] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.729923 20694 raft_consensus.cc:2243] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.730720 20694 raft_consensus.cc:2272] T 373c4d5502fd42dca6f9cbb5a894ee0b P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.732692 20694 tablet_replica.cc:333] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.733255 20694 raft_consensus.cc:2243] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.734157 20694 raft_consensus.cc:2272] T 0bca2c885e084ef9af7344b6abb486aa P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.736744 20694 tablet_replica.cc:333] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.737608 20694 raft_consensus.cc:2243] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.738801 20694 raft_consensus.cc:2272] T c8aeca641b1d407488c25c7e1e347adc P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.739878 30161 raft_consensus.cc:493] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:54.740371 30161 raft_consensus.cc:515] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } }
I20260709 13:08:54.741678 20694 tablet_replica.cc:333] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.742664 20694 raft_consensus.cc:2243] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.744210 30161 leader_election.cc:290] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
I20260709 13:08:54.744313 20694 raft_consensus.cc:2272] T ad9d9c562d2d411db01a7eaf4427d325 P 3d76b2c4699e43fba10eeb81a91e4913 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.747263 20694 tablet_replica.cc:333] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.748145 20694 raft_consensus.cc:2243] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:08:54.749737 21948 leader_election.cc:336] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:54.750188 20694 raft_consensus.cc:2272] T dbb4eb8dd14248918867a27aa6d9bac9 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.752987 20694 tablet_replica.cc:333] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
W20260709 13:08:54.753628 22519 consensus_peers.cc:597] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.753861 20694 raft_consensus.cc:2243] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:54.754372 21949 leader_election.cc:336] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:08:54.754519 20694 raft_consensus.cc:2272] T 554595014abc431286bf4ba1922fc147 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.754806 21949 leader_election.cc:304] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d76b2c4699e43fba10eeb81a91e4913; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:54.755687 30189 raft_consensus.cc:2749] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:54.757179 20694 tablet_replica.cc:333] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.757823 20694 raft_consensus.cc:2243] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.758854 20694 raft_consensus.cc:2272] T 2705e36077094db8a03a8b3e606284be P 3d76b2c4699e43fba10eeb81a91e4913 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.758890 21949 consensus_peers.cc:597] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:54.761178 20694 tablet_replica.cc:333] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.761833 20694 raft_consensus.cc:2243] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.763587 20694 raft_consensus.cc:2272] T edb7f62b920e42349d56d878295176b2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.765642 20694 tablet_replica.cc:333] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.766283 20694 raft_consensus.cc:2243] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.767026 20694 raft_consensus.cc:2272] T 9a451fba336b41e5954a827976c17a50 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.768941 20694 tablet_replica.cc:333] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.769498 20694 raft_consensus.cc:2243] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.770525 20694 raft_consensus.cc:2272] T fa248ef2ee9049c9a1f86b77185b86a3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.772478 20694 tablet_replica.cc:333] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.773029 20694 raft_consensus.cc:2243] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.773943 20694 raft_consensus.cc:2272] T ff74442193fb468c966c8842f014e361 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.776262 20694 tablet_replica.cc:333] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.776954 20694 raft_consensus.cc:2243] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.777601 20694 raft_consensus.cc:2272] T 864ca05a434d488c83f87f71e27dfa63 P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.778447 22519 consensus_peers.cc:597] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.780179 20694 tablet_replica.cc:333] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.780941 20694 raft_consensus.cc:2243] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.781632 20694 raft_consensus.cc:2272] T 79240f02176941bdb28ac4ee2d3f446e P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.784286 20694 tablet_replica.cc:333] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
W20260709 13:08:54.784926 22521 consensus_peers.cc:597] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:08:54.785130 20694 raft_consensus.cc:2243] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:08:54.785554 22519 consensus_peers.cc:597] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.786255 20694 raft_consensus.cc:2272] T 9206e3439eb54425a3de6b25e0d8b36a P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.788182 20694 tablet_replica.cc:333] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.788794 20694 raft_consensus.cc:2243] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.789635 20694 raft_consensus.cc:2272] T b51a2766379a4c6195da185ed192fd0d P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.791646 20694 tablet_replica.cc:333] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.792198 20694 raft_consensus.cc:2243] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.792701 20694 raft_consensus.cc:2272] T a6e402ca5ed540e5a1c44b9a1dafcf78 P 3d76b2c4699e43fba10eeb81a91e4913 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.795040 20694 tablet_replica.cc:333] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.795621 20694 raft_consensus.cc:2243] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.796398 20694 raft_consensus.cc:2272] T b3bbb48eaef64910973105f716cf813d P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.798413 20694 tablet_replica.cc:333] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.799048 20694 raft_consensus.cc:2243] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.799618 20694 raft_consensus.cc:2272] T efae0b9ae5b44891a8bd0df1878c7c42 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.801648 20694 tablet_replica.cc:333] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.802281 20694 raft_consensus.cc:2243] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.803376 20694 raft_consensus.cc:2272] T 094b605ab81240b687b2fd4857aee3c3 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.805859 20694 tablet_replica.cc:333] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.806576 20694 raft_consensus.cc:2243] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.807256 20694 raft_consensus.cc:2272] T 14d5f024a39b4860be959c964acb51e6 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.809588 20694 tablet_replica.cc:333] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.810146 20694 raft_consensus.cc:2243] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.810693 20694 raft_consensus.cc:2272] T 6f5da3aecad04fb0982188c37426f599 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.812752 20694 tablet_replica.cc:333] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.813285 20694 raft_consensus.cc:2243] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.813828 20694 raft_consensus.cc:2272] T dd50c9e5c9a94fbb940c4168747744ab P 3d76b2c4699e43fba10eeb81a91e4913 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.816525 20694 tablet_replica.cc:333] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.817209 20694 raft_consensus.cc:2243] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.817866 20694 raft_consensus.cc:2272] T ae693bf6616e4755b822cea96cf12222 P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.817955 22519 consensus_peers.cc:597] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.819922 20694 tablet_replica.cc:333] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.820521 20694 raft_consensus.cc:2243] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.821020 20694 raft_consensus.cc:2272] T dd4225b745e54206b600f5380ed664be P 3d76b2c4699e43fba10eeb81a91e4913 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.823205 20694 tablet_replica.cc:333] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.823802 20694 raft_consensus.cc:2243] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.824671 20694 raft_consensus.cc:2272] T add79beae9d04c6983a531c46dc72deb P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.827351 20694 tablet_replica.cc:333] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.828090 20694 raft_consensus.cc:2243] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.829234 20694 raft_consensus.cc:2272] T 9f4dac7f6b7b440d84e044b62b559aae P 3d76b2c4699e43fba10eeb81a91e4913 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.831805 20694 tablet_replica.cc:333] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
W20260709 13:08:54.832199 22519 consensus_peers.cc:597] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.832394 20694 raft_consensus.cc:2243] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.833061 20694 raft_consensus.cc:2272] T 48cad01af8fd4976ba77658d6a8e31b7 P 3d76b2c4699e43fba10eeb81a91e4913 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.835235 20694 tablet_replica.cc:333] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.835772 20694 raft_consensus.cc:2243] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.836261 20694 raft_consensus.cc:2272] T 32a7f60c55ae4cc99c25348a1d82e6de P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.838079 20694 tablet_replica.cc:333] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.838697 20694 raft_consensus.cc:2243] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.839200 20694 raft_consensus.cc:2272] T 402a4aa48c774bb6919a83e05b1a61ee P 3d76b2c4699e43fba10eeb81a91e4913 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.841385 20694 tablet_replica.cc:333] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.841958 20694 raft_consensus.cc:2243] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.842604 20694 raft_consensus.cc:2272] T 86489c4c9e90474881f2bd8eb6fa582f P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.844465 20694 tablet_replica.cc:333] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.844941 20694 raft_consensus.cc:2243] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.845505 20694 raft_consensus.cc:2272] T 4a225d8f594046389ec56c017df3b70c P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.847353 20694 tablet_replica.cc:333] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.847806 20694 raft_consensus.cc:2243] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.848311 20694 raft_consensus.cc:2272] T 503591d3d16047368f003bcc9f73d8a2 P 3d76b2c4699e43fba10eeb81a91e4913 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.850050 20694 tablet_replica.cc:333] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913: stopping tablet replica
I20260709 13:08:54.850495 20694 raft_consensus.cc:2243] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.850955 20694 raft_consensus.cc:2272] T 865ede4842b04242930bf2619bb09d16 P 3d76b2c4699e43fba10eeb81a91e4913 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.861974 22519 consensus_peers.cc:597] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.864452 22519 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.893183 22519 consensus_peers.cc:597] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.924943 22521 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:54.928380 22519 consensus_peers.cc:597] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.947541 22520 consensus_peers.cc:597] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:54.962888 22519 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.131:42795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.014420 22519 consensus_peers.cc:597] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.131:42795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.019279 22519 consensus_peers.cc:597] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc -> Peer 3d76b2c4699e43fba10eeb81a91e4913 (127.20.53.131:42795): Couldn't send request to peer 3d76b2c4699e43fba10eeb81a91e4913. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.131:42795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.030879 30187 raft_consensus.cc:493] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac1dd8ad9fc44263932ec57d9376a271)
I20260709 13:08:55.031396 30187 raft_consensus.cc:515] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: false } }
I20260709 13:08:55.033422 30187 leader_election.cc:290] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085), ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149)
W20260709 13:08:55.037683 22521 leader_election.cc:336] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:08:55.040014 22520 leader_election.cc:336] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111)
I20260709 13:08:55.040531 22520 leader_election.cc:304] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0157b4f0725d4f92a53938c921db9efc; no voters: 479255846c5141b584b16aa253f587c7, ac1dd8ad9fc44263932ec57d9376a271
I20260709 13:08:55.041435 30187 raft_consensus.cc:2749] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:55.060756 22520 consensus_peers.cc:597] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:55.094590 22520 consensus_peers.cc:597] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.245225 22520 consensus_peers.cc:597] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:55.297036 22521 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:55.328022 22520 consensus_peers.cc:597] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:55.420145 20694 tablet_server.cc:196] TabletServer@127.20.53.131:0 shutdown complete.
W20260709 13:08:55.440274 22521 consensus_peers.cc:597] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:08:55.454963 22520 consensus_peers.cc:597] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.487039 22520 consensus_peers.cc:597] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.508898 22520 consensus_peers.cc:597] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:55.521162 20694 tablet_server.cc:179] TabletServer@127.20.53.132:0 shutting down...
W20260709 13:08:55.550649 22520 consensus_peers.cc:597] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:55.574282 22520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111) [suppressed 577 similar messages]
W20260709 13:08:55.579969 22520 consensus_peers.cc:597] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:55.588836 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:55.589917 20694 tablet_replica.cc:333] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.591195 20694 raft_consensus.cc:2243] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.592748 20694 raft_consensus.cc:2272] T 373c4d5502fd42dca6f9cbb5a894ee0b P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.596642 20694 tablet_replica.cc:333] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.597534 20694 raft_consensus.cc:2243] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.598333 20694 raft_consensus.cc:2272] T 6bde6ac1d042400fbc88831c01b9fdda P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.601609 20694 tablet_replica.cc:333] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.602520 20694 raft_consensus.cc:2243] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:55.602622 22520 consensus_peers.cc:597] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:55.603360 20694 raft_consensus.cc:2272] T ad9d9c562d2d411db01a7eaf4427d325 P 0157b4f0725d4f92a53938c921db9efc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.606791 20694 tablet_replica.cc:333] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.607873 20694 raft_consensus.cc:2243] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc [term 13 LEARNER]: Raft consensus shutting down.
I20260709 13:08:55.608455 20694 pending_rounds.cc:70] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Trying to abort 1 pending ops.
I20260709 13:08:55.608677 20694 pending_rounds.cc:77] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7305635580173946880 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "2705e36077094db8a03a8b3e606284be" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } } new_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } attrs { replace: true } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } } }
I20260709 13:08:55.609766 20694 raft_consensus.cc:2917] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc [term 13 LEARNER]: Aborting config change with OpId 12.9: Aborted: Op aborted
I20260709 13:08:55.610133 20694 raft_consensus.cc:2889] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc [term 13 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:55.610478 20694 raft_consensus.cc:2272] T 2705e36077094db8a03a8b3e606284be P 0157b4f0725d4f92a53938c921db9efc [term 13 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:08:55.613694 20694 tablet_replica.cc:333] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.614497 20694 raft_consensus.cc:2243] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.615787 20694 raft_consensus.cc:2272] T 864ca05a434d488c83f87f71e27dfa63 P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.618633 20694 tablet_replica.cc:333] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.619405 20694 raft_consensus.cc:2243] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:08:55.619735 22521 consensus_peers.cc:597] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc -> Peer 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): Couldn't send request to peer 479255846c5141b584b16aa253f587c7. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:08:55.620608 20694 raft_consensus.cc:2272] T 402a4aa48c774bb6919a83e05b1a61ee P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.623400 20694 tablet_replica.cc:333] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.624276 20694 raft_consensus.cc:2243] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.625458 20694 raft_consensus.cc:2272] T 18adc37fa2ee428c9cdcfe76e72e77a4 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.628600 20694 tablet_replica.cc:333] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.629556 20694 raft_consensus.cc:2243] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.630441 20694 raft_consensus.cc:2272] T 094b605ab81240b687b2fd4857aee3c3 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.633496 20694 tablet_replica.cc:333] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.634431 20694 raft_consensus.cc:2243] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.635320 20694 raft_consensus.cc:2272] T ff74442193fb468c966c8842f014e361 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.638410 20694 tablet_replica.cc:333] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.639155 20694 raft_consensus.cc:2243] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.640257 20694 raft_consensus.cc:2272] T 865ede4842b04242930bf2619bb09d16 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.643499 20694 tablet_replica.cc:333] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.644462 20694 raft_consensus.cc:2243] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.645114 20694 raft_consensus.cc:2272] T fa248ef2ee9049c9a1f86b77185b86a3 P 0157b4f0725d4f92a53938c921db9efc [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.647970 20694 tablet_replica.cc:333] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.648890 20694 raft_consensus.cc:2243] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.649760 20694 raft_consensus.cc:2272] T 9bdbae418d5246588152f31784da5bec P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.652454 20694 tablet_replica.cc:333] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.653237 20694 raft_consensus.cc:2243] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.654266 20694 raft_consensus.cc:2272] T 503591d3d16047368f003bcc9f73d8a2 P 0157b4f0725d4f92a53938c921db9efc [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.657245 20694 tablet_replica.cc:333] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.658080 20694 raft_consensus.cc:2243] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.659436 20694 raft_consensus.cc:2272] T b3bbb48eaef64910973105f716cf813d P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.662245 20694 tablet_replica.cc:333] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.662951 20694 raft_consensus.cc:2243] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.663964 20694 raft_consensus.cc:2272] T bccfbbc2aaa5423fb599eeb56b38121c P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.666468 20694 tablet_replica.cc:333] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.667137 20694 raft_consensus.cc:2243] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.668141 20694 raft_consensus.cc:2272] T 9a451fba336b41e5954a827976c17a50 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.670794 20694 tablet_replica.cc:333] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.671538 20694 raft_consensus.cc:2243] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.672536 20694 raft_consensus.cc:2272] T 535de8a48bb34b5f9976321c2d08b8d6 P 0157b4f0725d4f92a53938c921db9efc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.675181 20694 tablet_replica.cc:333] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.675894 20694 raft_consensus.cc:2243] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.677090 20694 raft_consensus.cc:2272] T dd4225b745e54206b600f5380ed664be P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:55.678100 22520 consensus_peers.cc:597] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc -> Peer ac1dd8ad9fc44263932ec57d9376a271 (127.20.53.130:43149): Couldn't send request to peer ac1dd8ad9fc44263932ec57d9376a271. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:43149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:55.679664 20694 tablet_replica.cc:333] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.680439 20694 raft_consensus.cc:2243] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.681438 20694 raft_consensus.cc:2272] T 554595014abc431286bf4ba1922fc147 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.683897 20694 tablet_replica.cc:333] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.684592 20694 raft_consensus.cc:2243] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.685521 20694 raft_consensus.cc:2272] T 1f2f8130ad944310bea7f2f3d408309f P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.688016 20694 tablet_replica.cc:333] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.688710 20694 raft_consensus.cc:2243] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.689638 20694 raft_consensus.cc:2272] T 24f26969ffdf4e1eb377ceacb0750ca5 P 0157b4f0725d4f92a53938c921db9efc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.692094 20694 tablet_replica.cc:333] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.692778 20694 raft_consensus.cc:2243] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.693742 20694 raft_consensus.cc:2272] T ed07e2d846e24b06abb770ea1376b9fb P 0157b4f0725d4f92a53938c921db9efc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.696291 20694 tablet_replica.cc:333] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.696990 20694 raft_consensus.cc:2243] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.698091 20694 raft_consensus.cc:2272] T 691d4cf0a1ef4f689413711647c88f75 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.700706 20694 tablet_replica.cc:333] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.701442 20694 raft_consensus.cc:2243] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEARNER]: Raft consensus shutting down.
I20260709 13:08:55.701905 20694 pending_rounds.cc:70] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Trying to abort 1 pending ops.
I20260709 13:08:55.702128 20694 pending_rounds.cc:77] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc: Aborting op as it isn't in flight: id { term: 6 index: 5 } timestamp: 7305635363025248256 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "dbb4eb8dd14248918867a27aa6d9bac9" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } } } new_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "479255846c5141b584b16aa253f587c7" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 39085 } } peers { permanent_uuid: "ac1dd8ad9fc44263932ec57d9376a271" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 43149 } } peers { permanent_uuid: "3d76b2c4699e43fba10eeb81a91e4913" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42795 } attrs { replace: true } } peers { permanent_uuid: "0157b4f0725d4f92a53938c921db9efc" member_type: NON_VOTER last_known_addr { host: "127.20.53.132" port: 38783 } attrs { promote: true } } } }
I20260709 13:08:55.703058 20694 raft_consensus.cc:2917] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc [term 7 LEARNER]: Aborting config change with OpId 6.5: Aborted: Op aborted
I20260709 13:08:55.703429 20694 raft_consensus.cc:2889] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc [term 7 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:55.703738 20694 raft_consensus.cc:2272] T dbb4eb8dd14248918867a27aa6d9bac9 P 0157b4f0725d4f92a53938c921db9efc [term 7 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:08:55.706408 20694 tablet_replica.cc:333] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.707077 20694 raft_consensus.cc:2243] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.708050 20694 raft_consensus.cc:2272] T 14d5f024a39b4860be959c964acb51e6 P 0157b4f0725d4f92a53938c921db9efc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.710433 20694 tablet_replica.cc:333] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.711113 20694 raft_consensus.cc:2243] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.712122 20694 raft_consensus.cc:2272] T 6f5da3aecad04fb0982188c37426f599 P 0157b4f0725d4f92a53938c921db9efc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.714661 20694 tablet_replica.cc:333] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.715338 20694 raft_consensus.cc:2243] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.715828 20694 raft_consensus.cc:2272] T cc0e6a6fba594f8db28b949dbce488c7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.718432 20694 tablet_replica.cc:333] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.719156 20694 raft_consensus.cc:2243] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.720218 20694 raft_consensus.cc:2272] T 911b6cb205984b78bafd3ecdcc02ef3c P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.722939 20694 tablet_replica.cc:333] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.723608 20694 raft_consensus.cc:2243] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.724680 20694 raft_consensus.cc:2272] T 9a439d1de6924cf49dda5333182516bb P 0157b4f0725d4f92a53938c921db9efc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.727036 20694 tablet_replica.cc:333] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.727540 20694 raft_consensus.cc:2243] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.728375 20694 raft_consensus.cc:2272] T 8957eea5c26d4180a331c4edcb3753b7 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.731042 20694 tablet_replica.cc:333] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.731770 20694 raft_consensus.cc:2243] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.732481 20694 raft_consensus.cc:2272] T 9f4dac7f6b7b440d84e044b62b559aae P 0157b4f0725d4f92a53938c921db9efc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.734706 20694 tablet_replica.cc:333] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.735205 20694 raft_consensus.cc:2243] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.736064 20694 raft_consensus.cc:2272] T 0ef872609f3d4b9ab42d0ccec83ae647 P 0157b4f0725d4f92a53938c921db9efc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.738029 20694 tablet_replica.cc:333] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc: stopping tablet replica
I20260709 13:08:55.738526 20694 raft_consensus.cc:2243] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.739063 20694 raft_consensus.cc:2272] T 61e3ce132d8a443eb412d1816ffc7579 P 0157b4f0725d4f92a53938c921db9efc [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.193472 20694 tablet_server.cc:196] TabletServer@127.20.53.132:0 shutdown complete.
I20260709 13:08:56.254483 20694 master.cc:562] Master@127.20.53.190:38207 shutting down...
W20260709 13:08:56.292877 21780 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:08:56.293207 21780 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:56.293418 21780 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:57.358366 21718 catalog_manager.cc:4755] TS 0157b4f0725d4f92a53938c921db9efc (127.20.53.132:38783): ChangeConfig:REMOVE_PEER RPC failed for tablet 864ca05a434d488c83f87f71e27dfa63: Network error: Client connection negotiation failed: client connection to 127.20.53.132:38783: connect: Connection refused (error 111)
W20260709 13:09:01.903679 21719 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111) [suppressed 12 similar messages]
W20260709 13:09:01.907272 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff74442193fb468c966c8842f014e361: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
W20260709 13:09:05.629001 21719 catalog_manager.cc:4755] TS 479255846c5141b584b16aa253f587c7 (127.20.53.129:39085): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 691d4cf0a1ef4f689413711647c88f75: Network error: Client connection negotiation failed: client connection to 127.20.53.129:39085: connect: Connection refused (error 111)
I20260709 13:09:07.194519 20694 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.195533 20694 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.196002 20694 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8f8230518d3b4d7090bda1a8eda4b421: stopping tablet replica
I20260709 13:09:07.396489 20694 master.cc:584] Master@127.20.53.190:38207 shutdown complete.
I20260709 13:09:07.457633 20694 test_util.cc:182] -----------------------------------------------
I20260709 13:09:07.457962 20694 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602266622664-20694-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (256109 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:07.461797 20694 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.53.190:42571
I20260709 13:09:07.463132 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:07.468921 30199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.469996 30200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.471072 30202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.471881 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:07.474723 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:07.474906 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:07.475100 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602547475068 us; error 0 us; skew 500 ppm
I20260709 13:09:07.475623 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:07.478058 20694 webserver.cc:533] Webserver started at http://127.20.53.190:34203/ using document root <none> and password file <none>
I20260709 13:09:07.478593 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:07.478744 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:07.479068 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:07.480252 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/master-0-root/instance:
uuid: "22a0333f2b28492daaf1f583e7d477fc"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-r056"
I20260709 13:09:07.484820 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:07.488735 30207 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.489538 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:07.489878 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/master-0-root
uuid: "22a0333f2b28492daaf1f583e7d477fc"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-r056"
I20260709 13:09:07.490226 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:07.504515 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:07.505810 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:07.548767 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.190:42571
I20260709 13:09:07.548863 30258 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.190:42571 every 8 connection(s)
I20260709 13:09:07.553311 30259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:07.564908 30259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc: Bootstrap starting.
I20260709 13:09:07.569702 30259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.573846 30259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc: No bootstrap required, opened a new log
I20260709 13:09:07.576459 30259 raft_consensus.cc:359] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22a0333f2b28492daaf1f583e7d477fc" member_type: VOTER }
I20260709 13:09:07.576889 30259 raft_consensus.cc:385] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.577149 30259 raft_consensus.cc:740] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a0333f2b28492daaf1f583e7d477fc, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.577725 30259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22a0333f2b28492daaf1f583e7d477fc" member_type: VOTER }
I20260709 13:09:07.578215 30259 raft_consensus.cc:399] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:07.578442 30259 raft_consensus.cc:493] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:07.578708 30259 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.583108 30259 raft_consensus.cc:515] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22a0333f2b28492daaf1f583e7d477fc" member_type: VOTER }
I20260709 13:09:07.583599 30259 leader_election.cc:304] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22a0333f2b28492daaf1f583e7d477fc; no voters: 
I20260709 13:09:07.584730 30259 leader_election.cc:290] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:07.585235 30262 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.586833 30262 raft_consensus.cc:697] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 1 LEADER]: Becoming Leader. State: Replica: 22a0333f2b28492daaf1f583e7d477fc, State: Running, Role: LEADER
I20260709 13:09:07.587607 30259 sys_catalog.cc:565] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:07.587625 30262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22a0333f2b28492daaf1f583e7d477fc" member_type: VOTER }
I20260709 13:09:07.595160 30264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22a0333f2b28492daaf1f583e7d477fc. Latest consensus state: current_term: 1 leader_uuid: "22a0333f2b28492daaf1f583e7d477fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22a0333f2b28492daaf1f583e7d477fc" member_type: VOTER } }
I20260709 13:09:07.595800 30264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:07.595706 30263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22a0333f2b28492daaf1f583e7d477fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22a0333f2b28492daaf1f583e7d477fc" member_type: VOTER } }
I20260709 13:09:07.596334 30263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:07.598235 30272 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:07.603188 30272 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:07.604348 20694 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:07.612057 30272 catalog_manager.cc:1383] Generated new cluster ID: 597591e42b294186a761b6a6dd64c3a8
I20260709 13:09:07.612344 30272 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:07.631753 30272 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:07.632948 30272 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:07.646250 30272 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc: Generated new TSK 0
I20260709 13:09:07.646816 30272 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:07.671092 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:07.677358 30280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.678377 30281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.679953 30283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.681228 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:07.684000 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:07.684216 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:07.684408 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602547684386 us; error 0 us; skew 500 ppm
I20260709 13:09:07.684986 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:07.690008 20694 webserver.cc:533] Webserver started at http://127.20.53.129:36737/ using document root <none> and password file <none>
I20260709 13:09:07.690730 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:07.691046 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:07.691443 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:07.693418 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/instance:
uuid: "d868b6e1c0be407dbc470002a447a620"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-r056"
I20260709 13:09:07.701010 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:09:07.707341 30288 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.708365 20694 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:09:07.708716 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "d868b6e1c0be407dbc470002a447a620"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-r056"
I20260709 13:09:07.709092 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:07.736466 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:07.737684 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:07.739370 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:07.742568 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:07.742776 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.743026 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:07.743384 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.787595 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:46147
I20260709 13:09:07.787719 30350 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:46147 every 8 connection(s)
I20260709 13:09:07.792835 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:07.799999 30355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.801527 30356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.807354 20694 server_base.cc:1061] running on GCE node
W20260709 13:09:07.811359 30358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.812559 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:07.812877 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:07.813149 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602547813125 us; error 0 us; skew 500 ppm
I20260709 13:09:07.814435 30351 heartbeater.cc:344] Connected to a master server at 127.20.53.190:42571
I20260709 13:09:07.815035 30351 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:07.815546 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:07.816026 30351 heartbeater.cc:507] Master 127.20.53.190:42571 requested a full tablet report, sending...
I20260709 13:09:07.818572 30224 ts_manager.cc:194] Registered new tserver with Master: d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:07.818892 20694 webserver.cc:533] Webserver started at http://127.20.53.130:35427/ using document root <none> and password file <none>
I20260709 13:09:07.819526 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:07.819756 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:07.820089 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:07.821095 30224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41210
I20260709 13:09:07.821689 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/instance:
uuid: "9ce9922db6144b968eeb78946b314cd2"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-r056"
I20260709 13:09:07.826625 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:09:07.829957 30363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.830848 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 13:09:07.831138 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-1-root
uuid: "9ce9922db6144b968eeb78946b314cd2"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-r056"
I20260709 13:09:07.831372 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:07.843508 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:07.844653 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:07.846073 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:07.848213 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:07.848405 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.848668 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:07.848825 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.889832 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.130:32987
I20260709 13:09:07.890014 30425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.130:32987 every 8 connection(s)
I20260709 13:09:07.894920 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:07.903052 30429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.905920 30430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.907042 30432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.908586 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:07.909333 30426 heartbeater.cc:344] Connected to a master server at 127.20.53.190:42571
I20260709 13:09:07.909633 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:07.909705 30426 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:07.909971 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:07.910236 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602547910217 us; error 0 us; skew 500 ppm
I20260709 13:09:07.910784 30426 heartbeater.cc:507] Master 127.20.53.190:42571 requested a full tablet report, sending...
I20260709 13:09:07.910987 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:07.912962 30224 ts_manager.cc:194] Registered new tserver with Master: 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:07.913861 20694 webserver.cc:533] Webserver started at http://127.20.53.131:34203/ using document root <none> and password file <none>
I20260709 13:09:07.914426 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:07.914633 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:07.914903 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:07.914893 30224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41214
I20260709 13:09:07.916370 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/instance:
uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-r056"
I20260709 13:09:07.920755 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:09:07.924220 30437 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.924937 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:07.925223 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-2-root
uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-r056"
I20260709 13:09:07.925511 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:07.947913 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:07.949123 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:07.950579 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:07.952745 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:07.952970 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.953208 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:07.953389 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.995106 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.131:42903
I20260709 13:09:07.995215 30499 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.131:42903 every 8 connection(s)
I20260709 13:09:08.000209 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:08.008308 30503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.009776 30504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.012892 30506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:08.013449 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:08.013484 30500 heartbeater.cc:344] Connected to a master server at 127.20.53.190:42571
I20260709 13:09:08.014195 30500 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:08.014771 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:08.015090 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:08.015134 30500 heartbeater.cc:507] Master 127.20.53.190:42571 requested a full tablet report, sending...
I20260709 13:09:08.015388 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602548015371 us; error 0 us; skew 500 ppm
I20260709 13:09:08.016266 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:08.017424 30224 ts_manager.cc:194] Registered new tserver with Master: 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:08.018915 20694 webserver.cc:533] Webserver started at http://127.20.53.132:42373/ using document root <none> and password file <none>
I20260709 13:09:08.019196 30224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41226
I20260709 13:09:08.019493 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:08.019752 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:08.020020 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:08.021299 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-3-root/instance:
uuid: "746044612df94d4493276099e7ab6adc"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-r056"
I20260709 13:09:08.025698 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:09:08.029457 30511 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.030354 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:08.030617 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-3-root
uuid: "746044612df94d4493276099e7ab6adc"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-r056"
I20260709 13:09:08.030851 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:08.044459 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:08.045600 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:08.047032 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:08.049212 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:08.049407 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.049671 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:08.049827 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.091239 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.132:41005
I20260709 13:09:08.091413 30573 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.132:41005 every 8 connection(s)
I20260709 13:09:08.105268 30574 heartbeater.cc:344] Connected to a master server at 127.20.53.190:42571
I20260709 13:09:08.105702 30574 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:08.106516 30574 heartbeater.cc:507] Master 127.20.53.190:42571 requested a full tablet report, sending...
I20260709 13:09:08.108264 30224 ts_manager.cc:194] Registered new tserver with Master: 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:08.109181 20694 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014598478s
I20260709 13:09:08.109570 30224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41230
I20260709 13:09:08.137253 30224 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41242:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:08.373127 30316 tablet_service.cc:1511] Processing CreateTablet for tablet f33c2293eacb4a2594938e734a24a3d4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:08.374888 30316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33c2293eacb4a2594938e734a24a3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.379405 30314 tablet_service.cc:1511] Processing CreateTablet for tablet eb5f0e4a8947427fbf76e8880498a33e (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:08.381026 30314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5f0e4a8947427fbf76e8880498a33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.383181 30312 tablet_service.cc:1511] Processing CreateTablet for tablet 78821f2f4788465aa83d3e5c08880b46 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:08.384817 30312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78821f2f4788465aa83d3e5c08880b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.385062 30311 tablet_service.cc:1511] Processing CreateTablet for tablet 02f8d6b0a2c24237bfd34dc90265a90b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:08.386492 30311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f8d6b0a2c24237bfd34dc90265a90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.387540 30313 tablet_service.cc:1511] Processing CreateTablet for tablet b7fed5fd32f04d9a9145de3f147b7d1a (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:08.389335 30391 tablet_service.cc:1511] Processing CreateTablet for tablet bea36533e01d4b6b83d15744c3b6ef1d (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:08.390096 30315 tablet_service.cc:1511] Processing CreateTablet for tablet bea36533e01d4b6b83d15744c3b6ef1d (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:08.389899 30310 tablet_service.cc:1511] Processing CreateTablet for tablet c5e67aacbc9140e5acab54d159ff5200 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:08.390762 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea36533e01d4b6b83d15744c3b6ef1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.391777 30310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e67aacbc9140e5acab54d159ff5200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.395414 30390 tablet_service.cc:1511] Processing CreateTablet for tablet eb5f0e4a8947427fbf76e8880498a33e (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:08.396142 30309 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1c8338cdfb4acc80a508d622aaa2c0 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:08.396763 30390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5f0e4a8947427fbf76e8880498a33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.397651 30309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1c8338cdfb4acc80a508d622aaa2c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.399320 30389 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9be44608c24a2d82c02ed55ba6fa7c (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:08.400641 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9be44608c24a2d82c02ed55ba6fa7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.401229 30313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7fed5fd32f04d9a9145de3f147b7d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.402938 30315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea36533e01d4b6b83d15744c3b6ef1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.403355 30388 tablet_service.cc:1511] Processing CreateTablet for tablet b7fed5fd32f04d9a9145de3f147b7d1a (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:08.404626 30388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7fed5fd32f04d9a9145de3f147b7d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.407357 30387 tablet_service.cc:1511] Processing CreateTablet for tablet 78821f2f4788465aa83d3e5c08880b46 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:08.408938 30387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78821f2f4788465aa83d3e5c08880b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.408337 30307 tablet_service.cc:1511] Processing CreateTablet for tablet f2a49f967b754cf9b4fc400d9b7b6dec (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:08.410356 30386 tablet_service.cc:1511] Processing CreateTablet for tablet 66bf446bd28a42eca1b83c5e74dbc6bc (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:08.411171 30308 tablet_service.cc:1511] Processing CreateTablet for tablet 5f2b6fea68dc4530a2e23485e5c6bbbf (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:08.411849 30307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a49f967b754cf9b4fc400d9b7b6dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.413203 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f2b6fea68dc4530a2e23485e5c6bbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.413865 30383 tablet_service.cc:1511] Processing CreateTablet for tablet e4915caf16db459c8af6f794aca6143c (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:08.414680 30385 tablet_service.cc:1511] Processing CreateTablet for tablet c5e67aacbc9140e5acab54d159ff5200 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:08.417263 30384 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1c8338cdfb4acc80a508d622aaa2c0 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:08.415203 30386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bf446bd28a42eca1b83c5e74dbc6bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.421600 30383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4915caf16db459c8af6f794aca6143c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.422596 30382 tablet_service.cc:1511] Processing CreateTablet for tablet f2a49f967b754cf9b4fc400d9b7b6dec (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:08.427755 30539 tablet_service.cc:1511] Processing CreateTablet for tablet f33c2293eacb4a2594938e734a24a3d4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:08.429458 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33c2293eacb4a2594938e734a24a3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.432833 30384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1c8338cdfb4acc80a508d622aaa2c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.433559 30382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a49f967b754cf9b4fc400d9b7b6dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.438510 30385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e67aacbc9140e5acab54d159ff5200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.447232 30538 tablet_service.cc:1511] Processing CreateTablet for tablet eb5f0e4a8947427fbf76e8880498a33e (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:08.448835 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5f0e4a8947427fbf76e8880498a33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.451874 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9be44608c24a2d82c02ed55ba6fa7c (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:08.454380 30536 tablet_service.cc:1511] Processing CreateTablet for tablet 78821f2f4788465aa83d3e5c08880b46 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:08.456449 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78821f2f4788465aa83d3e5c08880b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.456624 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1c8338cdfb4acc80a508d622aaa2c0 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:08.458027 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1c8338cdfb4acc80a508d622aaa2c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.462520 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9be44608c24a2d82c02ed55ba6fa7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.463480 30535 tablet_service.cc:1511] Processing CreateTablet for tablet 02f8d6b0a2c24237bfd34dc90265a90b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:08.465034 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f8d6b0a2c24237bfd34dc90265a90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.467387 30534 tablet_service.cc:1511] Processing CreateTablet for tablet 66bf446bd28a42eca1b83c5e74dbc6bc (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:08.468860 30534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bf446bd28a42eca1b83c5e74dbc6bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.472801 30532 tablet_service.cc:1511] Processing CreateTablet for tablet 5f2b6fea68dc4530a2e23485e5c6bbbf (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:08.475325 30531 tablet_service.cc:1511] Processing CreateTablet for tablet e4915caf16db459c8af6f794aca6143c (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:08.477797 30530 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7681f8cd3041589fc1ba1729668b1f (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:08.482534 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f2b6fea68dc4530a2e23485e5c6bbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.484206 30530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7681f8cd3041589fc1ba1729668b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.485805 30531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4915caf16db459c8af6f794aca6143c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.519769 30384 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7681f8cd3041589fc1ba1729668b1f (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:08.524822 30384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7681f8cd3041589fc1ba1729668b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.488543 30314 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7681f8cd3041589fc1ba1729668b1f (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:08.542763 30314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7681f8cd3041589fc1ba1729668b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.575278 30595 tablet_bootstrap.cc:492] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:08.594903 30593 tablet_bootstrap.cc:492] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:08.585989 30595 tablet_bootstrap.cc:654] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.602581 30596 tablet_bootstrap.cc:492] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:08.611052 30596 tablet_bootstrap.cc:654] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:08.654676 30271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:08.661485 30536 tablet_service.cc:1511] Processing CreateTablet for tablet da3877cc17044236b7955a08144da062 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:08.663443 30532 tablet_service.cc:1511] Processing CreateTablet for tablet f575f3dfa76f49958385c22448272c61 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:08.665767 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 3a853d771be841e38e285f5e9ba2b8a9 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:08.643829 30315 tablet_service.cc:1511] Processing CreateTablet for tablet da3877cc17044236b7955a08144da062 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:08.718096 30596 tablet_bootstrap.cc:492] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:08.718832 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 3a853d771be841e38e285f5e9ba2b8a9 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:08.719875 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3877cc17044236b7955a08144da062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.720088 30596 ts_tablet_manager.cc:1403] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.008s
I20260709 13:09:08.721122 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a853d771be841e38e285f5e9ba2b8a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.676985 30595 tablet_bootstrap.cc:492] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:08.717291 30387 tablet_service.cc:1511] Processing CreateTablet for tablet f575f3dfa76f49958385c22448272c61 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:08.721190 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f575f3dfa76f49958385c22448272c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.722513 30595 ts_tablet_manager.cc:1403] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.148s	user 0.021s	sys 0.011s
I20260709 13:09:08.723264 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a853d771be841e38e285f5e9ba2b8a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.724963 30462 tablet_service.cc:1511] Processing CreateTablet for tablet b7fed5fd32f04d9a9145de3f147b7d1a (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:08.667891 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 648581791a9940b1859861be5ff76dbb (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:08.726775 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7fed5fd32f04d9a9145de3f147b7d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.727069 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648581791a9940b1859861be5ff76dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.730790 30595 raft_consensus.cc:359] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:08.732643 30595 raft_consensus.cc:385] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.733107 30595 raft_consensus.cc:740] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.734509 30595 consensus_queue.cc:260] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:08.646571 30310 tablet_service.cc:1511] Processing CreateTablet for tablet 631b500e93c247dc8c294f5c3921b854 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:08.739280 30310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631b500e93c247dc8c294f5c3921b854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.676159 30539 tablet_service.cc:1511] Processing CreateTablet for tablet b3d42d01b36c4d8d97b27f7cb0a7d177 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:08.741976 30315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3877cc17044236b7955a08144da062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.742776 30387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f575f3dfa76f49958385c22448272c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.744537 30313 tablet_service.cc:1511] Processing CreateTablet for tablet 3a853d771be841e38e285f5e9ba2b8a9 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:08.746061 30313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a853d771be841e38e285f5e9ba2b8a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.725642 30596 raft_consensus.cc:359] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:08.748057 30311 tablet_service.cc:1511] Processing CreateTablet for tablet b3d42d01b36c4d8d97b27f7cb0a7d177 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:08.748533 30596 raft_consensus.cc:385] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.748978 30596 raft_consensus.cc:740] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.749523 30311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d42d01b36c4d8d97b27f7cb0a7d177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.661098 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9be44608c24a2d82c02ed55ba6fa7c (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:08.751748 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9be44608c24a2d82c02ed55ba6fa7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.752092 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 02f8d6b0a2c24237bfd34dc90265a90b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:08.753605 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f8d6b0a2c24237bfd34dc90265a90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.756007 30460 tablet_service.cc:1511] Processing CreateTablet for tablet 66bf446bd28a42eca1b83c5e74dbc6bc (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:08.757532 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bf446bd28a42eca1b83c5e74dbc6bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.760166 30459 tablet_service.cc:1511] Processing CreateTablet for tablet c5e67aacbc9140e5acab54d159ff5200 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:08.761868 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e67aacbc9140e5acab54d159ff5200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.763931 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 5f2b6fea68dc4530a2e23485e5c6bbbf (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:08.768126 30456 tablet_service.cc:1511] Processing CreateTablet for tablet f2a49f967b754cf9b4fc400d9b7b6dec (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:08.742383 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d42d01b36c4d8d97b27f7cb0a7d177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.769829 30457 tablet_service.cc:1511] Processing CreateTablet for tablet e4915caf16db459c8af6f794aca6143c (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:08.774294 30596 consensus_queue.cc:260] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:08.775202 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4915caf16db459c8af6f794aca6143c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.778522 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f2b6fea68dc4530a2e23485e5c6bbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.783582 30456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a49f967b754cf9b4fc400d9b7b6dec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:08.790623 30209 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.130:32987, user_credentials={real_user=slave}} blocked reactor thread for 146292us
I20260709 13:09:08.812171 30574 heartbeater.cc:499] Master 127.20.53.190:42571 was elected leader, sending a full tablet report...
I20260709 13:09:08.824735 30351 heartbeater.cc:499] Master 127.20.53.190:42571 was elected leader, sending a full tablet report...
I20260709 13:09:08.826740 30596 ts_tablet_manager.cc:1434] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.106s	user 0.018s	sys 0.006s
I20260709 13:09:08.833832 30596 tablet_bootstrap.cc:492] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:08.615622 30593 tablet_bootstrap.cc:654] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.658886 30464 tablet_service.cc:1511] Processing CreateTablet for tablet bea36533e01d4b6b83d15744c3b6ef1d (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:08.676503 30388 tablet_service.cc:1511] Processing CreateTablet for tablet 631b500e93c247dc8c294f5c3921b854 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
W20260709 13:09:08.846371 30575 tablet.cc:2406] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:09:08.854609 30210 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.132:41005, user_credentials={real_user=slave}} blocked reactor thread for 106646us
I20260709 13:09:08.675007 30389 tablet_service.cc:1511] Processing CreateTablet for tablet 648581791a9940b1859861be5ff76dbb (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:08.858754 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648581791a9940b1859861be5ff76dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.656950 30465 tablet_service.cc:1511] Processing CreateTablet for tablet f33c2293eacb4a2594938e734a24a3d4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:08.863201 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33c2293eacb4a2594938e734a24a3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.867218 30388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631b500e93c247dc8c294f5c3921b854. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:08.837396 30209 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.130:32987, user_credentials={real_user=slave}} blocked reactor thread for 45311.6us
I20260709 13:09:08.874996 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea36533e01d4b6b83d15744c3b6ef1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.896222 30426 heartbeater.cc:499] Master 127.20.53.190:42571 was elected leader, sending a full tablet report...
I20260709 13:09:08.898924 30595 ts_tablet_manager.cc:1434] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.176s	user 0.014s	sys 0.034s
I20260709 13:09:08.902208 30457 tablet_service.cc:1511] Processing CreateTablet for tablet f575f3dfa76f49958385c22448272c61 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:08.906949 30602 tablet_bootstrap.cc:492] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:08.910280 30456 tablet_service.cc:1511] Processing CreateTablet for tablet 648581791a9940b1859861be5ff76dbb (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:08.910686 30460 tablet_service.cc:1511] Processing CreateTablet for tablet da3877cc17044236b7955a08144da062 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:08.912276 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3877cc17044236b7955a08144da062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.920058 30595 tablet_bootstrap.cc:492] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:08.922417 30596 tablet_bootstrap.cc:654] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.923796 30463 tablet_service.cc:1511] Processing CreateTablet for tablet b3d42d01b36c4d8d97b27f7cb0a7d177 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:08.933156 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 631b500e93c247dc8c294f5c3921b854 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:08.936267 30593 tablet_bootstrap.cc:492] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:08.936864 30593 ts_tablet_manager.cc:1403] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.342s	user 0.012s	sys 0.017s
I20260709 13:09:08.941381 30602 tablet_bootstrap.cc:654] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.941407 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 36116499b18c4347ab81d06dae391bde (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:08.945744 30595 tablet_bootstrap.cc:654] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:08.946512 30209 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 52233.2us
I20260709 13:09:08.948664 30593 raft_consensus.cc:359] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:08.949514 30593 raft_consensus.cc:385] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.949864 30593 raft_consensus.cc:740] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.955717 30313 tablet_service.cc:1511] Processing CreateTablet for tablet 3f3222ed63e245c29f20b9920f4ca4e4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:08.956153 30593 consensus_queue.cc:260] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:08.926179 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f575f3dfa76f49958385c22448272c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.953500 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 3f3222ed63e245c29f20b9920f4ca4e4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:08.957136 30313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3222ed63e245c29f20b9920f4ca4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.957885 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3222ed63e245c29f20b9920f4ca4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.950994 30310 tablet_service.cc:1511] Processing CreateTablet for tablet 36116499b18c4347ab81d06dae391bde (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:08.958984 30310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36116499b18c4347ab81d06dae391bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.960075 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36116499b18c4347ab81d06dae391bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.956472 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 36116499b18c4347ab81d06dae391bde (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:08.962361 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36116499b18c4347ab81d06dae391bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.963996 30384 tablet_service.cc:1511] Processing CreateTablet for tablet 3f3222ed63e245c29f20b9920f4ca4e4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:08.964859 30456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648581791a9940b1859861be5ff76dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.965204 30384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3222ed63e245c29f20b9920f4ca4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.976753 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d42d01b36c4d8d97b27f7cb0a7d177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.954713 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 39c9c5d7bdc24f9f9f2b47e78c0b682e (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:08.983422 30602 tablet_bootstrap.cc:492] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:08.986938 30315 tablet_service.cc:1511] Processing CreateTablet for tablet 39c9c5d7bdc24f9f9f2b47e78c0b682e (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:08.993906 30315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c9c5d7bdc24f9f9f2b47e78c0b682e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.989182 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631b500e93c247dc8c294f5c3921b854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.998750 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c9c5d7bdc24f9f9f2b47e78c0b682e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.001992 30600 raft_consensus.cc:493] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.002599 30600 raft_consensus.cc:515] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:09.003260 30389 tablet_service.cc:1511] Processing CreateTablet for tablet 3196a23ac17a4a778e547bb9727a327a (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:09.004709 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3196a23ac17a4a778e547bb9727a327a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.007718 30602 ts_tablet_manager.cc:1403] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.101s	user 0.000s	sys 0.016s
I20260709 13:09:09.025941 30606 raft_consensus.cc:493] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.026472 30606 raft_consensus.cc:515] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:09.029253 30606 leader_election.cc:290] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:09.030798 30593 ts_tablet_manager.cc:1434] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.012s
I20260709 13:09:09.010638 30600 leader_election.cc:290] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:09.036923 30596 tablet_bootstrap.cc:492] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:09.038122 30500 heartbeater.cc:499] Master 127.20.53.190:42571 was elected leader, sending a full tablet report...
I20260709 13:09:09.040602 30602 raft_consensus.cc:359] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.054149 30593 tablet_bootstrap.cc:492] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:09.055744 30596 ts_tablet_manager.cc:1403] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.221s	user 0.018s	sys 0.007s
I20260709 13:09:09.055193 30602 raft_consensus.cc:385] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:09.057706 30210 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.131:42903, user_credentials={real_user=slave}} blocked reactor thread for 47761.5us
I20260709 13:09:09.074945 30596 raft_consensus.cc:359] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:09.075712 30596 raft_consensus.cc:385] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.075991 30596 raft_consensus.cc:740] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.076730 30596 consensus_queue.cc:260] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:09.078868 30595 tablet_bootstrap.cc:492] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:09.078917 30600 raft_consensus.cc:493] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.079566 30595 ts_tablet_manager.cc:1403] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.179s	user 0.012s	sys 0.008s
I20260709 13:09:09.079535 30600 raft_consensus.cc:515] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:09.082353 30600 leader_election.cc:290] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:09.083099 30596 ts_tablet_manager.cc:1434] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:09:09.084097 30596 tablet_bootstrap.cc:492] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:09.091126 30596 tablet_bootstrap.cc:654] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.065469 30602 raft_consensus.cc:740] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.099339 30595 raft_consensus.cc:359] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:09.100184 30595 raft_consensus.cc:385] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.100482 30595 raft_consensus.cc:740] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.101446 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 39c9c5d7bdc24f9f9f2b47e78c0b682e (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:09.103844 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c9c5d7bdc24f9f9f2b47e78c0b682e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.113049 30602 consensus_queue.cc:260] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.116654 30532 tablet_service.cc:1511] Processing CreateTablet for tablet 3196a23ac17a4a778e547bb9727a327a (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:09.118005 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3196a23ac17a4a778e547bb9727a327a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.117698 30457 tablet_service.cc:1511] Processing CreateTablet for tablet 93781ed772e74585ac49edeea6eb0421 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:09.119057 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93781ed772e74585ac49edeea6eb0421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.121534 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 37c9a6a34931479d909d663f8b380d22 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:09.101296 30595 consensus_queue.cc:260] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:09.122371 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 3196a23ac17a4a778e547bb9727a327a (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:09.123688 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3196a23ac17a4a778e547bb9727a327a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.123945 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c9a6a34931479d909d663f8b380d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.124411 30595 ts_tablet_manager.cc:1434] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.002s
I20260709 13:09:09.125378 30595 tablet_bootstrap.cc:492] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:09.140955 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:09.142391 30384 tablet_service.cc:1511] Processing CreateTablet for tablet 93781ed772e74585ac49edeea6eb0421 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:09.142730 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:09.142545 30388 tablet_service.cc:1511] Processing CreateTablet for tablet 37c9a6a34931479d909d663f8b380d22 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:09.143692 30384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93781ed772e74585ac49edeea6eb0421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.144447 30388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c9a6a34931479d909d663f8b380d22. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:09.148447 30514 leader_election.cc:343] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:09.149165 30514 leader_election.cc:343] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.157369 30599 raft_consensus.cc:493] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.157927 30599 raft_consensus.cc:515] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.160543 30599 leader_election.cc:290] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:09.172001 30596 tablet_bootstrap.cc:492] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:09.172606 30596 ts_tablet_manager.cc:1403] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.089s	user 0.005s	sys 0.024s
I20260709 13:09:09.175937 30596 raft_consensus.cc:359] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.176708 30596 raft_consensus.cc:385] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.177138 30596 raft_consensus.cc:740] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.178382 30596 consensus_queue.cc:260] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.179158 30310 tablet_service.cc:1511] Processing CreateTablet for tablet 93781ed772e74585ac49edeea6eb0421 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:09.183666 30310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93781ed772e74585ac49edeea6eb0421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.185933 30595 tablet_bootstrap.cc:654] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.186553 30593 tablet_bootstrap.cc:654] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.187309 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 978a4cca1c0a4046aa9666eec4400b95 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:09.188601 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978a4cca1c0a4046aa9666eec4400b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.191203 30389 tablet_service.cc:1511] Processing CreateTablet for tablet eb089b78d6b94082a36b55b40736d58b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:09.191983 30536 tablet_service.cc:1511] Processing CreateTablet for tablet 978a4cca1c0a4046aa9666eec4400b95 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:09.192499 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb089b78d6b94082a36b55b40736d58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.198441 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978a4cca1c0a4046aa9666eec4400b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.199165 30596 ts_tablet_manager.cc:1434] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 13:09:09.200189 30596 tablet_bootstrap.cc:492] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:09.206848 30311 tablet_service.cc:1511] Processing CreateTablet for tablet 37c9a6a34931479d909d663f8b380d22 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:09.208117 30311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c9a6a34931479d909d663f8b380d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.211727 30314 tablet_service.cc:1511] Processing CreateTablet for tablet 978a4cca1c0a4046aa9666eec4400b95 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:09.213124 30314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978a4cca1c0a4046aa9666eec4400b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.214268 30596 tablet_bootstrap.cc:654] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.231194 30533 tablet_service.cc:1511] Processing CreateTablet for tablet eb089b78d6b94082a36b55b40736d58b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:09.233168 30326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:09.234067 30463 tablet_service.cc:1511] Processing CreateTablet for tablet eb089b78d6b94082a36b55b40736d58b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:09.234616 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
W20260709 13:09:09.243260 30513 leader_election.cc:343] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.243733 30513 leader_election.cc:304] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:09.236342 30602 ts_tablet_manager.cc:1434] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.215s	user 0.010s	sys 0.006s
I20260709 13:09:09.243963 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb089b78d6b94082a36b55b40736d58b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:09.244966 30513 leader_election.cc:343] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.245393 30513 leader_election.cc:304] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:09.236562 30309 tablet_service.cc:1511] Processing CreateTablet for tablet 64ac125ecb5b491f9092fee90d68849c (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:09.267148 30600 raft_consensus.cc:2749] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.287703 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb089b78d6b94082a36b55b40736d58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.291821 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 64ac125ecb5b491f9092fee90d68849c (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:09.288229 30600 raft_consensus.cc:2749] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.293232 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ac125ecb5b491f9092fee90d68849c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.287002 30602 tablet_bootstrap.cc:492] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:09.308750 30309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ac125ecb5b491f9092fee90d68849c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.308455 30313 tablet_service.cc:1511] Processing CreateTablet for tablet efd931b10a3349438e3cc5b5d821ec37 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:09.325836 30593 tablet_bootstrap.cc:492] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:09.326366 30593 ts_tablet_manager.cc:1403] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.292s	user 0.014s	sys 0.033s
I20260709 13:09:09.319074 30457 tablet_service.cc:1511] Processing CreateTablet for tablet 64ac125ecb5b491f9092fee90d68849c (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:09.327798 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ac125ecb5b491f9092fee90d68849c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.332970 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:09.334087 30617 raft_consensus.cc:493] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.334612 30291 leader_election.cc:343] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.335026 30532 tablet_service.cc:1511] Processing CreateTablet for tablet efd931b10a3349438e3cc5b5d821ec37 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:09.336280 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd931b10a3349438e3cc5b5d821ec37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.334661 30617 raft_consensus.cc:515] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.338781 30595 tablet_bootstrap.cc:492] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:09.339372 30595 ts_tablet_manager.cc:1403] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.214s	user 0.020s	sys 0.019s
I20260709 13:09:09.349462 30313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd931b10a3349438e3cc5b5d821ec37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.337116 30593 raft_consensus.cc:359] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:09.359443 30593 raft_consensus.cc:385] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.359588 30602 tablet_bootstrap.cc:654] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.359784 30593 raft_consensus.cc:740] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.360934 30593 consensus_queue.cc:260] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:09.363377 30593 ts_tablet_manager.cc:1434] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
W20260709 13:09:09.355342 30513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 110401us
I20260709 13:09:09.373875 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:09.375036 30617 leader_election.cc:290] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:09.377731 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:09.377902 30388 tablet_service.cc:1511] Processing CreateTablet for tablet efd931b10a3349438e3cc5b5d821ec37 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 13:09:09.379324 30290 leader_election.cc:343] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.379772 30290 leader_election.cc:304] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:09.381019 30609 raft_consensus.cc:2749] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.382867 30593 tablet_bootstrap.cc:492] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:09.392143 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:09.393204 30549 raft_consensus.cc:2468] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:09.392168 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 268b2be94e304b6089db69b7e298b414 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:09.396394 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268b2be94e304b6089db69b7e298b414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.400700 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 268b2be94e304b6089db69b7e298b414 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:09.402012 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268b2be94e304b6089db69b7e298b414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.408862 30388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd931b10a3349438e3cc5b5d821ec37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.409381 30310 tablet_service.cc:1511] Processing CreateTablet for tablet 268b2be94e304b6089db69b7e298b414 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
W20260709 13:09:09.410341 30366 leader_election.cc:343] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.410903 30310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268b2be94e304b6089db69b7e298b414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.411127 30366 leader_election.cc:304] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:09.412088 30599 raft_consensus.cc:2804] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.412619 30599 raft_consensus.cc:493] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.413105 30599 raft_consensus.cc:3060] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.409818 30595 raft_consensus.cc:359] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.430464 30595 raft_consensus.cc:385] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.430827 30595 raft_consensus.cc:740] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.439299 30596 tablet_bootstrap.cc:492] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:09.441514 30596 ts_tablet_manager.cc:1403] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.242s	user 0.017s	sys 0.007s
W20260709 13:09:09.506374 30210 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.131:42903, user_credentials={real_user=slave}} blocked reactor thread for 80015.8us
I20260709 13:09:09.506191 30595 consensus_queue.cc:260] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
W20260709 13:09:09.496460 30209 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.130:32987, user_credentials={real_user=slave}} blocked reactor thread for 74542.6us
I20260709 13:09:09.515978 30384 tablet_service.cc:1511] Processing CreateTablet for tablet a3b774d24dc7436581485b454bbf956d (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:09.517211 30384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b774d24dc7436581485b454bbf956d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.512215 30630 raft_consensus.cc:493] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.520643 30630 raft_consensus.cc:515] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:09.523896 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c8338cdfb4acc80a508d622aaa2c0" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
W20260709 13:09:09.525349 30366 leader_election.cc:343] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.526671 30630 leader_election.cc:290] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:09.528367 30596 raft_consensus.cc:359] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.529167 30596 raft_consensus.cc:385] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.529515 30596 raft_consensus.cc:740] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.536366 30596 consensus_queue.cc:260] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.538486 30463 tablet_service.cc:1511] Processing CreateTablet for tablet a3b774d24dc7436581485b454bbf956d (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:09.539767 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b774d24dc7436581485b454bbf956d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.539845 30596 ts_tablet_manager.cc:1434] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.097s	user 0.002s	sys 0.005s
I20260709 13:09:09.541051 30596 tablet_bootstrap.cc:492] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:09.535166 30593 tablet_bootstrap.cc:654] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.543555 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf446bd28a42eca1b83c5e74dbc6bc" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:09.544211 30401 raft_consensus.cc:2468] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:09.546921 30439 leader_election.cc:304] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:09.547948 30623 raft_consensus.cc:2804] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.548328 30623 raft_consensus.cc:493] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.548638 30623 raft_consensus.cc:3060] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.551815 30533 tablet_service.cc:1511] Processing CreateTablet for tablet a3b774d24dc7436581485b454bbf956d (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:09.553145 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b774d24dc7436581485b454bbf956d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.553175 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c8338cdfb4acc80a508d622aaa2c0" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
W20260709 13:09:09.555325 30365 leader_election.cc:343] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.555810 30365 leader_election.cc:304] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:09.557648 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf446bd28a42eca1b83c5e74dbc6bc" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:09.558522 30549 raft_consensus.cc:2468] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:09.565356 30463 tablet_service.cc:1511] Processing CreateTablet for tablet dc099b35daa949c5aa0039ec0e6570c4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:09.567392 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 3f2c0ec726e342608b2e4bbce2a6dd76 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:09.568670 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2c0ec726e342608b2e4bbce2a6dd76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.569072 30629 raft_consensus.cc:2749] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.572432 30457 tablet_service.cc:1511] Processing CreateTablet for tablet 5b58667a160f4c47bca188153bae9969 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:09.573678 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b58667a160f4c47bca188153bae9969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.578568 30596 tablet_bootstrap.cc:654] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.535341 30599 raft_consensus.cc:515] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.584355 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:09.584959 30530 tablet_service.cc:1511] Processing CreateTablet for tablet 5b58667a160f4c47bca188153bae9969 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:09:09.585659 30366 leader_election.cc:343] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.586733 30530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b58667a160f4c47bca188153bae9969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.587703 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:09.588290 30549 raft_consensus.cc:3060] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.591724 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 0a08cc3a22a945c3bb034b67deb2b379 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:09.595371 30549 raft_consensus.cc:2468] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:09.596524 30366 leader_election.cc:304] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:09.597374 30629 raft_consensus.cc:2804] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.597838 30629 raft_consensus.cc:697] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:09.598640 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 0a08cc3a22a945c3bb034b67deb2b379 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:09.600565 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a08cc3a22a945c3bb034b67deb2b379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.601261 30313 tablet_service.cc:1511] Processing CreateTablet for tablet dc099b35daa949c5aa0039ec0e6570c4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:09.602525 30313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc099b35daa949c5aa0039ec0e6570c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.604869 30456 tablet_service.cc:1511] Processing CreateTablet for tablet cdc31bc49093420ba42ce2487858ce2b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:09.607748 30532 tablet_service.cc:1511] Processing CreateTablet for tablet dcad579e9c484c3cbb0c1352ef847b44 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:09.608707 30309 tablet_service.cc:1511] Processing CreateTablet for tablet 3f2c0ec726e342608b2e4bbce2a6dd76 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:09.609198 30389 tablet_service.cc:1511] Processing CreateTablet for tablet 3f2c0ec726e342608b2e4bbce2a6dd76 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:09.609985 30309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2c0ec726e342608b2e4bbce2a6dd76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.609046 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad579e9c484c3cbb0c1352ef847b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.611711 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2c0ec726e342608b2e4bbce2a6dd76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.607751 30391 tablet_service.cc:1511] Processing CreateTablet for tablet dc099b35daa949c5aa0039ec0e6570c4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:09.598719 30629 consensus_queue.cc:237] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.615763 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc099b35daa949c5aa0039ec0e6570c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.617425 30602 tablet_bootstrap.cc:492] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:09.626825 30602 ts_tablet_manager.cc:1403] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.346s	user 0.027s	sys 0.019s
I20260709 13:09:09.628516 30595 ts_tablet_manager.cc:1434] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.289s	user 0.013s	sys 0.000s
I20260709 13:09:09.629655 30595 tablet_bootstrap.cc:492] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:09.622346 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc099b35daa949c5aa0039ec0e6570c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.632470 30314 tablet_service.cc:1511] Processing CreateTablet for tablet 5b58667a160f4c47bca188153bae9969 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:09.632911 30388 tablet_service.cc:1511] Processing CreateTablet for tablet 0a08cc3a22a945c3bb034b67deb2b379 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:09.633991 30456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc31bc49093420ba42ce2487858ce2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.633956 30314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b58667a160f4c47bca188153bae9969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.634507 30388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a08cc3a22a945c3bb034b67deb2b379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.635896 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a08cc3a22a945c3bb034b67deb2b379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.615083 30599 leader_election.cc:290] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:09.651536 30310 tablet_service.cc:1511] Processing CreateTablet for tablet cdc31bc49093420ba42ce2487858ce2b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:09.652199 30387 tablet_service.cc:1511] Processing CreateTablet for tablet cdc31bc49093420ba42ce2487858ce2b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:09.653227 30310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc31bc49093420ba42ce2487858ce2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.653858 30387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc31bc49093420ba42ce2487858ce2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.676760 30602 raft_consensus.cc:359] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:09.677557 30602 raft_consensus.cc:385] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.677860 30602 raft_consensus.cc:740] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.681177 30315 tablet_service.cc:1511] Processing CreateTablet for tablet dcad579e9c484c3cbb0c1352ef847b44 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:09.682497 30315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad579e9c484c3cbb0c1352ef847b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.683808 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 287a40c43efc4dd499b573c0e9e2278b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:09.685025 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287a40c43efc4dd499b573c0e9e2278b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.699816 30382 tablet_service.cc:1511] Processing CreateTablet for tablet dcad579e9c484c3cbb0c1352ef847b44 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:09.700109 30311 tablet_service.cc:1511] Processing CreateTablet for tablet 287a40c43efc4dd499b573c0e9e2278b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:09.701184 30382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad579e9c484c3cbb0c1352ef847b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.701504 30311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287a40c43efc4dd499b573c0e9e2278b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.703737 30385 tablet_service.cc:1511] Processing CreateTablet for tablet 13d32a45402a4c35a2191d14f57bc155 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:09.707010 30385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d32a45402a4c35a2191d14f57bc155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.707132 30308 tablet_service.cc:1511] Processing CreateTablet for tablet 797883f7836a4e6091473c791399388f (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:09.713073 30386 tablet_service.cc:1511] Processing CreateTablet for tablet 797883f7836a4e6091473c791399388f (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:09.715061 30623 raft_consensus.cc:515] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.717878 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf446bd28a42eca1b83c5e74dbc6bc" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:09.718534 30386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797883f7836a4e6091473c791399388f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:09.720242 30271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:09.718483 30401 raft_consensus.cc:3060] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.723290 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797883f7836a4e6091473c791399388f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.723702 30460 tablet_service.cc:1511] Processing CreateTablet for tablet 797883f7836a4e6091473c791399388f (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:09.725152 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797883f7836a4e6091473c791399388f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.704349 30602 consensus_queue.cc:260] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:09.728024 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 13d32a45402a4c35a2191d14f57bc155 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:09.729316 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d32a45402a4c35a2191d14f57bc155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.729985 30602 ts_tablet_manager.cc:1434] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.005s
I20260709 13:09:09.735160 30457 tablet_service.cc:1511] Processing CreateTablet for tablet 13d32a45402a4c35a2191d14f57bc155 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:09.736745 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d32a45402a4c35a2191d14f57bc155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.761965 30593 tablet_bootstrap.cc:492] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:09.762633 30593 ts_tablet_manager.cc:1403] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.380s	user 0.039s	sys 0.050s
I20260709 13:09:09.731419 30602 tablet_bootstrap.cc:492] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:09.765771 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 287a40c43efc4dd499b573c0e9e2278b (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:09.768689 30623 leader_election.cc:290] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:09.769475 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf446bd28a42eca1b83c5e74dbc6bc" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:09.770260 30549 raft_consensus.cc:3060] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.782595 30595 tablet_bootstrap.cc:654] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.785900 30609 raft_consensus.cc:493] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.790005 30609 raft_consensus.cc:515] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:09.792557 30609 leader_election.cc:290] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:09.786444 30222 catalog_manager.cc:5697] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.800110 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5f0e4a8947427fbf76e8880498a33e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
W20260709 13:09:09.801712 30290 leader_election.cc:343] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.814070 30593 raft_consensus.cc:359] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:09.817345 30593 raft_consensus.cc:385] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.820355 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5f0e4a8947427fbf76e8880498a33e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
W20260709 13:09:09.822154 30291 leader_election.cc:343] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.822619 30291 leader_election.cc:304] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:09.823690 30609 raft_consensus.cc:2749] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.824952 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287a40c43efc4dd499b573c0e9e2278b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.824833 30593 raft_consensus.cc:740] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.829612 30623 raft_consensus.cc:493] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.834872 30623 raft_consensus.cc:515] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:09.835842 30401 raft_consensus.cc:2468] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:09.836980 30439 leader_election.cc:304] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:09.837193 30623 leader_election.cc:290] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:09.842276 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:09.846200 30602 tablet_bootstrap.cc:654] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.847415 30623 raft_consensus.cc:2804] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.851536 30623 raft_consensus.cc:697] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:09.852402 30623 consensus_queue.cc:237] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.856626 30389 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7962a39d6c4a7f9cee77c26e3c6018 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:09.857880 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7962a39d6c4a7f9cee77c26e3c6018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.858021 30532 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7962a39d6c4a7f9cee77c26e3c6018 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:09.859261 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7962a39d6c4a7f9cee77c26e3c6018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.853592 30310 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7962a39d6c4a7f9cee77c26e3c6018 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:09.862689 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 11632b693d5b414081e9b42a335cc646 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:09.863361 30310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7962a39d6c4a7f9cee77c26e3c6018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.864401 30314 tablet_service.cc:1511] Processing CreateTablet for tablet 11632b693d5b414081e9b42a335cc646 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:09.866565 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11632b693d5b414081e9b42a335cc646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.870851 30314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11632b693d5b414081e9b42a335cc646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.826839 30549 raft_consensus.cc:2468] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
W20260709 13:09:09.850427 30439 leader_election.cc:343] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.877990 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 11632b693d5b414081e9b42a335cc646 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:09.887617 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11632b693d5b414081e9b42a335cc646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.890025 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:09.890951 30325 raft_consensus.cc:2468] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:09.892737 30439 leader_election.cc:304] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:09.892911 30387 tablet_service.cc:1511] Processing CreateTablet for tablet e0b1a3391a474c1d99afc49c8113990f (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:09.893885 30617 raft_consensus.cc:2804] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.894281 30617 raft_consensus.cc:493] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.894467 30387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b1a3391a474c1d99afc49c8113990f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.894618 30617 raft_consensus.cc:3060] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.895013 30596 tablet_bootstrap.cc:492] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:09.874553 30593 consensus_queue.cc:260] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:09.895504 30596 ts_tablet_manager.cc:1403] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.355s	user 0.021s	sys 0.012s
I20260709 13:09:09.897083 30593 ts_tablet_manager.cc:1434] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.134s	user 0.004s	sys 0.004s
I20260709 13:09:09.898097 30593 tablet_bootstrap.cc:492] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:09.898758 30596 raft_consensus.cc:359] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.906733 30596 raft_consensus.cc:385] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.907025 30596 raft_consensus.cc:740] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.907881 30596 consensus_queue.cc:260] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.914867 30617 raft_consensus.cc:515] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:09.916975 30617 leader_election.cc:290] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:09.917613 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:09.918185 30325 raft_consensus.cc:3060] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.921797 30596 ts_tablet_manager.cc:1434] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:09:09.923287 30456 tablet_service.cc:1511] Processing CreateTablet for tablet e0b1a3391a474c1d99afc49c8113990f (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:09.924608 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:09.925010 30456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b1a3391a474c1d99afc49c8113990f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:09.927134 30439 leader_election.cc:343] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.928553 30537 tablet_service.cc:1511] Processing CreateTablet for tablet e0b1a3391a474c1d99afc49c8113990f (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:09.929814 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b1a3391a474c1d99afc49c8113990f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.932818 30596 tablet_bootstrap.cc:492] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:09.933801 30391 tablet_service.cc:1511] Processing CreateTablet for tablet fe391ca7cf224a87975e01e553aa19cc (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:09.935202 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe391ca7cf224a87975e01e553aa19cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.930189 30308 tablet_service.cc:1511] Processing CreateTablet for tablet fe391ca7cf224a87975e01e553aa19cc (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:09.922732 30595 tablet_bootstrap.cc:492] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:09.939121 30595 ts_tablet_manager.cc:1403] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.310s	user 0.021s	sys 0.001s
I20260709 13:09:09.939595 30325 raft_consensus.cc:2468] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:09.940670 30439 leader_election.cc:304] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:09.941448 30463 tablet_service.cc:1511] Processing CreateTablet for tablet fe391ca7cf224a87975e01e553aa19cc (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:09.941835 30617 raft_consensus.cc:2804] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.942688 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe391ca7cf224a87975e01e553aa19cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.943825 30595 raft_consensus.cc:359] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:09.944588 30595 raft_consensus.cc:385] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.944864 30595 raft_consensus.cc:740] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.940913 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe391ca7cf224a87975e01e553aa19cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.948293 30602 tablet_bootstrap.cc:492] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:09.948822 30602 ts_tablet_manager.cc:1403] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.218s	user 0.015s	sys 0.001s
I20260709 13:09:09.959784 30602 raft_consensus.cc:359] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.960322 30593 tablet_bootstrap.cc:654] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.960523 30602 raft_consensus.cc:385] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.960888 30602 raft_consensus.cc:740] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.961684 30602 consensus_queue.cc:260] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:09.969178 30602 ts_tablet_manager.cc:1434] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:09:09.970407 30602 tablet_bootstrap.cc:492] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:09.980206 30602 tablet_bootstrap.cc:654] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.985831 30595 consensus_queue.cc:260] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:09.988197 30595 ts_tablet_manager.cc:1434] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.003s
I20260709 13:09:09.989199 30595 tablet_bootstrap.cc:492] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:09.992013 30596 tablet_bootstrap.cc:654] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.013662 30532 tablet_service.cc:1511] Processing CreateTablet for tablet a938526c3f4d4e7aaedba12e36fc5e25 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:10.015566 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a938526c3f4d4e7aaedba12e36fc5e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.016924 30389 tablet_service.cc:1511] Processing CreateTablet for tablet a938526c3f4d4e7aaedba12e36fc5e25 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:10.018122 30617 raft_consensus.cc:697] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:10.018625 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a938526c3f4d4e7aaedba12e36fc5e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.019088 30617 consensus_queue.cc:237] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.020915 30629 raft_consensus.cc:493] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.022610 30629 raft_consensus.cc:515] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.024917 30629 leader_election.cc:290] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:10.017000 30314 tablet_service.cc:1511] Processing CreateTablet for tablet a938526c3f4d4e7aaedba12e36fc5e25 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:10.026886 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5f0e4a8947427fbf76e8880498a33e" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:10.027714 30314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a938526c3f4d4e7aaedba12e36fc5e25. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:10.028775 30366 leader_election.cc:343] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.028880 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5f0e4a8947427fbf76e8880498a33e" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:10.029569 30325 raft_consensus.cc:2468] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:10.029616 30638 raft_consensus.cc:493] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.031229 30365 leader_election.cc:304] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc
I20260709 13:09:10.032478 30629 raft_consensus.cc:2804] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.032845 30629 raft_consensus.cc:493] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.033229 30595 tablet_bootstrap.cc:654] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.033181 30629 raft_consensus.cc:3060] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.034719 30456 tablet_service.cc:1511] Processing CreateTablet for tablet 748b5efba5c6486ab5974a080fc1d298 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:10.036041 30456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748b5efba5c6486ab5974a080fc1d298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.039983 30609 raft_consensus.cc:493] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.040457 30609 raft_consensus.cc:515] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.040613 30629 raft_consensus.cc:515] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.042517 30609 leader_election.cc:290] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:10.043633 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5f0e4a8947427fbf76e8880498a33e" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:10.044010 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 748b5efba5c6486ab5974a080fc1d298 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 13:09:10.045023 30366 leader_election.cc:343] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.045109 30596 tablet_bootstrap.cc:492] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:10.031404 30638 raft_consensus.cc:515] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:10.045763 30596 ts_tablet_manager.cc:1403] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.000s
I20260709 13:09:10.046896 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:10.047914 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
W20260709 13:09:10.048826 30291 leader_election.cc:343] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.049723 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:10.050365 30549 raft_consensus.cc:2468] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:10.045253 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748b5efba5c6486ab5974a080fc1d298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.051667 30291 leader_election.cc:304] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:10.052999 30609 raft_consensus.cc:2804] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.052984 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:10.053668 30609 raft_consensus.cc:493] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.054109 30609 raft_consensus.cc:3060] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.054526 30638 leader_election.cc:290] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:10.048637 30308 tablet_service.cc:1511] Processing CreateTablet for tablet 748b5efba5c6486ab5974a080fc1d298 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:10.054131 30549 raft_consensus.cc:2393] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:10.058758 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748b5efba5c6486ab5974a080fc1d298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.059676 30440 leader_election.cc:304] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:10.060045 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5f0e4a8947427fbf76e8880498a33e" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:10.060657 30325 raft_consensus.cc:3060] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.063110 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 3651fee799e6451a8fe39b2c4b19eaaf (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:10.064524 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3651fee799e6451a8fe39b2c4b19eaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.065523 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 3651fee799e6451a8fe39b2c4b19eaaf (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:10.066923 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3651fee799e6451a8fe39b2c4b19eaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.067590 30325 raft_consensus.cc:2468] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:10.068609 30365 leader_election.cc:304] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc
I20260709 13:09:10.069487 30599 raft_consensus.cc:2804] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.069947 30599 raft_consensus.cc:697] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:10.070727 30599 consensus_queue.cc:237] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.074358 30638 raft_consensus.cc:3060] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.079717 30629 leader_election.cc:290] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:10.086076 30311 tablet_service.cc:1511] Processing CreateTablet for tablet 5e5052554c804cfb88e8c770a62fcbf9 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:10.087598 30311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5052554c804cfb88e8c770a62fcbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.088498 30595 tablet_bootstrap.cc:492] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:10.057322 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 3651fee799e6451a8fe39b2c4b19eaaf (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:10.089043 30595 ts_tablet_manager.cc:1403] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.002s
I20260709 13:09:10.089900 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3651fee799e6451a8fe39b2c4b19eaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.051646 30593 tablet_bootstrap.cc:492] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:10.090719 30593 ts_tablet_manager.cc:1403] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.193s	user 0.018s	sys 0.001s
I20260709 13:09:10.090898 30223 catalog_manager.cc:5697] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.073645 30609 raft_consensus.cc:515] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.102897 30602 tablet_bootstrap.cc:492] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:10.103477 30602 ts_tablet_manager.cc:1403] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.009s
I20260709 13:09:10.104928 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:10.105567 30549 raft_consensus.cc:3060] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.115128 30602 raft_consensus.cc:359] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.115998 30602 raft_consensus.cc:385] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.118193 30549 raft_consensus.cc:2468] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:10.119484 30291 leader_election.cc:304] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:10.120162 30387 tablet_service.cc:1511] Processing CreateTablet for tablet 5e5052554c804cfb88e8c770a62fcbf9 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:10.121482 30456 tablet_service.cc:1511] Processing CreateTablet for tablet 5e5052554c804cfb88e8c770a62fcbf9 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:10.123312 30456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5052554c804cfb88e8c770a62fcbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.140995 30387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5052554c804cfb88e8c770a62fcbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.142215 30609 leader_election.cc:290] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:10.097851 30596 raft_consensus.cc:359] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.143244 30596 raft_consensus.cc:385] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.143570 30596 raft_consensus.cc:740] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.093947 30593 raft_consensus.cc:359] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.116379 30602 raft_consensus.cc:740] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.148262 30609 raft_consensus.cc:2804] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.145056 30593 raft_consensus.cc:385] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.148752 30609 raft_consensus.cc:697] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:10.149124 30593 raft_consensus.cc:740] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.149647 30609 consensus_queue.cc:237] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.154953 30308 tablet_service.cc:1511] Processing CreateTablet for tablet 168e34fb6e72416680e50fbf1f847b6a (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:10.156224 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168e34fb6e72416680e50fbf1f847b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.153998 30638 raft_consensus.cc:2749] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.141075 30595 raft_consensus.cc:359] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.159358 30595 raft_consensus.cc:385] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.159660 30595 raft_consensus.cc:740] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.160379 30595 consensus_queue.cc:260] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.162308 30593 consensus_queue.cc:260] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.165370 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 168e34fb6e72416680e50fbf1f847b6a (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:10.163197 30596 consensus_queue.cc:260] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.167652 30222 catalog_manager.cc:5697] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:10.169137 30596 ts_tablet_manager.cc:1434] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.123s	user 0.009s	sys 0.000s
I20260709 13:09:10.166777 30223 catalog_manager.cc:5697] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.153429 30602 consensus_queue.cc:260] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.170970 30617 raft_consensus.cc:493] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.171465 30617 raft_consensus.cc:515] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.174502 30602 ts_tablet_manager.cc:1434] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.004s
I20260709 13:09:10.175576 30602 tablet_bootstrap.cc:492] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:10.166782 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168e34fb6e72416680e50fbf1f847b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.181212 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e67aacbc9140e5acab54d159ff5200" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:10.181481 30596 tablet_bootstrap.cc:492] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
W20260709 13:09:10.182766 30439 leader_election.cc:343] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.183406 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 168e34fb6e72416680e50fbf1f847b6a (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:09:10.164515 30291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:41005, user_credentials={real_user=slave}} blocked reactor thread for 45138.4us
I20260709 13:09:10.186124 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:10.186614 30617 leader_election.cc:290] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:10.186803 30602 tablet_bootstrap.cc:654] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.187703 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e67aacbc9140e5acab54d159ff5200" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:10.188364 30400 raft_consensus.cc:2468] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:10.196691 30439 leader_election.cc:304] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: d868b6e1c0be407dbc470002a447a620
I20260709 13:09:10.189795 30595 ts_tablet_manager.cc:1434] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.001s
I20260709 13:09:10.203069 30595 tablet_bootstrap.cc:492] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
W20260709 13:09:10.202829 30291 leader_election.cc:343] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.207432 30463 tablet_service.cc:1511] Processing CreateTablet for tablet a5e11a3a73344f4f89bb1e70414ac6c1 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:10.209861 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e11a3a73344f4f89bb1e70414ac6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.211405 30638 raft_consensus.cc:2804] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.215590 30638 raft_consensus.cc:493] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.215991 30638 raft_consensus.cc:3060] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.222258 30599 consensus_queue.cc:1048] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.229216 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168e34fb6e72416680e50fbf1f847b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.232215 30537 tablet_service.cc:1511] Processing CreateTablet for tablet a5e11a3a73344f4f89bb1e70414ac6c1 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:10.234882 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e11a3a73344f4f89bb1e70414ac6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.235702 30599 consensus_queue.cc:1048] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.241825 30622 raft_consensus.cc:493] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.242436 30622 raft_consensus.cc:515] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:10.254251 30622 leader_election.cc:290] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:10.241796 30593 ts_tablet_manager.cc:1434] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.151s	user 0.019s	sys 0.011s
I20260709 13:09:10.265272 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9be44608c24a2d82c02ed55ba6fa7c" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:10.267817 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 8c184374a9da4329ac0084e458ebe905 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:10.269731 30532 tablet_service.cc:1511] Processing CreateTablet for tablet 8c184374a9da4329ac0084e458ebe905 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:10.271052 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c184374a9da4329ac0084e458ebe905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.272246 30595 tablet_bootstrap.cc:654] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.265506 30314 tablet_service.cc:1511] Processing CreateTablet for tablet a5e11a3a73344f4f89bb1e70414ac6c1 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:09:10.274789 30514 leader_election.cc:343] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.275244 30311 tablet_service.cc:1511] Processing CreateTablet for tablet 0de7165657dd44b4821cb28eeb64824e (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:10.290879 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c184374a9da4329ac0084e458ebe905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.300674 30593 tablet_bootstrap.cc:492] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:10.280803 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa4872354f64208a9454aa62f5fa488 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:10.302745 30310 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa4872354f64208a9454aa62f5fa488 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:10.303498 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4872354f64208a9454aa62f5fa488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.296269 30638 raft_consensus.cc:515] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.307133 30460 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1f795e00974bcc85806849556a3a35 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:10.308046 30593 tablet_bootstrap.cc:654] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.308770 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1f795e00974bcc85806849556a3a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.309614 30638 leader_election.cc:290] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:10.310844 30532 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1f795e00974bcc85806849556a3a35 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:10.312181 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1f795e00974bcc85806849556a3a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.293519 30596 tablet_bootstrap.cc:654] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.316998 30314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e11a3a73344f4f89bb1e70414ac6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.318135 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e67aacbc9140e5acab54d159ff5200" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:10.297689 30456 tablet_service.cc:1511] Processing CreateTablet for tablet 0de7165657dd44b4821cb28eeb64824e (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:10.329068 30308 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1f795e00974bcc85806849556a3a35 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:09:10.344703 30439 leader_election.cc:343] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.349740 30309 tablet_service.cc:1511] Processing CreateTablet for tablet b80f0c101daa484bb62d6ec96d3357f4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:10.328651 30223 catalog_manager.cc:5697] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.356472 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 13d9fab0b2994ae382f21e0c00690b67 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:10.334088 30311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de7165657dd44b4821cb28eeb64824e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.343402 30456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de7165657dd44b4821cb28eeb64824e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.372036 30457 tablet_service.cc:1511] Processing CreateTablet for tablet b80f0c101daa484bb62d6ec96d3357f4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:10.376451 30538 tablet_service.cc:1511] Processing CreateTablet for tablet f5f14e3fbaa940a7a60f77290ba16ed2 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:10.377760 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f14e3fbaa940a7a60f77290ba16ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.399587 30609 raft_consensus.cc:493] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.400143 30609 raft_consensus.cc:515] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.407408 30310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4872354f64208a9454aa62f5fa488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.407940 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:10.407708 30530 tablet_service.cc:1511] Processing CreateTablet for tablet 13d9fab0b2994ae382f21e0c00690b67 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:09:10.409638 30291 leader_election.cc:343] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.409746 30530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d9fab0b2994ae382f21e0c00690b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.410272 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d9fab0b2994ae382f21e0c00690b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.419849 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 0de7165657dd44b4821cb28eeb64824e (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:10.420820 30308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1f795e00974bcc85806849556a3a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.420958 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de7165657dd44b4821cb28eeb64824e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.421931 30309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80f0c101daa484bb62d6ec96d3357f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.413470 30315 tablet_service.cc:1511] Processing CreateTablet for tablet f5f14e3fbaa940a7a60f77290ba16ed2 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:10.423003 30315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f14e3fbaa940a7a60f77290ba16ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.418004 30387 tablet_service.cc:1511] Processing CreateTablet for tablet 8c184374a9da4329ac0084e458ebe905 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:10.426590 30387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c184374a9da4329ac0084e458ebe905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.434415 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80f0c101daa484bb62d6ec96d3357f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.440893 30609 leader_election.cc:290] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:10.444581 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 70b2a45700e14c769022b4d7361c3dee (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:10.445751 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b2a45700e14c769022b4d7361c3dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.451649 30595 tablet_bootstrap.cc:492] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:10.452174 30595 ts_tablet_manager.cc:1403] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.249s	user 0.009s	sys 0.010s
I20260709 13:09:10.453711 30313 tablet_service.cc:1511] Processing CreateTablet for tablet 70b2a45700e14c769022b4d7361c3dee (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:10.454934 30313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b2a45700e14c769022b4d7361c3dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.457193 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 70b2a45700e14c769022b4d7361c3dee (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:10.458381 30638 consensus_queue.cc:1048] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.468673 30602 tablet_bootstrap.cc:492] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:10.469161 30617 consensus_queue.cc:1048] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.482488 30602 ts_tablet_manager.cc:1403] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.307s	user 0.022s	sys 0.038s
I20260709 13:09:10.485494 30602 raft_consensus.cc:359] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:10.458596 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b2a45700e14c769022b4d7361c3dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.490959 30595 raft_consensus.cc:359] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.492100 30595 raft_consensus.cc:385] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.492437 30595 raft_consensus.cc:740] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.493216 30595 consensus_queue.cc:260] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.498481 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa4872354f64208a9454aa62f5fa488 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:10.498924 30389 tablet_service.cc:1511] Processing CreateTablet for tablet 13d9fab0b2994ae382f21e0c00690b67 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:10.531806 30595 ts_tablet_manager.cc:1434] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 13:09:10.501209 30388 tablet_service.cc:1511] Processing CreateTablet for tablet f5f14e3fbaa940a7a60f77290ba16ed2 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:10.503059 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:10.504137 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e67aacbc9140e5acab54d159ff5200" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:10.534345 30400 raft_consensus.cc:2468] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:10.507367 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9be44608c24a2d82c02ed55ba6fa7c" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:10.525852 30617 consensus_queue.cc:1048] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.499403 30382 tablet_service.cc:1511] Processing CreateTablet for tablet b80f0c101daa484bb62d6ec96d3357f4 (DEFAULT_TABLE table=test-workload [id=c679596115ab46149583ee4f5aff7dcd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:09:10.538905 30513 leader_election.cc:343] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.539582 30513 leader_election.cc:304] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:10.541044 30622 raft_consensus.cc:2749] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.542891 30290 leader_election.cc:304] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc
I20260709 13:09:10.544343 30609 raft_consensus.cc:2804] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.532657 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4872354f64208a9454aa62f5fa488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.544727 30609 raft_consensus.cc:493] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.545130 30609 raft_consensus.cc:3060] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.534473 30401 raft_consensus.cc:3060] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:10.531571 30366 consensus_peers.cc:597] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 -> Peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Couldn't send request to peer 746044612df94d4493276099e7ab6adc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.554215 30602 raft_consensus.cc:385] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.558663 30622 raft_consensus.cc:493] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.564103 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d9fab0b2994ae382f21e0c00690b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.570711 30382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80f0c101daa484bb62d6ec96d3357f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.572935 30593 tablet_bootstrap.cc:492] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:10.573482 30593 ts_tablet_manager.cc:1403] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.273s	user 0.029s	sys 0.055s
I20260709 13:09:10.576354 30401 raft_consensus.cc:2468] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:10.576860 30593 raft_consensus.cc:359] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.577661 30593 raft_consensus.cc:385] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.578299 30622 raft_consensus.cc:515] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.579780 30596 tablet_bootstrap.cc:492] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:10.580188 30595 tablet_bootstrap.cc:492] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:10.580322 30596 ts_tablet_manager.cc:1403] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.410s	user 0.006s	sys 0.016s
I20260709 13:09:10.581349 30388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f14e3fbaa940a7a60f77290ba16ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.582553 30622 leader_election.cc:290] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:10.582877 30326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f2b6fea68dc4530a2e23485e5c6bbbf" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:10.583362 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f2b6fea68dc4530a2e23485e5c6bbbf" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:10.584456 30513 leader_election.cc:343] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:10.585088 30514 leader_election.cc:343] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.585552 30514 leader_election.cc:304] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:10.563604 30602 raft_consensus.cc:740] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.578002 30593 raft_consensus.cc:740] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
W20260709 13:09:10.565433 30439 consensus_peers.cc:597] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.599324 30595 tablet_bootstrap.cc:654] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.592573 30622 raft_consensus.cc:2749] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.603264 30439 leader_election.cc:304] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: d868b6e1c0be407dbc470002a447a620
I20260709 13:09:10.611856 30638 raft_consensus.cc:2804] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.609799 30599 consensus_queue.cc:1048] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.612612 30609 raft_consensus.cc:515] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.614794 30609 leader_election.cc:290] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:10.618505 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:10.619875 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:10.610323 30602 consensus_queue.cc:260] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:10.592713 30596 raft_consensus.cc:359] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.641675 30638 raft_consensus.cc:697] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
W20260709 13:09:10.645622 30291 leader_election.cc:343] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.645620 30401 raft_consensus.cc:3060] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.647003 30596 raft_consensus.cc:385] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.651705 30596 raft_consensus.cc:740] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.652539 30596 consensus_queue.cc:260] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.652798 30638 consensus_queue.cc:237] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.603235 30593 consensus_queue.cc:260] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.668484 30593 ts_tablet_manager.cc:1434] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.003s
I20260709 13:09:10.669608 30593 tablet_bootstrap.cc:492] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:10.660851 30596 ts_tablet_manager.cc:1434] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.002s
I20260709 13:09:10.677961 30596 tablet_bootstrap.cc:492] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:10.697721 30401 raft_consensus.cc:2468] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:10.699096 30290 leader_election.cc:304] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc
I20260709 13:09:10.703713 30609 raft_consensus.cc:2804] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:10.703889 30291 consensus_peers.cc:597] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.707088 30609 raft_consensus.cc:697] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:10.708786 30602 ts_tablet_manager.cc:1434] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.226s	user 0.008s	sys 0.004s
I20260709 13:09:10.712154 30609 consensus_queue.cc:237] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.714412 30650 consensus_queue.cc:1048] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:10.717821 30593 tablet_bootstrap.cc:654] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.718714 30596 tablet_bootstrap.cc:654] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.719655 30602 tablet_bootstrap.cc:492] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:10.719287 30222 catalog_manager.cc:5697] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:10.729559 30271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:10.740449 30595 tablet_bootstrap.cc:492] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:10.741060 30595 ts_tablet_manager.cc:1403] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.161s	user 0.006s	sys 0.009s
I20260709 13:09:10.744611 30595 raft_consensus.cc:359] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.745412 30595 raft_consensus.cc:385] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.745833 30595 raft_consensus.cc:740] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.747030 30595 consensus_queue.cc:260] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.745510 30602 tablet_bootstrap.cc:654] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.750664 30222 catalog_manager.cc:5697] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.762732 30595 ts_tablet_manager.cc:1434] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:09:10.764353 30593 tablet_bootstrap.cc:492] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:10.764889 30593 ts_tablet_manager.cc:1403] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.002s
I20260709 13:09:10.766008 30595 tablet_bootstrap.cc:492] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:10.766870 30596 tablet_bootstrap.cc:492] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:10.767361 30596 ts_tablet_manager.cc:1403] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.000s
I20260709 13:09:10.767925 30593 raft_consensus.cc:359] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.768667 30593 raft_consensus.cc:385] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.768942 30593 raft_consensus.cc:740] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.769972 30596 raft_consensus.cc:359] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.769840 30593 consensus_queue.cc:260] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.770637 30596 raft_consensus.cc:385] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.770951 30596 raft_consensus.cc:740] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.771626 30596 consensus_queue.cc:260] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.772893 30593 ts_tablet_manager.cc:1434] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:09:10.773686 30596 ts_tablet_manager.cc:1434] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:10.773891 30593 tablet_bootstrap.cc:492] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:10.774706 30596 tablet_bootstrap.cc:492] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:10.778574 30595 tablet_bootstrap.cc:654] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.780370 30596 tablet_bootstrap.cc:654] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.780958 30593 tablet_bootstrap.cc:654] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.790076 30593 tablet_bootstrap.cc:492] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:10.790762 30593 ts_tablet_manager.cc:1403] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:09:10.805154 30595 tablet_bootstrap.cc:492] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:10.805724 30595 ts_tablet_manager.cc:1403] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.002s
I20260709 13:09:10.808462 30593 raft_consensus.cc:359] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.808825 30622 raft_consensus.cc:493] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.808719 30595 raft_consensus.cc:359] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.809259 30593 raft_consensus.cc:385] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.809397 30622 raft_consensus.cc:515] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.809660 30593 raft_consensus.cc:740] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.811640 30622 leader_election.cc:290] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:10.812251 30596 tablet_bootstrap.cc:492] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:10.811728 30593 consensus_queue.cc:260] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.812759 30596 ts_tablet_manager.cc:1403] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.014s
I20260709 13:09:10.813633 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c8338cdfb4acc80a508d622aaa2c0" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:10.814965 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c8338cdfb4acc80a508d622aaa2c0" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:10.815589 30401 raft_consensus.cc:2468] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:10.815842 30593 ts_tablet_manager.cc:1434] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:09:10.815515 30596 raft_consensus.cc:359] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.816342 30596 raft_consensus.cc:385] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.816639 30596 raft_consensus.cc:740] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.817054 30513 leader_election.cc:304] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:10.817294 30596 consensus_queue.cc:260] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:10.818889 30513 leader_election.cc:343] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.820353 30622 raft_consensus.cc:2804] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.820892 30622 raft_consensus.cc:493] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.821333 30622 raft_consensus.cc:3060] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.821471 30595 raft_consensus.cc:385] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.822503 30595 raft_consensus.cc:740] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.824038 30595 consensus_queue.cc:260] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.830982 30595 ts_tablet_manager.cc:1434] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.006s
I20260709 13:09:10.817071 30593 tablet_bootstrap.cc:492] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:10.835012 30596 ts_tablet_manager.cc:1434] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.022s	user 0.018s	sys 0.005s
I20260709 13:09:10.831965 30622 raft_consensus.cc:515] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.835433 30595 tablet_bootstrap.cc:492] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:10.836010 30596 tablet_bootstrap.cc:492] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:10.837600 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c8338cdfb4acc80a508d622aaa2c0" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
W20260709 13:09:10.839124 30513 leader_election.cc:343] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.841313 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c8338cdfb4acc80a508d622aaa2c0" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:10.841878 30401 raft_consensus.cc:3060] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.842433 30596 tablet_bootstrap.cc:654] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.846469 30595 tablet_bootstrap.cc:654] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.850296 30622 leader_election.cc:290] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:10.857699 30401 raft_consensus.cc:2468] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:10.859723 30513 leader_election.cc:304] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: d868b6e1c0be407dbc470002a447a620
I20260709 13:09:10.861256 30622 raft_consensus.cc:2804] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.862249 30622 raft_consensus.cc:697] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:10.863562 30622 consensus_queue.cc:237] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.864787 30595 tablet_bootstrap.cc:492] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:10.856540 30593 tablet_bootstrap.cc:654] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.865353 30595 ts_tablet_manager.cc:1403] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 13:09:10.866844 30672 raft_consensus.cc:493] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.867360 30672 raft_consensus.cc:515] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:10.869273 30602 tablet_bootstrap.cc:492] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:10.869791 30602 ts_tablet_manager.cc:1403] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.031s
I20260709 13:09:10.869925 30595 raft_consensus.cc:359] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:10.870704 30595 raft_consensus.cc:385] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.870988 30595 raft_consensus.cc:740] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.871451 30683 raft_consensus.cc:493] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.871708 30595 consensus_queue.cc:260] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:10.871976 30683 raft_consensus.cc:515] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.873353 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9be44608c24a2d82c02ed55ba6fa7c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:10.874275 30683 leader_election.cc:290] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:10.874233 30549 raft_consensus.cc:2468] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:10.876839 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:10.878520 30440 leader_election.cc:304] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:10.879189 30595 ts_tablet_manager.cc:1434] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:09:10.878902 30602 raft_consensus.cc:359] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.879603 30602 raft_consensus.cc:385] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.879868 30666 raft_consensus.cc:2804] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.880373 30666 raft_consensus.cc:493] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.880781 30666 raft_consensus.cc:3060] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.882411 30595 tablet_bootstrap.cc:492] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:10.883103 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:10.883862 30398 raft_consensus.cc:2393] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:10.885324 30513 leader_election.cc:304] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:10.875380 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9be44608c24a2d82c02ed55ba6fa7c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:10.886430 30683 raft_consensus.cc:3060] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.886612 30401 raft_consensus.cc:2468] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:10.887789 30672 leader_election.cc:290] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:10.893594 30683 raft_consensus.cc:2749] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.879902 30602 raft_consensus.cc:740] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.895529 30666 raft_consensus.cc:515] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:10.896896 30602 consensus_queue.cc:260] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.897715 30596 tablet_bootstrap.cc:492] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:10.898197 30596 ts_tablet_manager.cc:1403] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.062s	user 0.028s	sys 0.030s
I20260709 13:09:10.899211 30602 ts_tablet_manager.cc:1434] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:09:10.900089 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9be44608c24a2d82c02ed55ba6fa7c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:10.900648 30401 raft_consensus.cc:3060] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.900856 30593 tablet_bootstrap.cc:492] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:10.901118 30596 raft_consensus.cc:359] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.901342 30595 tablet_bootstrap.cc:654] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.901352 30593 ts_tablet_manager.cc:1403] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.000s
I20260709 13:09:10.901789 30596 raft_consensus.cc:385] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.902225 30596 raft_consensus.cc:740] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.903028 30596 consensus_queue.cc:260] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.904516 30593 raft_consensus.cc:359] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.905206 30593 raft_consensus.cc:385] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.905400 30596 ts_tablet_manager.cc:1434] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:10.905556 30593 raft_consensus.cc:740] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.906606 30596 tablet_bootstrap.cc:492] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:10.906740 30593 consensus_queue.cc:260] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.907879 30401 raft_consensus.cc:2468] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:10.912113 30439 leader_election.cc:304] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:10.912667 30595 tablet_bootstrap.cc:492] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:10.913132 30595 ts_tablet_manager.cc:1403] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.033s	user 0.002s	sys 0.008s
I20260709 13:09:10.913066 30672 raft_consensus.cc:2804] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.913534 30596 tablet_bootstrap.cc:654] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.913820 30672 raft_consensus.cc:697] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:10.914721 30672 consensus_queue.cc:237] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:10.916147 30595 raft_consensus.cc:359] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.916839 30595 raft_consensus.cc:385] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.917102 30595 raft_consensus.cc:740] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.917868 30595 consensus_queue.cc:260] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.919453 30593 ts_tablet_manager.cc:1434] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:09:10.921577 30666 leader_election.cc:290] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:10.922578 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9be44608c24a2d82c02ed55ba6fa7c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:10.934307 30549 raft_consensus.cc:3060] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.936493 30223 catalog_manager.cc:5697] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.926111 30593 tablet_bootstrap.cc:492] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:10.931039 30595 ts_tablet_manager.cc:1434] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:09:10.943317 30593 tablet_bootstrap.cc:654] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.947640 30548 raft_consensus.cc:3060] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.949792 30595 tablet_bootstrap.cc:492] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:10.955135 30549 raft_consensus.cc:2468] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:10.959448 30629 raft_consensus.cc:493] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.960569 30629 raft_consensus.cc:515] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.962749 30629 leader_election.cc:290] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:10.965704 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:10.966329 30595 tablet_bootstrap.cc:654] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.967450 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:10.969362 30593 tablet_bootstrap.cc:492] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:10.969872 30593 ts_tablet_manager.cc:1403] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.005s
W20260709 13:09:10.969378 30366 leader_election.cc:343] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:10.970695 30365 leader_election.cc:343] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.971127 30365 leader_election.cc:304] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:10.971704 30596 tablet_bootstrap.cc:492] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:10.972214 30596 ts_tablet_manager.cc:1403] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.031s
I20260709 13:09:10.973306 30593 raft_consensus.cc:359] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.974367 30593 raft_consensus.cc:385] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.974733 30593 raft_consensus.cc:740] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.975263 30596 raft_consensus.cc:359] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.976032 30596 raft_consensus.cc:385] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.975724 30593 consensus_queue.cc:260] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:10.976402 30596 raft_consensus.cc:740] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.976310 30222 catalog_manager.cc:5697] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.977319 30596 consensus_queue.cc:260] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:10.978690 30630 raft_consensus.cc:2749] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.979825 30596 ts_tablet_manager.cc:1434] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:10.980808 30596 tablet_bootstrap.cc:492] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:10.984380 30593 ts_tablet_manager.cc:1434] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:09:10.985718 30593 tablet_bootstrap.cc:492] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:10.992460 30672 raft_consensus.cc:493] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.992915 30596 tablet_bootstrap.cc:654] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.992978 30672 raft_consensus.cc:515] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:10.995306 30672 leader_election.cc:290] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:10.997113 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f2b6fea68dc4530a2e23485e5c6bbbf" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:10.997756 30548 raft_consensus.cc:2468] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:10.998476 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f2b6fea68dc4530a2e23485e5c6bbbf" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:10.999073 30325 raft_consensus.cc:2468] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:10.933495 30602 tablet_bootstrap.cc:492] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:11.000264 30593 tablet_bootstrap.cc:654] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.001230 30440 leader_election.cc:304] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:11.003396 30672 raft_consensus.cc:2804] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.003932 30672 raft_consensus.cc:493] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.004426 30672 raft_consensus.cc:3060] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.007723 30650 raft_consensus.cc:493] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.008359 30650 raft_consensus.cc:515] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.010875 30650 leader_election.cc:290] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:11.013025 30672 raft_consensus.cc:515] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.013713 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:11.016319 30549 raft_consensus.cc:2468] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:11.016445 30602 tablet_bootstrap.cc:654] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.016538 30596 tablet_bootstrap.cc:492] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:11.017343 30596 ts_tablet_manager.cc:1403] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.010s
I20260709 13:09:11.017628 30291 leader_election.cc:304] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:11.015722 30595 tablet_bootstrap.cc:492] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:11.015089 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:11.018680 30650 raft_consensus.cc:2804] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.019202 30650 raft_consensus.cc:493] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.019589 30650 raft_consensus.cc:3060] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.020053 30595 ts_tablet_manager.cc:1403] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.012s
I20260709 13:09:11.020694 30596 raft_consensus.cc:359] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.021539 30596 raft_consensus.cc:385] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.021889 30596 raft_consensus.cc:740] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
W20260709 13:09:11.022828 30291 leader_election.cc:343] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.022840 30596 consensus_queue.cc:260] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.025717 30596 ts_tablet_manager.cc:1434] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:11.025882 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f2b6fea68dc4530a2e23485e5c6bbbf" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:11.026113 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f2b6fea68dc4530a2e23485e5c6bbbf" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:11.026571 30549 raft_consensus.cc:3060] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.026726 30325 raft_consensus.cc:3060] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.030308 30596 tablet_bootstrap.cc:492] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:11.034983 30650 raft_consensus.cc:515] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.036139 30595 raft_consensus.cc:359] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.037992 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:11.039706 30596 tablet_bootstrap.cc:654] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:11.039876 30291 leader_election.cc:343] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.040572 30595 raft_consensus.cc:385] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.040962 30595 raft_consensus.cc:740] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.041725 30595 consensus_queue.cc:260] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.046061 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:11.046978 30548 raft_consensus.cc:3060] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.038471 30672 leader_election.cc:290] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:11.037352 30325 raft_consensus.cc:2468] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:11.048725 30439 leader_election.cc:304] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:11.049584 30629 raft_consensus.cc:493] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.050078 30629 raft_consensus.cc:515] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.052537 30629 leader_election.cc:290] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:11.055081 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fed5fd32f04d9a9145de3f147b7d1a" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:11.057050 30666 raft_consensus.cc:2804] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.057724 30666 raft_consensus.cc:697] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:11.058795 30666 consensus_queue.cc:237] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.060554 30549 raft_consensus.cc:2468] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:11.061254 30326 raft_consensus.cc:3060] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.062379 30650 leader_election.cc:290] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
W20260709 13:09:11.063095 30366 leader_election.cc:343] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.066468 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fed5fd32f04d9a9145de3f147b7d1a" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.066951 30602 tablet_bootstrap.cc:492] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:11.067216 30324 raft_consensus.cc:2468] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:11.067543 30602 ts_tablet_manager.cc:1403] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.000s
I20260709 13:09:11.068529 30365 leader_election.cc:304] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.069751 30629 raft_consensus.cc:2804] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.070199 30629 raft_consensus.cc:493] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.070607 30629 raft_consensus.cc:3060] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.063086 30548 raft_consensus.cc:2468] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:11.071314 30602 raft_consensus.cc:359] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.073864 30602 raft_consensus.cc:385] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.072116 30672 consensus_queue.cc:1048] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.074374 30291 leader_election.cc:304] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.074836 30602 raft_consensus.cc:740] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.073393 30593 tablet_bootstrap.cc:492] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:11.075522 30650 raft_consensus.cc:2804] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.076087 30593 ts_tablet_manager.cc:1403] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.091s	user 0.024s	sys 0.024s
I20260709 13:09:11.076120 30650 raft_consensus.cc:697] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:11.077401 30629 raft_consensus.cc:515] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.077252 30650 consensus_queue.cc:237] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.078666 30596 tablet_bootstrap.cc:492] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:11.078583 30602 consensus_queue.cc:260] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.080606 30602 ts_tablet_manager.cc:1434] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:09:11.079272 30596 ts_tablet_manager.cc:1403] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.010s
I20260709 13:09:11.081734 30602 tablet_bootstrap.cc:492] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:11.082615 30593 raft_consensus.cc:359] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.083329 30593 raft_consensus.cc:385] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.083629 30593 raft_consensus.cc:740] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.084139 30596 raft_consensus.cc:359] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.084324 30593 consensus_queue.cc:260] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.085667 30596 raft_consensus.cc:385] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.086014 30630 raft_consensus.cc:493] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.086386 30223 catalog_manager.cc:5697] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.087266 30593 ts_tablet_manager.cc:1434] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:11.087131 30596 raft_consensus.cc:740] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.087203 30630 raft_consensus.cc:515] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.088443 30593 tablet_bootstrap.cc:492] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:11.090492 30595 ts_tablet_manager.cc:1434] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.001s
I20260709 13:09:11.094071 30595 tablet_bootstrap.cc:492] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:11.094535 30593 tablet_bootstrap.cc:654] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.096840 30222 catalog_manager.cc:5697] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.089627 30622 raft_consensus.cc:493] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.098534 30622 raft_consensus.cc:515] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.100868 30622 leader_election.cc:290] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:11.090003 30630 leader_election.cc:290] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:11.103343 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.103433 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:11.105753 30602 tablet_bootstrap.cc:654] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.106060 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
W20260709 13:09:11.107604 30513 leader_election.cc:343] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.089134 30596 consensus_queue.cc:260] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.110970 30366 leader_election.cc:304] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:11.111552 30672 consensus_queue.cc:1048] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.112182 30630 raft_consensus.cc:2749] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.113306 30672 raft_consensus.cc:493] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.114992 30674 raft_consensus.cc:493] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.115547 30674 raft_consensus.cc:515] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.113899 30672 raft_consensus.cc:515] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.121817 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c8338cdfb4acc80a508d622aaa2c0" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:11.119225 30674 leader_election.cc:290] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:11.126222 30629 leader_election.cc:290] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:11.129639 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c8338cdfb4acc80a508d622aaa2c0" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.130604 30398 raft_consensus.cc:2393] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d868b6e1c0be407dbc470002a447a620 in current term 1: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:11.135875 30398 raft_consensus.cc:3060] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.138005 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fed5fd32f04d9a9145de3f147b7d1a" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:11.141031 30291 leader_election.cc:304] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:11.143903 30595 tablet_bootstrap.cc:654] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.143713 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fed5fd32f04d9a9145de3f147b7d1a" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:11.144654 30324 raft_consensus.cc:3060] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.150375 30650 raft_consensus.cc:3060] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.155113 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:11.156914 30366 leader_election.cc:343] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:11.158481 30514 leader_election.cc:343] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.159065 30514 leader_election.cc:304] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:11.160379 30622 raft_consensus.cc:2749] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.161998 30672 leader_election.cc:290] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:11.163666 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:11.175894 30596 ts_tablet_manager.cc:1434] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:09:11.177201 30596 tablet_bootstrap.cc:492] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:11.177470 30548 raft_consensus.cc:2393] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:11.179411 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.190152 30622 raft_consensus.cc:493] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.190752 30622 raft_consensus.cc:515] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.190672 30440 leader_election.cc:304] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:11.192749 30596 tablet_bootstrap.cc:654] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.193027 30622 leader_election.cc:290] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:11.195377 30674 raft_consensus.cc:493] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.195878 30674 raft_consensus.cc:515] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.197057 30324 raft_consensus.cc:2468] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:11.197777 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a853d771be841e38e285f5e9ba2b8a9" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.198122 30674 leader_election.cc:290] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:11.199527 30666 raft_consensus.cc:3060] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.204658 30602 tablet_bootstrap.cc:492] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
W20260709 13:09:11.204828 30513 leader_election.cc:343] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.205994 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.206664 30400 raft_consensus.cc:2468] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:11.207901 30650 raft_consensus.cc:2749] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.208626 30290 leader_election.cc:304] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:11.205117 30602 ts_tablet_manager.cc:1403] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.024s
I20260709 13:09:11.211717 30674 raft_consensus.cc:2804] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.212096 30674 raft_consensus.cc:493] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.209903 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a853d771be841e38e285f5e9ba2b8a9" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.212440 30674 raft_consensus.cc:3060] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.213779 30365 leader_election.cc:304] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.214967 30602 raft_consensus.cc:359] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.215734 30602 raft_consensus.cc:385] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:11.216012 30513 leader_election.cc:343] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.216079 30602 raft_consensus.cc:740] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.216755 30513 leader_election.cc:304] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:11.217650 30602 consensus_queue.cc:260] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.219830 30593 tablet_bootstrap.cc:492] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:11.220312 30593 ts_tablet_manager.cc:1403] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.051s
I20260709 13:09:11.221374 30602 ts_tablet_manager.cc:1434] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:11.222440 30602 tablet_bootstrap.cc:492] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:11.222886 30593 raft_consensus.cc:359] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.223537 30593 raft_consensus.cc:385] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.223801 30593 raft_consensus.cc:740] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.215214 30629 raft_consensus.cc:2804] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.224714 30629 raft_consensus.cc:697] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:11.224439 30593 consensus_queue.cc:260] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.225422 30609 raft_consensus.cc:493] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.225560 30629 consensus_queue.cc:237] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.225903 30609 raft_consensus.cc:515] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.227910 30609 leader_election.cc:290] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:11.230322 30602 tablet_bootstrap.cc:654] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.232136 30622 raft_consensus.cc:2749] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.233111 30593 ts_tablet_manager.cc:1434] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:09:11.234050 30593 tablet_bootstrap.cc:492] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:11.238734 30674 raft_consensus.cc:515] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.239838 30650 consensus_queue.cc:1048] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.241153 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:11.241861 30548 raft_consensus.cc:2468] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:11.242441 30593 tablet_bootstrap.cc:654] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.243460 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:11.244163 30475 raft_consensus.cc:2468] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:11.247215 30291 leader_election.cc:304] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:11.250579 30650 raft_consensus.cc:2804] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.251039 30650 raft_consensus.cc:493] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.234593 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.251408 30650 raft_consensus.cc:3060] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:11.252513 30290 leader_election.cc:343] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.224452 30666 raft_consensus.cc:2749] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.260370 30650 raft_consensus.cc:515] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.261353 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:11.262255 30401 raft_consensus.cc:3060] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.263370 30593 tablet_bootstrap.cc:492] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:11.263970 30593 ts_tablet_manager.cc:1403] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.001s
I20260709 13:09:11.274695 30593 raft_consensus.cc:359] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.275159 30593 raft_consensus.cc:385] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.275383 30593 raft_consensus.cc:740] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.276373 30593 consensus_queue.cc:260] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.280228 30674 leader_election.cc:290] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:11.281308 30401 raft_consensus.cc:2468] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:11.282598 30602 tablet_bootstrap.cc:492] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:11.282497 30290 leader_election.cc:304] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:11.283066 30602 ts_tablet_manager.cc:1403] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.020s
I20260709 13:09:11.283293 30674 raft_consensus.cc:2804] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.283447 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:11.283850 30674 raft_consensus.cc:697] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:11.284143 30475 raft_consensus.cc:3060] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.284721 30674 consensus_queue.cc:237] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.285809 30602 raft_consensus.cc:359] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.286525 30602 raft_consensus.cc:385] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.286774 30602 raft_consensus.cc:740] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.287454 30602 consensus_queue.cc:260] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.292181 30593 ts_tablet_manager.cc:1434] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.003s
I20260709 13:09:11.293424 30224 catalog_manager.cc:5697] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.294412 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:11.294984 30549 raft_consensus.cc:3060] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.299372 30475 raft_consensus.cc:2468] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:11.301234 30593 tablet_bootstrap.cc:492] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:11.301761 30602 ts_tablet_manager.cc:1434] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:09:11.302704 30602 tablet_bootstrap.cc:492] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:11.305155 30596 tablet_bootstrap.cc:492] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:11.305593 30596 ts_tablet_manager.cc:1403] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.129s	user 0.019s	sys 0.007s
I20260709 13:09:11.311524 30596 raft_consensus.cc:359] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.312168 30596 raft_consensus.cc:385] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.312433 30596 raft_consensus.cc:740] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.312667 30609 consensus_queue.cc:1048] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.313210 30596 consensus_queue.cc:260] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.315675 30596 ts_tablet_manager.cc:1434] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:11.316619 30596 tablet_bootstrap.cc:492] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:11.320111 30650 leader_election.cc:290] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:11.324182 30593 tablet_bootstrap.cc:654] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.323688 30224 catalog_manager.cc:5697] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.325295 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:11.327610 30595 tablet_bootstrap.cc:492] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:11.330536 30595 ts_tablet_manager.cc:1403] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.237s	user 0.022s	sys 0.001s
I20260709 13:09:11.331390 30602 tablet_bootstrap.cc:654] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:11.331961 30290 leader_election.cc:343] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.329012 30549 raft_consensus.cc:2468] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:11.333271 30595 raft_consensus.cc:359] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.349328 30595 raft_consensus.cc:385] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.349656 30595 raft_consensus.cc:740] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.350119 30291 leader_election.cc:304] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:11.350407 30595 consensus_queue.cc:260] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.351363 30650 raft_consensus.cc:2804] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.352192 30650 raft_consensus.cc:697] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:11.352622 30595 ts_tablet_manager.cc:1434] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:09:11.353543 30595 tablet_bootstrap.cc:492] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:11.354112 30596 tablet_bootstrap.cc:654] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.339676 30666 consensus_queue.cc:1048] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.363775 30622 consensus_queue.cc:1048] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.353144 30650 consensus_queue.cc:237] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.371279 30622 consensus_queue.cc:1048] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.373266 30595 tablet_bootstrap.cc:654] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.413841 30596 tablet_bootstrap.cc:492] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:11.414451 30596 ts_tablet_manager.cc:1403] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.003s
I20260709 13:09:11.417181 30596 raft_consensus.cc:359] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.417922 30596 raft_consensus.cc:385] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.418663 30596 raft_consensus.cc:740] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.419348 30596 consensus_queue.cc:260] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.419889 30667 consensus_queue.cc:1048] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.421865 30596 ts_tablet_manager.cc:1434] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:09:11.422845 30596 tablet_bootstrap.cc:492] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:11.422881 30683 raft_consensus.cc:493] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.423617 30683 raft_consensus.cc:515] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.425060 30593 tablet_bootstrap.cc:492] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:11.425535 30593 ts_tablet_manager.cc:1403] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.023s
I20260709 13:09:11.428511 30593 raft_consensus.cc:359] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.429209 30593 raft_consensus.cc:385] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.429556 30596 tablet_bootstrap.cc:654] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.430485 30683 leader_election.cc:290] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:11.429533 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648581791a9940b1859861be5ff76dbb" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.432189 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648581791a9940b1859861be5ff76dbb" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:11.429503 30593 raft_consensus.cc:740] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.433971 30622 raft_consensus.cc:493] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.434655 30622 raft_consensus.cc:515] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.434676 30593 consensus_queue.cc:260] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.436717 30629 raft_consensus.cc:493] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.437116 30622 leader_election.cc:290] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:11.437229 30629 raft_consensus.cc:515] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
W20260709 13:09:11.438709 30514 leader_election.cc:343] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.439281 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d42d01b36c4d8d97b27f7cb0a7d177" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:11.440286 30629 leader_election.cc:290] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
W20260709 13:09:11.440802 30514 leader_election.cc:343] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.441012 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d42d01b36c4d8d97b27f7cb0a7d177" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.441646 30325 raft_consensus.cc:2468] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:11.442054 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f575f3dfa76f49958385c22448272c61" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:11.443451 30366 leader_election.cc:343] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.444301 30593 ts_tablet_manager.cc:1434] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.007s
I20260709 13:09:11.445222 30593 tablet_bootstrap.cc:492] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:11.445318 30596 tablet_bootstrap.cc:492] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:11.445842 30596 ts_tablet_manager.cc:1403] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 13:09:11.448526 30596 raft_consensus.cc:359] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.449292 30596 raft_consensus.cc:385] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:11.440277 30513 leader_election.cc:343] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.449636 30596 raft_consensus.cc:740] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.450075 30513 leader_election.cc:304] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.450696 30596 consensus_queue.cc:260] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.451597 30683 raft_consensus.cc:2749] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.442013 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f575f3dfa76f49958385c22448272c61" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:11.452775 30549 raft_consensus.cc:2468] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:11.453238 30596 ts_tablet_manager.cc:1434] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:11.453843 30366 leader_election.cc:304] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.454231 30596 tablet_bootstrap.cc:492] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:11.451355 30513 leader_election.cc:304] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.456050 30622 raft_consensus.cc:2804] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.456445 30622 raft_consensus.cc:493] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.456770 30622 raft_consensus.cc:3060] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.458627 30629 raft_consensus.cc:2804] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.459107 30629 raft_consensus.cc:493] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.459523 30629 raft_consensus.cc:3060] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.461928 30667 raft_consensus.cc:493] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.462570 30667 raft_consensus.cc:515] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.465087 30667 leader_election.cc:290] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:11.467800 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fed5fd32f04d9a9145de3f147b7d1a" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.468777 30325 raft_consensus.cc:2393] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:11.469748 30593 tablet_bootstrap.cc:654] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.473111 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7fed5fd32f04d9a9145de3f147b7d1a" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.475144 30439 leader_election.cc:304] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:11.465248 30622 raft_consensus.cc:515] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.478713 30667 raft_consensus.cc:3060] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.481858 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d42d01b36c4d8d97b27f7cb0a7d177" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
W20260709 13:09:11.483552 30514 leader_election.cc:343] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.484786 30593 tablet_bootstrap.cc:492] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:11.485354 30593 ts_tablet_manager.cc:1403] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 13:09:11.488739 30596 tablet_bootstrap.cc:654] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.489363 30622 leader_election.cc:290] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:11.500494 30629 raft_consensus.cc:515] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.508823 30617 consensus_queue.cc:1048] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.509372 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f575f3dfa76f49958385c22448272c61" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
W20260709 13:09:11.511207 30366 leader_election.cc:343] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.489064 30221 catalog_manager.cc:5697] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.490576 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d42d01b36c4d8d97b27f7cb0a7d177" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:11.512264 30325 raft_consensus.cc:3060] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.488350 30593 raft_consensus.cc:359] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.519444 30593 raft_consensus.cc:385] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.519878 30593 raft_consensus.cc:740] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.520845 30593 consensus_queue.cc:260] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.524153 30325 raft_consensus.cc:2468] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:11.525803 30513 leader_election.cc:304] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.530990 30593 ts_tablet_manager.cc:1434] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 13:09:11.532434 30593 tablet_bootstrap.cc:492] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:11.535372 30667 raft_consensus.cc:2749] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.539547 30602 tablet_bootstrap.cc:492] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:11.540007 30602 ts_tablet_manager.cc:1403] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.237s	user 0.051s	sys 0.081s
I20260709 13:09:11.542585 30595 tablet_bootstrap.cc:492] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:11.543257 30595 ts_tablet_manager.cc:1403] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.190s	user 0.028s	sys 0.022s
I20260709 13:09:11.542963 30602 raft_consensus.cc:359] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.543954 30602 raft_consensus.cc:385] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.544313 30602 raft_consensus.cc:740] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.545181 30602 consensus_queue.cc:260] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.547142 30595 raft_consensus.cc:359] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.547998 30595 raft_consensus.cc:385] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.547708 30596 tablet_bootstrap.cc:492] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:11.548422 30602 ts_tablet_manager.cc:1434] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:11.549050 30596 ts_tablet_manager.cc:1403] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.095s	user 0.028s	sys 0.019s
I20260709 13:09:11.550411 30650 raft_consensus.cc:493] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.550937 30650 raft_consensus.cc:515] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.553064 30650 leader_election.cc:290] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:11.553646 30595 raft_consensus.cc:740] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.550944 30602 tablet_bootstrap.cc:492] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:11.554630 30595 consensus_queue.cc:260] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.554406 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:11.558732 30629 leader_election.cc:290] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:11.558913 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:11.559554 30549 raft_consensus.cc:2468] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:11.560499 30593 tablet_bootstrap.cc:654] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:11.562088 30291 leader_election.cc:343] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.559870 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f575f3dfa76f49958385c22448272c61" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:11.562589 30683 raft_consensus.cc:2804] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.562902 30548 raft_consensus.cc:3060] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.563059 30291 leader_election.cc:304] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.563299 30683 raft_consensus.cc:697] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:11.563972 30650 raft_consensus.cc:2804] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.564344 30650 raft_consensus.cc:493] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.564653 30650 raft_consensus.cc:3060] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.567467 30595 ts_tablet_manager.cc:1434] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:11.568534 30595 tablet_bootstrap.cc:492] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:11.572909 30730 raft_consensus.cc:493] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.573680 30730 raft_consensus.cc:515] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:11.574148 30513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 48484us
I20260709 13:09:11.574447 30602 tablet_bootstrap.cc:654] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.576534 30730 leader_election.cc:290] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:11.577669 30595 tablet_bootstrap.cc:654] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.583498 30596 raft_consensus.cc:359] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.584154 30596 raft_consensus.cc:385] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.584399 30596 raft_consensus.cc:740] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.586364 30596 consensus_queue.cc:260] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.591481 30548 raft_consensus.cc:2468] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:11.596190 30667 consensus_queue.cc:1048] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.596460 30366 leader_election.cc:304] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.597524 30629 raft_consensus.cc:2804] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.598014 30629 raft_consensus.cc:697] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:11.599071 30629 consensus_queue.cc:237] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.580425 30650 raft_consensus.cc:515] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.600270 30683 consensus_queue.cc:237] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.602072 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
W20260709 13:09:11.603556 30291 leader_election.cc:343] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.606837 30650 leader_election.cc:290] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:11.607417 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3222ed63e245c29f20b9920f4ca4e4" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.609768 30475 raft_consensus.cc:3060] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.622563 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:11.623209 30548 raft_consensus.cc:3060] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.627406 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3222ed63e245c29f20b9920f4ca4e4" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.628049 30609 consensus_queue.cc:1048] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:11.629283 30513 leader_election.cc:343] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:11.630052 30513 leader_election.cc:343] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.630533 30513 leader_election.cc:304] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:11.631340 30730 raft_consensus.cc:2749] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.637683 30725 raft_consensus.cc:493] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.638181 30725 raft_consensus.cc:515] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.643754 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a853d771be841e38e285f5e9ba2b8a9" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.644521 30324 raft_consensus.cc:2468] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:11.646437 30725 leader_election.cc:290] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:11.649215 30650 consensus_queue.cc:1048] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.649511 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a853d771be841e38e285f5e9ba2b8a9" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:11.646896 30596 ts_tablet_manager.cc:1434] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.000s
I20260709 13:09:11.647617 30365 leader_election.cc:304] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:11.659749 30223 catalog_manager.cc:5697] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.651208 30596 tablet_bootstrap.cc:492] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:11.664886 30595 tablet_bootstrap.cc:492] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:11.665493 30595 ts_tablet_manager.cc:1403] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.097s	user 0.006s	sys 0.009s
I20260709 13:09:11.676826 30221 catalog_manager.cc:5697] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.676277 30725 raft_consensus.cc:2804] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.680711 30725 raft_consensus.cc:493] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.681108 30725 raft_consensus.cc:3060] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.668601 30549 raft_consensus.cc:2468] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:11.678746 30548 raft_consensus.cc:2468] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:11.684386 30650 consensus_queue.cc:1048] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:11.692031 30596 tablet_bootstrap.cc:654] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.692327 30291 leader_election.cc:304] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.693908 30674 raft_consensus.cc:2804] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.694389 30674 raft_consensus.cc:697] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:11.695165 30674 consensus_queue.cc:237] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.704999 30602 tablet_bootstrap.cc:492] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:11.705735 30602 ts_tablet_manager.cc:1403] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.155s	user 0.023s	sys 0.002s
I20260709 13:09:11.722820 30595 raft_consensus.cc:359] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.723649 30595 raft_consensus.cc:385] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.723975 30595 raft_consensus.cc:740] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.724517 30593 tablet_bootstrap.cc:492] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:11.724949 30593 ts_tablet_manager.cc:1403] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.193s	user 0.033s	sys 0.007s
I20260709 13:09:11.724618 30595 consensus_queue.cc:260] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.735167 30602 raft_consensus.cc:359] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.737013 30602 raft_consensus.cc:385] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.737317 30602 raft_consensus.cc:740] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.737926 30602 consensus_queue.cc:260] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.739849 30602 ts_tablet_manager.cc:1434] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:09:11.736316 30593 raft_consensus.cc:359] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.740257 30593 raft_consensus.cc:385] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.740526 30593 raft_consensus.cc:740] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.741142 30593 consensus_queue.cc:260] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.743783 30593 ts_tablet_manager.cc:1434] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:11.744624 30593 tablet_bootstrap.cc:492] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:11.751137 30595 ts_tablet_manager.cc:1434] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.001s
I20260709 13:09:11.752096 30595 tablet_bootstrap.cc:492] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:11.750254 30650 consensus_queue.cc:1048] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:11.754778 30593 tablet_bootstrap.cc:654] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.758994 30602 tablet_bootstrap.cc:492] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:11.764808 30725 raft_consensus.cc:515] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.767979 30596 tablet_bootstrap.cc:492] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:11.773309 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a853d771be841e38e285f5e9ba2b8a9" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:11.777349 30629 consensus_queue.cc:1048] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.779292 30602 tablet_bootstrap.cc:654] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.789981 30548 raft_consensus.cc:3060] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:11.781220 30271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:11.782471 30595 tablet_bootstrap.cc:654] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.782816 30725 leader_election.cc:290] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:11.795019 30609 raft_consensus.cc:493] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.795553 30609 raft_consensus.cc:515] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.797639 30609 leader_election.cc:290] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:11.799240 30602 tablet_bootstrap.cc:492] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:11.785562 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a853d771be841e38e285f5e9ba2b8a9" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:11.800439 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.800884 30324 raft_consensus.cc:3060] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.801090 30400 raft_consensus.cc:2468] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:11.801937 30595 tablet_bootstrap.cc:492] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:11.799840 30548 raft_consensus.cc:2468] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:11.802421 30595 ts_tablet_manager.cc:1403] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.004s
I20260709 13:09:11.799271 30725 consensus_queue.cc:1048] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:11.805074 30595 raft_consensus.cc:359] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.805004 30224 catalog_manager.cc:5697] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.805610 30290 leader_election.cc:304] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:11.805851 30595 raft_consensus.cc:385] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.806298 30595 raft_consensus.cc:740] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.806592 30609 raft_consensus.cc:2804] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.806756 30366 leader_election.cc:304] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:11.807024 30609 raft_consensus.cc:493] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.807493 30609 raft_consensus.cc:3060] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.807080 30595 consensus_queue.cc:260] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.808171 30629 raft_consensus.cc:493] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.808444 30602 ts_tablet_manager.cc:1403] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.003s
I20260709 13:09:11.808643 30629 raft_consensus.cc:515] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.809927 30630 raft_consensus.cc:2804] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.810732 30629 leader_election.cc:290] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:11.811444 30602 raft_consensus.cc:359] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.812186 30602 raft_consensus.cc:385] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.808171 30324 raft_consensus.cc:2468] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:11.812533 30602 raft_consensus.cc:740] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.813359 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:11.813490 30602 consensus_queue.cc:260] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.814144 30548 raft_consensus.cc:2393] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:11.814935 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:11.815857 30602 ts_tablet_manager.cc:1434] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:11.816076 30617 raft_consensus.cc:493] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.816416 30595 ts_tablet_manager.cc:1434] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:11.816951 30602 tablet_bootstrap.cc:492] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:11.816579 30617 raft_consensus.cc:515] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.817341 30595 tablet_bootstrap.cc:492] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:11.818642 30617 leader_election.cc:290] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
W20260709 13:09:11.819638 30291 leader_election.cc:343] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.820899 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.823823 30326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.824414 30595 tablet_bootstrap.cc:654] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:11.825299 30439 leader_election.cc:343] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.826297 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
W20260709 13:09:11.827857 30439 leader_election.cc:343] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.828433 30439 leader_election.cc:304] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:11.803128 30596 ts_tablet_manager.cc:1403] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.152s	user 0.019s	sys 0.011s
I20260709 13:09:11.829855 30617 raft_consensus.cc:2749] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.785573 30593 tablet_bootstrap.cc:492] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:11.830734 30593 ts_tablet_manager.cc:1403] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.003s
I20260709 13:09:11.833696 30365 leader_election.cc:304] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:11.834547 30629 raft_consensus.cc:3060] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.834805 30593 raft_consensus.cc:359] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.835453 30593 raft_consensus.cc:385] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.835708 30593 raft_consensus.cc:740] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.842078 30630 raft_consensus.cc:697] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:11.845165 30725 raft_consensus.cc:493] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.845831 30725 raft_consensus.cc:515] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.856249 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648581791a9940b1859861be5ff76dbb" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:11.857756 30366 leader_election.cc:343] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.859465 30629 raft_consensus.cc:2749] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.860000 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648581791a9940b1859861be5ff76dbb" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:11.860687 30548 raft_consensus.cc:2468] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:11.859674 30596 raft_consensus.cc:359] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.861672 30596 raft_consensus.cc:385] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.862167 30725 leader_election.cc:290] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:11.862084 30366 leader_election.cc:304] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.862962 30744 consensus_queue.cc:1048] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.866112 30602 tablet_bootstrap.cc:654] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.866667 30595 tablet_bootstrap.cc:492] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:11.862074 30596 raft_consensus.cc:740] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.867302 30595 ts_tablet_manager.cc:1403] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.000s
I20260709 13:09:11.868099 30596 consensus_queue.cc:260] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:11.868898 30630 consensus_queue.cc:237] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.869551 30609 raft_consensus.cc:515] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.870810 30629 raft_consensus.cc:2804] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.871251 30629 raft_consensus.cc:493] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.871676 30629 raft_consensus.cc:3060] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.876434 30609 leader_election.cc:290] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:11.875655 30595 raft_consensus.cc:359] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.877206 30595 raft_consensus.cc:385] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.877483 30595 raft_consensus.cc:740] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.878137 30595 consensus_queue.cc:260] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.872735 30593 consensus_queue.cc:260] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.878695 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
W20260709 13:09:11.879961 30291 leader_election.cc:343] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.880472 30593 ts_tablet_manager.cc:1434] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.001s
I20260709 13:09:11.881441 30593 tablet_bootstrap.cc:492] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:11.890060 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:11.890415 30602 tablet_bootstrap.cc:492] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:11.890769 30400 raft_consensus.cc:3060] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.890911 30602 ts_tablet_manager.cc:1403] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.006s
I20260709 13:09:11.894577 30596 ts_tablet_manager.cc:1434] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.065s	user 0.004s	sys 0.005s
I20260709 13:09:11.896994 30602 raft_consensus.cc:359] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.898422 30602 raft_consensus.cc:385] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.898686 30602 raft_consensus.cc:740] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.899569 30595 ts_tablet_manager.cc:1434] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:09:11.899441 30602 consensus_queue.cc:260] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.901262 30595 tablet_bootstrap.cc:492] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:11.901613 30602 ts_tablet_manager.cc:1434] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:11.902562 30602 tablet_bootstrap.cc:492] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:11.908139 30602 tablet_bootstrap.cc:654] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.909327 30400 raft_consensus.cc:2468] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:11.909699 30650 consensus_queue.cc:1048] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.910892 30290 leader_election.cc:304] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.913991 30609 raft_consensus.cc:2804] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.915441 30596 tablet_bootstrap.cc:492] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:11.918509 30609 raft_consensus.cc:697] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:11.920205 30609 consensus_queue.cc:237] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.935036 30683 raft_consensus.cc:493] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.935652 30683 raft_consensus.cc:515] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.937871 30683 leader_election.cc:290] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:11.940047 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:11.938084 30629 raft_consensus.cc:515] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
W20260709 13:09:11.954380 30513 leader_election.cc:343] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.955180 30629 leader_election.cc:290] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:11.956302 30593 tablet_bootstrap.cc:654] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.959618 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648581791a9940b1859861be5ff76dbb" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:11.964422 30595 tablet_bootstrap.cc:654] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.967074 30221 catalog_manager.cc:5697] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:11.970468 30366 leader_election.cc:343] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.970927 30602 tablet_bootstrap.cc:492] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:11.971520 30602 ts_tablet_manager.cc:1403] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.030s
I20260709 13:09:11.971496 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648581791a9940b1859861be5ff76dbb" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:11.971946 30609 raft_consensus.cc:493] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.972545 30548 raft_consensus.cc:3060] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.972710 30609 raft_consensus.cc:515] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:11.974815 30602 raft_consensus.cc:359] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.975476 30602 raft_consensus.cc:385] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.975737 30602 raft_consensus.cc:740] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.976150 30593 tablet_bootstrap.cc:492] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:11.976599 30593 ts_tablet_manager.cc:1403] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.000s
I20260709 13:09:11.976495 30602 consensus_queue.cc:260] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.979287 30593 raft_consensus.cc:359] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.979945 30593 raft_consensus.cc:385] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.980203 30593 raft_consensus.cc:740] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.981035 30593 consensus_queue.cc:260] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:11.982208 30548 raft_consensus.cc:2468] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:11.982699 30602 ts_tablet_manager.cc:1434] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:11.983649 30595 tablet_bootstrap.cc:492] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:11.983649 30602 tablet_bootstrap.cc:492] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:11.984294 30595 ts_tablet_manager.cc:1403] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.005s
I20260709 13:09:11.985677 30366 leader_election.cc:304] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:11.986821 30595 raft_consensus.cc:359] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.987536 30595 raft_consensus.cc:385] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.987775 30595 raft_consensus.cc:740] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.989806 30593 ts_tablet_manager.cc:1434] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:09:11.990041 30602 tablet_bootstrap.cc:654] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.990770 30593 tablet_bootstrap.cc:492] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:11.990826 30630 raft_consensus.cc:2804] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.969723 30224 catalog_manager.cc:5697] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.991919 30630 raft_consensus.cc:697] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:11.992973 30630 consensus_queue.cc:237] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.996142 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:11.992005 30595 consensus_queue.cc:260] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:11.996622 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:11.997386 30474 raft_consensus.cc:2468] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
W20260709 13:09:11.997648 30290 leader_election.cc:343] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.999051 30291 leader_election.cc:304] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:11.998440 30595 ts_tablet_manager.cc:1434] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:09:12.000150 30650 raft_consensus.cc:2804] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.000696 30650 raft_consensus.cc:493] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.944154 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.001469 30650 raft_consensus.cc:3060] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:12.005676 30513 leader_election.cc:343] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.006379 30513 leader_election.cc:304] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:12.008242 30724 raft_consensus.cc:2749] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.002725 30595 tablet_bootstrap.cc:492] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:12.013057 30670 raft_consensus.cc:493] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.013576 30670 raft_consensus.cc:515] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.014693 30629 consensus_queue.cc:1048] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.015647 30595 tablet_bootstrap.cc:654] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.015697 30670 leader_election.cc:290] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:12.022524 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.022689 30650 raft_consensus.cc:515] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.024963 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.025806 30549 raft_consensus.cc:2393] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:12.026437 30650 leader_election.cc:290] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:12.003648 30596 tablet_bootstrap.cc:654] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.003644 30593 tablet_bootstrap.cc:654] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.027395 30440 leader_election.cc:304] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:12.029134 30670 raft_consensus.cc:3060] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.029197 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:12.030202 30474 raft_consensus.cc:3060] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.028623 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
W20260709 13:09:12.035902 30290 leader_election.cc:343] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.040477 30670 raft_consensus.cc:2749] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.043241 30602 tablet_bootstrap.cc:492] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:12.045686 30602 ts_tablet_manager.cc:1403] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.011s
I20260709 13:09:12.048449 30609 leader_election.cc:290] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:12.049150 30602 raft_consensus.cc:359] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.050012 30602 raft_consensus.cc:385] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.050344 30602 raft_consensus.cc:740] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.051092 30602 consensus_queue.cc:260] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.054320 30596 tablet_bootstrap.cc:492] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:12.054803 30596 ts_tablet_manager.cc:1403] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.140s	user 0.014s	sys 0.000s
I20260709 13:09:12.057318 30596 raft_consensus.cc:359] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.057945 30596 raft_consensus.cc:385] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.066042 30596 raft_consensus.cc:740] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.059402 30474 raft_consensus.cc:2468] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:12.066888 30596 consensus_queue.cc:260] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.067423 30291 leader_election.cc:304] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:12.069228 30596 ts_tablet_manager.cc:1434] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:12.069497 30609 raft_consensus.cc:2804] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.070019 30596 tablet_bootstrap.cc:492] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:12.070150 30609 raft_consensus.cc:697] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:12.071868 30609 consensus_queue.cc:237] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.059830 30602 ts_tablet_manager.cc:1434] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:09:12.074657 30602 tablet_bootstrap.cc:492] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:12.079871 30593 tablet_bootstrap.cc:492] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:12.080343 30593 ts_tablet_manager.cc:1403] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.010s
I20260709 13:09:12.081000 30224 catalog_manager.cc:5697] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.088286 30602 tablet_bootstrap.cc:654] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.088195 30474 raft_consensus.cc:3060] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.089368 30593 raft_consensus.cc:359] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.089885 30593 raft_consensus.cc:385] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.090044 30593 raft_consensus.cc:740] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.090782 30593 consensus_queue.cc:260] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.093020 30595 tablet_bootstrap.cc:492] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:12.093503 30595 ts_tablet_manager.cc:1403] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.009s
I20260709 13:09:12.096072 30596 tablet_bootstrap.cc:654] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.096390 30593 ts_tablet_manager.cc:1434] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:09:12.097354 30593 tablet_bootstrap.cc:492] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:12.101251 30602 tablet_bootstrap.cc:492] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:12.101758 30602 ts_tablet_manager.cc:1403] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 13:09:12.102475 30595 raft_consensus.cc:359] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.103358 30595 raft_consensus.cc:385] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.103673 30595 raft_consensus.cc:740] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.104838 30602 raft_consensus.cc:359] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.105494 30602 raft_consensus.cc:385] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.105765 30602 raft_consensus.cc:740] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.104492 30595 consensus_queue.cc:260] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.108417 30683 raft_consensus.cc:493] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.111466 30683 raft_consensus.cc:515] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.113174 30595 ts_tablet_manager.cc:1434] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:09:12.113552 30683 leader_election.cc:290] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:12.115365 30593 tablet_bootstrap.cc:654] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.117947 30595 tablet_bootstrap.cc:492] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:12.120040 30670 raft_consensus.cc:493] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.120535 30670 raft_consensus.cc:515] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.121240 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.121939 30400 raft_consensus.cc:2468] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:12.106866 30602 consensus_queue.cc:260] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.122552 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:12.123369 30513 leader_election.cc:304] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
W20260709 13:09:12.123939 30514 leader_election.cc:343] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.124840 30683 raft_consensus.cc:2804] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.125222 30683 raft_consensus.cc:493] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.125588 30683 raft_consensus.cc:3060] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.126250 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f575f3dfa76f49958385c22448272c61" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.130745 30670 leader_election.cc:290] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:12.132273 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f575f3dfa76f49958385c22448272c61" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.132915 30595 tablet_bootstrap.cc:654] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.134027 30602 ts_tablet_manager.cc:1434] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:09:12.134227 30440 leader_election.cc:304] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:12.135010 30602 tablet_bootstrap.cc:492] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:12.135478 30630 raft_consensus.cc:493] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.136029 30630 raft_consensus.cc:515] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.135532 30670 raft_consensus.cc:2749] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.138269 30630 leader_election.cc:290] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:12.132980 30683 raft_consensus.cc:515] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.140707 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3222ed63e245c29f20b9920f4ca4e4" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.141126 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3222ed63e245c29f20b9920f4ca4e4" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.141278 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:12.141356 30325 raft_consensus.cc:2468] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:12.141777 30548 raft_consensus.cc:2468] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:12.141891 30400 raft_consensus.cc:3060] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.142721 30630 consensus_queue.cc:1048] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.142900 30365 leader_election.cc:304] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:12.143724 30753 raft_consensus.cc:2804] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.144110 30753 raft_consensus.cc:493] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.144434 30753 raft_consensus.cc:3060] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:12.144671 30514 consensus_peers.cc:597] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:12.145681 30593 tablet_bootstrap.cc:492] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:12.149546 30724 consensus_queue.cc:1048] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.149534 30400 raft_consensus.cc:2468] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:12.152141 30683 leader_election.cc:290] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:12.151510 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:12.153088 30513 leader_election.cc:304] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:12.153963 30683 raft_consensus.cc:2804] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:12.154067 30514 leader_election.cc:343] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.154556 30683 raft_consensus.cc:697] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:12.146140 30593 ts_tablet_manager.cc:1403] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.003s
I20260709 13:09:12.158301 30602 tablet_bootstrap.cc:654] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.151510 30753 raft_consensus.cc:515] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.158730 30683 consensus_queue.cc:237] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.160543 30753 leader_election.cc:290] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:12.161382 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3222ed63e245c29f20b9920f4ca4e4" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:12.162210 30548 raft_consensus.cc:3060] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.158128 30593 raft_consensus.cc:359] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.165587 30593 raft_consensus.cc:385] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.165863 30593 raft_consensus.cc:740] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.168352 30596 tablet_bootstrap.cc:492] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:12.168006 30593 consensus_queue.cc:260] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.162108 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3222ed63e245c29f20b9920f4ca4e4" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:12.175755 30324 raft_consensus.cc:3060] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.176331 30670 raft_consensus.cc:493] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.176862 30670 raft_consensus.cc:515] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.178982 30670 leader_election.cc:290] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:12.174546 30224 catalog_manager.cc:5697] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.180850 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.181660 30400 raft_consensus.cc:2393] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:12.182824 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.183552 30602 tablet_bootstrap.cc:492] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:12.184039 30602 ts_tablet_manager.cc:1403] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.008s
I20260709 13:09:12.184099 30439 leader_election.cc:304] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:12.185483 30548 raft_consensus.cc:2468] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:12.185717 30617 raft_consensus.cc:3060] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.187018 30602 raft_consensus.cc:359] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.187523 30324 raft_consensus.cc:2468] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:12.187815 30602 raft_consensus.cc:385] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.188182 30602 raft_consensus.cc:740] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.189224 30744 consensus_queue.cc:1048] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.189643 30602 consensus_queue.cc:260] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.192256 30602 ts_tablet_manager.cc:1434] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:12.192302 30365 leader_election.cc:304] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:12.193344 30602 tablet_bootstrap.cc:492] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:12.196890 30744 raft_consensus.cc:493] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.197367 30744 raft_consensus.cc:515] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.175163 30596 ts_tablet_manager.cc:1403] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.003s
I20260709 13:09:12.200420 30602 tablet_bootstrap.cc:654] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.201612 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.202328 30547 raft_consensus.cc:2468] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:12.203648 30291 leader_election.cc:304] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:12.204466 30674 raft_consensus.cc:2804] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.204833 30674 raft_consensus.cc:493] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.205180 30674 raft_consensus.cc:3060] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.213838 30744 leader_election.cc:290] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:12.214301 30596 raft_consensus.cc:359] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.214973 30596 raft_consensus.cc:385] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.215242 30596 raft_consensus.cc:740] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.204957 30222 catalog_manager.cc:5697] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.217757 30596 consensus_queue.cc:260] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.219097 30674 raft_consensus.cc:515] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.220276 30596 ts_tablet_manager.cc:1434] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:09:12.221242 30596 tablet_bootstrap.cc:492] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:12.221199 30674 leader_election.cc:290] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:12.223205 30593 ts_tablet_manager.cc:1434] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.000s
I20260709 13:09:12.226502 30593 tablet_bootstrap.cc:492] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:12.227788 30596 tablet_bootstrap.cc:654] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.225540 30595 tablet_bootstrap.cc:492] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:12.227916 30753 raft_consensus.cc:2804] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.228945 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:12.231333 30595 ts_tablet_manager.cc:1403] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.000s
I20260709 13:09:12.234359 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:12.238080 30546 raft_consensus.cc:3060] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.240033 30753 raft_consensus.cc:697] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:12.241313 30753 consensus_queue.cc:237] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.245596 30474 raft_consensus.cc:2468] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:12.254838 30670 raft_consensus.cc:493] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.255333 30670 raft_consensus.cc:515] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.250392 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:12.258278 30475 raft_consensus.cc:3060] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.262948 30617 raft_consensus.cc:2749] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.263319 30595 raft_consensus.cc:359] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.264058 30595 raft_consensus.cc:385] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.264348 30595 raft_consensus.cc:740] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.265084 30595 consensus_queue.cc:260] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.267177 30670 leader_election.cc:290] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:12.267383 30595 ts_tablet_manager.cc:1434] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:09:12.268404 30595 tablet_bootstrap.cc:492] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:12.268896 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.271768 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.272616 30325 raft_consensus.cc:2393] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:12.273905 30439 leader_election.cc:304] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:12.279862 30546 raft_consensus.cc:2468] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:12.283033 30593 tablet_bootstrap.cc:654] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.288461 30609 raft_consensus.cc:493] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.289006 30609 raft_consensus.cc:515] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.291678 30609 leader_election.cc:290] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:12.293350 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.294147 30400 raft_consensus.cc:2468] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:12.295241 30475 raft_consensus.cc:2468] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:12.295612 30290 leader_election.cc:304] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:12.300590 30602 tablet_bootstrap.cc:492] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:12.301129 30602 ts_tablet_manager.cc:1403] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.108s	user 0.019s	sys 0.034s
I20260709 13:09:12.297744 30670 raft_consensus.cc:2749] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.303386 30595 tablet_bootstrap.cc:654] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.297078 30609 raft_consensus.cc:2804] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.306408 30609 raft_consensus.cc:493] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.306474 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.306945 30609 raft_consensus.cc:3060] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.307371 30546 raft_consensus.cc:2468] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:12.305115 30291 leader_election.cc:304] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:12.308377 30744 raft_consensus.cc:2804] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.308853 30744 raft_consensus.cc:697] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:12.309657 30744 consensus_queue.cc:237] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.316044 30596 tablet_bootstrap.cc:492] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:12.316524 30596 ts_tablet_manager.cc:1403] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.015s
I20260709 13:09:12.319728 30596 raft_consensus.cc:359] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.320458 30596 raft_consensus.cc:385] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.320763 30596 raft_consensus.cc:740] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.321588 30596 consensus_queue.cc:260] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.323894 30602 raft_consensus.cc:359] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.329666 30602 raft_consensus.cc:385] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.330650 30222 catalog_manager.cc:5697] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.337297 30593 tablet_bootstrap.cc:492] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:12.330158 30602 raft_consensus.cc:740] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.339218 30602 consensus_queue.cc:260] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.341416 30674 consensus_queue.cc:1048] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.342360 30596 ts_tablet_manager.cc:1434] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 13:09:12.342662 30593 ts_tablet_manager.cc:1403] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.116s	user 0.018s	sys 0.004s
I20260709 13:09:12.343379 30596 tablet_bootstrap.cc:492] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:12.353793 30593 raft_consensus.cc:359] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.354514 30593 raft_consensus.cc:385] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.354784 30593 raft_consensus.cc:740] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.355397 30593 consensus_queue.cc:260] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.357671 30593 ts_tablet_manager.cc:1434] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:09:12.358420 30602 ts_tablet_manager.cc:1434] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.002s
I20260709 13:09:12.358565 30593 tablet_bootstrap.cc:492] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:12.365417 30593 tablet_bootstrap.cc:654] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.367975 30602 tablet_bootstrap.cc:492] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:12.332254 30609 raft_consensus.cc:515] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.381569 30609 leader_election.cc:290] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:12.382872 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:12.383720 30400 raft_consensus.cc:3060] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.385717 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:12.386327 30546 raft_consensus.cc:3060] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.386348 30617 raft_consensus.cc:493] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.402999 30596 tablet_bootstrap.cc:654] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.402747 30753 consensus_queue.cc:1048] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:12.405620 30750 consensus_queue.cc:1048] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.406455 30595 tablet_bootstrap.cc:492] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:12.406945 30595 ts_tablet_manager.cc:1403] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.139s	user 0.022s	sys 0.019s
I20260709 13:09:12.403225 30617 raft_consensus.cc:515] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.411736 30617 leader_election.cc:290] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:12.413417 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648581791a9940b1859861be5ff76dbb" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.414538 30549 raft_consensus.cc:2393] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:12.413417 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648581791a9940b1859861be5ff76dbb" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.419332 30753 consensus_queue.cc:1048] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.420324 30439 leader_election.cc:304] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:12.401401 30400 raft_consensus.cc:2468] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:12.421844 30617 raft_consensus.cc:3060] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.428799 30595 raft_consensus.cc:359] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.429330 30595 raft_consensus.cc:385] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.429556 30595 raft_consensus.cc:740] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.436126 30595 consensus_queue.cc:260] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.436966 30778 raft_consensus.cc:493] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.441975 30778 raft_consensus.cc:515] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.443199 30593 tablet_bootstrap.cc:492] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:12.443712 30593 ts_tablet_manager.cc:1403] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.018s
I20260709 13:09:12.435510 30290 leader_election.cc:304] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:12.444062 30778 leader_election.cc:290] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:12.452481 30595 ts_tablet_manager.cc:1434] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 13:09:12.446127 30221 catalog_manager.cc:5697] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.456009 30595 tablet_bootstrap.cc:492] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:12.455942 30786 raft_consensus.cc:2804] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.460538 30786 raft_consensus.cc:697] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:12.461635 30786 consensus_queue.cc:237] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.469141 30593 raft_consensus.cc:359] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.469859 30593 raft_consensus.cc:385] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.472080 30750 raft_consensus.cc:493] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.472513 30650 consensus_queue.cc:1048] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.472579 30750 raft_consensus.cc:515] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.475059 30750 leader_election.cc:290] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:12.475904 30546 raft_consensus.cc:2468] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:12.476111 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.477411 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:12.477641 30513 leader_election.cc:343] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.478209 30474 raft_consensus.cc:2393] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:12.479379 30595 tablet_bootstrap.cc:654] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.470997 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.470108 30593 raft_consensus.cc:740] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.485423 30602 tablet_bootstrap.cc:654] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.485416 30593 consensus_queue.cc:260] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.494719 30593 ts_tablet_manager.cc:1434] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
W20260709 13:09:12.495409 30513 leader_election.cc:343] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.495920 30513 leader_election.cc:304] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:12.496956 30617 raft_consensus.cc:2749] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.496965 30778 raft_consensus.cc:2749] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.499173 30595 tablet_bootstrap.cc:492] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:12.499727 30595 ts_tablet_manager.cc:1403] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.006s
I20260709 13:09:12.503101 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.504419 30596 tablet_bootstrap.cc:492] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:12.504902 30596 ts_tablet_manager.cc:1403] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.001s
I20260709 13:09:12.506318 30750 consensus_queue.cc:1048] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.507542 30596 raft_consensus.cc:359] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.508236 30596 raft_consensus.cc:385] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.508502 30596 raft_consensus.cc:740] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.509922 30596 consensus_queue.cc:260] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.510067 30609 consensus_queue.cc:1048] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.510922 30595 raft_consensus.cc:359] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.511588 30595 raft_consensus.cc:385] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.511875 30595 raft_consensus.cc:740] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.512509 30595 consensus_queue.cc:260] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.513449 30593 tablet_bootstrap.cc:492] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:12.518483 30365 leader_election.cc:304] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:12.523087 30596 ts_tablet_manager.cc:1434] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:09:12.524029 30596 tablet_bootstrap.cc:492] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:12.498739 30400 raft_consensus.cc:3060] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.524679 30593 tablet_bootstrap.cc:654] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.528719 30595 ts_tablet_manager.cc:1434] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:09:12.529686 30595 tablet_bootstrap.cc:492] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:12.537806 30596 tablet_bootstrap.cc:654] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.537871 30593 tablet_bootstrap.cc:492] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:12.540382 30593 ts_tablet_manager.cc:1403] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:09:12.543089 30602 tablet_bootstrap.cc:492] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:12.543797 30602 ts_tablet_manager.cc:1403] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.008s
I20260709 13:09:12.543187 30593 raft_consensus.cc:359] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.544214 30593 raft_consensus.cc:385] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.544553 30593 raft_consensus.cc:740] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.545365 30593 consensus_queue.cc:260] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.546905 30602 raft_consensus.cc:359] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.547554 30602 raft_consensus.cc:385] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.547921 30593 ts_tablet_manager.cc:1434] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:12.549105 30593 tablet_bootstrap.cc:492] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:12.550293 30595 tablet_bootstrap.cc:654] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.547822 30602 raft_consensus.cc:740] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.551860 30602 consensus_queue.cc:260] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.541668 30221 catalog_manager.cc:5697] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.555361 30593 tablet_bootstrap.cc:654] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.556156 30602 ts_tablet_manager.cc:1434] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:09:12.557175 30602 tablet_bootstrap.cc:492] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:12.560529 30629 raft_consensus.cc:2749] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.562932 30786 raft_consensus.cc:493] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.563490 30786 raft_consensus.cc:515] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.565552 30786 leader_election.cc:290] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:12.567807 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b2be94e304b6089db69b7e298b414" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:12.568661 30596 tablet_bootstrap.cc:492] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:12.569159 30596 ts_tablet_manager.cc:1403] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.003s
I20260709 13:09:12.570179 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b2be94e304b6089db69b7e298b414" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
W20260709 13:09:12.571640 30291 leader_election.cc:343] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.571775 30596 raft_consensus.cc:359] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:12.572299 30291 leader_election.cc:343] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.572451 30596 raft_consensus.cc:385] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.572744 30596 raft_consensus.cc:740] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.572747 30291 leader_election.cc:304] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:12.573798 30744 raft_consensus.cc:2749] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.579406 30593 tablet_bootstrap.cc:492] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:12.579914 30593 ts_tablet_manager.cc:1403] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.002s
I20260709 13:09:12.587504 30593 raft_consensus.cc:359] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.588153 30593 raft_consensus.cc:385] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.588462 30593 raft_consensus.cc:740] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.589211 30593 consensus_queue.cc:260] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.589746 30609 consensus_queue.cc:1048] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.591355 30596 consensus_queue.cc:260] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.598243 30593 ts_tablet_manager.cc:1434] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:09:12.603005 30593 tablet_bootstrap.cc:492] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:12.607517 30596 ts_tablet_manager.cc:1434] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:09:12.605943 30670 raft_consensus.cc:493] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.610888 30670 raft_consensus.cc:515] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.611744 30596 tablet_bootstrap.cc:492] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:12.615051 30593 tablet_bootstrap.cc:654] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.615134 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d42d01b36c4d8d97b27f7cb0a7d177" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.612921 30670 leader_election.cc:290] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:12.620335 30596 tablet_bootstrap.cc:654] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.637179 30778 raft_consensus.cc:493] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.639904 30778 raft_consensus.cc:515] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.640964 30683 consensus_queue.cc:1048] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.643086 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb089b78d6b94082a36b55b40736d58b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.644486 30602 tablet_bootstrap.cc:654] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.644819 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d42d01b36c4d8d97b27f7cb0a7d177" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.641924 30778 leader_election.cc:290] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:12.646634 30750 consensus_queue.cc:1048] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.648049 30595 tablet_bootstrap.cc:492] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:12.648524 30595 ts_tablet_manager.cc:1403] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.119s	user 0.010s	sys 0.023s
W20260709 13:09:12.649106 30513 leader_election.cc:343] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.647585 30609 consensus_queue.cc:1048] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:12.650512 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb089b78d6b94082a36b55b40736d58b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:12.651165 30595 raft_consensus.cc:359] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.651834 30595 raft_consensus.cc:385] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.652087 30595 raft_consensus.cc:740] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.652720 30595 consensus_queue.cc:260] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.653004 30439 leader_election.cc:304] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:12.654325 30617 raft_consensus.cc:2749] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.654757 30595 ts_tablet_manager.cc:1434] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 13:09:12.655012 30514 leader_election.cc:343] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.655666 30595 tablet_bootstrap.cc:492] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:12.655499 30514 leader_election.cc:304] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:12.660363 30474 raft_consensus.cc:3060] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.662245 30595 tablet_bootstrap.cc:654] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.662329 30683 raft_consensus.cc:2749] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.671212 30593 tablet_bootstrap.cc:492] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:12.671882 30593 ts_tablet_manager.cc:1403] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.016s
I20260709 13:09:12.688621 30593 raft_consensus.cc:359] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.689519 30593 raft_consensus.cc:385] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.689949 30593 raft_consensus.cc:740] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.693593 30593 consensus_queue.cc:260] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.695055 30753 consensus_queue.cc:1048] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.697808 30593 ts_tablet_manager.cc:1434] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 13:09:12.699309 30593 tablet_bootstrap.cc:492] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:12.714241 30473 raft_consensus.cc:3060] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.716941 30602 tablet_bootstrap.cc:492] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:12.717453 30602 ts_tablet_manager.cc:1403] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.161s	user 0.012s	sys 0.001s
I20260709 13:09:12.720706 30602 raft_consensus.cc:359] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.721370 30602 raft_consensus.cc:385] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.721714 30602 raft_consensus.cc:740] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.722368 30602 consensus_queue.cc:260] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.723162 30593 tablet_bootstrap.cc:654] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.711732 30683 raft_consensus.cc:493] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.726778 30670 raft_consensus.cc:493] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.728421 30753 raft_consensus.cc:493] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.729017 30753 raft_consensus.cc:515] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.726073 30683 raft_consensus.cc:515] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:12.745148 30670 raft_consensus.cc:515] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.747253 30670 leader_election.cc:290] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:12.749413 30602 ts_tablet_manager.cc:1434] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:09:12.750401 30602 tablet_bootstrap.cc:492] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:12.757112 30750 raft_consensus.cc:493] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.757429 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93781ed772e74585ac49edeea6eb0421" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:12.757592 30750 raft_consensus.cc:515] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:12.758383 30807 log.cc:927] Time spent T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:09:12.758293 30472 raft_consensus.cc:2468] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:12.759817 30750 leader_election.cc:290] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:12.759969 30366 leader_election.cc:304] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:12.760730 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93781ed772e74585ac49edeea6eb0421" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.761399 30324 raft_consensus.cc:2468] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:12.762091 30630 raft_consensus.cc:2804] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.762534 30630 raft_consensus.cc:493] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.762902 30630 raft_consensus.cc:3060] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.762691 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.748631 30595 tablet_bootstrap.cc:492] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:12.766760 30595 ts_tablet_manager.cc:1403] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.021s
I20260709 13:09:12.748608 30753 leader_election.cc:290] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:12.794996 30596 tablet_bootstrap.cc:492] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:12.795656 30596 ts_tablet_manager.cc:1403] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.188s	user 0.014s	sys 0.008s
I20260709 13:09:12.798216 30638 raft_consensus.cc:493] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.802726 30638 raft_consensus.cc:515] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
W20260709 13:09:12.806123 30513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:32987, user_credentials={real_user=slave}} blocked reactor thread for 75444.9us
I20260709 13:09:12.806450 30778 raft_consensus.cc:493] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.807209 30778 raft_consensus.cc:515] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:12.807787 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.807591 30813 consensus_queue.cc:1048] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.809617 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.826869 30683 leader_election.cc:290] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:12.842834 30596 raft_consensus.cc:359] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.843598 30596 raft_consensus.cc:385] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.843848 30596 raft_consensus.cc:740] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.844456 30596 consensus_queue.cc:260] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.846827 30326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.847326 30638 leader_election.cc:290] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:12.847496 30326 raft_consensus.cc:2468] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:12.854270 30630 raft_consensus.cc:515] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.854669 30326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978a4cca1c0a4046aa9666eec4400b95" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:12.855553 30326 raft_consensus.cc:2468] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:12.856431 30630 leader_election.cc:290] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:12.857743 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93781ed772e74585ac49edeea6eb0421" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
W20260709 13:09:12.838333 30513 leader_election.cc:343] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.858390 30475 raft_consensus.cc:3060] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.862586 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978a4cca1c0a4046aa9666eec4400b95" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.863343 30546 raft_consensus.cc:2468] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:12.864538 30439 leader_election.cc:304] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:12.865962 30670 raft_consensus.cc:2804] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.866425 30670 raft_consensus.cc:493] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.866813 30670 raft_consensus.cc:3060] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.872850 30440 leader_election.cc:304] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:12.874408 30617 raft_consensus.cc:2749] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.877652 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.880087 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:12.896414 30475 raft_consensus.cc:2468] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:12.897425 30786 consensus_queue.cc:1048] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.903244 30326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93781ed772e74585ac49edeea6eb0421" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
W20260709 13:09:12.906038 30513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 46140.5us
I20260709 13:09:12.913614 30596 ts_tablet_manager.cc:1434] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.118s	user 0.006s	sys 0.003s
I20260709 13:09:12.910722 30602 tablet_bootstrap.cc:654] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.838842 30778 leader_election.cc:290] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:12.915732 30596 tablet_bootstrap.cc:492] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:12.917330 30326 raft_consensus.cc:3060] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.935446 30595 raft_consensus.cc:359] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.938263 30595 raft_consensus.cc:385] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.938499 30595 raft_consensus.cc:740] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.939586 30595 consensus_queue.cc:260] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.917937 30365 leader_election.cc:304] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:12.943985 30595 ts_tablet_manager.cc:1434] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.176s	user 0.006s	sys 0.001s
W20260709 13:09:12.938966 30513 leader_election.cc:343] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.945549 30595 tablet_bootstrap.cc:492] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
W20260709 13:09:12.933602 30514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42903, user_credentials={real_user=slave}} blocked reactor thread for 138696us
I20260709 13:09:12.932567 30366 leader_election.cc:304] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:12.947674 30513 leader_election.cc:304] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
W20260709 13:09:12.951251 30513 leader_election.cc:343] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.951905 30326 raft_consensus.cc:2468] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:12.952096 30818 raft_consensus.cc:2749] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.960752 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:12.961493 30547 raft_consensus.cc:2468] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:12.964161 30595 tablet_bootstrap.cc:654] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:12.964773 30365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 51328.2us
I20260709 13:09:12.967687 30816 raft_consensus.cc:2804] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.971498 30753 raft_consensus.cc:2804] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.971640 30670 raft_consensus.cc:515] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:12.972009 30753 raft_consensus.cc:697] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:12.973018 30753 consensus_queue.cc:237] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:12.975147 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978a4cca1c0a4046aa9666eec4400b95" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:12.975739 30325 raft_consensus.cc:3060] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.968052 30816 raft_consensus.cc:493] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.982676 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978a4cca1c0a4046aa9666eec4400b95" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:12.983353 30548 raft_consensus.cc:3060] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.984432 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:12.980350 30816 raft_consensus.cc:3060] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.990365 30670 leader_election.cc:290] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:12.992857 30593 tablet_bootstrap.cc:492] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:12.993348 30593 ts_tablet_manager.cc:1403] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.294s	user 0.009s	sys 0.013s
I20260709 13:09:12.996472 30325 raft_consensus.cc:2468] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:12.998219 30439 leader_election.cc:304] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:12.998517 30548 raft_consensus.cc:2468] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:13.001746 30670 raft_consensus.cc:2804] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.005256 30670 raft_consensus.cc:697] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
W20260709 13:09:13.016592 30514 leader_election.cc:343] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.012583 30593 raft_consensus.cc:359] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.019450 30593 raft_consensus.cc:385] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.019492 30821 consensus_queue.cc:1048] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.019907 30593 raft_consensus.cc:740] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.011981 30670 consensus_queue.cc:237] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.019907 30596 tablet_bootstrap.cc:654] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.020741 30593 consensus_queue.cc:260] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.021643 30514 leader_election.cc:304] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.026297 30683 raft_consensus.cc:2749] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.028321 30593 ts_tablet_manager.cc:1434] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:09:13.029489 30593 tablet_bootstrap.cc:492] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:13.034449 30602 tablet_bootstrap.cc:492] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:13.035387 30595 tablet_bootstrap.cc:492] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:13.036299 30595 ts_tablet_manager.cc:1403] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.006s
I20260709 13:09:13.036341 30602 ts_tablet_manager.cc:1403] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.286s	user 0.012s	sys 0.009s
I20260709 13:09:13.036316 30593 tablet_bootstrap.cc:654] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.030416 30821 consensus_queue.cc:1048] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:13.005138 30816 raft_consensus.cc:515] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.043660 30816 leader_election.cc:290] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:13.056465 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:13.057209 30325 raft_consensus.cc:3060] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.058014 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:13.058712 30549 raft_consensus.cc:3060] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:13.059973 30271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:13.063903 30595 raft_consensus.cc:359] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.064268 30821 raft_consensus.cc:493] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.064653 30595 raft_consensus.cc:385] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.065438 30595 raft_consensus.cc:740] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.068492 30595 consensus_queue.cc:260] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.077983 30595 ts_tablet_manager.cc:1434] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 13:09:13.078896 30595 tablet_bootstrap.cc:492] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:13.068132 30821 raft_consensus.cc:515] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.087841 30650 raft_consensus.cc:493] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.089107 30650 raft_consensus.cc:515] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.095886 30821 leader_election.cc:290] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:13.096454 30821 consensus_queue.cc:1048] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.098613 30549 raft_consensus.cc:2468] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:13.099444 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:13.100057 30398 raft_consensus.cc:2468] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:13.100185 30650 leader_election.cc:290] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:13.102479 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.102738 30290 leader_election.cc:304] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:13.103602 30786 raft_consensus.cc:2804] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.103669 30366 leader_election.cc:304] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:13.104029 30786 raft_consensus.cc:493] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.104415 30786 raft_consensus.cc:3060] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.104549 30816 raft_consensus.cc:2804] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.105136 30816 raft_consensus.cc:697] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:13.105818 30816 consensus_queue.cc:237] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.101245 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.102988 30596 tablet_bootstrap.cc:492] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:13.101110 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:13.109128 30596 ts_tablet_manager.cc:1403] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.195s	user 0.017s	sys 0.007s
I20260709 13:09:13.110458 30602 raft_consensus.cc:359] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.111068 30602 raft_consensus.cc:385] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.111272 30602 raft_consensus.cc:740] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
W20260709 13:09:13.112383 30291 leader_election.cc:343] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:13.113088 30291 leader_election.cc:343] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.117739 30786 raft_consensus.cc:515] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.119437 30595 tablet_bootstrap.cc:654] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.128499 30817 raft_consensus.cc:493] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.129004 30817 raft_consensus.cc:515] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.130029 30325 raft_consensus.cc:2468] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:13.134351 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb089b78d6b94082a36b55b40736d58b" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.134531 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb089b78d6b94082a36b55b40736d58b" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:13.135185 30546 raft_consensus.cc:2468] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
W20260709 13:09:13.136708 30290 leader_election.cc:343] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.136859 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:13.137553 30401 raft_consensus.cc:3060] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.137478 30290 leader_election.cc:304] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.139233 30366 leader_election.cc:304] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:13.140074 30753 raft_consensus.cc:2804] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.140455 30753 raft_consensus.cc:493] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.140777 30753 raft_consensus.cc:3060] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.141490 30821 raft_consensus.cc:2749] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.143059 30224 catalog_manager.cc:5697] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.144593 30786 leader_election.cc:290] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:13.147032 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:13.144731 30401 raft_consensus.cc:2468] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
W20260709 13:09:13.149212 30291 leader_election.cc:343] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.150261 30290 leader_election.cc:304] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.151288 30821 raft_consensus.cc:2804] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.151901 30821 raft_consensus.cc:697] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:13.152982 30821 consensus_queue.cc:237] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.153692 30817 leader_election.cc:290] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:13.153178 30753 raft_consensus.cc:515] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.157459 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb089b78d6b94082a36b55b40736d58b" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:13.134913 30602 consensus_queue.cc:260] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.162578 30473 raft_consensus.cc:2468] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:13.168660 30602 ts_tablet_manager.cc:1434] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.001s
I20260709 13:09:13.169862 30602 tablet_bootstrap.cc:492] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:13.180408 30223 catalog_manager.cc:5697] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.188874 30595 tablet_bootstrap.cc:492] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:13.189386 30595 ts_tablet_manager.cc:1403] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.000s
I20260709 13:09:13.189670 30596 raft_consensus.cc:359] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.190392 30596 raft_consensus.cc:385] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.190634 30596 raft_consensus.cc:740] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.191249 30596 consensus_queue.cc:260] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.192121 30595 raft_consensus.cc:359] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.192737 30753 leader_election.cc:290] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:13.193545 30596 ts_tablet_manager.cc:1434] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.000s
I20260709 13:09:13.194532 30596 tablet_bootstrap.cc:492] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:13.194891 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb089b78d6b94082a36b55b40736d58b" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:13.195637 30549 raft_consensus.cc:3060] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.192755 30595 raft_consensus.cc:385] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.197706 30595 raft_consensus.cc:740] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.204588 30602 tablet_bootstrap.cc:654] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.212721 30595 consensus_queue.cc:260] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.215026 30595 ts_tablet_manager.cc:1434] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:09:13.216182 30595 tablet_bootstrap.cc:492] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:13.219923 30549 raft_consensus.cc:2468] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:13.221153 30820 raft_consensus.cc:493] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.221313 30366 leader_election.cc:304] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.221689 30820 raft_consensus.cc:515] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.223281 30753 raft_consensus.cc:2804] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.223856 30820 leader_election.cc:290] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:13.223928 30753 raft_consensus.cc:697] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:13.225208 30753 consensus_queue.cc:237] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.227075 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b2be94e304b6089db69b7e298b414" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.227856 30593 tablet_bootstrap.cc:492] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:13.228345 30593 ts_tablet_manager.cc:1403] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.199s	user 0.015s	sys 0.020s
I20260709 13:09:13.228648 30816 raft_consensus.cc:493] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.229255 30816 raft_consensus.cc:515] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
W20260709 13:09:13.230557 30514 leader_election.cc:343] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.231994 30593 raft_consensus.cc:359] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.232808 30593 raft_consensus.cc:385] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.233008 30816 leader_election.cc:290] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:13.233143 30593 raft_consensus.cc:740] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.233424 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b2be94e304b6089db69b7e298b414" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:13.234112 30325 raft_consensus.cc:2468] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:13.234633 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.234753 30593 consensus_queue.cc:260] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.235507 30513 leader_election.cc:304] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.236585 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:13.237186 30820 raft_consensus.cc:2804] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.237985 30820 raft_consensus.cc:493] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.238318 30820 raft_consensus.cc:3060] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.239096 30593 ts_tablet_manager.cc:1434] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:09:13.240487 30593 tablet_bootstrap.cc:492] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:13.245038 30820 raft_consensus.cc:515] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.237186 30549 raft_consensus.cc:2468] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:13.248405 30595 tablet_bootstrap.cc:654] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.235817 30596 tablet_bootstrap.cc:654] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:13.236002 30366 leader_election.cc:343] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.253607 30366 leader_election.cc:304] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.254719 30816 raft_consensus.cc:2804] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.255266 30816 raft_consensus.cc:493] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.255609 30816 raft_consensus.cc:3060] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.255980 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b2be94e304b6089db69b7e298b414" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:13.256713 30325 raft_consensus.cc:3060] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.254665 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268b2be94e304b6089db69b7e298b414" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
W20260709 13:09:13.263185 30514 leader_election.cc:343] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.263751 30816 raft_consensus.cc:515] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.266471 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:13.267370 30602 tablet_bootstrap.cc:492] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:13.267850 30602 ts_tablet_manager.cc:1403] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.007s
W20260709 13:09:13.268900 30366 leader_election.cc:343] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.269095 30820 leader_election.cc:290] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:13.270498 30602 raft_consensus.cc:359] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.271198 30602 raft_consensus.cc:385] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.271471 30602 raft_consensus.cc:740] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.272135 30593 tablet_bootstrap.cc:654] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.272672 30816 leader_election.cc:290] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:13.275167 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:13.275584 30602 consensus_queue.cc:260] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.275916 30549 raft_consensus.cc:3060] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.278083 30602 ts_tablet_manager.cc:1434] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:09:13.279022 30602 tablet_bootstrap.cc:492] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:13.272894 30325 raft_consensus.cc:2468] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:13.281634 30513 leader_election.cc:304] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.284922 30820 raft_consensus.cc:2804] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.285506 30820 raft_consensus.cc:697] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:13.285776 30638 raft_consensus.cc:493] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.286254 30638 raft_consensus.cc:515] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.288331 30638 leader_election.cc:290] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:13.289831 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:13.290663 30398 raft_consensus.cc:2393] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:13.291647 30820 consensus_queue.cc:237] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.294581 30549 raft_consensus.cc:2468] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:13.300117 30366 leader_election.cc:304] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.301815 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:13.302918 30753 raft_consensus.cc:2804] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.303565 30439 leader_election.cc:304] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:13.304934 30638 raft_consensus.cc:3060] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.303607 30753 raft_consensus.cc:697] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:13.306903 30753 consensus_queue.cc:237] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.312958 30596 tablet_bootstrap.cc:492] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:13.317371 30638 raft_consensus.cc:2749] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.319006 30596 ts_tablet_manager.cc:1403] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.125s	user 0.020s	sys 0.020s
I20260709 13:09:13.314445 30595 tablet_bootstrap.cc:492] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:13.319949 30595 ts_tablet_manager.cc:1403] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.000s
I20260709 13:09:13.320676 30593 tablet_bootstrap.cc:492] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:13.321194 30593 ts_tablet_manager.cc:1403] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.002s
I20260709 13:09:13.321767 30602 tablet_bootstrap.cc:654] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.322921 30595 raft_consensus.cc:359] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.323601 30595 raft_consensus.cc:385] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.323871 30595 raft_consensus.cc:740] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.324342 30593 raft_consensus.cc:359] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.327399 30593 raft_consensus.cc:385] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.327766 30593 raft_consensus.cc:740] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.328464 30593 consensus_queue.cc:260] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.321843 30596 raft_consensus.cc:359] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.329466 30596 raft_consensus.cc:385] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.329828 30596 raft_consensus.cc:740] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.330577 30596 consensus_queue.cc:260] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.324733 30595 consensus_queue.cc:260] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.333875 30595 ts_tablet_manager.cc:1434] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:13.336495 30596 ts_tablet_manager.cc:1434] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:13.338864 30596 tablet_bootstrap.cc:492] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:13.338989 30821 raft_consensus.cc:493] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.339486 30821 raft_consensus.cc:515] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.341501 30821 leader_election.cc:290] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:13.343133 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:13.346956 30549 raft_consensus.cc:2468] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:13.347127 30596 tablet_bootstrap.cc:654] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.348567 30291 leader_election.cc:304] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:13.349447 30821 raft_consensus.cc:2804] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.349879 30821 raft_consensus.cc:493] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.351270 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:13.337337 30595 tablet_bootstrap.cc:492] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:13.337919 30593 ts_tablet_manager.cc:1434] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:09:13.354322 30593 tablet_bootstrap.cc:492] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
W20260709 13:09:13.357045 30290 leader_election.cc:343] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.358314 30650 raft_consensus.cc:493] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.358943 30650 raft_consensus.cc:515] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.361663 30650 leader_election.cc:290] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:13.363613 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
W20260709 13:09:13.365270 30291 leader_election.cc:343] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.367336 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
W20260709 13:09:13.369454 30290 leader_election.cc:343] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.370033 30290 leader_election.cc:304] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:13.372138 30786 raft_consensus.cc:2749] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.374888 30223 catalog_manager.cc:5697] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.350309 30821 raft_consensus.cc:3060] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.378749 30593 tablet_bootstrap.cc:654] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.383100 30221 catalog_manager.cc:5697] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.376899 30223 catalog_manager.cc:5697] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.411847 30595 tablet_bootstrap.cc:654] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.412875 30821 raft_consensus.cc:515] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.407666 30223 catalog_manager.cc:5697] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.416905 30816 consensus_queue.cc:1048] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.417263 30593 tablet_bootstrap.cc:492] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:13.417862 30593 ts_tablet_manager.cc:1403] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.003s
I20260709 13:09:13.420696 30602 tablet_bootstrap.cc:492] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:13.421205 30602 ts_tablet_manager.cc:1403] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.142s	user 0.036s	sys 0.052s
I20260709 13:09:13.420513 30593 raft_consensus.cc:359] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.421948 30593 raft_consensus.cc:385] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.423985 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:13.423733 30593 raft_consensus.cc:740] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.424754 30548 raft_consensus.cc:3060] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.425474 30593 consensus_queue.cc:260] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.423166 30821 leader_election.cc:290] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:13.429661 30593 ts_tablet_manager.cc:1434] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:13.432127 30593 tablet_bootstrap.cc:492] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:13.434075 30548 raft_consensus.cc:2468] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:13.423892 30602 raft_consensus.cc:359] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.435353 30602 raft_consensus.cc:385] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.435664 30602 raft_consensus.cc:740] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.436590 30602 consensus_queue.cc:260] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.438519 30596 tablet_bootstrap.cc:492] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:13.439061 30596 ts_tablet_manager.cc:1403] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.042s
I20260709 13:09:13.441833 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:13.443930 30291 leader_election.cc:304] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:13.441745 30596 raft_consensus.cc:359] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.444825 30596 raft_consensus.cc:385] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.446007 30602 ts_tablet_manager.cc:1434] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:09:13.445155 30596 raft_consensus.cc:740] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.446216 30650 raft_consensus.cc:2804] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.446964 30602 tablet_bootstrap.cc:492] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:13.447113 30596 consensus_queue.cc:260] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.451709 30817 consensus_queue.cc:1048] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:13.453187 30290 leader_election.cc:343] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.453531 30602 tablet_bootstrap.cc:654] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.455435 30596 ts_tablet_manager.cc:1434] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:09:13.456532 30596 tablet_bootstrap.cc:492] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:13.449241 30593 tablet_bootstrap.cc:654] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.458431 30221 catalog_manager.cc:5697] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.447181 30650 raft_consensus.cc:697] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:13.460207 30650 consensus_queue.cc:237] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.467347 30617 consensus_queue.cc:1048] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.473428 30596 tablet_bootstrap.cc:654] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.480997 30593 tablet_bootstrap.cc:492] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:13.484107 30593 ts_tablet_manager.cc:1403] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.009s
I20260709 13:09:13.484685 30595 tablet_bootstrap.cc:492] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:13.485327 30595 ts_tablet_manager.cc:1403] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.004s
I20260709 13:09:13.488040 30593 raft_consensus.cc:359] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.490474 30593 raft_consensus.cc:385] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.490846 30593 raft_consensus.cc:740] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.491775 30593 consensus_queue.cc:260] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.495646 30593 ts_tablet_manager.cc:1434] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:09:13.497725 30593 tablet_bootstrap.cc:492] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:13.498420 30817 consensus_queue.cc:1048] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.500231 30223 catalog_manager.cc:5697] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.506422 30753 raft_consensus.cc:493] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.506917 30753 raft_consensus.cc:515] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.507565 30617 consensus_queue.cc:1048] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.511574 30753 leader_election.cc:290] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:13.513346 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:13.515331 30366 leader_election.cc:343] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.516292 30820 raft_consensus.cc:493] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.516804 30820 raft_consensus.cc:515] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.516467 30593 tablet_bootstrap.cc:654] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.519021 30820 leader_election.cc:290] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:13.521404 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.526628 30602 tablet_bootstrap.cc:492] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:13.527673 30602 ts_tablet_manager.cc:1403] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.008s
W20260709 13:09:13.527941 30514 leader_election.cc:343] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.551893 30326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:13.488792 30595 raft_consensus.cc:359] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.560099 30595 raft_consensus.cc:385] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.560354 30595 raft_consensus.cc:740] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.561228 30593 tablet_bootstrap.cc:492] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:13.561008 30595 consensus_queue.cc:260] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.561858 30593 ts_tablet_manager.cc:1403] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.005s
I20260709 13:09:13.555255 30602 raft_consensus.cc:359] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.562848 30602 raft_consensus.cc:385] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.563120 30602 raft_consensus.cc:740] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.563774 30602 consensus_queue.cc:260] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.565671 30602 ts_tablet_manager.cc:1434] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.000s
I20260709 13:09:13.566593 30593 raft_consensus.cc:359] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.567534 30593 raft_consensus.cc:385] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.567934 30593 raft_consensus.cc:740] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.569054 30593 consensus_queue.cc:260] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.571273 30593 ts_tablet_manager.cc:1434] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:13.572489 30593 tablet_bootstrap.cc:492] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:13.583455 30602 tablet_bootstrap.cc:492] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
W20260709 13:09:13.586361 30365 leader_election.cc:343] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.593225 30593 tablet_bootstrap.cc:654] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.606031 30596 tablet_bootstrap.cc:492] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:13.606612 30596 ts_tablet_manager.cc:1403] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.150s	user 0.032s	sys 0.027s
I20260709 13:09:13.610899 30602 tablet_bootstrap.cc:654] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.612484 30596 raft_consensus.cc:359] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.614409 30596 raft_consensus.cc:385] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.615185 30595 ts_tablet_manager.cc:1434] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.129s	user 0.004s	sys 0.004s
I20260709 13:09:13.616629 30595 tablet_bootstrap.cc:492] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:13.614684 30596 raft_consensus.cc:740] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.617874 30596 consensus_queue.cc:260] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.597659 30365 leader_election.cc:304] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:13.622563 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
W20260709 13:09:13.624584 30513 leader_election.cc:343] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.625115 30513 leader_election.cc:304] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.626717 30753 raft_consensus.cc:2749] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.633000 30820 raft_consensus.cc:2749] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.640003 30753 consensus_queue.cc:1048] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.640852 30650 raft_consensus.cc:493] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.641434 30650 raft_consensus.cc:515] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.643679 30650 leader_election.cc:290] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:13.648133 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.648660 30593 tablet_bootstrap.cc:492] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:13.649168 30593 ts_tablet_manager.cc:1403] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.013s
I20260709 13:09:13.651885 30595 tablet_bootstrap.cc:654] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.653741 30753 raft_consensus.cc:493] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.654232 30753 raft_consensus.cc:515] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.656234 30753 leader_election.cc:290] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:13.658135 30593 raft_consensus.cc:359] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.659030 30593 raft_consensus.cc:385] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.659235 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.659663 30593 raft_consensus.cc:740] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.658526 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:13.661542 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:13.662269 30398 raft_consensus.cc:2468] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:13.660598 30593 consensus_queue.cc:260] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:13.662740 30366 leader_election.cc:343] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:13.663527 30366 leader_election.cc:343] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.664141 30290 leader_election.cc:304] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:13.662732 30638 raft_consensus.cc:493] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.665035 30366 leader_election.cc:304] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.665257 30638 raft_consensus.cc:515] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.666309 30596 ts_tablet_manager.cc:1434] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:09:13.667265 30596 tablet_bootstrap.cc:492] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:13.667575 30638 leader_election.cc:290] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:13.668931 30816 raft_consensus.cc:2749] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.669132 30821 raft_consensus.cc:2804] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.669575 30821 raft_consensus.cc:493] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.671577 30473 raft_consensus.cc:3060] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.669937 30821 raft_consensus.cc:3060] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.672621 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:13.673390 30547 raft_consensus.cc:2393] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:13.675299 30813 raft_consensus.cc:493] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.675781 30813 raft_consensus.cc:515] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.677675 30813 leader_election.cc:290] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:13.680032 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b58667a160f4c47bca188153bae9969" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.680683 30472 raft_consensus.cc:2468] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:13.682467 30602 tablet_bootstrap.cc:492] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:13.682546 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b58667a160f4c47bca188153bae9969" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:13.683004 30514 leader_election.cc:304] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:13.689937 30325 raft_consensus.cc:2468] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:13.690632 30820 raft_consensus.cc:2804] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.690994 30820 raft_consensus.cc:493] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.691289 30820 raft_consensus.cc:3060] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.694288 30602 ts_tablet_manager.cc:1403] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.112s	user 0.010s	sys 0.003s
I20260709 13:09:13.699644 30602 raft_consensus.cc:359] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.706593 30602 raft_consensus.cc:385] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.709457 30602 raft_consensus.cc:740] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.709802 30595 tablet_bootstrap.cc:492] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
W20260709 13:09:13.686981 30291 leader_election.cc:343] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.710666 30602 consensus_queue.cc:260] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.683419 30593 ts_tablet_manager.cc:1434] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:09:13.701917 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:13.713862 30593 tablet_bootstrap.cc:492] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:13.704607 30821 raft_consensus.cc:515] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.715802 30821 leader_election.cc:290] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:13.717523 30602 ts_tablet_manager.cc:1434] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:09:13.732933 30602 tablet_bootstrap.cc:492] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:13.733062 30638 raft_consensus.cc:493] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.733613 30638 raft_consensus.cc:515] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.734239 30593 tablet_bootstrap.cc:654] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.735847 30638 leader_election.cc:290] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:13.737617 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
W20260709 13:09:13.739583 30440 leader_election.cc:343] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.704703 30820 raft_consensus.cc:515] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.741746 30820 leader_election.cc:290] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:13.741865 30865 consensus_queue.cc:1048] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.720122 30596 tablet_bootstrap.cc:654] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.685580 30753 consensus_queue.cc:1048] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.743415 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b58667a160f4c47bca188153bae9969" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:13.713933 30595 ts_tablet_manager.cc:1403] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.011s
I20260709 13:09:13.722437 30439 leader_election.cc:304] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:13.743999 30473 raft_consensus.cc:3060] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.723273 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:13.745446 30398 raft_consensus.cc:3060] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.747098 30617 raft_consensus.cc:3060] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.726924 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:13.750285 30817 consensus_queue.cc:1048] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.747126 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b58667a160f4c47bca188153bae9969" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:13.751582 30325 raft_consensus.cc:3060] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.751658 30326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:13.709714 30650 raft_consensus.cc:493] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.754446 30650 raft_consensus.cc:515] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.756698 30650 leader_election.cc:290] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:13.759150 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc31bc49093420ba42ce2487858ce2b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:13.760890 30473 raft_consensus.cc:2468] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
W20260709 13:09:13.761193 30290 leader_election.cc:343] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.762090 30650 consensus_queue.cc:1048] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.762323 30514 leader_election.cc:304] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:13.764134 30813 raft_consensus.cc:2804] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.764671 30813 raft_consensus.cc:697] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:13.765769 30593 tablet_bootstrap.cc:492] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:13.766407 30593 ts_tablet_manager.cc:1403] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.018s
I20260709 13:09:13.765823 30813 consensus_queue.cc:237] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.769398 30593 raft_consensus.cc:359] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.770040 30593 raft_consensus.cc:385] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.770313 30593 raft_consensus.cc:740] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.771003 30593 consensus_queue.cc:260] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.771929 30753 consensus_queue.cc:1048] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.773083 30593 ts_tablet_manager.cc:1434] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:13.773983 30593 tablet_bootstrap.cc:492] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:13.779901 30593 tablet_bootstrap.cc:654] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:13.783157 30439 leader_election.cc:343] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.783229 30398 raft_consensus.cc:2468] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:13.785380 30439 leader_election.cc:304] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:13.787175 30670 raft_consensus.cc:2749] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.739776 30602 tablet_bootstrap.cc:654] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.795871 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc31bc49093420ba42ce2487858ce2b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:13.792291 30290 leader_election.cc:304] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:13.799973 30325 raft_consensus.cc:2468] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:13.800908 30821 raft_consensus.cc:2804] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.801621 30821 raft_consensus.cc:697] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:13.806818 30821 consensus_queue.cc:237] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.825078 30617 raft_consensus.cc:2749] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.834306 30753 consensus_queue.cc:1048] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.846370 30786 raft_consensus.cc:493] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.846877 30786 raft_consensus.cc:515] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:13.848965 30786 leader_election.cc:290] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:13.793458 30595 raft_consensus.cc:359] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.880152 30595 raft_consensus.cc:385] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.882651 30820 consensus_queue.cc:1048] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.893211 30596 tablet_bootstrap.cc:492] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
W20260709 13:09:13.890236 30291 leader_election.cc:343] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.893993 30596 ts_tablet_manager.cc:1403] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.227s	user 0.014s	sys 0.009s
I20260709 13:09:13.880637 30595 raft_consensus.cc:740] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
W20260709 13:09:13.895270 30291 leader_election.cc:343] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.870751 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:13.902411 30595 consensus_queue.cc:260] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.906929 30291 leader_election.cc:304] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:13.907892 30593 tablet_bootstrap.cc:492] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:13.908430 30593 ts_tablet_manager.cc:1403] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.135s	user 0.050s	sys 0.074s
I20260709 13:09:13.911473 30595 ts_tablet_manager.cc:1434] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.000s
I20260709 13:09:13.912454 30595 tablet_bootstrap.cc:492] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:13.916326 30596 raft_consensus.cc:359] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:13.917169 30596 raft_consensus.cc:385] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.917519 30596 raft_consensus.cc:740] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.918922 30596 consensus_queue.cc:260] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
W20260709 13:09:13.924835 30290 leader_election.cc:343] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.909601 30865 raft_consensus.cc:2749] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.934697 30602 tablet_bootstrap.cc:492] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:13.935622 30602 ts_tablet_manager.cc:1403] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.203s	user 0.015s	sys 0.000s
I20260709 13:09:13.949234 30596 ts_tablet_manager.cc:1434] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:09:13.952199 30596 tablet_bootstrap.cc:492] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:13.952282 30221 catalog_manager.cc:5697] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.959486 30602 raft_consensus.cc:359] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.960268 30602 raft_consensus.cc:385] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.960563 30602 raft_consensus.cc:740] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.961305 30602 consensus_queue.cc:260] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.964569 30602 ts_tablet_manager.cc:1434] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:09:13.965512 30602 tablet_bootstrap.cc:492] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:13.968413 30595 tablet_bootstrap.cc:654] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.970008 30817 raft_consensus.cc:493] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.970589 30817 raft_consensus.cc:515] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:13.970894 30514 consensus_peers.cc:597] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.972610 30817 leader_election.cc:290] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:13.973291 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:13.974102 30546 raft_consensus.cc:2393] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:13.974606 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:13.975816 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
W20260709 13:09:13.959930 30877 log.cc:927] Time spent T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:09:13.980883 30291 leader_election.cc:343] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.980909 30222 catalog_manager.cc:5697] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.982204 30786 raft_consensus.cc:493] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.982964 30786 raft_consensus.cc:515] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:13.983880 30593 raft_consensus.cc:359] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.984572 30593 raft_consensus.cc:385] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.984972 30786 leader_election.cc:290] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:13.984969 30593 raft_consensus.cc:740] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.985987 30593 consensus_queue.cc:260] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:13.988531 30291 leader_election.cc:304] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:13.989995 30650 raft_consensus.cc:2749] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.988250 30593 ts_tablet_manager.cc:1434] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.003s
I20260709 13:09:13.990798 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
W20260709 13:09:13.999378 30291 leader_election.cc:343] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.991246 30365 leader_election.cc:304] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:14.001780 30753 raft_consensus.cc:3060] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.991763 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:14.003069 30473 raft_consensus.cc:2468] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:14.003459 30595 tablet_bootstrap.cc:492] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:14.003961 30595 ts_tablet_manager.cc:1403] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.002s
I20260709 13:09:14.006589 30595 raft_consensus.cc:359] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.007364 30595 raft_consensus.cc:385] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.010365 30879 raft_consensus.cc:493] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.992806 30593 tablet_bootstrap.cc:492] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:14.010912 30879 raft_consensus.cc:515] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.012390 30291 leader_election.cc:304] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc
I20260709 13:09:14.014462 30650 raft_consensus.cc:2804] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.014828 30650 raft_consensus.cc:493] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.014925 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:14.015208 30650 raft_consensus.cc:3060] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.015666 30325 raft_consensus.cc:2468] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:14.016782 30513 leader_election.cc:304] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:14.020790 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
W20260709 13:09:14.022295 30513 leader_election.cc:343] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.023048 30879 leader_election.cc:290] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:14.022327 30813 raft_consensus.cc:2804] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.023877 30813 raft_consensus.cc:493] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.024209 30813 raft_consensus.cc:3060] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.025271 30753 raft_consensus.cc:2749] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.995580 30602 tablet_bootstrap.cc:654] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.997031 30596 tablet_bootstrap.cc:654] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.032648 30813 raft_consensus.cc:515] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.034890 30650 raft_consensus.cc:515] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.007695 30595 raft_consensus.cc:740] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.036077 30786 consensus_queue.cc:1048] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.037933 30596 tablet_bootstrap.cc:492] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:14.041785 30596 ts_tablet_manager.cc:1403] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.004s
I20260709 13:09:14.037436 30595 consensus_queue.cc:260] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.045578 30595 ts_tablet_manager.cc:1434] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.001s
I20260709 13:09:14.047240 30813 leader_election.cc:290] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:14.048267 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:14.048533 30650 leader_election.cc:290] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.048813 30325 raft_consensus.cc:3060] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.049202 30595 tablet_bootstrap.cc:492] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:14.051117 30593 tablet_bootstrap.cc:654] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.054939 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
W20260709 13:09:14.056265 30513 leader_election.cc:343] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.058666 30595 tablet_bootstrap.cc:654] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.060196 30325 raft_consensus.cc:2468] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:14.061467 30513 leader_election.cc:304] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:14.063230 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:14.064826 30879 raft_consensus.cc:2804] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:14.065137 30291 leader_election.cc:343] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.065440 30879 raft_consensus.cc:697] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:14.065734 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:14.066326 30473 raft_consensus.cc:3060] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.067610 30879 consensus_queue.cc:237] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.072245 30650 consensus_queue.cc:1048] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.071121 30596 raft_consensus.cc:359] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.074098 30596 raft_consensus.cc:385] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.074460 30596 raft_consensus.cc:740] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.075260 30596 consensus_queue.cc:260] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.091933 30596 ts_tablet_manager.cc:1434] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.000s
I20260709 13:09:14.092023 30602 tablet_bootstrap.cc:492] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:14.095925 30602 ts_tablet_manager.cc:1403] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.131s	user 0.025s	sys 0.030s
I20260709 13:09:14.094391 30473 raft_consensus.cc:2468] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:14.097829 30291 leader_election.cc:304] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc
I20260709 13:09:14.098975 30650 raft_consensus.cc:2804] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.098799 30602 raft_consensus.cc:359] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.099733 30602 raft_consensus.cc:385] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.100104 30602 raft_consensus.cc:740] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.101357 30596 tablet_bootstrap.cc:492] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:14.099852 30650 raft_consensus.cc:697] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:14.103466 30650 consensus_queue.cc:237] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.106043 30602 consensus_queue.cc:260] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.107298 30596 tablet_bootstrap.cc:654] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.112816 30602 ts_tablet_manager.cc:1434] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:14.114151 30602 tablet_bootstrap.cc:492] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:14.114943 30593 tablet_bootstrap.cc:492] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:14.115423 30593 ts_tablet_manager.cc:1403] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.000s
I20260709 13:09:14.117800 30595 tablet_bootstrap.cc:492] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:14.119108 30593 raft_consensus.cc:359] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.119792 30593 raft_consensus.cc:385] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.120042 30593 raft_consensus.cc:740] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.120666 30595 ts_tablet_manager.cc:1403] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.002s
I20260709 13:09:14.122864 30602 tablet_bootstrap.cc:654] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.127360 30593 consensus_queue.cc:260] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.128684 30221 catalog_manager.cc:5697] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.129456 30593 ts_tablet_manager.cc:1434] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:09:14.130394 30593 tablet_bootstrap.cc:492] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:14.134929 30224 catalog_manager.cc:5697] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.123148 30595 raft_consensus.cc:359] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.141427 30595 raft_consensus.cc:385] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.141686 30595 raft_consensus.cc:740] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.146019 30596 tablet_bootstrap.cc:492] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:14.146498 30596 ts_tablet_manager.cc:1403] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:09:14.142437 30595 consensus_queue.cc:260] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.151234 30879 consensus_queue.cc:1048] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.160537 30596 raft_consensus.cc:359] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.161201 30596 raft_consensus.cc:385] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.161464 30596 raft_consensus.cc:740] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.162353 30595 ts_tablet_manager.cc:1434] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:09:14.162051 30596 consensus_queue.cc:260] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.163429 30595 tablet_bootstrap.cc:492] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:14.169916 30593 tablet_bootstrap.cc:654] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.174526 30596 ts_tablet_manager.cc:1434] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:09:14.211977 30596 tablet_bootstrap.cc:492] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:14.217355 30596 tablet_bootstrap.cc:654] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.184815 30879 consensus_queue.cc:1048] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.219694 30602 tablet_bootstrap.cc:492] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:14.220340 30602 ts_tablet_manager.cc:1403] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.106s	user 0.031s	sys 0.032s
I20260709 13:09:14.219655 30595 tablet_bootstrap.cc:654] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.223176 30602 raft_consensus.cc:359] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.223973 30602 raft_consensus.cc:385] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.224315 30602 raft_consensus.cc:740] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.225275 30602 consensus_queue.cc:260] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.227752 30602 ts_tablet_manager.cc:1434] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:14.233839 30602 tablet_bootstrap.cc:492] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:14.237133 30595 tablet_bootstrap.cc:492] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:14.237665 30595 ts_tablet_manager.cc:1403] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.004s
I20260709 13:09:14.239450 30650 raft_consensus.cc:493] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.240108 30650 raft_consensus.cc:515] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.247704 30602 tablet_bootstrap.cc:654] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.247656 30650 leader_election.cc:290] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:14.252722 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe391ca7cf224a87975e01e553aa19cc" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:14.258548 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe391ca7cf224a87975e01e553aa19cc" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:14.259320 30593 tablet_bootstrap.cc:492] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:14.259793 30593 ts_tablet_manager.cc:1403] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.130s	user 0.001s	sys 0.011s
W20260709 13:09:14.268407 30271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:14.265654 30290 leader_election.cc:343] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:14.273522 30291 leader_election.cc:343] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.274084 30291 leader_election.cc:304] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:14.275321 30650 raft_consensus.cc:2749] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.276259 30879 raft_consensus.cc:493] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.276741 30879 raft_consensus.cc:515] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.279188 30879 leader_election.cc:290] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:14.281997 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:14.283658 30514 leader_election.cc:343] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.285383 30820 raft_consensus.cc:493] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.285879 30820 raft_consensus.cc:515] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.287930 30820 leader_election.cc:290] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:14.290289 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:14.291641 30514 leader_election.cc:343] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.292675 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:14.293298 30398 raft_consensus.cc:2468] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:14.293363 30593 raft_consensus.cc:359] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.294051 30593 raft_consensus.cc:385] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.295024 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:14.295200 30595 raft_consensus.cc:359] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.295853 30595 raft_consensus.cc:385] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.296125 30595 raft_consensus.cc:740] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.297042 30602 tablet_bootstrap.cc:492] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:14.296772 30595 consensus_queue.cc:260] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.297518 30602 ts_tablet_manager.cc:1403] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.011s
I20260709 13:09:14.298256 30513 leader_election.cc:304] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
W20260709 13:09:14.299379 30513 leader_election.cc:343] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.299636 30813 raft_consensus.cc:2804] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.299804 30513 leader_election.cc:304] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:14.300076 30813 raft_consensus.cc:493] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.300501 30813 raft_consensus.cc:3060] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.300931 30879 raft_consensus.cc:2749] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.302934 30602 raft_consensus.cc:359] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.303556 30602 raft_consensus.cc:385] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.303825 30602 raft_consensus.cc:740] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.305686 30596 tablet_bootstrap.cc:492] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:14.305919 30753 raft_consensus.cc:493] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.306185 30596 ts_tablet_manager.cc:1403] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.032s
I20260709 13:09:14.306447 30753 raft_consensus.cc:515] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.306775 30473 raft_consensus.cc:3060] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.308525 30753 leader_election.cc:290] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:14.308848 30596 raft_consensus.cc:359] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.309115 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc31bc49093420ba42ce2487858ce2b" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:14.309518 30596 raft_consensus.cc:385] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.309568 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc31bc49093420ba42ce2487858ce2b" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:14.309991 30596 raft_consensus.cc:740] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.309760 30325 raft_consensus.cc:2468] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:14.310420 30472 raft_consensus.cc:2468] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:14.310750 30596 consensus_queue.cc:260] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.312263 30365 leader_election.cc:304] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:14.312886 30596 ts_tablet_manager.cc:1434] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:14.314220 30816 raft_consensus.cc:2804] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.314613 30816 raft_consensus.cc:493] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.314934 30816 raft_consensus.cc:3060] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.321521 30816 raft_consensus.cc:515] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.294368 30593 raft_consensus.cc:740] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.313894 30596 tablet_bootstrap.cc:492] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:14.324029 30813 raft_consensus.cc:515] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.327099 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:14.327026 30593 consensus_queue.cc:260] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.327690 30816 leader_election.cc:290] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:14.327872 30398 raft_consensus.cc:3060] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.324467 30602 consensus_queue.cc:260] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.329236 30595 ts_tablet_manager.cc:1434] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.091s	user 0.004s	sys 0.002s
I20260709 13:09:14.324478 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc31bc49093420ba42ce2487858ce2b" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:14.329787 30475 raft_consensus.cc:3060] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.329957 30602 ts_tablet_manager.cc:1434] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:09:14.330142 30595 tablet_bootstrap.cc:492] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:14.333179 30602 tablet_bootstrap.cc:492] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:14.336478 30475 raft_consensus.cc:2468] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:14.336797 30593 ts_tablet_manager.cc:1434] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.001s
I20260709 13:09:14.337786 30813 leader_election.cc:290] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:14.337664 30366 leader_election.cc:304] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:14.324757 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc31bc49093420ba42ce2487858ce2b" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:14.338620 30817 raft_consensus.cc:2804] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.338984 30325 raft_consensus.cc:3060] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.339102 30817 raft_consensus.cc:697] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:14.340025 30817 consensus_queue.cc:237] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
W20260709 13:09:14.343055 30291 consensus_peers.cc:597] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:14.343497 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:14.345455 30596 tablet_bootstrap.cc:654] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.337692 30593 tablet_bootstrap.cc:492] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:14.350075 30595 tablet_bootstrap.cc:654] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:14.347720 30514 leader_election.cc:343] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.353253 30325 raft_consensus.cc:2468] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:14.357151 30650 raft_consensus.cc:493] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.357347 30602 tablet_bootstrap.cc:654] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.357618 30650 raft_consensus.cc:515] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.359827 30650 leader_election.cc:290] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.362380 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:14.362963 30549 raft_consensus.cc:2468] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:14.367317 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:14.367681 30291 leader_election.cc:304] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:14.366792 30596 tablet_bootstrap.cc:492] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
W20260709 13:09:14.368541 30291 leader_election.cc:343] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.368791 30596 ts_tablet_manager.cc:1403] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.002s
I20260709 13:09:14.369354 30650 raft_consensus.cc:2804] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.369716 30650 raft_consensus.cc:493] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.370009 30650 raft_consensus.cc:3060] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.375562 30593 tablet_bootstrap.cc:654] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.377311 30650 raft_consensus.cc:515] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.378597 30596 raft_consensus.cc:359] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.382536 30596 raft_consensus.cc:385] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.382846 30596 raft_consensus.cc:740] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.383257 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:14.383518 30596 consensus_queue.cc:260] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:14.384647 30291 leader_election.cc:343] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.385528 30596 ts_tablet_manager.cc:1434] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.002s
I20260709 13:09:14.386417 30650 leader_election.cc:290] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.386529 30596 tablet_bootstrap.cc:492] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:14.386602 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:14.387247 30549 raft_consensus.cc:3060] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.392156 30593 tablet_bootstrap.cc:492] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:14.392634 30593 ts_tablet_manager.cc:1403] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.001s
I20260709 13:09:14.394519 30602 tablet_bootstrap.cc:492] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:14.394992 30602 ts_tablet_manager.cc:1403] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.005s
I20260709 13:09:14.395637 30549 raft_consensus.cc:2468] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:14.395794 30593 raft_consensus.cc:359] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.396517 30593 raft_consensus.cc:385] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.392767 30595 tablet_bootstrap.cc:492] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:14.396622 30291 leader_election.cc:304] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:14.397789 30650 raft_consensus.cc:2804] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.398358 30650 raft_consensus.cc:697] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:14.399809 30650 consensus_queue.cc:237] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.401743 30596 tablet_bootstrap.cc:654] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.398599 30595 ts_tablet_manager.cc:1403] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.002s
I20260709 13:09:14.396669 30224 catalog_manager.cc:5697] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.404505 30593 raft_consensus.cc:740] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.405211 30593 consensus_queue.cc:260] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.405352 30595 raft_consensus.cc:359] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.405958 30595 raft_consensus.cc:385] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.406665 30595 raft_consensus.cc:740] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.407388 30593 ts_tablet_manager.cc:1434] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:09:14.408787 30593 tablet_bootstrap.cc:492] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:14.413864 30595 consensus_queue.cc:260] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.416651 30595 ts_tablet_manager.cc:1434] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:09:14.417832 30595 tablet_bootstrap.cc:492] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:14.425998 30398 raft_consensus.cc:2468] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:14.398289 30602 raft_consensus.cc:359] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.427943 30602 raft_consensus.cc:385] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.428283 30602 raft_consensus.cc:740] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.429044 30602 consensus_queue.cc:260] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.433333 30602 ts_tablet_manager.cc:1434] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:09:14.434546 30513 leader_election.cc:304] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:14.435245 30602 tablet_bootstrap.cc:492] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:14.435680 30820 raft_consensus.cc:2804] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.436177 30820 raft_consensus.cc:697] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:14.436976 30820 consensus_queue.cc:237] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.441826 30602 tablet_bootstrap.cc:654] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.446471 30670 raft_consensus.cc:493] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.446940 30670 raft_consensus.cc:515] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.448869 30670 leader_election.cc:290] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.450978 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:14.451591 30549 raft_consensus.cc:2468] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:14.452678 30440 leader_election.cc:304] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:14.453459 30670 raft_consensus.cc:2804] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.453795 30670 raft_consensus.cc:493] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.454119 30670 raft_consensus.cc:3060] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.458560 30223 catalog_manager.cc:5697] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.460255 30902 raft_consensus.cc:493] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.460716 30902 raft_consensus.cc:515] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.462708 30593 tablet_bootstrap.cc:654] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.462806 30902 leader_election.cc:290] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.463475 30670 raft_consensus.cc:515] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.465394 30670 leader_election.cc:290] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.465858 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:14.466665 30473 raft_consensus.cc:2393] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 1: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:14.469169 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:14.469724 30549 raft_consensus.cc:2468] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:14.470978 30595 tablet_bootstrap.cc:654] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.470924 30366 leader_election.cc:304] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:14.472213 30902 raft_consensus.cc:2804] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.472393 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:14.472992 30549 raft_consensus.cc:3060] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.479350 30549 raft_consensus.cc:2468] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:14.480827 30440 leader_election.cc:304] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:14.472756 30902 raft_consensus.cc:493] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.481709 30399 raft_consensus.cc:3060] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.483290 30670 raft_consensus.cc:2804] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.484807 30670 raft_consensus.cc:697] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:14.485996 30670 consensus_queue.cc:237] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.481755 30902 raft_consensus.cc:3060] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.492120 30602 tablet_bootstrap.cc:492] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:14.492645 30602 ts_tablet_manager.cc:1403] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.000s
I20260709 13:09:14.495378 30602 raft_consensus.cc:359] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.496901 30602 raft_consensus.cc:385] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.497267 30602 raft_consensus.cc:740] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.498057 30602 consensus_queue.cc:260] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.500190 30602 ts_tablet_manager.cc:1434] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:09:14.500686 30596 tablet_bootstrap.cc:492] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:14.501153 30596 ts_tablet_manager.cc:1403] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.115s	user 0.052s	sys 0.047s
I20260709 13:09:14.501680 30602 tablet_bootstrap.cc:492] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:14.502936 30816 raft_consensus.cc:493] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.503592 30650 raft_consensus.cc:493] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.503423 30816 raft_consensus.cc:515] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.503914 30596 raft_consensus.cc:359] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.504020 30650 raft_consensus.cc:515] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.504674 30596 raft_consensus.cc:385] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.505018 30596 raft_consensus.cc:740] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.505784 30596 consensus_queue.cc:260] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.507052 30816 leader_election.cc:290] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:14.507362 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:14.507805 30596 ts_tablet_manager.cc:1434] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:14.508771 30596 tablet_bootstrap.cc:492] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:14.507820 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748b5efba5c6486ab5974a080fc1d298" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:14.511224 30291 leader_election.cc:343] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.511734 30880 consensus_queue.cc:1048] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.514118 30880 consensus_queue.cc:1048] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.514700 30596 tablet_bootstrap.cc:654] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.516037 30593 tablet_bootstrap.cc:492] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:14.516523 30593 ts_tablet_manager.cc:1403] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.000s
I20260709 13:09:14.517902 30650 leader_election.cc:290] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.521456 30638 raft_consensus.cc:493] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.521934 30638 raft_consensus.cc:515] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.522764 30813 consensus_queue.cc:1048] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.524840 30638 leader_election.cc:290] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:14.523837 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748b5efba5c6486ab5974a080fc1d298" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:14.527070 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:14.527886 30546 raft_consensus.cc:2393] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:14.528790 30596 tablet_bootstrap.cc:492] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:14.529251 30596 ts_tablet_manager.cc:1403] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.007s
I20260709 13:09:14.528999 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:14.531059 30439 leader_election.cc:304] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:14.532037 30596 raft_consensus.cc:359] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.532892 30596 raft_consensus.cc:385] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.532665 30638 raft_consensus.cc:3060] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.531513 30593 raft_consensus.cc:359] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.536054 30593 raft_consensus.cc:385] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.536306 30593 raft_consensus.cc:740] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.513687 30902 raft_consensus.cc:515] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.536908 30593 consensus_queue.cc:260] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.539287 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:14.540727 30593 ts_tablet_manager.cc:1434] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:14.541677 30593 tablet_bootstrap.cc:492] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:14.546963 30638 raft_consensus.cc:2749] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.547612 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:14.548388 30546 raft_consensus.cc:2393] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 1: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:14.549335 30366 leader_election.cc:304] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8
W20260709 13:09:14.536867 30291 leader_election.cc:343] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.550037 30899 raft_consensus.cc:2749] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.550083 30291 leader_election.cc:304] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:14.553068 30880 raft_consensus.cc:2749] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.553164 30596 raft_consensus.cc:740] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.554023 30596 consensus_queue.cc:260] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.555518 30786 raft_consensus.cc:493] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.556025 30786 raft_consensus.cc:515] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.557678 30596 ts_tablet_manager.cc:1434] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:09:14.558293 30786 leader_election.cc:290] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:14.558673 30596 tablet_bootstrap.cc:492] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:14.560194 30593 tablet_bootstrap.cc:654] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.551020 30902 leader_election.cc:290] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.566329 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:14.572418 30398 raft_consensus.cc:2393] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:14.562049 30899 raft_consensus.cc:493] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.573344 30899 raft_consensus.cc:515] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.575958 30917 raft_consensus.cc:493] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.574467 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a08cc3a22a945c3bb034b67deb2b379" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:14.580510 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:14.578424 30820 consensus_queue.cc:1048] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:14.586161 30899 leader_election.cc:290] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:14.586593 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:14.582104 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:14.590998 30365 leader_election.cc:304] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:14.597218 30399 raft_consensus.cc:2393] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:14.599872 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:14.600513 30324 raft_consensus.cc:2468] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:14.584816 30917 raft_consensus.cc:515] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.603279 30917 leader_election.cc:290] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
W20260709 13:09:14.604153 30290 leader_election.cc:343] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.606299 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:14.606951 30324 raft_consensus.cc:2468] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:14.605052 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:14.608243 30439 leader_election.cc:304] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:14.608548 30474 raft_consensus.cc:2468] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
W20260709 13:09:14.608963 30291 leader_election.cc:343] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.609160 30917 raft_consensus.cc:2804] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.609408 30291 leader_election.cc:304] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:14.609549 30917 raft_consensus.cc:493] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.610723 30917 raft_consensus.cc:3060] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.610972 30595 tablet_bootstrap.cc:492] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:14.612811 30595 ts_tablet_manager.cc:1403] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.195s	user 0.022s	sys 0.008s
I20260709 13:09:14.612094 30224 catalog_manager.cc:5697] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.610622 30880 raft_consensus.cc:2749] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.610621 30366 leader_election.cc:304] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:14.623034 30596 tablet_bootstrap.cc:654] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.627163 30221 catalog_manager.cc:5697] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.633309 30602 tablet_bootstrap.cc:654] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.638340 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:14.641686 30670 raft_consensus.cc:493] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.642200 30670 raft_consensus.cc:515] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.645162 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:14.655969 30595 raft_consensus.cc:359] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.656638 30595 raft_consensus.cc:385] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.656898 30595 raft_consensus.cc:740] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.657503 30595 consensus_queue.cc:260] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.659389 30546 raft_consensus.cc:3060] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.660777 30595 ts_tablet_manager.cc:1434] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:09:14.622059 30920 raft_consensus.cc:2804] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.665360 30920 raft_consensus.cc:493] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.665710 30920 raft_consensus.cc:3060] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.678498 30593 tablet_bootstrap.cc:492] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:14.679029 30593 ts_tablet_manager.cc:1403] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.000s
I20260709 13:09:14.679692 30820 raft_consensus.cc:493] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.680210 30820 raft_consensus.cc:515] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.682314 30820 leader_election.cc:290] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:14.684234 30595 tablet_bootstrap.cc:492] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:14.649279 30670 leader_election.cc:290] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.689915 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748b5efba5c6486ab5974a080fc1d298" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:14.690117 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748b5efba5c6486ab5974a080fc1d298" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:14.691213 30324 raft_consensus.cc:2468] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
W20260709 13:09:14.691387 30514 leader_election.cc:343] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.693608 30513 leader_election.cc:304] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:14.694823 30820 raft_consensus.cc:2804] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.695173 30820 raft_consensus.cc:493] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.695549 30820 raft_consensus.cc:3060] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.695276 30593 raft_consensus.cc:359] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.696054 30593 raft_consensus.cc:385] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.696357 30593 raft_consensus.cc:740] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.697455 30917 raft_consensus.cc:515] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.700398 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:14.700841 30920 raft_consensus.cc:515] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.701465 30324 raft_consensus.cc:3060] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.702682 30399 raft_consensus.cc:2393] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:14.704389 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:14.705298 30917 leader_election.cc:290] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:14.706537 30596 tablet_bootstrap.cc:492] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:14.710450 30596 ts_tablet_manager.cc:1403] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.003s
I20260709 13:09:14.707190 30475 raft_consensus.cc:2393] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 1: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:14.712023 30920 leader_election.cc:290] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:14.697084 30593 consensus_queue.cc:260] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.715358 30596 raft_consensus.cc:359] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.719012 30596 raft_consensus.cc:385] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.719357 30596 raft_consensus.cc:740] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.723784 30596 consensus_queue.cc:260] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.730774 30595 tablet_bootstrap.cc:654] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.732436 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:14.738023 30365 leader_election.cc:304] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:14.725957 30324 raft_consensus.cc:2468] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:14.735363 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:14.738986 30813 raft_consensus.cc:493] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.743227 30596 ts_tablet_manager.cc:1434] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:09:14.743497 30593 ts_tablet_manager.cc:1434] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:09:14.747474 30593 tablet_bootstrap.cc:492] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:14.747372 30439 leader_election.cc:304] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:14.752198 30917 raft_consensus.cc:2804] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.752794 30917 raft_consensus.cc:697] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:14.753679 30593 tablet_bootstrap.cc:654] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.753670 30917 consensus_queue.cc:237] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.718627 30820 raft_consensus.cc:515] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.758294 30398 raft_consensus.cc:2393] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:14.745580 30920 raft_consensus.cc:2749] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.739398 30879 raft_consensus.cc:493] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.769695 30596 tablet_bootstrap.cc:492] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
W20260709 13:09:14.781961 30921 log.cc:927] Time spent T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:09:14.782197 30439 leader_election.cc:304] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:14.783774 30919 raft_consensus.cc:3060] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.785573 30820 leader_election.cc:290] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:14.774012 30879 raft_consensus.cc:515] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.788872 30602 tablet_bootstrap.cc:492] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:14.789345 30602 ts_tablet_manager.cc:1403] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.288s	user 0.019s	sys 0.018s
I20260709 13:09:14.789371 30879 leader_election.cc:290] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:14.793757 30602 raft_consensus.cc:359] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.797578 30602 raft_consensus.cc:385] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.797969 30602 raft_consensus.cc:740] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.798918 30602 consensus_queue.cc:260] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.816151 30602 ts_tablet_manager.cc:1434] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:09:14.818395 30927 consensus_queue.cc:1048] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:14.779165 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc099b35daa949c5aa0039ec0e6570c4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:14.823346 30397 raft_consensus.cc:2393] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:14.823135 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748b5efba5c6486ab5974a080fc1d298" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:14.825781 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748b5efba5c6486ab5974a080fc1d298" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:14.825965 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:14.761153 30813 raft_consensus.cc:515] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.826715 30325 raft_consensus.cc:2468] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:14.806123 30753 raft_consensus.cc:2749] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:14.848526 30593 tablet_bootstrap.cc:492] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:14.849246 30593 ts_tablet_manager.cc:1403] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.034s
I20260709 13:09:14.850589 30865 raft_consensus.cc:493] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.840648 30324 raft_consensus.cc:3060] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.852627 30865 raft_consensus.cc:515] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.850564 30786 consensus_queue.cc:1048] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:09:14.850936 30513 leader_election.cc:304] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:14.907923 30919 raft_consensus.cc:2749] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:14.908783 30514 leader_election.cc:343] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.907995 30899 raft_consensus.cc:493] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.909621 30899 raft_consensus.cc:515] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.859230 30920 raft_consensus.cc:493] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.912190 30920 raft_consensus.cc:515] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.912575 30593 raft_consensus.cc:359] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.913246 30593 raft_consensus.cc:385] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.913501 30593 raft_consensus.cc:740] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.914371 30920 leader_election.cc:290] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.914904 30593 consensus_queue.cc:260] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:14.913475 30899 leader_election.cc:290] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:14.917387 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:14.918062 30546 raft_consensus.cc:2468] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:14.915169 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:14.919693 30549 raft_consensus.cc:2468] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:14.922917 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:14.925711 30366 leader_election.cc:304] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:14.926677 30595 tablet_bootstrap.cc:492] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:14.927152 30595 ts_tablet_manager.cc:1403] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.255s	user 0.015s	sys 0.000s
I20260709 13:09:14.926975 30366 leader_election.cc:304] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:14.928097 30899 raft_consensus.cc:2804] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.928457 30902 raft_consensus.cc:2804] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.928568 30899 raft_consensus.cc:493] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.929039 30902 raft_consensus.cc:493] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.929123 30899 raft_consensus.cc:3060] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.929507 30902 raft_consensus.cc:3060] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.929801 30595 raft_consensus.cc:359] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.932092 30595 raft_consensus.cc:385] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:14.931032 30366 leader_election.cc:343] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.932423 30595 raft_consensus.cc:740] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
W20260709 13:09:14.934470 30513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 90612.9us
I20260709 13:09:14.935840 30931 raft_consensus.cc:2804] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.936336 30931 raft_consensus.cc:493] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.936661 30931 raft_consensus.cc:3060] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.937074 30865 leader_election.cc:290] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:14.938548 30899 raft_consensus.cc:515] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:14.934377 30595 consensus_queue.cc:260] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:14.917142 30596 tablet_bootstrap.cc:654] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.959173 30899 leader_election.cc:290] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:14.979202 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
W20260709 13:09:14.980926 30366 leader_election.cc:343] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.985340 30595 ts_tablet_manager.cc:1434] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:09:14.987406 30595 tablet_bootstrap.cc:492] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:14.991977 30931 raft_consensus.cc:515] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:14.995613 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:14.996173 30323 raft_consensus.cc:3060] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.997763 30324 raft_consensus.cc:2468] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:14.999049 30513 leader_election.cc:304] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:15.000983 30820 raft_consensus.cc:2804] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.001768 30820 raft_consensus.cc:697] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:15.002914 30820 consensus_queue.cc:237] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.005517 30595 tablet_bootstrap.cc:654] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.000624 30902 raft_consensus.cc:515] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.009553 30931 leader_election.cc:290] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:15.014612 30602 tablet_bootstrap.cc:492] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:15.021766 30602 tablet_bootstrap.cc:654] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.024674 30323 raft_consensus.cc:2468] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:15.027745 30513 leader_election.cc:304] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:15.029942 30931 raft_consensus.cc:2804] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.033947 30933 raft_consensus.cc:493] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.034498 30933 raft_consensus.cc:515] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.035718 30596 tablet_bootstrap.cc:492] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:15.036273 30596 ts_tablet_manager.cc:1403] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.273s	user 0.015s	sys 0.000s
I20260709 13:09:15.036803 30933 leader_election.cc:290] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:15.030839 30902 leader_election.cc:290] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:15.030879 30931 raft_consensus.cc:697] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:15.039106 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:15.039857 30931 consensus_queue.cc:237] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.046003 30593 ts_tablet_manager.cc:1434] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.196s	user 0.010s	sys 0.006s
I20260709 13:09:15.047163 30593 tablet_bootstrap.cc:492] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:15.055773 30939 raft_consensus.cc:493] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.056303 30939 raft_consensus.cc:515] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.058267 30813 leader_election.cc:290] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:15.059100 30939 leader_election.cc:290] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
W20260709 13:09:15.059857 30290 leader_election.cc:343] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.062134 30596 raft_consensus.cc:359] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.062876 30596 raft_consensus.cc:385] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.063236 30596 raft_consensus.cc:740] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
W20260709 13:09:15.064814 30514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42903, user_credentials={real_user=slave}} blocked reactor thread for 143852us
I20260709 13:09:15.064905 30918 consensus_queue.cc:1048] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.067545 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:15.068130 30549 raft_consensus.cc:2468] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:15.078225 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:15.080186 30595 tablet_bootstrap.cc:492] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:15.080734 30595 ts_tablet_manager.cc:1403] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.000s
I20260709 13:09:15.081821 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651fee799e6451a8fe39b2c4b19eaaf" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:15.084193 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:15.085930 30595 raft_consensus.cc:359] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.086624 30595 raft_consensus.cc:385] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.086889 30595 raft_consensus.cc:740] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.087491 30595 consensus_queue.cc:260] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.089203 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:15.090281 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:15.091216 30595 ts_tablet_manager.cc:1434] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:09:15.092175 30595 tablet_bootstrap.cc:492] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:15.092069 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:15.092833 30397 raft_consensus.cc:2393] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:15.093986 30596 consensus_queue.cc:260] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.095675 30593 tablet_bootstrap.cc:654] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.098031 30547 raft_consensus.cc:3060] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.114527 30596 ts_tablet_manager.cc:1434] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 13:09:15.119886 30596 tablet_bootstrap.cc:492] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:15.124311 30291 leader_election.cc:304] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:15.128307 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:15.129222 30399 raft_consensus.cc:2393] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:15.130952 30938 consensus_queue.cc:1048] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.140903 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651fee799e6451a8fe39b2c4b19eaaf" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:15.141669 30399 raft_consensus.cc:2468] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:15.142509 30923 raft_consensus.cc:2804] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.143114 30923 raft_consensus.cc:493] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.143563 30923 raft_consensus.cc:3060] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.164719 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:15.166277 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:15.169687 30602 tablet_bootstrap.cc:492] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:15.170248 30602 ts_tablet_manager.cc:1403] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.156s	user 0.018s	sys 0.012s
I20260709 13:09:15.171332 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:15.172176 30325 raft_consensus.cc:2393] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 1: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:15.173023 30602 raft_consensus.cc:359] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.173692 30602 raft_consensus.cc:385] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.173933 30602 raft_consensus.cc:740] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.180531 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7962a39d6c4a7f9cee77c26e3c6018" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:15.180857 30602 consensus_queue.cc:260] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
W20260709 13:09:15.147837 30514 leader_election.cc:343] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.181613 30224 catalog_manager.cc:5697] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.190351 30325 raft_consensus.cc:2393] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 1: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:15.197623 30602 ts_tablet_manager.cc:1434] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:15.186841 30919 consensus_queue.cc:1048] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 13:09:15.199306 30290 leader_election.cc:343] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:15.193630 30514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42903, user_credentials={real_user=slave}} blocked reactor thread for 46526.4us
I20260709 13:09:15.230389 30514 leader_election.cc:304] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:15.231376 30820 raft_consensus.cc:2749] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:15.232666 30602 tablet_bootstrap.cc:492] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:15.220468 30818 consensus_queue.cc:1048] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.221778 30513 leader_election.cc:304] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:15.236590 30818 raft_consensus.cc:2804] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.237076 30818 raft_consensus.cc:493] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.237932 30818 raft_consensus.cc:3060] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.241843 30918 consensus_queue.cc:1048] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.248311 30602 tablet_bootstrap.cc:654] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.225267 30595 tablet_bootstrap.cc:654] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.260677 30786 raft_consensus.cc:493] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.263442 30786 raft_consensus.cc:515] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.265470 30786 leader_election.cc:290] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:15.267539 30865 consensus_queue.cc:1048] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.291754 30596 tablet_bootstrap.cc:654] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.296654 30593 tablet_bootstrap.cc:492] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:15.297209 30593 ts_tablet_manager.cc:1403] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.250s	user 0.007s	sys 0.013s
I20260709 13:09:15.306313 30919 raft_consensus.cc:493] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.314813 30365 leader_election.cc:304] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:15.307941 30919 raft_consensus.cc:515] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.318364 30919 leader_election.cc:290] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:15.318913 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e11a3a73344f4f89bb1e70414ac6c1" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:15.320086 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e11a3a73344f4f89bb1e70414ac6c1" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:15.320145 30475 raft_consensus.cc:3060] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.325875 30818 raft_consensus.cc:515] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.328094 30927 raft_consensus.cc:2749] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.328608 30818 leader_election.cc:290] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:15.329704 30927 consensus_queue.cc:1048] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.331352 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651fee799e6451a8fe39b2c4b19eaaf" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:15.332185 30401 raft_consensus.cc:3060] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.335188 30547 raft_consensus.cc:2468] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
W20260709 13:09:15.338246 30291 leader_election.cc:343] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.339118 30291 leader_election.cc:304] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:15.307796 30923 raft_consensus.cc:515] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.342319 30923 leader_election.cc:290] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
W20260709 13:09:15.345119 30291 leader_election.cc:343] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.346781 30924 raft_consensus.cc:2749] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.347935 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
W20260709 13:09:15.353549 30290 leader_election.cc:343] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.358299 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:15.358939 30547 raft_consensus.cc:3060] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.367046 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:15.369591 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:15.365854 30401 raft_consensus.cc:2468] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:15.379253 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3651fee799e6451a8fe39b2c4b19eaaf" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:15.377647 30593 raft_consensus.cc:359] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:15.357154 30291 leader_election.cc:343] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.380014 30593 raft_consensus.cc:385] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.380288 30291 leader_election.cc:304] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:15.380975 30593 raft_consensus.cc:740] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.377646 30547 raft_consensus.cc:2468] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:15.379571 30513 leader_election.cc:304] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:15.394085 30931 raft_consensus.cc:2804] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.394595 30931 raft_consensus.cc:697] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:15.386293 30786 raft_consensus.cc:2749] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.397423 30593 consensus_queue.cc:260] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.383540 30638 consensus_queue.cc:1048] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:09:15.402273 30366 leader_election.cc:304] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:15.401562 30818 consensus_queue.cc:1048] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:15.412034 30595 tablet_bootstrap.cc:492] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:15.411944 30439 leader_election.cc:304] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
W20260709 13:09:15.413668 30514 leader_election.cc:343] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.417035 30595 ts_tablet_manager.cc:1403] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.325s	user 0.018s	sys 0.024s
I20260709 13:09:15.423758 30291 leader_election.cc:304] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:15.428828 30670 raft_consensus.cc:2749] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.428690 30595 raft_consensus.cc:359] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.418964 30753 raft_consensus.cc:2804] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.431159 30602 tablet_bootstrap.cc:492] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:15.431339 30753 raft_consensus.cc:697] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:15.429448 30595 raft_consensus.cc:385] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.431972 30595 raft_consensus.cc:740] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.432217 30753 consensus_queue.cc:237] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.432581 30595 consensus_queue.cc:260] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.403190 30931 consensus_queue.cc:237] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.435863 30595 ts_tablet_manager.cc:1434] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 13:09:15.436749 30595 tablet_bootstrap.cc:492] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:15.431638 30602 ts_tablet_manager.cc:1403] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.015s
I20260709 13:09:15.443398 30593 ts_tablet_manager.cc:1434] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.000s
I20260709 13:09:15.444624 30593 tablet_bootstrap.cc:492] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:15.457003 30602 raft_consensus.cc:359] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.457693 30602 raft_consensus.cc:385] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.459596 30595 tablet_bootstrap.cc:654] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.457973 30602 raft_consensus.cc:740] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.451732 30221 catalog_manager.cc:5697] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.445868 30939 raft_consensus.cc:2804] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.467304 30602 consensus_queue.cc:260] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.469321 30221 catalog_manager.cc:5697] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.479310 30602 ts_tablet_manager.cc:1434] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:09:15.480288 30602 tablet_bootstrap.cc:492] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:15.476150 30939 raft_consensus.cc:697] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:15.484099 30902 raft_consensus.cc:493] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.501284 30902 raft_consensus.cc:515] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.506918 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe391ca7cf224a87975e01e553aa19cc" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:15.507550 30323 raft_consensus.cc:2468] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:15.516872 30365 leader_election.cc:304] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:15.519526 30816 raft_consensus.cc:2804] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.519999 30816 raft_consensus.cc:493] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.520413 30816 raft_consensus.cc:3060] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.521932 30593 tablet_bootstrap.cc:654] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.524354 30931 consensus_queue.cc:1048] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.525779 30902 leader_election.cc:290] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:15.525882 30596 tablet_bootstrap.cc:492] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:15.526608 30596 ts_tablet_manager.cc:1403] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.411s	user 0.010s	sys 0.008s
I20260709 13:09:15.527612 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe391ca7cf224a87975e01e553aa19cc" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:15.528270 30472 raft_consensus.cc:2468] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:15.528548 30939 consensus_queue.cc:237] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.529521 30931 raft_consensus.cc:493] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.529989 30931 raft_consensus.cc:515] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.532868 30931 leader_election.cc:290] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:15.533746 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:15.533861 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
W20260709 13:09:15.542755 30962 log.cc:927] Time spent T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:09:15.551677 30514 leader_election.cc:343] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:15.552676 30513 leader_election.cc:343] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.556706 30602 tablet_bootstrap.cc:654] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.557274 30513 leader_election.cc:304] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:15.558822 30931 raft_consensus.cc:2749] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.570194 30596 raft_consensus.cc:359] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:15.574496 30514 consensus_peers.cc:597] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.575178 30596 raft_consensus.cc:385] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.574965 30816 raft_consensus.cc:515] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.575584 30596 raft_consensus.cc:740] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.577482 30596 consensus_queue.cc:260] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.586335 30593 tablet_bootstrap.cc:492] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:15.586928 30593 ts_tablet_manager.cc:1403] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.143s	user 0.009s	sys 0.003s
I20260709 13:09:15.587990 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe391ca7cf224a87975e01e553aa19cc" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:15.588591 30472 raft_consensus.cc:3060] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.586357 30221 catalog_manager.cc:5697] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.586828 30816 leader_election.cc:290] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:15.582957 30596 ts_tablet_manager.cc:1434] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 13:09:15.593936 30596 tablet_bootstrap.cc:492] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:15.589744 30593 raft_consensus.cc:359] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.597751 30593 raft_consensus.cc:385] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.598027 30593 raft_consensus.cc:740] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.598712 30593 consensus_queue.cc:260] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.600708 30593 ts_tablet_manager.cc:1434] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:09:15.606797 30931 consensus_queue.cc:1048] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.608011 30472 raft_consensus.cc:2468] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:15.609261 30366 leader_election.cc:304] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:15.609464 30324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe391ca7cf224a87975e01e553aa19cc" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:15.610090 30324 raft_consensus.cc:3060] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.614835 30753 raft_consensus.cc:2804] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.615515 30753 raft_consensus.cc:697] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:15.616346 30753 consensus_queue.cc:237] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.618672 30593 tablet_bootstrap.cc:492] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:15.625566 30593 tablet_bootstrap.cc:654] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:15.631693 30271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:15.632210 30596 tablet_bootstrap.cc:654] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.633359 30222 catalog_manager.cc:5697] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.652535 30593 tablet_bootstrap.cc:492] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:15.653102 30593 ts_tablet_manager.cc:1403] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.005s
I20260709 13:09:15.671624 30221 catalog_manager.cc:5697] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.673493 30596 tablet_bootstrap.cc:492] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:15.674026 30596 ts_tablet_manager.cc:1403] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 13:09:15.677066 30596 raft_consensus.cc:359] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.677760 30596 raft_consensus.cc:385] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.678031 30596 raft_consensus.cc:740] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.678800 30596 consensus_queue.cc:260] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.681034 30596 ts_tablet_manager.cc:1434] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:15.681996 30596 tablet_bootstrap.cc:492] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:15.682864 30593 raft_consensus.cc:359] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.683575 30593 raft_consensus.cc:385] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.683955 30593 raft_consensus.cc:740] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.684667 30593 consensus_queue.cc:260] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.686487 30816 raft_consensus.cc:493] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.688464 30818 consensus_queue.cc:1048] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.689308 30816 raft_consensus.cc:515] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.691171 30595 tablet_bootstrap.cc:492] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:15.691675 30595 ts_tablet_manager.cc:1403] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.255s	user 0.010s	sys 0.009s
I20260709 13:09:15.692772 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:15.693576 30542 raft_consensus.cc:2393] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 1: Already voted for candidate d868b6e1c0be407dbc470002a447a620 in this term.
I20260709 13:09:15.694497 30595 raft_consensus.cc:359] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.695166 30595 raft_consensus.cc:385] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.695427 30595 raft_consensus.cc:740] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.696166 30595 consensus_queue.cc:260] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.696611 30953 raft_consensus.cc:493] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.697129 30953 raft_consensus.cc:515] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.698673 30595 ts_tablet_manager.cc:1434] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:15.699769 30953 leader_election.cc:290] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:15.701556 30602 tablet_bootstrap.cc:492] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:15.702023 30602 ts_tablet_manager.cc:1403] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.222s	user 0.013s	sys 0.001s
I20260709 13:09:15.703835 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1f795e00974bcc85806849556a3a35" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:15.705582 30291 leader_election.cc:343] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.708177 30602 raft_consensus.cc:359] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.708927 30596 tablet_bootstrap.cc:654] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.708927 30602 raft_consensus.cc:385] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.709481 30602 raft_consensus.cc:740] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.710201 30602 consensus_queue.cc:260] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.710726 30593 ts_tablet_manager.cc:1434] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.005s
I20260709 13:09:15.699625 30595 tablet_bootstrap.cc:492] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:15.711576 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1f795e00974bcc85806849556a3a35" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:15.714977 30593 tablet_bootstrap.cc:492] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:15.714926 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:15.714207 30816 leader_election.cc:290] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:15.716190 30365 leader_election.cc:304] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
W20260709 13:09:15.716853 30291 leader_election.cc:343] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.717308 30291 leader_election.cc:304] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:15.717926 30602 ts_tablet_manager.cc:1434] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:15.720362 30953 raft_consensus.cc:2749] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.720527 30602 tablet_bootstrap.cc:492] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:15.722998 30223 catalog_manager.cc:5697] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.729478 30816 raft_consensus.cc:3060] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.733798 30595 tablet_bootstrap.cc:654] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.740615 30602 tablet_bootstrap.cc:654] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.743803 30816 raft_consensus.cc:2749] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.755595 30593 tablet_bootstrap.cc:654] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.740536 30324 raft_consensus.cc:2468] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:15.774767 30638 raft_consensus.cc:493] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.782529 30638 raft_consensus.cc:515] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.784894 30638 leader_election.cc:290] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:15.791800 30595 tablet_bootstrap.cc:492] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:15.792481 30595 ts_tablet_manager.cc:1403] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.005s
I20260709 13:09:15.796135 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:15.796993 30542 raft_consensus.cc:2393] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:15.796741 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:15.800820 30439 leader_election.cc:304] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:15.802333 30670 raft_consensus.cc:3060] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:15.827636 30514 consensus_peers.cc:597] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.828430 30595 raft_consensus.cc:359] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.829118 30595 raft_consensus.cc:385] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.829389 30595 raft_consensus.cc:740] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.830104 30595 consensus_queue.cc:260] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.831537 30595 ts_tablet_manager.cc:1434] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:09:15.835769 30670 raft_consensus.cc:2749] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.836544 30596 tablet_bootstrap.cc:492] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:15.842540 30596 ts_tablet_manager.cc:1403] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.161s	user 0.018s	sys 0.025s
I20260709 13:09:15.836704 30786 raft_consensus.cc:493] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.843108 30595 tablet_bootstrap.cc:492] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:15.843232 30786 raft_consensus.cc:515] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.837041 30602 tablet_bootstrap.cc:492] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:15.841058 30593 tablet_bootstrap.cc:492] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:15.845019 30593 ts_tablet_manager.cc:1403] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.130s	user 0.024s	sys 0.007s
I20260709 13:09:15.844945 30941 raft_consensus.cc:493] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.845289 30786 leader_election.cc:290] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:15.845615 30941 raft_consensus.cc:515] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.846823 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:15.847595 30941 leader_election.cc:290] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
W20260709 13:09:15.848289 30290 leader_election.cc:343] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.844956 30602 ts_tablet_manager.cc:1403] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.002s
I20260709 13:09:15.849362 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:15.849607 30596 raft_consensus.cc:359] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.849913 30593 raft_consensus.cc:359] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.850673 30596 raft_consensus.cc:385] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.850744 30593 raft_consensus.cc:385] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.851043 30596 raft_consensus.cc:740] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.851158 30593 raft_consensus.cc:740] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.851650 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:15.852288 30542 raft_consensus.cc:2468] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:15.851806 30596 consensus_queue.cc:260] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.854626 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:15.855284 30401 raft_consensus.cc:2468] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:15.856403 30513 leader_election.cc:304] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:15.857069 30941 raft_consensus.cc:2804] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.851895 30593 consensus_queue.cc:260] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.857474 30941 raft_consensus.cc:493] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.857872 30941 raft_consensus.cc:3060] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.858086 30596 ts_tablet_manager.cc:1434] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:15.858755 30593 ts_tablet_manager.cc:1434] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:09:15.849974 30323 raft_consensus.cc:2468] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:15.859169 30596 tablet_bootstrap.cc:492] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:15.859678 30593 tablet_bootstrap.cc:492] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:15.865685 30596 tablet_bootstrap.cc:654] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.857672 30291 leader_election.cc:304] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:15.867919 30786 raft_consensus.cc:2804] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.868268 30786 raft_consensus.cc:493] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.868604 30786 raft_consensus.cc:3060] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.851606 30602 raft_consensus.cc:359] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.872982 30602 raft_consensus.cc:385] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.875732 30786 raft_consensus.cc:515] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.879880 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:15.880167 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:15.880451 30542 raft_consensus.cc:3060] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:15.881557 30290 leader_election.cc:343] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.857333 30595 tablet_bootstrap.cc:654] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.884613 30786 leader_election.cc:290] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:15.865557 30593 tablet_bootstrap.cc:654] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.871857 30941 raft_consensus.cc:515] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.890208 30595 tablet_bootstrap.cc:492] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:15.873342 30602 raft_consensus.cc:740] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.900152 30595 ts_tablet_manager.cc:1403] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.004s
I20260709 13:09:15.902863 30595 raft_consensus.cc:359] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.903541 30595 raft_consensus.cc:385] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.903793 30602 consensus_queue.cc:260] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:15.906008 30593 tablet_bootstrap.cc:492] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:15.906591 30593 ts_tablet_manager.cc:1403] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:09:15.909694 30593 raft_consensus.cc:359] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.910720 30593 raft_consensus.cc:385] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.903846 30595 raft_consensus.cc:740] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.911696 30595 consensus_queue.cc:260] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:15.912348 30593 raft_consensus.cc:740] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.913518 30593 consensus_queue.cc:260] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.921396 30593 ts_tablet_manager.cc:1434] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:09:15.922390 30593 tablet_bootstrap.cc:492] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:15.922578 30542 raft_consensus.cc:2468] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:15.915953 30595 ts_tablet_manager.cc:1434] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:09:15.923730 30595 tablet_bootstrap.cc:492] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:15.923695 30291 leader_election.cc:304] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:15.925122 30953 raft_consensus.cc:2804] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.925635 30953 raft_consensus.cc:697] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:15.926594 30953 consensus_queue.cc:237] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.928524 30753 consensus_queue.cc:1048] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.912535 30602 ts_tablet_manager.cc:1434] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.004s
I20260709 13:09:15.939811 30753 consensus_queue.cc:1048] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.938115 30602 tablet_bootstrap.cc:492] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:15.945448 30593 tablet_bootstrap.cc:654] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.954245 30596 tablet_bootstrap.cc:492] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:15.960868 30953 raft_consensus.cc:493] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.965627 30953 raft_consensus.cc:515] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.967811 30953 leader_election.cc:290] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:15.968508 30596 ts_tablet_manager.cc:1403] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.110s	user 0.037s	sys 0.041s
I20260709 13:09:15.968676 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4872354f64208a9454aa62f5fa488" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:15.971227 30602 tablet_bootstrap.cc:654] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:15.971163 30290 leader_election.cc:343] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.972072 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4872354f64208a9454aa62f5fa488" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
W20260709 13:09:15.973397 30291 leader_election.cc:343] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.973829 30291 leader_election.cc:304] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:15.974857 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:15.975302 30786 raft_consensus.cc:2749] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.975442 30323 raft_consensus.cc:3060] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.950071 30595 tablet_bootstrap.cc:654] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.984926 30323 raft_consensus.cc:2468] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:15.987425 30513 leader_election.cc:304] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:15.988217 30931 raft_consensus.cc:2804] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.988716 30931 raft_consensus.cc:697] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:15.988376 30596 raft_consensus.cc:359] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:15.989580 30931 consensus_queue.cc:237] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.992106 30941 leader_election.cc:290] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:15.995342 30820 consensus_queue.cc:1048] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.995492 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:16.004040 30593 tablet_bootstrap.cc:492] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: No bootstrap required, opened a new log
I20260709 13:09:16.004310 30401 raft_consensus.cc:3060] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.004532 30593 ts_tablet_manager.cc:1403] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 13:09:16.006263 30602 tablet_bootstrap.cc:492] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:16.006716 30595 tablet_bootstrap.cc:492] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:16.006898 30602 ts_tablet_manager.cc:1403] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.012s
I20260709 13:09:16.007165 30595 ts_tablet_manager.cc:1403] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.002s
I20260709 13:09:16.010475 30596 raft_consensus.cc:385] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.010699 30596 raft_consensus.cc:740] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.011562 30595 raft_consensus.cc:359] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:15.973239 30221 catalog_manager.cc:5697] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.011831 30602 raft_consensus.cc:359] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.019954 30602 raft_consensus.cc:385] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.012202 30596 consensus_queue.cc:260] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.020226 30602 raft_consensus.cc:740] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.021881 30596 ts_tablet_manager.cc:1434] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.036s	user 0.001s	sys 0.004s
I20260709 13:09:16.021718 30602 consensus_queue.cc:260] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.022828 30596 tablet_bootstrap.cc:492] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:16.018748 30786 consensus_queue.cc:1048] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:16.024565 30222 catalog_manager.cc:5697] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.019138 30593 raft_consensus.cc:359] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.027287 30593 raft_consensus.cc:385] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.027562 30593 raft_consensus.cc:740] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.028277 30593 consensus_queue.cc:260] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.029270 30953 consensus_queue.cc:1048] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:16.032963 30593 ts_tablet_manager.cc:1434] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:09:16.018031 30401 raft_consensus.cc:2468] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:16.012807 30595 raft_consensus.cc:385] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.042636 30595 raft_consensus.cc:740] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.024569 30602 ts_tablet_manager.cc:1434] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:09:16.043304 30595 consensus_queue.cc:260] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:16.044092 30602 tablet_bootstrap.cc:492] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:16.045544 30595 ts_tablet_manager.cc:1434] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.000s
I20260709 13:09:16.046469 30595 tablet_bootstrap.cc:492] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:16.048883 30596 tablet_bootstrap.cc:654] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.059110 30816 consensus_queue.cc:1048] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.059516 30602 tablet_bootstrap.cc:654] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.066948 30596 tablet_bootstrap.cc:492] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:16.067481 30596 ts_tablet_manager.cc:1403] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:09:16.080629 30596 raft_consensus.cc:359] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:16.081422 30596 raft_consensus.cc:385] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.081745 30596 raft_consensus.cc:740] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.082608 30595 tablet_bootstrap.cc:654] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.082557 30596 consensus_queue.cc:260] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:16.086102 30596 ts_tablet_manager.cc:1434] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:16.087322 30596 tablet_bootstrap.cc:492] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:16.089411 30953 raft_consensus.cc:493] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.102061 30786 raft_consensus.cc:493] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.149060 30602 tablet_bootstrap.cc:492] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:16.149608 30602 ts_tablet_manager.cc:1403] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.016s
I20260709 13:09:16.149331 30786 raft_consensus.cc:515] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.152017 30786 leader_election.cc:290] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:16.152581 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:16.153051 30602 raft_consensus.cc:359] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.153234 30399 raft_consensus.cc:2468] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 0.
I20260709 13:09:16.153779 30602 raft_consensus.cc:385] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.140715 30953 raft_consensus.cc:515] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.154052 30602 raft_consensus.cc:740] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.154695 30290 leader_election.cc:304] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:16.154973 30602 consensus_queue.cc:260] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.155577 30953 leader_election.cc:290] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:16.156204 30953 raft_consensus.cc:2804] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.156589 30953 raft_consensus.cc:493] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.157267 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:16.158257 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80f0c101daa484bb62d6ec96d3357f4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
W20260709 13:09:16.158871 30291 leader_election.cc:343] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.159088 30953 raft_consensus.cc:3060] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.160885 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80f0c101daa484bb62d6ec96d3357f4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
W20260709 13:09:16.164583 30290 leader_election.cc:343] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:16.166967 30291 leader_election.cc:343] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.167358 30291 leader_election.cc:304] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:16.177474 30602 ts_tablet_manager.cc:1434] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:09:16.179984 30602 tablet_bootstrap.cc:492] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:16.188038 30474 raft_consensus.cc:3060] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.178913 30865 raft_consensus.cc:2749] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.191625 30818 raft_consensus.cc:493] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.197014 30818 raft_consensus.cc:515] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.211318 30595 tablet_bootstrap.cc:492] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:16.212000 30595 ts_tablet_manager.cc:1403] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.166s	user 0.016s	sys 0.007s
I20260709 13:09:16.212805 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1f795e00974bcc85806849556a3a35" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:16.208150 30818 leader_election.cc:290] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:16.216180 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1f795e00974bcc85806849556a3a35" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:16.213562 30325 raft_consensus.cc:2468] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:16.218537 30513 leader_election.cc:304] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
W20260709 13:09:16.219233 30514 leader_election.cc:343] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.220678 30596 tablet_bootstrap.cc:654] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.234545 30475 raft_consensus.cc:3060] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.235598 30602 tablet_bootstrap.cc:654] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.239912 30813 raft_consensus.cc:493] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.240388 30813 raft_consensus.cc:515] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:16.242380 30595 raft_consensus.cc:359] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.243031 30595 raft_consensus.cc:385] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.243299 30595 raft_consensus.cc:740] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.244367 30595 consensus_queue.cc:260] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.225270 30820 raft_consensus.cc:2804] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.245422 30820 raft_consensus.cc:493] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.245515 30813 leader_election.cc:290] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:16.245807 30820 raft_consensus.cc:3060] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.246462 30880 raft_consensus.cc:493] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.246925 30880 raft_consensus.cc:515] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.247364 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4872354f64208a9454aa62f5fa488" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:16.247954 30401 raft_consensus.cc:2468] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:16.248749 30880 leader_election.cc:290] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:16.248896 30513 leader_election.cc:304] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:16.250823 30595 ts_tablet_manager.cc:1434] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.004s
I20260709 13:09:16.250905 30325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4872354f64208a9454aa62f5fa488" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:16.251523 30902 raft_consensus.cc:493] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.251579 30325 raft_consensus.cc:2468] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:16.252236 30902 raft_consensus.cc:515] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.254328 30902 leader_election.cc:290] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:16.254176 30941 raft_consensus.cc:2804] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.256078 30941 raft_consensus.cc:493] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.256771 30941 raft_consensus.cc:3060] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.256820 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:16.267709 30472 raft_consensus.cc:2468] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:16.268958 30366 leader_election.cc:304] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:16.272985 30595 tablet_bootstrap.cc:492] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:16.281563 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b2a45700e14c769022b4d7361c3dee" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:16.281874 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b2a45700e14c769022b4d7361c3dee" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:16.288754 30953 raft_consensus.cc:515] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.279453 30902 raft_consensus.cc:2804] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.289678 30902 raft_consensus.cc:493] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.290036 30902 raft_consensus.cc:3060] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.290709 30919 raft_consensus.cc:493] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 746044612df94d4493276099e7ab6adc)
I20260709 13:09:16.290940 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:16.291239 30919 raft_consensus.cc:515] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.291605 30323 raft_consensus.cc:2468] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:16.291743 30818 raft_consensus.cc:493] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.292227 30818 raft_consensus.cc:515] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
W20260709 13:09:16.295325 30291 leader_election.cc:343] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.299103 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:16.299865 30401 raft_consensus.cc:3060] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:16.300674 30291 leader_election.cc:343] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 746044612df94d4493276099e7ab6adc (127.20.53.132:41005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.301102 30291 leader_election.cc:304] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:16.301786 30924 raft_consensus.cc:2749] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.307222 30953 leader_election.cc:290] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:16.314962 30401 raft_consensus.cc:2468] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 1.
I20260709 13:09:16.318353 30290 leader_election.cc:304] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:16.309608 30902 raft_consensus.cc:515] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.311676 30941 raft_consensus.cc:515] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:16.322331 30439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:32987, user_credentials={real_user=slave}} blocked reactor thread for 89118.5us
I20260709 13:09:16.323568 30919 leader_election.cc:290] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:16.320438 30818 leader_election.cc:290] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:16.320611 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e11a3a73344f4f89bb1e70414ac6c1" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:16.324352 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e11a3a73344f4f89bb1e70414ac6c1" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:16.320111 30816 consensus_queue.cc:1048] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:16.324806 30474 raft_consensus.cc:2468] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:16.324995 30323 raft_consensus.cc:2468] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:16.326287 30513 leader_election.cc:304] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:16.326833 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748b5efba5c6486ab5974a080fc1d298" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:16.328218 30813 raft_consensus.cc:2804] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.321040 30953 raft_consensus.cc:2804] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.328605 30813 raft_consensus.cc:493] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.328969 30953 raft_consensus.cc:697] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:16.329882 30953 consensus_queue.cc:237] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.330539 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:16.329013 30813 raft_consensus.cc:3060] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.333969 30941 leader_election.cc:290] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:16.342522 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748b5efba5c6486ab5974a080fc1d298" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:16.344951 30813 raft_consensus.cc:515] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.354430 30323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4872354f64208a9454aa62f5fa488" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:16.355088 30323 raft_consensus.cc:3060] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:16.350458 30291 leader_election.cc:343] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.350481 30440 leader_election.cc:304] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:16.356091 30602 tablet_bootstrap.cc:492] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:16.356290 30670 raft_consensus.cc:2749] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.356616 30602 ts_tablet_manager.cc:1403] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.004s
I20260709 13:09:16.351432 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4872354f64208a9454aa62f5fa488" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:16.362574 30401 raft_consensus.cc:3060] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.348506 30596 tablet_bootstrap.cc:492] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:16.366621 30596 ts_tablet_manager.cc:1403] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.280s	user 0.016s	sys 0.001s
I20260709 13:09:16.367005 30401 raft_consensus.cc:2468] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:16.367548 30820 raft_consensus.cc:515] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.370886 30513 leader_election.cc:304] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:16.371992 30595 tablet_bootstrap.cc:654] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.373620 30818 raft_consensus.cc:2804] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.374148 30818 raft_consensus.cc:697] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:16.374975 30818 consensus_queue.cc:237] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:16.377641 30596 raft_consensus.cc:359] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.378391 30596 raft_consensus.cc:385] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.381489 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e11a3a73344f4f89bb1e70414ac6c1" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:16.382050 30474 raft_consensus.cc:3060] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.376371 30602 raft_consensus.cc:359] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.387169 30602 raft_consensus.cc:385] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.387549 30602 raft_consensus.cc:740] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.378660 30596 raft_consensus.cc:740] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.390625 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1f795e00974bcc85806849556a3a35" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:16.394601 30596 consensus_queue.cc:260] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.388325 30602 consensus_queue.cc:260] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.398407 30602 ts_tablet_manager.cc:1434] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.005s
I20260709 13:09:16.399305 30602 tablet_bootstrap.cc:492] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:16.403705 30813 leader_election.cc:290] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:16.411545 30817 raft_consensus.cc:493] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.412130 30670 raft_consensus.cc:493] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.412070 30817 raft_consensus.cc:515] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.412671 30670 raft_consensus.cc:515] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.413152 30322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e11a3a73344f4f89bb1e70414ac6c1" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:16.415011 30322 raft_consensus.cc:3060] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.415946 30326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1f795e00974bcc85806849556a3a35" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:16.416561 30326 raft_consensus.cc:3060] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.418673 30596 ts_tablet_manager.cc:1434] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:09:16.423013 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:16.423661 30475 raft_consensus.cc:2468] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:16.405777 30820 leader_election.cc:290] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:16.430965 30366 leader_election.cc:304] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:16.426153 30596 tablet_bootstrap.cc:492] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc: Bootstrap starting.
I20260709 13:09:16.437990 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:16.438791 30475 raft_consensus.cc:3060] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:16.421085 30514 leader_election.cc:343] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.408885 30323 raft_consensus.cc:2468] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:16.448622 30602 tablet_bootstrap.cc:654] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.460340 30475 raft_consensus.cc:2468] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:16.420053 30670 leader_election.cc:290] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:16.419499 30902 leader_election.cc:290] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:16.442188 30221 catalog_manager.cc:5697] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 0 to 1, leader changed from <none> to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.434749 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:16.464844 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:16.441628 30816 raft_consensus.cc:2804] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.425489 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:16.430243 30817 leader_election.cc:290] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:16.454839 30326 raft_consensus.cc:2468] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:16.473661 30545 raft_consensus.cc:2468] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
I20260709 13:09:16.447983 30321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:16.480288 30321 raft_consensus.cc:3060] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.472376 30816 raft_consensus.cc:493] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.481519 30513 leader_election.cc:304] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:16.482651 30941 raft_consensus.cc:2804] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.483117 30941 raft_consensus.cc:697] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:16.483907 30941 consensus_queue.cc:237] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.476140 30322 raft_consensus.cc:2468] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:16.485613 30513 leader_election.cc:304] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:16.477944 30366 leader_election.cc:304] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:16.481515 30816 raft_consensus.cc:3060] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.487818 30899 raft_consensus.cc:2804] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.489018 30474 raft_consensus.cc:2468] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:16.490206 30595 tablet_bootstrap.cc:492] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:16.493916 30595 ts_tablet_manager.cc:1403] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.221s	user 0.010s	sys 0.013s
I20260709 13:09:16.486531 30820 raft_consensus.cc:2804] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.494637 30820 raft_consensus.cc:697] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:16.495604 30820 consensus_queue.cc:237] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.451726 30880 consensus_queue.cc:1048] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:09:16.509756 30899 raft_consensus.cc:697] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:16.521869 30816 raft_consensus.cc:515] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.522338 30899 consensus_queue.cc:237] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.524245 30400 raft_consensus.cc:2393] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:16.527611 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:16.528256 30472 raft_consensus.cc:3060] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.536499 30816 leader_election.cc:290] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:16.537983 30321 raft_consensus.cc:2468] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:16.543843 30595 raft_consensus.cc:359] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:16.544548 30595 raft_consensus.cc:385] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.544857 30595 raft_consensus.cc:740] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.545539 30595 consensus_queue.cc:260] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:16.547832 30472 raft_consensus.cc:2468] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:16.555477 30596 tablet_bootstrap.cc:654] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.564365 30439 leader_election.cc:304] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:16.560547 30224 catalog_manager.cc:5697] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:16.568369 30290 consensus_peers.cc:597] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.572467 30595 ts_tablet_manager.cc:1434] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 13:09:16.570689 30919 raft_consensus.cc:2749] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.579115 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:16.579739 30542 raft_consensus.cc:3060] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.587368 30595 tablet_bootstrap.cc:492] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:16.606876 30602 tablet_bootstrap.cc:492] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:16.607571 30602 ts_tablet_manager.cc:1403] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.208s	user 0.008s	sys 0.009s
I20260709 13:09:16.612643 30931 consensus_queue.cc:1048] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:16.617173 30595 tablet_bootstrap.cc:654] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.610672 30602 raft_consensus.cc:359] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.626466 30602 raft_consensus.cc:385] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.626963 30602 raft_consensus.cc:740] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.641844 30602 consensus_queue.cc:260] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.642431 31015 consensus_queue.cc:1048] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.644200 30602 ts_tablet_manager.cc:1434] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:09:16.653919 30224 catalog_manager.cc:5697] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.655668 30224 catalog_manager.cc:5697] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.611543 30542 raft_consensus.cc:2468] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:16.657277 30366 leader_election.cc:304] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:16.658401 30602 tablet_bootstrap.cc:492] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:16.666620 30902 raft_consensus.cc:2804] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.669124 30902 raft_consensus.cc:697] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:16.675952 30902 consensus_queue.cc:237] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.678959 30596 tablet_bootstrap.cc:492] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc: No bootstrap required, opened a new log
I20260709 13:09:16.679507 30596 ts_tablet_manager.cc:1403] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc: Time spent bootstrapping tablet: real 0.258s	user 0.016s	sys 0.002s
I20260709 13:09:16.703130 30596 raft_consensus.cc:359] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.706251 30596 raft_consensus.cc:385] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.706530 30596 raft_consensus.cc:740] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.707866 30596 consensus_queue.cc:260] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.710093 30596 ts_tablet_manager.cc:1434] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:09:16.714076 30595 tablet_bootstrap.cc:492] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:16.714603 30595 ts_tablet_manager.cc:1403] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.003s
W20260709 13:09:16.715580 30271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:16.717916 30595 raft_consensus.cc:359] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.718642 30595 raft_consensus.cc:385] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.718923 30595 raft_consensus.cc:740] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.719669 30595 consensus_queue.cc:260] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.721101 30595 ts_tablet_manager.cc:1434] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:16.721999 30595 tablet_bootstrap.cc:492] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2: Bootstrap starting.
I20260709 13:09:16.727494 30595 tablet_bootstrap.cc:654] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.741664 30602 tablet_bootstrap.cc:654] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.744946 30220 catalog_manager.cc:5697] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.790678 30223 catalog_manager.cc:5697] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.807276 30595 tablet_bootstrap.cc:492] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2: No bootstrap required, opened a new log
I20260709 13:09:16.807746 30595 ts_tablet_manager.cc:1403] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.029s
I20260709 13:09:16.816767 30595 raft_consensus.cc:359] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.817492 30595 raft_consensus.cc:385] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.818239 30595 raft_consensus.cc:740] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.820696 30595 consensus_queue.cc:260] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.832764 31024 raft_consensus.cc:493] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.833257 31024 raft_consensus.cc:515] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.835210 31024 leader_election.cc:290] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:16.841179 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:16.841473 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:16.841944 30544 raft_consensus.cc:2468] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 0.
W20260709 13:09:16.842939 30366 leader_election.cc:343] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.843900 30366 leader_election.cc:304] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:16.844919 31024 raft_consensus.cc:2804] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.845268 31024 raft_consensus.cc:493] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.845582 31024 raft_consensus.cc:3060] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.862099 31015 consensus_queue.cc:1048] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.864243 30401 raft_consensus.cc:3060] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.865130 30602 tablet_bootstrap.cc:492] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:16.865599 30602 ts_tablet_manager.cc:1403] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.219s	user 0.031s	sys 0.033s
I20260709 13:09:16.865844 31024 raft_consensus.cc:515] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.867925 31024 leader_election.cc:290] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:16.868222 30602 raft_consensus.cc:359] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.868486 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:16.868871 30602 raft_consensus.cc:385] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.869194 30602 raft_consensus.cc:740] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.869412 30595 ts_tablet_manager.cc:1434] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.003s
W20260709 13:09:16.870074 30366 leader_election.cc:343] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.869889 30602 consensus_queue.cc:260] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.872485 30602 ts_tablet_manager.cc:1434] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:16.874220 30602 tablet_bootstrap.cc:492] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:16.875224 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:16.875824 30544 raft_consensus.cc:3060] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.880084 30602 tablet_bootstrap.cc:654] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.894776 30544 raft_consensus.cc:2468] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:16.896126 30366 leader_election.cc:304] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:16.896981 31024 raft_consensus.cc:2804] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.898986 30941 consensus_queue.cc:1048] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.899253 31024 raft_consensus.cc:697] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:16.900453 31024 consensus_queue.cc:237] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:16.919705 30939 consensus_queue.cc:1048] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.921077 30602 tablet_bootstrap.cc:492] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:16.921618 30602 ts_tablet_manager.cc:1403] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.006s
I20260709 13:09:16.924161 30602 raft_consensus.cc:359] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.924777 30602 raft_consensus.cc:385] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.925012 30602 raft_consensus.cc:740] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.925168 31008 raft_consensus.cc:493] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.925797 30602 consensus_queue.cc:260] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:16.925834 31008 raft_consensus.cc:515] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:16.928390 31008 leader_election.cc:290] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:16.930444 30321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1f795e00974bcc85806849556a3a35" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:16.931317 30321 raft_consensus.cc:2393] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:16.932966 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1f795e00974bcc85806849556a3a35" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:16.934610 30440 leader_election.cc:304] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:16.935568 31008 raft_consensus.cc:3060] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.942550 30474 raft_consensus.cc:3060] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.942783 31008 raft_consensus.cc:2749] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.943918 30602 ts_tablet_manager.cc:1434] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:09:16.944881 30602 tablet_bootstrap.cc:492] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:16.947562 31017 consensus_queue.cc:1048] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.953143 30602 tablet_bootstrap.cc:654] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.952917 30816 consensus_queue.cc:1048] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.962803 30880 consensus_queue.cc:1048] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:16.932550 30221 catalog_manager.cc:5697] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.003810 30602 tablet_bootstrap.cc:492] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:17.004345 30602 ts_tablet_manager.cc:1403] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.015s
I20260709 13:09:17.007282 30602 raft_consensus.cc:359] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:17.008023 30602 raft_consensus.cc:385] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.008322 30602 raft_consensus.cc:740] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.009094 30602 consensus_queue.cc:260] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:17.017786 30602 ts_tablet_manager.cc:1434] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:09:17.018834 30602 tablet_bootstrap.cc:492] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8: Bootstrap starting.
I20260709 13:09:17.020042 30820 consensus_queue.cc:1048] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.028575 30602 tablet_bootstrap.cc:654] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.037564 30941 consensus_queue.cc:1048] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.039737 30941 consensus_queue.cc:1048] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.047518 30818 raft_consensus.cc:493] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.048203 30818 raft_consensus.cc:515] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:17.062124 30818 leader_election.cc:290] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:17.069424 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b2a45700e14c769022b4d7361c3dee" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:17.070420 30475 raft_consensus.cc:2468] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:17.079998 30322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b2a45700e14c769022b4d7361c3dee" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:17.080788 30322 raft_consensus.cc:2468] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 0.
I20260709 13:09:17.083200 30602 tablet_bootstrap.cc:492] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8: No bootstrap required, opened a new log
I20260709 13:09:17.083487 30514 leader_election.cc:304] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:17.083756 30602 ts_tablet_manager.cc:1403] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.037s
I20260709 13:09:17.084386 30818 raft_consensus.cc:2804] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.084815 30818 raft_consensus.cc:493] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.085191 30818 raft_consensus.cc:3060] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.086867 30602 raft_consensus.cc:359] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:17.087647 30602 raft_consensus.cc:385] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.087945 30602 raft_consensus.cc:740] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.088649 30602 consensus_queue.cc:260] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:17.091638 30602 ts_tablet_manager.cc:1434] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:17.092944 30931 consensus_queue.cc:1048] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.109413 31008 raft_consensus.cc:493] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.110057 31008 raft_consensus.cc:515] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:17.113305 31008 leader_election.cc:290] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:17.113731 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:17.116304 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:17.117067 30547 raft_consensus.cc:2393] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 1: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:17.119289 30440 leader_election.cc:304] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:17.120340 31008 raft_consensus.cc:3060] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.123129 30818 raft_consensus.cc:515] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:17.125869 30818 leader_election.cc:290] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:17.126513 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b2a45700e14c769022b4d7361c3dee" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:17.126839 30322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b2a45700e14c769022b4d7361c3dee" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:17.127403 30475 raft_consensus.cc:3060] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.127453 30322 raft_consensus.cc:3060] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.130158 31008 raft_consensus.cc:2749] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.135540 30322 raft_consensus.cc:2468] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:17.136620 30513 leader_election.cc:304] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:17.137503 30818 raft_consensus.cc:2804] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.137985 30818 raft_consensus.cc:697] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:17.140413 30818 consensus_queue.cc:237] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:17.188522 30475 raft_consensus.cc:2468] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:17.202905 31008 raft_consensus.cc:493] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.203727 31008 raft_consensus.cc:515] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:17.205991 31008 leader_election.cc:290] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:17.204646 30220 catalog_manager.cc:5697] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 1 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.206615 30322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80f0c101daa484bb62d6ec96d3357f4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:17.207468 30322 raft_consensus.cc:2468] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:17.207657 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80f0c101daa484bb62d6ec96d3357f4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:17.208320 30400 raft_consensus.cc:2468] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 0.
I20260709 13:09:17.208524 30439 leader_election.cc:304] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:17.209404 31008 raft_consensus.cc:2804] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.209823 31008 raft_consensus.cc:493] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.210194 31008 raft_consensus.cc:3060] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.217782 31008 raft_consensus.cc:515] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:17.220997 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80f0c101daa484bb62d6ec96d3357f4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:17.220997 30322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80f0c101daa484bb62d6ec96d3357f4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:17.221731 30401 raft_consensus.cc:3060] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.224274 30899 consensus_queue.cc:1048] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.221764 30322 raft_consensus.cc:3060] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.227022 31008 leader_election.cc:290] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:17.230993 30401 raft_consensus.cc:2468] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:17.232254 30439 leader_election.cc:304] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:17.233045 31008 raft_consensus.cc:2804] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.233542 30322 raft_consensus.cc:2468] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:17.234735 31008 raft_consensus.cc:697] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:17.235637 31008 consensus_queue.cc:237] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:17.247511 31017 consensus_queue.cc:1048] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.251399 30223 catalog_manager.cc:5697] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.360898 31017 consensus_queue.cc:1048] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.371078 30899 consensus_queue.cc:1048] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.589452 30931 consensus_queue.cc:1048] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.599640 30931 consensus_queue.cc:1048] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.678725 30670 consensus_queue.cc:1048] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.689014 31057 consensus_queue.cc:1048] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:18.900818 30291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:41005, user_credentials={real_user=slave}} blocked reactor thread for 62478.4us
W20260709 13:09:18.945405 30513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:32987, user_credentials={real_user=slave}} blocked reactor thread for 44875.6us
I20260709 13:09:19.136292 20694 tablet_server.cc:179] TabletServer@127.20.53.129:0 shutting down...
W20260709 13:09:19.164620 30365 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 13:09:19.171988 30365 consensus_peers.cc:597] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.185319 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:19.186239 20694 tablet_replica.cc:333] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.187150 20694 raft_consensus.cc:2243] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.188151 20694 raft_consensus.cc:2272] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.191344 20694 tablet_replica.cc:333] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.192512 20694 raft_consensus.cc:2243] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.193435 20694 raft_consensus.cc:2272] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.197177 20694 tablet_replica.cc:333] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.198328 20694 raft_consensus.cc:2243] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.199733 20694 raft_consensus.cc:2272] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.203656 20694 tablet_replica.cc:333] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.204507 20694 raft_consensus.cc:2243] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.205614 20694 raft_consensus.cc:2272] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.208608 20694 tablet_replica.cc:333] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.209702 20694 raft_consensus.cc:2243] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.210409 20694 raft_consensus.cc:2272] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.212829 30513 consensus_peers.cc:597] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.213539 20694 tablet_replica.cc:333] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.214298 20694 raft_consensus.cc:2243] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.215363 20694 raft_consensus.cc:2272] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.217999 20694 tablet_replica.cc:333] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.218631 20694 raft_consensus.cc:2243] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.219098 20694 raft_consensus.cc:2272] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.221411 20694 tablet_replica.cc:333] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.222095 20694 raft_consensus.cc:2243] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.222628 20694 raft_consensus.cc:2272] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.226104 20694 tablet_replica.cc:333] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.227265 20694 raft_consensus.cc:2243] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.228560 20694 raft_consensus.cc:2272] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.231977 20694 tablet_replica.cc:333] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
W20260709 13:09:19.232678 30513 consensus_peers.cc:597] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.232872 20694 raft_consensus.cc:2243] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.233502 20694 raft_consensus.cc:2272] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.236023 20694 tablet_replica.cc:333] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.236604 20694 raft_consensus.cc:2243] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.237535 20694 raft_consensus.cc:2272] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.240051 20694 tablet_replica.cc:333] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.240589 20694 raft_consensus.cc:2243] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.241012 20694 raft_consensus.cc:2272] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.243101 20694 tablet_replica.cc:333] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.243700 20694 raft_consensus.cc:2243] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.244117 20694 raft_consensus.cc:2272] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.246322 20694 tablet_replica.cc:333] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.246855 20694 raft_consensus.cc:2243] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.247360 20694 raft_consensus.cc:2272] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.250147 20694 tablet_replica.cc:333] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.251049 20694 raft_consensus.cc:2243] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.251740 20694 raft_consensus.cc:2272] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.254807 20694 tablet_replica.cc:333] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.255467 20694 raft_consensus.cc:2243] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.255927 20694 raft_consensus.cc:2272] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.258111 20694 tablet_replica.cc:333] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.258731 20694 raft_consensus.cc:2243] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.259213 20694 raft_consensus.cc:2272] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.261363 20694 tablet_replica.cc:333] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.261902 20694 raft_consensus.cc:2243] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.262393 20694 raft_consensus.cc:2272] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.264714 20694 tablet_replica.cc:333] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.265380 20694 raft_consensus.cc:2243] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.266059 20694 raft_consensus.cc:2272] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.269636 20694 tablet_replica.cc:333] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.270562 20694 raft_consensus.cc:2243] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:19.271514 30365 consensus_peers.cc:597] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.271883 20694 raft_consensus.cc:2272] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.274683 20694 tablet_replica.cc:333] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.275267 20694 raft_consensus.cc:2243] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.276280 20694 raft_consensus.cc:2272] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.279457 20694 tablet_replica.cc:333] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.280033 20694 raft_consensus.cc:2243] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.280516 20694 raft_consensus.cc:2272] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.283520 20694 tablet_replica.cc:333] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.284365 20694 raft_consensus.cc:2243] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.285475 20694 raft_consensus.cc:2272] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.286768 30513 consensus_peers.cc:597] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.288112 20694 tablet_replica.cc:333] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.288792 20694 raft_consensus.cc:2243] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.289289 20694 raft_consensus.cc:2272] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.291630 20694 tablet_replica.cc:333] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.292309 20694 raft_consensus.cc:2243] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.292789 20694 raft_consensus.cc:2272] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.295313 20694 tablet_replica.cc:333] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.295914 20694 raft_consensus.cc:2243] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.296404 20694 raft_consensus.cc:2272] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.298975 20694 tablet_replica.cc:333] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.299628 20694 raft_consensus.cc:2243] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.300112 20694 raft_consensus.cc:2272] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.302919 20694 tablet_replica.cc:333] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.303507 20694 raft_consensus.cc:2243] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.303980 20694 raft_consensus.cc:2272] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.307072 20694 tablet_replica.cc:333] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.307938 20694 raft_consensus.cc:2243] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.308535 20694 raft_consensus.cc:2272] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.311774 20694 tablet_replica.cc:333] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.312477 20694 raft_consensus.cc:2243] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.313652 20694 raft_consensus.cc:2272] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.316751 20694 tablet_replica.cc:333] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.317564 20694 raft_consensus.cc:2243] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.318400 20694 raft_consensus.cc:2272] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.321900 20694 tablet_replica.cc:333] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.322538 20694 raft_consensus.cc:2243] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.323451 20694 raft_consensus.cc:2272] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.325923 20694 tablet_replica.cc:333] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.326624 20694 raft_consensus.cc:2243] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.327873 20694 raft_consensus.cc:2272] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.330094 20694 tablet_replica.cc:333] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.330785 20694 raft_consensus.cc:2243] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.331245 20694 raft_consensus.cc:2272] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.333499 20694 tablet_replica.cc:333] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.334097 20694 raft_consensus.cc:2243] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.334615 20694 raft_consensus.cc:2272] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.337416 20694 tablet_replica.cc:333] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.337956 20694 raft_consensus.cc:2243] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.338495 20694 raft_consensus.cc:2272] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.340579 20694 tablet_replica.cc:333] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.341120 20694 raft_consensus.cc:2243] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.342082 20694 raft_consensus.cc:2272] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.344285 20694 tablet_replica.cc:333] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.344931 20694 raft_consensus.cc:2243] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.346222 20694 raft_consensus.cc:2272] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.348989 20694 tablet_replica.cc:333] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.349666 20694 raft_consensus.cc:2243] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.350214 20694 raft_consensus.cc:2272] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.352393 20694 tablet_replica.cc:333] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.352955 20694 raft_consensus.cc:2243] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.353982 20694 raft_consensus.cc:2272] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.356074 20694 tablet_replica.cc:333] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.356611 20694 raft_consensus.cc:2243] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.357455 20694 raft_consensus.cc:2272] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.359514 20694 tablet_replica.cc:333] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.360023 20694 raft_consensus.cc:2243] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.360874 20694 raft_consensus.cc:2272] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.363019 20694 tablet_replica.cc:333] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.363559 20694 raft_consensus.cc:2243] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.364415 20694 raft_consensus.cc:2272] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.366587 20694 tablet_replica.cc:333] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.367108 20694 raft_consensus.cc:2243] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.367563 20694 raft_consensus.cc:2272] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.369594 20694 tablet_replica.cc:333] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: stopping tablet replica
I20260709 13:09:19.370098 20694 raft_consensus.cc:2243] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.370612 20694 raft_consensus.cc:2272] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.380311 30439 consensus_peers.cc:597] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.386431 30439 consensus_peers.cc:597] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.389367 30365 consensus_peers.cc:597] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.395124 30365 consensus_peers.cc:597] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.400916 30365 consensus_peers.cc:597] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.402318 30513 consensus_peers.cc:597] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.425423 30513 consensus_peers.cc:597] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.430333 30439 consensus_peers.cc:597] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.458191 20694 tablet_server.cc:196] TabletServer@127.20.53.129:0 shutdown complete.
W20260709 13:09:19.462476 30513 consensus_peers.cc:597] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.495410 30365 consensus_peers.cc:597] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.510720 30513 consensus_peers.cc:597] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.511375 30513 consensus_peers.cc:597] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.512207 30365 consensus_peers.cc:597] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.513152 30439 consensus_peers.cc:597] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.519335 30439 consensus_peers.cc:597] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.523527 30439 consensus_peers.cc:597] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.526130 30365 consensus_peers.cc:597] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.541200 30365 consensus_peers.cc:597] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.556627 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:19.569018 31082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:19.567376 31083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:19.589391 31086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:19.590996 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:19.593967 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:19.594292 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:19.594529 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602559594508 us; error 0 us; skew 500 ppm
I20260709 13:09:19.595273 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:19.598776 20694 webserver.cc:533] Webserver started at http://127.20.53.129:36737/ using document root <none> and password file <none>
W20260709 13:09:19.599226 30513 consensus_peers.cc:597] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.599303 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:19.599834 20694 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:19.603701 20694 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:09:19.611862 31090 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:19.612785 20694 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:09:19.613152 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "d868b6e1c0be407dbc470002a447a620"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-r056"
I20260709 13:09:19.613667 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:09:19.613903 30513 consensus_peers.cc:597] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.648451 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:19.654467 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:19.657433 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:09:19.660430 30513 consensus_peers.cc:597] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.663236 31098 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:09:19.685352 30513 consensus_peers.cc:597] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.885833 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:09:19.886276 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.224s	user 0.008s	sys 0.000s
I20260709 13:09:19.886660 20694 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:09:19.896684 31098 tablet_bootstrap.cc:492] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:19.910351 31098 tablet_bootstrap.cc:492] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:19.911707 31098 tablet_bootstrap.cc:492] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:19.912317 31098 ts_tablet_manager.cc:1403] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:09:19.915148 31098 raft_consensus.cc:359] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:19.916071 31098 raft_consensus.cc:740] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.916942 31098 consensus_queue.cc:260] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:19.925691 31098 ts_tablet_manager.cc:1434] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.006s
I20260709 13:09:19.926478 31098 tablet_bootstrap.cc:492] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:19.945170 31098 tablet_bootstrap.cc:492] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:19.946038 31098 tablet_bootstrap.cc:492] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:19.946651 31098 ts_tablet_manager.cc:1403] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.001s
I20260709 13:09:19.948560 31098 raft_consensus.cc:359] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:19.949206 31098 raft_consensus.cc:740] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.949743 31098 consensus_queue.cc:260] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:19.951676 31098 ts_tablet_manager.cc:1434] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:19.952394 31098 tablet_bootstrap.cc:492] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:19.965691 31098 tablet_bootstrap.cc:492] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:19.966516 31098 tablet_bootstrap.cc:492] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:19.966989 31098 ts_tablet_manager.cc:1403] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:09:19.969161 31098 raft_consensus.cc:359] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:19.969811 31098 raft_consensus.cc:740] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.970515 31098 consensus_queue.cc:260] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:19.971864 31098 ts_tablet_manager.cc:1434] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:19.972455 31098 tablet_bootstrap.cc:492] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:19.983220 31098 tablet_bootstrap.cc:492] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:19.983891 31098 tablet_bootstrap.cc:492] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:19.984367 31098 ts_tablet_manager.cc:1403] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:09:19.986091 31098 raft_consensus.cc:359] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:19.986655 31098 raft_consensus.cc:740] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.987236 31098 consensus_queue.cc:260] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:19.988662 31098 ts_tablet_manager.cc:1434] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:19.989317 31098 tablet_bootstrap.cc:492] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.004384 31098 tablet_bootstrap.cc:492] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.005314 31098 tablet_bootstrap.cc:492] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.007136 31098 ts_tablet_manager.cc:1403] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:09:20.009462 31098 raft_consensus.cc:359] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.010103 31098 raft_consensus.cc:740] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.010753 31098 consensus_queue.cc:260] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.012591 31098 ts_tablet_manager.cc:1434] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:20.013365 31098 tablet_bootstrap.cc:492] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.027927 31098 tablet_bootstrap.cc:492] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.028831 31098 tablet_bootstrap.cc:492] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.029425 31098 ts_tablet_manager.cc:1403] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:09:20.031867 31098 raft_consensus.cc:359] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.032509 31098 raft_consensus.cc:740] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.033305 31098 consensus_queue.cc:260] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.035115 31098 ts_tablet_manager.cc:1434] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:09:20.038751 31098 tablet_bootstrap.cc:492] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.052618 31098 tablet_bootstrap.cc:492] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.053541 31098 tablet_bootstrap.cc:492] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.054152 31098 ts_tablet_manager.cc:1403] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:09:20.056736 31098 raft_consensus.cc:359] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.057401 31098 raft_consensus.cc:740] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.058122 31098 consensus_queue.cc:260] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.060138 31098 ts_tablet_manager.cc:1434] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:20.060864 31098 tablet_bootstrap.cc:492] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.085577 31098 tablet_bootstrap.cc:492] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.086493 31098 tablet_bootstrap.cc:492] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.087082 31098 ts_tablet_manager.cc:1403] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:09:20.089411 31098 raft_consensus.cc:359] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.090057 31098 raft_consensus.cc:740] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.105086 31098 consensus_queue.cc:260] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.108397 31098 ts_tablet_manager.cc:1434] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:09:20.109143 31098 tablet_bootstrap.cc:492] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.138590 20694 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:09:20.139132 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.252s	user 0.222s	sys 0.004s
I20260709 13:09:20.160495 31100 raft_consensus.cc:493] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.161214 31100 raft_consensus.cc:515] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
W20260709 13:09:20.169823 30439 leader_election.cc:336] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111)
I20260709 13:09:20.172019 31100 leader_election.cc:290] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.179961 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.195386 30440 leader_election.cc:304] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:20.196671 31008 raft_consensus.cc:2749] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.229739 31098 tablet_bootstrap.cc:492] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.230858 31098 tablet_bootstrap.cc:492] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.231667 31098 ts_tablet_manager.cc:1403] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.123s	user 0.040s	sys 0.072s
I20260709 13:09:20.235415 31098 raft_consensus.cc:359] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.236299 31098 raft_consensus.cc:740] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.237293 31098 consensus_queue.cc:260] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.245607 31098 ts_tablet_manager.cc:1434] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:09:20.246596 31098 tablet_bootstrap.cc:492] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.263620 31098 tablet_bootstrap.cc:492] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.264442 31098 tablet_bootstrap.cc:492] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.265031 31098 ts_tablet_manager.cc:1403] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:09:20.266896 31098 raft_consensus.cc:359] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.267410 31098 raft_consensus.cc:740] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.267999 31098 consensus_queue.cc:260] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.269649 31098 ts_tablet_manager.cc:1434] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:20.270320 31098 tablet_bootstrap.cc:492] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.272743 30820 raft_consensus.cc:493] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.273303 30820 raft_consensus.cc:515] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.275300 30820 leader_election.cc:290] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.277359 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.278012 30472 raft_consensus.cc:2468] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:20.279927 30514 leader_election.cc:304] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:20.283138 31071 raft_consensus.cc:2804] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.283480 31071 raft_consensus.cc:493] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.283846 31071 raft_consensus.cc:3060] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:20.287891 30513 leader_election.cc:336] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111)
I20260709 13:09:20.296419 31098 tablet_bootstrap.cc:492] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.296936 31071 raft_consensus.cc:515] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.297427 31098 tablet_bootstrap.cc:492] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.298498 31098 ts_tablet_manager.cc:1403] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.004s
W20260709 13:09:20.304011 30513 leader_election.cc:336] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111)
I20260709 13:09:20.304828 31071 leader_election.cc:290] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.307348 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:20.304067 31098 raft_consensus.cc:359] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.311583 31098 raft_consensus.cc:740] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.311676 30472 raft_consensus.cc:3060] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.312387 31098 consensus_queue.cc:260] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.314596 31098 ts_tablet_manager.cc:1434] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:09:20.315335 31098 tablet_bootstrap.cc:492] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.318902 30472 raft_consensus.cc:2468] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
I20260709 13:09:20.320403 30514 leader_election.cc:304] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: d868b6e1c0be407dbc470002a447a620
I20260709 13:09:20.321218 31071 raft_consensus.cc:2804] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.321877 31071 raft_consensus.cc:697] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:20.323016 31071 consensus_queue.cc:237] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.341383 31098 tablet_bootstrap.cc:492] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.342357 31098 tablet_bootstrap.cc:492] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.343027 31098 ts_tablet_manager.cc:1403] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 13:09:20.345536 31098 raft_consensus.cc:359] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.348217 31098 raft_consensus.cc:740] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.348898 31098 consensus_queue.cc:260] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.351183 31098 ts_tablet_manager.cc:1434] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:20.351927 31098 tablet_bootstrap.cc:492] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.358565 30223 catalog_manager.cc:5697] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.369063 31098 tablet_bootstrap.cc:492] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.370455 31098 tablet_bootstrap.cc:492] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.371114 31098 ts_tablet_manager.cc:1403] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:09:20.373524 31098 raft_consensus.cc:359] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.374182 31098 raft_consensus.cc:740] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.374857 31098 consensus_queue.cc:260] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.376760 31098 ts_tablet_manager.cc:1434] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:20.377514 31098 tablet_bootstrap.cc:492] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.391494 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:46147
I20260709 13:09:20.391640 31176 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:46147 every 8 connection(s)
I20260709 13:09:20.394696 31098 tablet_bootstrap.cc:492] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.395628 31098 tablet_bootstrap.cc:492] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.396268 31098 ts_tablet_manager.cc:1403] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:09:20.398757 31098 raft_consensus.cc:359] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.399511 31098 raft_consensus.cc:740] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.400266 31098 consensus_queue.cc:260] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.401783 31098 ts_tablet_manager.cc:1434] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:20.403779 31098 tablet_bootstrap.cc:492] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.411144 31071 raft_consensus.cc:493] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.411729 31071 raft_consensus.cc:515] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.413841 31071 leader_election.cc:290] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.419518 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:20.417537 31008 raft_consensus.cc:493] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.421180 31008 raft_consensus.cc:515] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.425683 31008 leader_election.cc:290] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.427284 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:20.434098 31063 raft_consensus.cc:493] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.435665 31095 raft_consensus.cc:493] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.436233 31095 raft_consensus.cc:515] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.438577 31095 leader_election.cc:290] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.434703 31063 raft_consensus.cc:515] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.441350 31063 leader_election.cc:290] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.447819 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.451067 30816 raft_consensus.cc:493] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.451596 30816 raft_consensus.cc:515] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.453475 30816 leader_election.cc:290] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.460029 31099 raft_consensus.cc:493] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.460539 31099 raft_consensus.cc:515] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.462765 31099 leader_election.cc:290] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.464879 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.465466 30472 raft_consensus.cc:2468] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.467788 30366 leader_election.cc:304] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:20.468453 31063 raft_consensus.cc:2804] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.468829 31063 raft_consensus.cc:493] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.469985 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.470666 30544 raft_consensus.cc:2468] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.471026 31100 raft_consensus.cc:493] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.456092 31095 raft_consensus.cc:493] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.471567 31100 raft_consensus.cc:515] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.471906 31095 raft_consensus.cc:515] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.473598 31100 leader_election.cc:290] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.473914 31095 leader_election.cc:290] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.494549 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.475903 31177 heartbeater.cc:344] Connected to a master server at 127.20.53.190:42571
I20260709 13:09:20.485188 31063 raft_consensus.cc:3060] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.474102 31100 raft_consensus.cc:493] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.534902 31100 raft_consensus.cc:515] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.537585 31100 leader_election.cc:290] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.481102 31066 raft_consensus.cc:493] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.539623 31066 raft_consensus.cc:515] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.542843 31177 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:20.544220 31177 heartbeater.cc:507] Master 127.20.53.190:42571 requested a full tablet report, sending...
I20260709 13:09:20.548569 30816 raft_consensus.cc:493] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.548945 30820 raft_consensus.cc:493] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.549088 30816 raft_consensus.cc:515] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.549415 30820 raft_consensus.cc:515] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.550817 30816 leader_election.cc:290] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.551168 30820 leader_election.cc:290] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.551616 30820 raft_consensus.cc:493] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.552196 31095 raft_consensus.cc:493] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.552680 31095 raft_consensus.cc:515] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.552959 30366 leader_election.cc:304] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:20.551645 30816 raft_consensus.cc:493] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
W20260709 13:09:20.556279 30365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 57410.8us
I20260709 13:09:20.554296 30820 raft_consensus.cc:515] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.560423 30816 raft_consensus.cc:515] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.479384 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.479918 31141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.481880 31138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.567312 31138 raft_consensus.cc:2468] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.480420 31140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.569016 31142 raft_consensus.cc:2468] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.563292 31066 leader_election.cc:290] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.564208 31071 raft_consensus.cc:493] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.571027 31071 raft_consensus.cc:515] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.567324 30820 leader_election.cc:290] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.573647 31098 tablet_bootstrap.cc:492] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:20.575423 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.575977 30472 raft_consensus.cc:2468] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.586833 30816 leader_election.cc:290] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.592769 30816 raft_consensus.cc:2804] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.593283 30816 raft_consensus.cc:493] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.593708 30816 raft_consensus.cc:3060] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.577724 31008 raft_consensus.cc:493] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.577095 31066 raft_consensus.cc:493] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.597709 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.604048 31008 raft_consensus.cc:515] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.618861 31066 raft_consensus.cc:515] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.638059 30472 raft_consensus.cc:2468] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.639715 31066 leader_election.cc:290] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.641752 31188 raft_consensus.cc:493] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.626502 31095 leader_election.cc:290] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.603382 31186 raft_consensus.cc:493] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.631053 31098 tablet_bootstrap.cc:492] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:20.632053 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.632678 31099 raft_consensus.cc:493] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.591682 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.634696 31071 leader_election.cc:290] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.636515 30820 raft_consensus.cc:493] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.651130 31098 ts_tablet_manager.cc:1403] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.248s	user 0.041s	sys 0.084s
I20260709 13:09:20.650424 31188 raft_consensus.cc:515] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.648419 30366 leader_election.cc:304] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:20.655366 30544 raft_consensus.cc:2468] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.662467 31063 raft_consensus.cc:515] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.664445 31063 leader_election.cc:290] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.665263 31098 raft_consensus.cc:359] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.665838 30820 raft_consensus.cc:515] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.666214 31098 raft_consensus.cc:740] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.667479 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.667106 31098 consensus_queue.cc:260] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.668092 30475 raft_consensus.cc:2468] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:20.669417 31188 leader_election.cc:290] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.655759 31099 raft_consensus.cc:515] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.653682 31186 raft_consensus.cc:515] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.656944 31142 raft_consensus.cc:2468] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.658592 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.667760 30820 leader_election.cc:290] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.657387 30816 raft_consensus.cc:515] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.672902 30816 leader_election.cc:290] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.674096 30514 leader_election.cc:304] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:20.677690 30820 raft_consensus.cc:493] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.669888 31008 leader_election.cc:290] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.677867 31100 raft_consensus.cc:493] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.680366 31100 raft_consensus.cc:515] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.681509 31099 leader_election.cc:290] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.681836 31137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.682130 31189 raft_consensus.cc:493] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.682533 31137 raft_consensus.cc:2468] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:20.682657 31189 raft_consensus.cc:515] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.683596 31139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.684396 31135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.684813 31189 leader_election.cc:290] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.684892 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.682525 31140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.685724 31144 raft_consensus.cc:2468] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:20.686128 31140 raft_consensus.cc:2468] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:20.685086 31135 raft_consensus.cc:2468] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:20.687997 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:20.686383 31192 raft_consensus.cc:2804] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.688375 31098 ts_tablet_manager.cc:1434] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:09:20.689911 31098 tablet_bootstrap.cc:492] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:20.687433 30820 raft_consensus.cc:515] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.690822 30401 raft_consensus.cc:2393] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:20.690798 30366 leader_election.cc:304] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:20.676481 31066 raft_consensus.cc:493] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.682528 31100 leader_election.cc:290] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.696951 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:20.697135 31196 raft_consensus.cc:2804] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.697539 30547 raft_consensus.cc:3060] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.697767 31196 raft_consensus.cc:493] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.698348 31196 raft_consensus.cc:3060] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.701233 31063 raft_consensus.cc:493] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.696961 31066 raft_consensus.cc:515] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.701749 31063 raft_consensus.cc:515] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.704600 31066 leader_election.cc:290] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.705132 31063 leader_election.cc:290] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.692699 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.693326 31195 raft_consensus.cc:2804] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.705912 31195 raft_consensus.cc:493] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.689332 31192 raft_consensus.cc:493] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.706344 31195 raft_consensus.cc:3060] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.706737 31192 raft_consensus.cc:3060] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.709810 30547 raft_consensus.cc:2468] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:20.710440 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.710894 31186 leader_election.cc:290] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.711074 30544 raft_consensus.cc:2468] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.694463 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.694538 31008 raft_consensus.cc:493] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.695425 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:20.695473 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:20.695968 30366 leader_election.cc:304] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:20.712128 30472 raft_consensus.cc:2468] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:20.712956 30474 raft_consensus.cc:3060] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.713177 31008 raft_consensus.cc:515] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.715652 30514 leader_election.cc:304] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:20.716559 31199 raft_consensus.cc:2804] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.716775 31008 leader_election.cc:290] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:20.716953 31199 raft_consensus.cc:493] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.717417 31199 raft_consensus.cc:3060] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.717823 30475 raft_consensus.cc:2468] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:20.718467 31135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.719097 31135 raft_consensus.cc:2468] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:20.719635 30514 leader_election.cc:304] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:20.720503 31200 raft_consensus.cc:2804] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.721256 31140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.721580 31135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.721877 31140 raft_consensus.cc:2468] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:20.714520 30816 raft_consensus.cc:2804] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.722506 30816 raft_consensus.cc:493] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.720875 31200 raft_consensus.cc:493] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.723587 31200 raft_consensus.cc:3060] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.724525 30820 leader_election.cc:290] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.722870 31141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.722864 30816 raft_consensus.cc:3060] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.728232 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.728413 30474 raft_consensus.cc:2468] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:20.729619 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.727082 30366 leader_election.cc:304] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:20.723203 30223 ts_manager.cc:194] Re-registered known tserver with Master: d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.731572 30366 leader_election.cc:304] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:20.731863 31198 raft_consensus.cc:2804] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.732410 31198 raft_consensus.cc:697] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:20.733124 31095 raft_consensus.cc:2804] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.733613 31095 raft_consensus.cc:493] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.733209 31198 consensus_queue.cc:237] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.733982 31095 raft_consensus.cc:3060] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.736635 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" is_pre_election: true
I20260709 13:09:20.737233 30474 raft_consensus.cc:2468] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.738626 30366 leader_election.cc:304] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:20.739017 30439 leader_election.cc:304] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:20.739619 31185 raft_consensus.cc:493] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.739691 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
W20260709 13:09:20.740084 30439 leader_election.cc:343] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.740147 31185 raft_consensus.cc:515] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.740909 30439 leader_election.cc:304] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:20.742304 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:20.742652 31189 raft_consensus.cc:2804] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.743005 30401 raft_consensus.cc:2468] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:20.742390 31185 leader_election.cc:290] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.743245 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:20.743606 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.743954 30398 raft_consensus.cc:2468] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:20.744318 31142 raft_consensus.cc:2468] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.744920 30366 leader_election.cc:304] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:20.745622 31185 raft_consensus.cc:2804] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.743214 31189 raft_consensus.cc:697] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:20.746181 31185 raft_consensus.cc:493] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.746598 31185 raft_consensus.cc:3060] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.746834 31189 consensus_queue.cc:237] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.750020 31008 raft_consensus.cc:2804] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.750459 31008 raft_consensus.cc:493] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.750840 31008 raft_consensus.cc:3060] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.754616 31066 raft_consensus.cc:2804] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.754703 31193 raft_consensus.cc:493] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.755147 31066 raft_consensus.cc:493] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.755264 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.755568 31066 raft_consensus.cc:3060] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.755290 31193 raft_consensus.cc:515] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.759171 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.759479 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.759828 31193 leader_election.cc:290] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.760743 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.753140 30439 leader_election.cc:304] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:20.761389 30548 raft_consensus.cc:2468] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:20.765355 31190 raft_consensus.cc:2804] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.765801 31190 raft_consensus.cc:493] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.766148 31190 raft_consensus.cc:3060] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.771191 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.772027 30542 raft_consensus.cc:2468] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.773317 30474 raft_consensus.cc:1275] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:20.777199 31185 raft_consensus.cc:515] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.763538 30439 leader_election.cc:304] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:20.774760 31195 raft_consensus.cc:515] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.779570 30816 raft_consensus.cc:515] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.784607 31100 raft_consensus.cc:2804] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.790277 31100 raft_consensus.cc:493] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.790485 31141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ac125ecb5b491f9092fee90d68849c" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:20.785053 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:20.778937 30439 leader_election.cc:304] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:20.790694 31100 raft_consensus.cc:3060] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.783306 30820 consensus_queue.cc:1048] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:20.769654 31095 raft_consensus.cc:515] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
W20260709 13:09:20.792906 30439 leader_election.cc:343] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.792395 30366 leader_election.cc:304] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:20.797039 30439 leader_election.cc:304] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:20.791960 31135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
W20260709 13:09:20.800266 30439 leader_election.cc:343] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:20.801199 30439 leader_election.cc:343] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.801738 30400 raft_consensus.cc:2393] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:20.805586 30816 leader_election.cc:290] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.803273 30439 leader_election.cc:304] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:20.803357 31188 raft_consensus.cc:2804] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.803844 31194 raft_consensus.cc:2804] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.814057 31135 raft_consensus.cc:2468] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.831152 31194 raft_consensus.cc:493] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.831598 31194 raft_consensus.cc:3060] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.831755 30223 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52782
I20260709 13:09:20.831845 31185 leader_election.cc:290] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.805195 31140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:20.835310 31095 leader_election.cc:290] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.835844 31141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.836019 31191 raft_consensus.cc:2804] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.836491 31141 raft_consensus.cc:2468] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:20.793581 31192 raft_consensus.cc:515] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.835319 31195 leader_election.cc:290] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.836477 31191 raft_consensus.cc:493] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.838964 31137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.839201 31191 raft_consensus.cc:3060] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.839612 31137 raft_consensus.cc:2468] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:20.802939 31196 raft_consensus.cc:515] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.818094 31206 raft_consensus.cc:2749] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.861658 30820 raft_consensus.cc:493] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.862407 30820 raft_consensus.cc:515] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.830396 31188 raft_consensus.cc:493] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.833710 31190 raft_consensus.cc:515] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
W20260709 13:09:20.875715 30365 leader_election.cc:343] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.836480 31135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
W20260709 13:09:20.883816 30366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.132:41005, user_credentials={real_user=slave}} blocked reactor thread for 92293us
W20260709 13:09:20.886130 30439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:32987, user_credentials={real_user=slave}} blocked reactor thread for 82961us
W20260709 13:09:20.886524 30365 leader_election.cc:343] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.888085 30365 leader_election.cc:304] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:20.887593 30544 raft_consensus.cc:2393] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:20.919171 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:20.919862 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:20.920636 30547 raft_consensus.cc:3060] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.885316 30397 raft_consensus.cc:2393] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:20.923527 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:20.924206 30820 leader_election.cc:290] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.924443 30548 raft_consensus.cc:3060] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.925299 30472 raft_consensus.cc:2393] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 2: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:20.884040 31188 raft_consensus.cc:3060] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.935304 31008 raft_consensus.cc:515] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:20.932050 31137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.936836 31200 raft_consensus.cc:515] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:20.937472 31008 leader_election.cc:290] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.938753 30541 raft_consensus.cc:2393] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:20.939018 31200 leader_election.cc:290] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:20.940225 31196 leader_election.cc:290] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
W20260709 13:09:20.941593 30365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 53591.1us
I20260709 13:09:20.942358 31186 raft_consensus.cc:2804] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.942744 31186 raft_consensus.cc:493] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.943068 31186 raft_consensus.cc:3060] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:20.943387 30365 leader_election.cc:343] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.943898 30365 leader_election.cc:304] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:20.946031 31189 raft_consensus.cc:2749] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.946103 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:20.950570 31135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.951192 31190 leader_election.cc:290] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:20.951300 31135 raft_consensus.cc:2468] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.955171 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:20.956502 31199 raft_consensus.cc:515] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
W20260709 13:09:20.963568 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.132:41005, user_credentials={real_user=slave}} blocked reactor thread for 144641us
W20260709 13:09:20.968675 30365 leader_election.cc:343] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:20.970609 30365 leader_election.cc:343] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.961903 31192 leader_election.cc:290] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.974334 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:20.975216 30397 raft_consensus.cc:2393] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:20.975317 30396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:20.976037 30396 raft_consensus.cc:2468] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 1.
I20260709 13:09:20.978217 31191 raft_consensus.cc:515] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:20.973901 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:20.974527 31199 leader_election.cc:290] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:20.980779 30547 raft_consensus.cc:2468] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
W20260709 13:09:20.982019 30439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:32987, user_credentials={real_user=slave}} blocked reactor thread for 94250.3us
I20260709 13:09:20.983537 30439 leader_election.cc:304] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: d868b6e1c0be407dbc470002a447a620
I20260709 13:09:20.984185 30401 raft_consensus.cc:2393] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:20.989208 30366 leader_election.cc:304] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:20.988405 30545 raft_consensus.cc:2393] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:20.993053 31134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:20.993335 31205 raft_consensus.cc:2804] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.993767 31134 raft_consensus.cc:2468] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 1.
I20260709 13:09:20.995476 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:20.996181 31144 raft_consensus.cc:3060] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.998741 31206 raft_consensus.cc:2804] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.999035 31136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:20.999200 31206 raft_consensus.cc:493] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:20.998761 31177 heartbeater.cc:499] Master 127.20.53.190:42571 was elected leader, sending a full tablet report...
I20260709 13:09:21.002864 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:21.009083 30365 leader_election.cc:304] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc
I20260709 13:09:20.999665 31136 raft_consensus.cc:3060] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.002519 31206 raft_consensus.cc:3060] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.002066 31141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.003242 31205 raft_consensus.cc:697] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:21.015031 30399 raft_consensus.cc:2393] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:21.012138 31134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.021529 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.023775 31211 raft_consensus.cc:2804] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:21.034192 30440 leader_election.cc:304] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.036098 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2" is_pre_election: true
I20260709 13:09:21.017647 31141 raft_consensus.cc:3060] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.037119 30513 leader_election.cc:304] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:21.018766 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:21.035704 30398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:21.055558 30398 raft_consensus.cc:2393] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:21.055804 30548 raft_consensus.cc:2468] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:21.045964 31137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.059381 31137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:21.060034 31138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:21.062346 31205 consensus_queue.cc:237] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.063243 31098 tablet_bootstrap.cc:492] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.064030 31139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.064419 31098 tablet_bootstrap.cc:492] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:21.064611 31139 raft_consensus.cc:3060] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.065128 31098 ts_tablet_manager.cc:1403] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.375s	user 0.020s	sys 0.006s
I20260709 13:09:21.040316 31190 raft_consensus.cc:3060] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.067878 31098 raft_consensus.cc:359] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:21.068504 31098 raft_consensus.cc:740] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.068840 31191 leader_election.cc:290] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:21.038757 31134 raft_consensus.cc:3060] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.037596 31142 raft_consensus.cc:3060] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.037504 31140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:21.080243 31144 raft_consensus.cc:2468] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:21.054844 30541 raft_consensus.cc:3060] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.069168 31098 consensus_queue.cc:260] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
W20260709 13:09:21.071547 30365 leader_election.cc:343] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.073283 31135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:21.073560 31141 raft_consensus.cc:2468] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:21.088996 31098 ts_tablet_manager.cc:1434] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:09:21.079722 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:21.036370 31211 raft_consensus.cc:493] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:21.091903 31211 raft_consensus.cc:3060] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.092033 30545 raft_consensus.cc:2393] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:21.094900 31066 raft_consensus.cc:515] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.096045 30475 raft_consensus.cc:2393] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 2: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:21.099526 31211 raft_consensus.cc:515] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.100710 30401 raft_consensus.cc:2393] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:21.101616 31136 raft_consensus.cc:2468] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:21.082727 30440 leader_election.cc:304] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.039808 31194 raft_consensus.cc:515] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.104773 31194 leader_election.cc:290] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:21.081863 30366 leader_election.cc:304] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:21.105397 31142 raft_consensus.cc:2468] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:21.105749 31185 raft_consensus.cc:2804] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.106297 31185 raft_consensus.cc:697] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:21.106576 31066 leader_election.cc:290] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:21.084362 30439 leader_election.cc:304] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.108049 31098 tablet_bootstrap.cc:492] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:21.103171 31211 leader_election.cc:290] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:21.107121 31185 consensus_queue.cc:237] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.108588 31137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.109666 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:21.110503 30475 raft_consensus.cc:2393] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 2: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:21.114311 31214 raft_consensus.cc:2804] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:21.114825 31214 raft_consensus.cc:493] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:21.115212 31214 raft_consensus.cc:3060] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.117802 31139 raft_consensus.cc:2468] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:21.119601 31190 raft_consensus.cc:2749] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.120661 31100 raft_consensus.cc:515] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.121140 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:21.122182 30471 raft_consensus.cc:2393] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 2: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:21.122905 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:21.123405 31100 leader_election.cc:290] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:21.123570 30475 raft_consensus.cc:3060] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:21.129182 30439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 45122.4us
I20260709 13:09:21.130863 30365 leader_election.cc:304] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:21.133105 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:21.104964 31134 raft_consensus.cc:2468] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:21.133724 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.150527 31144 raft_consensus.cc:3060] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.151460 30545 raft_consensus.cc:3060] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.156213 30365 leader_election.cc:304] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:21.156498 31205 raft_consensus.cc:2804] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.157244 31189 raft_consensus.cc:2804] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:21.157645 30365 leader_election.cc:343] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.157712 31189 raft_consensus.cc:697] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:21.159009 31144 raft_consensus.cc:2468] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:21.136777 31098 tablet_bootstrap.cc:492] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.140369 30470 raft_consensus.cc:2468] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
I20260709 13:09:21.142524 31186 raft_consensus.cc:515] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.143304 31190 raft_consensus.cc:2749] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.144248 30220 catalog_manager.cc:5697] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.163272 30475 raft_consensus.cc:2468] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
I20260709 13:09:21.145301 31188 raft_consensus.cc:515] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:21.169272 31194 raft_consensus.cc:493] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:21.159070 31189 consensus_queue.cc:237] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.169777 31194 raft_consensus.cc:515] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:21.170523 31188 leader_election.cc:290] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:21.171804 31194 leader_election.cc:290] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:21.171636 31214 raft_consensus.cc:515] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.173621 31214 leader_election.cc:290] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:21.165738 31137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:21.167022 31134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78821f2f4788465aa83d3e5c08880b46" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:21.175697 31141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.164497 31205 raft_consensus.cc:697] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:21.159190 30365 leader_election.cc:304] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:21.168646 31215 raft_consensus.cc:2749] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.173652 31186 leader_election.cc:290] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:21.148741 31206 raft_consensus.cc:515] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.148362 30439 leader_election.cc:304] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 746044612df94d4493276099e7ab6adc
I20260709 13:09:21.183333 31141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f8d6b0a2c24237bfd34dc90265a90b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.183820 30545 raft_consensus.cc:2468] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:21.184124 31134 raft_consensus.cc:2393] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:21.179853 30514 leader_election.cc:304] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:21.184407 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:21.184558 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc" is_pre_election: true
I20260709 13:09:21.184895 31205 consensus_queue.cc:237] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.185422 31191 raft_consensus.cc:2804] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.186878 30365 leader_election.cc:304] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:21.195591 31212 raft_consensus.cc:2804] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.196308 31212 raft_consensus.cc:697] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:21.197400 31212 consensus_queue.cc:237] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:21.198045 31137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.198378 31186 raft_consensus.cc:2804] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.198701 31137 raft_consensus.cc:3060] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.198968 31186 raft_consensus.cc:697] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:21.194566 30549 raft_consensus.cc:2468] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:21.199849 31186 consensus_queue.cc:237] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.200356 30546 raft_consensus.cc:3060] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.203702 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:21.195643 31191 raft_consensus.cc:697] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:21.204319 30399 raft_consensus.cc:3060] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.205010 31191 consensus_queue.cc:237] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.206355 31100 raft_consensus.cc:2804] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.207057 31100 raft_consensus.cc:697] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
W20260709 13:09:21.209444 30365 consensus_peers.cc:597] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.187227 31140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c9a6a34931479d909d663f8b380d22" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.187500 30513 leader_election.cc:304] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:21.191669 31098 tablet_bootstrap.cc:492] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
W20260709 13:09:21.212535 30513 leader_election.cc:343] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.212970 30513 leader_election.cc:304] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.213294 31098 ts_tablet_manager.cc:1403] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.007s
I20260709 13:09:21.146381 30541 raft_consensus.cc:2468] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
W20260709 13:09:21.193617 30439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 45295.4us
I20260709 13:09:21.198324 31141 raft_consensus.cc:2393] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 2: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:21.190516 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c9c5d7bdc24f9f9f2b47e78c0b682e" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
W20260709 13:09:21.214246 30513 leader_election.cc:343] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.233875 30513 leader_election.cc:304] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
W20260709 13:09:21.235262 30513 leader_election.cc:343] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:21.237143 30513 leader_election.cc:343] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.194489 30514 leader_election.cc:304] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:21.222946 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:21.238677 30513 leader_election.cc:304] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.193105 31139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
W20260709 13:09:21.239405 30514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42903, user_credentials={real_user=slave}} blocked reactor thread for 45012us
I20260709 13:09:21.214761 31099 raft_consensus.cc:2804] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:21.240880 30366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:42903, user_credentials={real_user=slave}} blocked reactor thread for 63496.5us
I20260709 13:09:21.241533 30401 raft_consensus.cc:2393] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:21.208142 31100 consensus_queue.cc:237] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:21.219759 31192 raft_consensus.cc:2749] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.251791 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:21.252724 30470 raft_consensus.cc:2393] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ce9922db6144b968eeb78946b314cd2 in current term 2: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:21.234843 31193 raft_consensus.cc:2749] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.254678 30366 leader_election.cc:304] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.258294 31136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea36533e01d4b6b83d15744c3b6ef1d" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.260875 31098 raft_consensus.cc:359] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.261574 31098 raft_consensus.cc:740] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.262269 31139 raft_consensus.cc:2393] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:21.256772 30400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:21.247020 31099 raft_consensus.cc:493] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:21.264163 31099 raft_consensus.cc:3060] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.264909 31206 leader_election.cc:290] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:21.263073 30399 raft_consensus.cc:2468] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
I20260709 13:09:21.268296 30546 raft_consensus.cc:2468] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:21.248167 31071 raft_consensus.cc:2749] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.247321 31200 raft_consensus.cc:2804] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.248793 31144 raft_consensus.cc:3060] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.269820 31098 consensus_queue.cc:260] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.277806 31200 raft_consensus.cc:697] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:21.271191 31211 raft_consensus.cc:2804] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.286158 31211 raft_consensus.cc:697] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:21.287119 31211 consensus_queue.cc:237] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.289646 30396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:21.290288 31139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.290119 31200 consensus_queue.cc:237] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.291100 31139 raft_consensus.cc:2393] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:21.298959 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
W20260709 13:09:21.300015 30513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 56981.1us
I20260709 13:09:21.300493 30399 raft_consensus.cc:3060] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:21.300793 30513 leader_election.cc:343] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.301231 31098 ts_tablet_manager.cc:1434] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.001s
W20260709 13:09:21.301891 30513 consensus_peers.cc:597] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.302093 31098 tablet_bootstrap.cc:492] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
W20260709 13:09:21.302615 30513 leader_election.cc:343] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:21.304234 30513 leader_election.cc:343] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.305272 30440 leader_election.cc:304] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:21.307133 30440 leader_election.cc:304] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:21.292928 31137 raft_consensus.cc:2468] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:21.319796 30513 leader_election.cc:304] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.321205 30820 raft_consensus.cc:2804] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.321648 30820 raft_consensus.cc:697] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:21.310859 31215 raft_consensus.cc:2804] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:21.325366 30820 consensus_queue.cc:237] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.315709 31066 raft_consensus.cc:2804] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.341276 30513 leader_election.cc:304] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.342221 31137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620" is_pre_election: true
I20260709 13:09:21.342872 31137 raft_consensus.cc:2468] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 1.
I20260709 13:09:21.339102 30439 leader_election.cc:304] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.346989 30513 leader_election.cc:304] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.327554 31215 raft_consensus.cc:493] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:21.348956 30365 leader_election.cc:304] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:21.349155 30439 leader_election.cc:304] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.334462 31139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36116499b18c4347ab81d06dae391bde" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.374622 31071 raft_consensus.cc:2749] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.375866 31190 raft_consensus.cc:2749] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.345997 31099 raft_consensus.cc:515] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:21.339027 31066 raft_consensus.cc:697] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:21.397728 30513 leader_election.cc:304] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.397773 31066 consensus_queue.cc:237] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:21.399312 31071 raft_consensus.cc:2749] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.380837 30399 raft_consensus.cc:2468] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:21.388769 31188 raft_consensus.cc:2749] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.390736 31211 raft_consensus.cc:2804] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.404866 31211 raft_consensus.cc:697] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:21.348096 31135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797883f7836a4e6091473c791399388f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.393041 31140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3877cc17044236b7955a08144da062" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.406133 31140 raft_consensus.cc:3060] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.405827 31211 consensus_queue.cc:237] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.406777 31099 leader_election.cc:290] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
I20260709 13:09:21.374343 31215 raft_consensus.cc:3060] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:21.408468 30439 leader_election.cc:343] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.390789 30548 raft_consensus.cc:1275] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.394951 31139 raft_consensus.cc:2393] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 9ce9922db6144b968eeb78946b314cd2 in this term.
I20260709 13:09:21.414139 30439 leader_election.cc:304] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.346563 31200 raft_consensus.cc:2749] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.423580 30439 leader_election.cc:304] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.426662 31204 consensus_queue.cc:1048] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.427631 31188 raft_consensus.cc:2749] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.429270 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
W20260709 13:09:21.435979 30365 consensus_peers.cc:597] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.444420 31188 raft_consensus.cc:2804] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.461133 30475 raft_consensus.cc:1275] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.463248 30816 consensus_queue.cc:1048] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.468039 31141 raft_consensus.cc:1275] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.466465 31188 raft_consensus.cc:697] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:21.514783 31188 consensus_queue.cc:237] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.516088 31215 raft_consensus.cc:515] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:21.467769 31136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.517421 30470 raft_consensus.cc:2393] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 746044612df94d4493276099e7ab6adc in current term 2: Already voted for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in this term.
I20260709 13:09:21.517685 31136 raft_consensus.cc:3060] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.477685 31140 raft_consensus.cc:2468] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:21.474779 31144 raft_consensus.cc:2468] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
I20260709 13:09:21.532766 30220 catalog_manager.cc:5697] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:21.541746 30365 consensus_peers.cc:597] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.531314 31198 consensus_queue.cc:1048] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:09:21.568456 31136 raft_consensus.cc:2468] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
W20260709 13:09:21.583604 30365 consensus_peers.cc:597] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.595173 31215 leader_election.cc:290] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147)
W20260709 13:09:21.598513 30513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:46147, user_credentials={real_user=slave}} blocked reactor thread for 75654.5us
I20260709 13:09:21.608116 31136 raft_consensus.cc:1275] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.611409 31241 consensus_queue.cc:1048] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.614482 30513 leader_election.cc:304] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:21.615283 31192 raft_consensus.cc:2804] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.615756 31192 raft_consensus.cc:697] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:21.616530 31192 consensus_queue.cc:237] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:21.624915 30221 catalog_manager.cc:5697] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.627413 30474 raft_consensus.cc:1275] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.631923 30220 catalog_manager.cc:5697] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.638489 31141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d868b6e1c0be407dbc470002a447a620"
I20260709 13:09:21.639333 31141 raft_consensus.cc:2393] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbdb7dfefaa45db890b43f14b3867d8 in current term 2: Already voted for candidate 746044612df94d4493276099e7ab6adc in this term.
I20260709 13:09:21.641804 31141 raft_consensus.cc:1275] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.643662 31211 consensus_queue.cc:1048] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.644176 31205 consensus_queue.cc:1048] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.647754 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:21.648808 31098 tablet_bootstrap.cc:492] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.649849 31098 tablet_bootstrap.cc:492] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:21.650657 31098 ts_tablet_manager.cc:1403] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.349s	user 0.026s	sys 0.041s
I20260709 13:09:21.653334 31098 raft_consensus.cc:359] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.653820 30440 leader_election.cc:304] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:21.654101 31098 raft_consensus.cc:740] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.653556 30224 catalog_manager.cc:5697] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.655156 31098 consensus_queue.cc:260] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:21.655215 30224 catalog_manager.cc:5697] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.656602 31188 raft_consensus.cc:2749] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.657475 31098 ts_tablet_manager.cc:1434] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:21.658461 31098 tablet_bootstrap.cc:492] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:21.661260 31138 raft_consensus.cc:1275] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:21.665519 30365 consensus_peers.cc:597] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.666407 31189 consensus_queue.cc:1048] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.667840 30474 raft_consensus.cc:1275] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.669193 31234 consensus_queue.cc:1048] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.679777 30220 catalog_manager.cc:5697] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.681972 30220 catalog_manager.cc:5697] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.700521 31098 tablet_bootstrap.cc:492] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.701480 31098 tablet_bootstrap.cc:492] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:21.702085 31098 ts_tablet_manager.cc:1403] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 13:09:21.704171 31136 raft_consensus.cc:1275] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.705243 31098 raft_consensus.cc:359] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.705984 31098 raft_consensus.cc:740] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.705485 30220 catalog_manager.cc:5697] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.706802 31098 consensus_queue.cc:260] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.707864 30220 catalog_manager.cc:5697] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.709620 31098 ts_tablet_manager.cc:1434] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:21.710423 31098 tablet_bootstrap.cc:492] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:21.715219 30546 raft_consensus.cc:1275] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:21.709672 30513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:32987, user_credentials={real_user=slave}} blocked reactor thread for 48718.8us
I20260709 13:09:21.722074 30221 catalog_manager.cc:5697] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.722854 30474 raft_consensus.cc:1275] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.726357 31186 consensus_queue.cc:1048] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.732362 31136 raft_consensus.cc:1275] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.709398 30220 catalog_manager.cc:5697] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.735749 31071 consensus_queue.cc:1048] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.736451 30220 catalog_manager.cc:5697] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.738022 30220 catalog_manager.cc:5697] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.739475 30220 catalog_manager.cc:5697] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.749655 30546 raft_consensus.cc:1275] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.754753 30546 raft_consensus.cc:1275] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.755414 30475 raft_consensus.cc:1275] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.757943 30546 raft_consensus.cc:1275] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.763417 31186 consensus_queue.cc:1048] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.765587 31098 tablet_bootstrap.cc:492] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.777508 31098 tablet_bootstrap.cc:492] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:21.778141 31098 ts_tablet_manager.cc:1403] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.004s
I20260709 13:09:21.780529 30475 raft_consensus.cc:1275] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.780544 31098 raft_consensus.cc:359] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.782095 31098 raft_consensus.cc:740] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.781956 31071 consensus_queue.cc:1048] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.783294 31098 consensus_queue.cc:260] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.785123 31098 ts_tablet_manager.cc:1434] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:09:21.785892 31098 tablet_bootstrap.cc:492] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:21.783313 30224 catalog_manager.cc:5697] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.788852 31189 consensus_queue.cc:1048] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.789906 31241 consensus_queue.cc:1048] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.787957 30224 catalog_manager.cc:5697] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 1 to 2, leader changed from d868b6e1c0be407dbc470002a447a620 (127.20.53.129) to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.792021 31205 consensus_queue.cc:1048] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.794348 31205 consensus_queue.cc:1048] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:21.797472 30513 consensus_peers.cc:597] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.820016 31205 consensus_queue.cc:1048] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.844100 30546 raft_consensus.cc:1275] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.826537 31141 raft_consensus.cc:1275] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.855302 31100 consensus_queue.cc:1048] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:21.861217 30439 consensus_peers.cc:597] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.856168 31141 raft_consensus.cc:3060] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:21.871950 30365 consensus_peers.cc:597] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.874186 31191 consensus_queue.cc:1048] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.877849 31136 raft_consensus.cc:1275] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:21.888152 30513 consensus_peers.cc:597] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.889213 30513 consensus_peers.cc:597] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.901988 31197 consensus_queue.cc:1048] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.906005 30395 raft_consensus.cc:1275] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.907600 31140 raft_consensus.cc:1275] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.909178 31100 consensus_queue.cc:1048] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.909657 31098 tablet_bootstrap.cc:492] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.910666 31098 tablet_bootstrap.cc:492] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:21.911288 31098 ts_tablet_manager.cc:1403] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.126s	user 0.058s	sys 0.053s
I20260709 13:09:21.913836 31098 raft_consensus.cc:359] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.914669 31098 raft_consensus.cc:740] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.915460 31098 consensus_queue.cc:260] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:21.917768 31098 ts_tablet_manager.cc:1434] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:21.918975 31234 consensus_queue.cc:1048] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.923727 31098 tablet_bootstrap.cc:492] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:21.925421 30470 raft_consensus.cc:1275] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:21.927129 31195 consensus_queue.cc:1048] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.984200 31137 raft_consensus.cc:1275] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:21.986745 30439 consensus_peers.cc:597] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.987947 31215 consensus_queue.cc:1048] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.004968 31098 tablet_bootstrap.cc:492] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.005909 31098 tablet_bootstrap.cc:492] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.006521 30541 raft_consensus.cc:1275] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.011242 30395 raft_consensus.cc:1275] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.006520 31098 ts_tablet_manager.cc:1403] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.000s
I20260709 13:09:22.014540 31098 raft_consensus.cc:359] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.015170 31098 raft_consensus.cc:740] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.015839 31098 consensus_queue.cc:260] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.017839 31098 ts_tablet_manager.cc:1434] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:09:22.018904 31098 tablet_bootstrap.cc:492] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.019443 31190 consensus_queue.cc:1048] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.022468 31188 consensus_queue.cc:1048] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:22.028585 30365 consensus_peers.cc:597] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:22.043231 30439 consensus_peers.cc:597] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.069808 31098 tablet_bootstrap.cc:492] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:22.071429 30439 consensus_peers.cc:597] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.070716 31098 tablet_bootstrap.cc:492] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.072330 31098 ts_tablet_manager.cc:1403] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.017s
I20260709 13:09:22.080495 31098 raft_consensus.cc:359] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.081183 31098 raft_consensus.cc:740] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.082707 31139 raft_consensus.cc:1275] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.081885 31098 consensus_queue.cc:260] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.084414 31098 ts_tablet_manager.cc:1434] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.005s
I20260709 13:09:22.085652 31098 tablet_bootstrap.cc:492] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.085542 31071 consensus_queue.cc:1048] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:22.100534 30439 consensus_peers.cc:597] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.109040 30470 raft_consensus.cc:1275] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.110498 31099 consensus_queue.cc:1048] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.112829 31098 tablet_bootstrap.cc:492] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.113775 31098 tablet_bootstrap.cc:492] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.114406 31098 ts_tablet_manager.cc:1403] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.007s
I20260709 13:09:22.117126 31098 raft_consensus.cc:359] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.117789 31098 raft_consensus.cc:740] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.118575 31098 consensus_queue.cc:260] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.120568 31098 ts_tablet_manager.cc:1434] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:22.121354 31098 tablet_bootstrap.cc:492] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.145701 31098 tablet_bootstrap.cc:492] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.150287 31098 tablet_bootstrap.cc:492] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.150951 31098 ts_tablet_manager.cc:1403] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 13:09:22.153208 31098 raft_consensus.cc:359] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.153797 31098 raft_consensus.cc:740] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.154544 31098 consensus_queue.cc:260] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.156658 31098 ts_tablet_manager.cc:1434] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:09:22.157382 31098 tablet_bootstrap.cc:492] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
W20260709 13:09:22.163268 30513 consensus_peers.cc:597] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.171718 31098 tablet_bootstrap.cc:492] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.172418 31098 tablet_bootstrap.cc:492] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.173003 31098 ts_tablet_manager.cc:1403] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:09:22.174924 31098 raft_consensus.cc:359] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.175431 31098 raft_consensus.cc:740] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.175906 31098 consensus_queue.cc:260] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.177299 31098 ts_tablet_manager.cc:1434] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:09:22.178213 31098 tablet_bootstrap.cc:492] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.191249 31098 tablet_bootstrap.cc:492] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.192070 31098 tablet_bootstrap.cc:492] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.192729 31098 ts_tablet_manager.cc:1403] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:09:22.195254 31098 raft_consensus.cc:359] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.195896 31098 raft_consensus.cc:740] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.196590 31098 consensus_queue.cc:260] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.198770 31098 ts_tablet_manager.cc:1434] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:09:22.199493 31098 tablet_bootstrap.cc:492] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.211638 31098 tablet_bootstrap.cc:492] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.212543 31098 tablet_bootstrap.cc:492] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.213171 31098 ts_tablet_manager.cc:1403] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:09:22.215122 31098 raft_consensus.cc:359] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.215677 31098 raft_consensus.cc:740] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.216270 31098 consensus_queue.cc:260] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.218242 31098 ts_tablet_manager.cc:1434] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:09:22.219380 31098 tablet_bootstrap.cc:492] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.235282 31098 tablet_bootstrap.cc:492] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.236163 31098 tablet_bootstrap.cc:492] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.236785 31098 ts_tablet_manager.cc:1403] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:09:22.239360 31098 raft_consensus.cc:359] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.240012 31098 raft_consensus.cc:740] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.241032 31098 consensus_queue.cc:260] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.243119 31098 ts_tablet_manager.cc:1434] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:22.243986 31098 tablet_bootstrap.cc:492] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.257455 31098 tablet_bootstrap.cc:492] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.258085 31098 tablet_bootstrap.cc:492] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.258647 31098 ts_tablet_manager.cc:1403] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:09:22.260944 31098 raft_consensus.cc:359] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.261590 31098 raft_consensus.cc:740] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.262639 31098 consensus_queue.cc:260] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.265349 31098 ts_tablet_manager.cc:1434] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:22.266053 31098 tablet_bootstrap.cc:492] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.278972 31098 tablet_bootstrap.cc:492] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.279595 31098 tablet_bootstrap.cc:492] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.280058 31098 ts_tablet_manager.cc:1403] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:09:22.281744 31098 raft_consensus.cc:359] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.282366 31098 raft_consensus.cc:740] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.283075 31098 consensus_queue.cc:260] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.285038 31098 ts_tablet_manager.cc:1434] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:22.285964 31098 tablet_bootstrap.cc:492] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.298408 31098 tablet_bootstrap.cc:492] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.299104 31098 tablet_bootstrap.cc:492] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.299613 31098 ts_tablet_manager.cc:1403] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:09:22.301261 31098 raft_consensus.cc:359] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.301739 31098 raft_consensus.cc:740] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.302318 31098 consensus_queue.cc:260] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.303651 31098 ts_tablet_manager.cc:1434] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:22.304518 31098 tablet_bootstrap.cc:492] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.320698 31098 tablet_bootstrap.cc:492] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.321614 31098 tablet_bootstrap.cc:492] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.322255 31098 ts_tablet_manager.cc:1403] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:09:22.325474 31098 raft_consensus.cc:359] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.327004 31098 raft_consensus.cc:740] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.327711 31098 consensus_queue.cc:260] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.330109 31098 ts_tablet_manager.cc:1434] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:22.330896 31098 tablet_bootstrap.cc:492] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
W20260709 13:09:22.345762 30513 consensus_peers.cc:597] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.348433 31098 tablet_bootstrap.cc:492] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:22.348446 30513 consensus_peers.cc:597] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.350070 31098 tablet_bootstrap.cc:492] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.350745 31098 ts_tablet_manager.cc:1403] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 13:09:22.353284 31098 raft_consensus.cc:359] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.353978 31098 raft_consensus.cc:740] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.354650 31098 consensus_queue.cc:260] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.356099 31098 ts_tablet_manager.cc:1434] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:22.356876 31098 tablet_bootstrap.cc:492] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.360495 31137 raft_consensus.cc:3060] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:22.386503 30513 consensus_peers.cc:597] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.390530 31098 tablet_bootstrap.cc:492] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.391506 31098 tablet_bootstrap.cc:492] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.392130 31098 ts_tablet_manager.cc:1403] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.015s
I20260709 13:09:22.394531 31098 raft_consensus.cc:359] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.395180 31098 raft_consensus.cc:740] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.395887 31098 consensus_queue.cc:260] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.398524 31098 ts_tablet_manager.cc:1434] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:22.399260 31098 tablet_bootstrap.cc:492] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
W20260709 13:09:22.400504 30513 consensus_peers.cc:597] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.413236 31098 tablet_bootstrap.cc:492] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.414112 31098 tablet_bootstrap.cc:492] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.414732 31098 ts_tablet_manager.cc:1403] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.007s
I20260709 13:09:22.417132 31098 raft_consensus.cc:359] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.417747 31098 raft_consensus.cc:740] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.418390 31098 consensus_queue.cc:260] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.420534 31098 ts_tablet_manager.cc:1434] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:22.421484 31098 tablet_bootstrap.cc:492] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.435467 31098 tablet_bootstrap.cc:492] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.436326 31098 tablet_bootstrap.cc:492] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.436937 31098 ts_tablet_manager.cc:1403] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:09:22.439252 31098 raft_consensus.cc:359] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.439841 31098 raft_consensus.cc:740] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.440577 31098 consensus_queue.cc:260] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.442656 31098 ts_tablet_manager.cc:1434] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:09:22.443385 31098 tablet_bootstrap.cc:492] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
W20260709 13:09:22.450801 30513 consensus_peers.cc:597] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.460402 31098 tablet_bootstrap.cc:492] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.461347 31098 tablet_bootstrap.cc:492] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.462348 31098 ts_tablet_manager.cc:1403] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:09:22.464672 31098 raft_consensus.cc:359] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.465297 31098 raft_consensus.cc:740] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.465911 31098 consensus_queue.cc:260] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.467677 31098 ts_tablet_manager.cc:1434] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:22.468617 31098 tablet_bootstrap.cc:492] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.486635 31098 tablet_bootstrap.cc:492] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.487708 31098 tablet_bootstrap.cc:492] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.488409 31098 ts_tablet_manager.cc:1403] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:09:22.490875 31098 raft_consensus.cc:359] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.491415 31098 raft_consensus.cc:740] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.492101 31098 consensus_queue.cc:260] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.494020 31098 ts_tablet_manager.cc:1434] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:22.495476 31098 tablet_bootstrap.cc:492] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.513631 31098 tablet_bootstrap.cc:492] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.514556 31098 tablet_bootstrap.cc:492] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.515101 31098 ts_tablet_manager.cc:1403] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 13:09:22.517370 31098 raft_consensus.cc:359] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.519017 31098 raft_consensus.cc:740] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.519644 31098 consensus_queue.cc:260] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.521410 31098 ts_tablet_manager.cc:1434] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:09:22.522138 31098 tablet_bootstrap.cc:492] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.546504 31098 tablet_bootstrap.cc:492] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.547358 31098 tablet_bootstrap.cc:492] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.547968 31098 ts_tablet_manager.cc:1403] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.008s
I20260709 13:09:22.551182 31137 raft_consensus.cc:3060] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.551612 31098 raft_consensus.cc:359] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.552330 31098 raft_consensus.cc:740] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.554574 31098 consensus_queue.cc:260] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.562404 31098 ts_tablet_manager.cc:1434] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:22.564010 31098 tablet_bootstrap.cc:492] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.588253 31098 tablet_bootstrap.cc:492] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.589135 31098 tablet_bootstrap.cc:492] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.589784 31098 ts_tablet_manager.cc:1403] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
W20260709 13:09:22.590755 30513 consensus_peers.cc:597] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:22.591904 31098 raft_consensus.cc:359] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.592535 31098 raft_consensus.cc:740] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.593042 31098 consensus_queue.cc:260] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:22.594664 31098 ts_tablet_manager.cc:1434] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 13:09:22.595335 31098 tablet_bootstrap.cc:492] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.608424 31098 tablet_bootstrap.cc:492] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.609360 31098 tablet_bootstrap.cc:492] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.609985 31098 ts_tablet_manager.cc:1403] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:09:22.611943 31098 raft_consensus.cc:359] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.612429 31098 raft_consensus.cc:740] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.613006 31098 consensus_queue.cc:260] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:22.614221 31098 ts_tablet_manager.cc:1434] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.000s
I20260709 13:09:22.614828 31098 tablet_bootstrap.cc:492] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.628948 31098 tablet_bootstrap.cc:492] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.629906 31098 tablet_bootstrap.cc:492] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.630656 31098 ts_tablet_manager.cc:1403] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:09:22.632910 31098 raft_consensus.cc:359] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.634073 31098 raft_consensus.cc:740] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.634732 31098 consensus_queue.cc:260] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.636656 31098 ts_tablet_manager.cc:1434] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:22.637383 31098 tablet_bootstrap.cc:492] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: Bootstrap starting.
I20260709 13:09:22.650840 31139 raft_consensus.cc:3060] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.652017 31098 tablet_bootstrap.cc:492] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.652927 31098 tablet_bootstrap.cc:492] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: Bootstrap complete.
I20260709 13:09:22.653517 31098 ts_tablet_manager.cc:1403] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:09:22.656008 31098 raft_consensus.cc:359] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.656642 31098 raft_consensus.cc:740] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Initialized, Role: FOLLOWER
I20260709 13:09:22.657263 31098 consensus_queue.cc:260] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:22.661011 31098 ts_tablet_manager.cc:1434] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:09:22.676532 31139 raft_consensus.cc:3060] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.763264 31139 raft_consensus.cc:3060] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.869549 31141 raft_consensus.cc:3060] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.398041 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:30.454000 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11632b693d5b414081e9b42a335cc646"
dest_uuid: "746044612df94d4493276099e7ab6adc"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:58976
I20260709 13:09:30.455020 30548 raft_consensus.cc:606] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:30.457607 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155"
dest_uuid: "746044612df94d4493276099e7ab6adc"
mode: GRACEFUL
new_leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
 from {username='slave'} at 127.0.0.1:58976
I20260709 13:09:30.458084 30548 raft_consensus.cc:606] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Received request to transfer leadership to TS 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:30.460512 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b"
dest_uuid: "746044612df94d4493276099e7ab6adc"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:58976
I20260709 13:09:30.461030 30548 raft_consensus.cc:606] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:30.474253 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:30.474855 30399 raft_consensus.cc:606] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:30.477665 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44"
dest_uuid: "746044612df94d4493276099e7ab6adc"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:58976
I20260709 13:09:30.478263 30548 raft_consensus.cc:606] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:30.480731 30541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4"
dest_uuid: "746044612df94d4493276099e7ab6adc"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:58976
I20260709 13:09:30.481143 30541 raft_consensus.cc:606] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:30.482244 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:30.485272 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:30.699412 31192 raft_consensus.cc:993] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.699966 31192 raft_consensus.cc:1081] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.701509 31141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44312
I20260709 13:09:30.701934 31141 raft_consensus.cc:493] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.702296 31141 raft_consensus.cc:3060] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.709504 31141 raft_consensus.cc:515] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:30.711738 31141 leader_election.cc:290] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:30.723639 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:30.724226 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad579e9c484c3cbb0c1352ef847b44" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:30.724429 30541 raft_consensus.cc:3055] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.724803 30541 raft_consensus.cc:740] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:30.724839 30399 raft_consensus.cc:3060] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.725847 30541 consensus_queue.cc:260] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:30.727391 30541 raft_consensus.cc:3060] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.739987 30399 raft_consensus.cc:2468] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:30.742035 31092 leader_election.cc:304] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:30.743956 31335 raft_consensus.cc:2804] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.745872 30541 raft_consensus.cc:2468] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:30.747510 31335 raft_consensus.cc:697] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:30.748636 31335 consensus_queue.cc:237] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:30.754015 31327 raft_consensus.cc:993] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.754892 31327 raft_consensus.cc:1081] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.756433 31141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44312
I20260709 13:09:30.756876 31141 raft_consensus.cc:493] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.757181 31141 raft_consensus.cc:3060] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.762212 31141 raft_consensus.cc:515] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:30.764222 31141 leader_election.cc:290] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:30.764837 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:30.765389 30541 raft_consensus.cc:3055] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:30.765718 30541 raft_consensus.cc:740] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:30.766510 30541 consensus_queue.cc:260] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:30.767665 30541 raft_consensus.cc:3060] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.775811 30220 catalog_manager.cc:5697] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 1 to 2, leader changed from 746044612df94d4493276099e7ab6adc (127.20.53.132) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.779001 30541 raft_consensus.cc:2468] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:30.780222 31093 leader_election.cc:304] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:30.781075 31335 raft_consensus.cc:2804] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:30.781672 31335 raft_consensus.cc:697] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:30.782841 31335 consensus_queue.cc:237] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:30.789026 31327 raft_consensus.cc:993] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.792176 31327 raft_consensus.cc:1081] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.795710 31137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44312
I20260709 13:09:30.796263 31137 raft_consensus.cc:493] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.796562 31137 raft_consensus.cc:3060] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.801047 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c2293eacb4a2594938e734a24a3d4" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:30.801764 30475 raft_consensus.cc:3060] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.803515 31137 raft_consensus.cc:515] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:30.805722 31137 leader_election.cc:290] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:30.809504 30475 raft_consensus.cc:2468] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:30.810777 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:30.811609 30470 raft_consensus.cc:3060] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.814946 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "287a40c43efc4dd499b573c0e9e2278b" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:30.815572 30541 raft_consensus.cc:3055] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:30.815899 30541 raft_consensus.cc:740] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:30.816731 30541 consensus_queue.cc:260] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:30.817947 30541 raft_consensus.cc:3060] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.821038 30470 raft_consensus.cc:2468] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:30.822383 31093 leader_election.cc:304] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:30.823205 31335 raft_consensus.cc:2804] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:30.823762 31335 raft_consensus.cc:697] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:30.824779 30541 raft_consensus.cc:2468] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:30.824613 31335 consensus_queue.cc:237] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:30.839771 31332 raft_consensus.cc:993] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.839107 30220 catalog_manager.cc:5697] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 2 to 3, leader changed from 746044612df94d4493276099e7ab6adc (127.20.53.132) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.840420 31204 raft_consensus.cc:1081] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.840704 30220 catalog_manager.cc:5697] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 2 to 3, leader changed from 746044612df94d4493276099e7ab6adc (127.20.53.132) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.842087 31137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44286
I20260709 13:09:30.842645 31137 raft_consensus.cc:493] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.842965 31137 raft_consensus.cc:3060] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.848155 31137 raft_consensus.cc:515] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:30.850714 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:30.851171 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a938526c3f4d4e7aaedba12e36fc5e25" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:30.851313 30541 raft_consensus.cc:3060] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.851743 30399 raft_consensus.cc:3055] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:30.852097 30399 raft_consensus.cc:740] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:30.852907 30399 consensus_queue.cc:260] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:30.853976 30399 raft_consensus.cc:3060] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.859189 30541 raft_consensus.cc:2468] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:30.860664 31093 leader_election.cc:304] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:30.861033 30399 raft_consensus.cc:2468] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:30.861325 31335 raft_consensus.cc:2804] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:30.861686 31137 leader_election.cc:290] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:30.862345 31335 raft_consensus.cc:697] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:30.863281 31335 consensus_queue.cc:237] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:30.887465 30220 catalog_manager.cc:5697] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 2 to 3, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.893366 31192 raft_consensus.cc:993] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.894009 31347 raft_consensus.cc:1081] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:30.901103 31141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11632b693d5b414081e9b42a335cc646"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44312
I20260709 13:09:30.901646 31141 raft_consensus.cc:493] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.901998 31141 raft_consensus.cc:3060] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.910128 31141 raft_consensus.cc:515] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:30.912595 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:30.913146 30475 raft_consensus.cc:3060] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.919427 30475 raft_consensus.cc:2468] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:30.920522 31093 leader_election.cc:304] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:30.920734 31141 leader_election.cc:290] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:30.921305 31335 raft_consensus.cc:2804] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:30.921782 31335 raft_consensus.cc:697] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:30.922189 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11632b693d5b414081e9b42a335cc646" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:30.922801 30541 raft_consensus.cc:3055] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:30.923127 30541 raft_consensus.cc:740] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:30.922659 31335 consensus_queue.cc:237] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:30.924113 30541 consensus_queue.cc:260] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } }
I20260709 13:09:30.925370 30541 raft_consensus.cc:3060] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.933974 30541 raft_consensus.cc:2468] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:30.936005 30220 catalog_manager.cc:5697] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 2 to 3, leader changed from 746044612df94d4493276099e7ab6adc (127.20.53.132) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.969848 31347 raft_consensus.cc:993] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc: : Instructing follower 9fbdb7dfefaa45db890b43f14b3867d8 to start an election
I20260709 13:09:30.970323 31192 raft_consensus.cc:1081] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Signalling peer 9fbdb7dfefaa45db890b43f14b3867d8 to start an election
I20260709 13:09:30.971583 30475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155"
dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
 from {username='slave'} at 127.0.0.1:36904
I20260709 13:09:30.971998 30475 raft_consensus.cc:493] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.972285 30475 raft_consensus.cc:3060] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.979094 30475 raft_consensus.cc:515] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:30.982713 30475 leader_election.cc:290] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:30.982903 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:30.983235 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d32a45402a4c35a2191d14f57bc155" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:30.983543 30399 raft_consensus.cc:3060] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.983851 30541 raft_consensus.cc:3055] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.984180 30541 raft_consensus.cc:740] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:30.984864 30541 consensus_queue.cc:260] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:30.985769 30541 raft_consensus.cc:3060] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.988303 30399 raft_consensus.cc:2468] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:30.989477 30439 leader_election.cc:304] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:30.990319 31325 raft_consensus.cc:2804] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.990554 30541 raft_consensus.cc:2468] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:30.990876 31325 raft_consensus.cc:697] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:30.991797 31325 consensus_queue.cc:237] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:31.002607 30220 catalog_manager.cc:5697] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 1 to 2, leader changed from 746044612df94d4493276099e7ab6adc (127.20.53.132) to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.192448 30541 raft_consensus.cc:1275] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.193807 31335 consensus_queue.cc:1048] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.207186 30395 raft_consensus.cc:1275] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.208914 31335 consensus_queue.cc:1048] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.228153 30470 raft_consensus.cc:1275] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.229707 31335 consensus_queue.cc:1048] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:31.238425 30541 raft_consensus.cc:1275] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.241359 31352 consensus_queue.cc:1048] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:31.256426 30475 raft_consensus.cc:1275] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.257830 31352 consensus_queue.cc:1048] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:31.276540 30549 raft_consensus.cc:1275] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.279232 31336 consensus_queue.cc:1048] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:31.315689 30470 raft_consensus.cc:1275] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.316390 30541 raft_consensus.cc:1275] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.318271 31336 consensus_queue.cc:1048] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:31.318478 31360 consensus_queue.cc:1048] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:31.337105 30395 raft_consensus.cc:1275] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.337814 30549 raft_consensus.cc:1275] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.338757 31360 consensus_queue.cc:1048] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:31.339293 31335 consensus_queue.cc:1048] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:31.439656 30399 raft_consensus.cc:1275] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.440896 31325 consensus_queue.cc:1048] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.451411 30549 raft_consensus.cc:1275] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.453083 31190 consensus_queue.cc:1048] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.486248 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:31.526945 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:31.567236 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:31.567720 30399 raft_consensus.cc:606] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:31.570147 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:31.570613 30399 raft_consensus.cc:606] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Received request to transfer leadership to TS 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:31.572808 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:31.573196 30399 raft_consensus.cc:606] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:31.576300 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:31.576987 30399 raft_consensus.cc:606] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:31.579363 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:31.579751 30399 raft_consensus.cc:606] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Received request to transfer leadership to TS 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:31.580766 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:31.582057 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:31.607347 31332 raft_consensus.cc:993] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower 9fbdb7dfefaa45db890b43f14b3867d8 to start an election
I20260709 13:09:31.607972 31366 raft_consensus.cc:1081] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Signalling peer 9fbdb7dfefaa45db890b43f14b3867d8 to start an election
I20260709 13:09:31.609302 30470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67"
dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
 from {username='slave'} at 127.0.0.1:36918
I20260709 13:09:31.609742 30470 raft_consensus.cc:493] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.609988 30470 raft_consensus.cc:3060] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.615236 30470 raft_consensus.cc:515] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:31.617702 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:31.617895 30470 leader_election.cc:290] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:31.617924 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d9fab0b2994ae382f21e0c00690b67" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:31.618181 30399 raft_consensus.cc:3055] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:31.618713 30399 raft_consensus.cc:740] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:31.618731 30541 raft_consensus.cc:3060] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.619530 30399 consensus_queue.cc:260] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:31.620707 30399 raft_consensus.cc:3060] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.624154 30541 raft_consensus.cc:2468] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:31.625558 30440 leader_election.cc:304] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:31.626370 31190 raft_consensus.cc:2804] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.626796 31190 raft_consensus.cc:697] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:31.627565 31190 consensus_queue.cc:237] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:31.639256 30399 raft_consensus.cc:2468] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:31.640866 30222 catalog_manager.cc:5697] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 1 to 2, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.655519 31332 raft_consensus.cc:993] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:31.656001 31366 raft_consensus.cc:1081] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:31.657850 31141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44286
I20260709 13:09:31.658377 31141 raft_consensus.cc:493] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.658763 31141 raft_consensus.cc:3060] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.664034 31141 raft_consensus.cc:515] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:31.665621 31141 leader_election.cc:290] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:31.666162 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:31.666561 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5052554c804cfb88e8c770a62fcbf9" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:31.666815 30399 raft_consensus.cc:3055] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:31.667107 30470 raft_consensus.cc:3060] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.667122 30399 raft_consensus.cc:740] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:31.668113 30399 consensus_queue.cc:260] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:31.669312 30399 raft_consensus.cc:3060] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.673403 30470 raft_consensus.cc:2468] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:31.674377 31093 leader_election.cc:304] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:31.675100 31360 raft_consensus.cc:2804] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.675403 30399 raft_consensus.cc:2468] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:31.675611 31360 raft_consensus.cc:697] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:31.676613 31360 consensus_queue.cc:237] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:31.686275 30222 catalog_manager.cc:5697] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 1 to 2, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.848773 31332 raft_consensus.cc:993] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:31.849221 31366 raft_consensus.cc:1081] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:31.850597 31137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44286
I20260709 13:09:31.851186 31137 raft_consensus.cc:493] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.851518 31137 raft_consensus.cc:3060] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:31.856405 31137 raft_consensus.cc:515] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:31.858680 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:31.858946 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de7165657dd44b4821cb28eeb64824e" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:31.859117 31137 leader_election.cc:290] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:31.859189 30399 raft_consensus.cc:3055] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:31.859627 30470 raft_consensus.cc:3060] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:31.859684 30399 raft_consensus.cc:740] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:31.860582 30399 consensus_queue.cc:260] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:31.861586 30399 raft_consensus.cc:3060] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:31.866791 30399 raft_consensus.cc:2468] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:31.867776 31092 leader_election.cc:304] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:31.868454 31335 raft_consensus.cc:2804] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:31.868870 31335 raft_consensus.cc:697] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:31.869150 30470 raft_consensus.cc:2468] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:31.869719 31335 consensus_queue.cc:237] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:31.890904 30222 catalog_manager.cc:5697] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 2 to 3, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.942699 31332 raft_consensus.cc:993] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower 9fbdb7dfefaa45db890b43f14b3867d8 to start an election
I20260709 13:09:31.943228 31366 raft_consensus.cc:1081] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Signalling peer 9fbdb7dfefaa45db890b43f14b3867d8 to start an election
I20260709 13:09:31.944964 30475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f"
dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
 from {username='slave'} at 127.0.0.1:36918
I20260709 13:09:31.945484 30475 raft_consensus.cc:493] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.945787 30475 raft_consensus.cc:3060] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.953037 30475 raft_consensus.cc:515] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:31.956449 30475 leader_election.cc:290] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:31.957774 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:31.957897 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1a3391a474c1d99afc49c8113990f" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:31.958349 30399 raft_consensus.cc:3055] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:31.958489 30541 raft_consensus.cc:3060] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.958662 30399 raft_consensus.cc:740] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:31.959471 30399 consensus_queue.cc:260] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:31.960319 30399 raft_consensus.cc:3060] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.964810 30541 raft_consensus.cc:2468] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:31.965920 30440 leader_election.cc:304] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:31.966741 31368 raft_consensus.cc:2804] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.967188 31368 raft_consensus.cc:697] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:31.968058 31368 consensus_queue.cc:237] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:31.979094 30399 raft_consensus.cc:2468] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:31.990932 30222 catalog_manager.cc:5697] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 1 to 2, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.063303 31332 raft_consensus.cc:993] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:32.063841 31366 raft_consensus.cc:1081] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:32.065173 31137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44286
I20260709 13:09:32.065586 31137 raft_consensus.cc:493] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.065886 31137 raft_consensus.cc:3060] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.070623 31137 raft_consensus.cc:515] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:32.072069 31137 leader_election.cc:290] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:32.072891 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:32.073102 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2c0ec726e342608b2e4bbce2a6dd76" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:32.073537 30541 raft_consensus.cc:3060] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.073736 30399 raft_consensus.cc:3055] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:32.074102 30399 raft_consensus.cc:740] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:32.074958 30399 consensus_queue.cc:260] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:32.076078 30399 raft_consensus.cc:3060] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.081367 30541 raft_consensus.cc:2468] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:32.082003 30399 raft_consensus.cc:2468] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:32.082468 31093 leader_election.cc:304] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:32.083227 31335 raft_consensus.cc:2804] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:32.084712 31335 raft_consensus.cc:697] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:32.085630 31335 consensus_queue.cc:237] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:32.094977 30399 raft_consensus.cc:1275] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.096093 31335 consensus_queue.cc:1048] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.096750 30222 catalog_manager.cc:5697] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 2 to 3, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.112712 30475 raft_consensus.cc:1275] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.114444 31335 consensus_queue.cc:1048] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.125371 30541 raft_consensus.cc:1275] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.126835 31190 consensus_queue.cc:1048] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.136931 30399 raft_consensus.cc:1275] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.138116 31190 consensus_queue.cc:1048] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.270898 30397 raft_consensus.cc:1275] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:32.272948 31360 consensus_queue.cc:1048] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:32.286068 30475 raft_consensus.cc:1275] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:32.287601 31335 consensus_queue.cc:1048] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:32.357547 30397 raft_consensus.cc:1275] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.359124 31325 consensus_queue.cc:1048] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.367491 30541 raft_consensus.cc:1275] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.369930 31190 consensus_queue.cc:1048] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.529460 30541 raft_consensus.cc:1275] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:32.530663 31335 consensus_queue.cc:1048] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:32.542312 30397 raft_consensus.cc:1275] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:32.544770 31336 consensus_queue.cc:1048] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:32.582878 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:32.625344 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:32.657692 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:32.658274 30399 raft_consensus.cc:606] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:32.660620 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:32.661562 30399 raft_consensus.cc:606] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Received request to transfer leadership to TS 9fbdb7dfefaa45db890b43f14b3867d8
I20260709 13:09:32.663909 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "746044612df94d4493276099e7ab6adc"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:32.664326 30399 raft_consensus.cc:606] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Received request to transfer leadership to TS 746044612df94d4493276099e7ab6adc
I20260709 13:09:32.666508 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:32.666942 30399 raft_consensus.cc:606] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:32.668952 30399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:32.669359 30399 raft_consensus.cc:606] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:32.670269 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:32.671386 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:32.695473 31386 raft_consensus.cc:993] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower 746044612df94d4493276099e7ab6adc to start an election
I20260709 13:09:32.696015 31366 raft_consensus.cc:1081] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Signalling peer 746044612df94d4493276099e7ab6adc to start an election
I20260709 13:09:32.697932 30549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d"
dest_uuid: "746044612df94d4493276099e7ab6adc"
 from {username='slave'} at 127.0.0.1:59984
I20260709 13:09:32.698449 30549 raft_consensus.cc:493] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.698783 30549 raft_consensus.cc:3060] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.706108 30549 raft_consensus.cc:515] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:32.708112 30549 leader_election.cc:290] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:32.708770 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:32.708992 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b774d24dc7436581485b454bbf956d" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:32.709332 30399 raft_consensus.cc:3055] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:32.709663 30470 raft_consensus.cc:3060] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.709685 30399 raft_consensus.cc:740] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:32.710682 30399 consensus_queue.cc:260] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:32.711866 30399 raft_consensus.cc:3060] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.715797 30470 raft_consensus.cc:2468] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
I20260709 13:09:32.716898 30514 leader_election.cc:304] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:32.717223 30399 raft_consensus.cc:2468] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
I20260709 13:09:32.717540 31337 raft_consensus.cc:2804] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:32.718034 31337 raft_consensus.cc:697] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:32.718804 31337 consensus_queue.cc:237] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:32.737217 30220 catalog_manager.cc:5697] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 1 to 2, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.928886 31386 raft_consensus.cc:993] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:32.929369 31366 raft_consensus.cc:1081] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:32.930656 31137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44286
I20260709 13:09:32.931080 31137 raft_consensus.cc:493] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.931361 31137 raft_consensus.cc:3060] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.936764 31137 raft_consensus.cc:515] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:32.938298 31137 leader_election.cc:290] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:32.939038 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:32.939350 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd931b10a3349438e3cc5b5d821ec37" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:32.939704 30549 raft_consensus.cc:3060] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.940361 30399 raft_consensus.cc:3055] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:32.940713 30399 raft_consensus.cc:740] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:32.941393 30399 consensus_queue.cc:260] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:32.942562 30399 raft_consensus.cc:3060] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.944512 30549 raft_consensus.cc:2468] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:32.945401 31093 leader_election.cc:304] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:32.946106 31336 raft_consensus.cc:2804] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:32.946636 31336 raft_consensus.cc:697] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:32.947592 31336 consensus_queue.cc:237] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:32.949076 30399 raft_consensus.cc:2468] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:32.958488 30220 catalog_manager.cc:5697] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 1 to 2, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.034384 31386 raft_consensus.cc:993] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower 9fbdb7dfefaa45db890b43f14b3867d8 to start an election
I20260709 13:09:33.034889 31366 raft_consensus.cc:1081] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Signalling peer 9fbdb7dfefaa45db890b43f14b3867d8 to start an election
I20260709 13:09:33.036337 30475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905"
dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
 from {username='slave'} at 127.0.0.1:36918
I20260709 13:09:33.036850 30475 raft_consensus.cc:493] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.037171 30475 raft_consensus.cc:3060] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.042943 31386 raft_consensus.cc:993] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:33.043418 31386 raft_consensus.cc:1081] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:33.043699 30475 raft_consensus.cc:515] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:33.044909 31141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44286
I20260709 13:09:33.045436 31141 raft_consensus.cc:493] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.045701 30475 leader_election.cc:290] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:33.046481 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:33.047089 30397 raft_consensus.cc:3055] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:33.047399 30397 raft_consensus.cc:740] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:33.045744 31141 raft_consensus.cc:3060] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.048204 30397 consensus_queue.cc:260] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:33.049482 30397 raft_consensus.cc:3060] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.057407 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c184374a9da4329ac0084e458ebe905" candidate_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:33.057703 31386 raft_consensus.cc:993] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:33.058075 30549 raft_consensus.cc:3060] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.058156 31386 raft_consensus.cc:1081] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:33.059942 31139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44286
I20260709 13:09:33.060534 31139 raft_consensus.cc:493] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.060874 31139 raft_consensus.cc:3060] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.065218 30397 raft_consensus.cc:2468] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:33.067327 30439 leader_election.cc:304] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:33.068455 31368 raft_consensus.cc:2804] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:33.068936 31368 raft_consensus.cc:697] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:33.069792 31368 consensus_queue.cc:237] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:33.072890 30549 raft_consensus.cc:2468] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbdb7dfefaa45db890b43f14b3867d8 in term 2.
I20260709 13:09:33.070426 31139 raft_consensus.cc:515] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:33.071810 31141 raft_consensus.cc:515] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:33.076264 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:33.076783 30549 raft_consensus.cc:3060] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.078737 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:33.079279 30541 raft_consensus.cc:3060] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.081787 31139 leader_election.cc:290] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:33.082597 31141 leader_election.cc:290] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:33.084192 30399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f14e3fbaa940a7a60f77290ba16ed2" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:33.084750 30399 raft_consensus.cc:3055] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:33.085037 30399 raft_consensus.cc:740] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:33.085754 30399 consensus_queue.cc:260] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:33.089944 30399 raft_consensus.cc:3060] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.097115 30541 raft_consensus.cc:2468] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:33.098136 31093 leader_election.cc:304] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:33.098191 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7681f8cd3041589fc1ba1729668b1f" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:33.098934 30397 raft_consensus.cc:3055] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:33.099056 31336 raft_consensus.cc:2804] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:33.099305 30397 raft_consensus.cc:740] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:33.099685 31336 raft_consensus.cc:697] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:33.100162 30399 raft_consensus.cc:2468] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:33.100637 31336 consensus_queue.cc:237] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:33.100450 30397 consensus_queue.cc:260] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:33.100766 30220 catalog_manager.cc:5697] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 reported cstate change: term changed from 1 to 2, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.102124 30397 raft_consensus.cc:3060] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.089150 30549 raft_consensus.cc:2468] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:33.112139 30397 raft_consensus.cc:2468] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:33.113085 31093 leader_election.cc:304] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:33.114233 31360 raft_consensus.cc:2804] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:33.114732 31360 raft_consensus.cc:697] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:33.115530 31360 consensus_queue.cc:237] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:33.119270 30220 catalog_manager.cc:5697] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 2 to 3, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.131561 30220 catalog_manager.cc:5697] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 2 to 3, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.239768 30475 raft_consensus.cc:1275] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:33.240768 31192 consensus_queue.cc:1048] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.245671 30399 raft_consensus.cc:1275] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:33.247242 31394 consensus_queue.cc:1048] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.331027 30549 raft_consensus.cc:1275] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:33.332158 31360 consensus_queue.cc:1048] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.342859 30399 raft_consensus.cc:1275] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:33.344363 31360 consensus_queue.cc:1048] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.557453 30399 raft_consensus.cc:1275] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:33.558622 31190 consensus_queue.cc:1048] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.570927 30541 raft_consensus.cc:1275] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9fbdb7dfefaa45db890b43f14b3867d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:33.572078 31190 consensus_queue.cc:1048] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.583717 30541 raft_consensus.cc:1275] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:33.584995 31335 consensus_queue.cc:1048] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.591357 30399 raft_consensus.cc:1275] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:33.596618 31335 consensus_queue.cc:1048] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.597215 30399 raft_consensus.cc:1275] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:33.598560 31335 consensus_queue.cc:1048] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.613338 30549 raft_consensus.cc:1275] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:33.620934 31335 consensus_queue.cc:1048] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.672240 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:33.713532 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:33.752139 30549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a"
dest_uuid: "746044612df94d4493276099e7ab6adc"
mode: GRACEFUL
new_leader_uuid: "9ce9922db6144b968eeb78946b314cd2"
 from {username='slave'} at 127.0.0.1:58976
I20260709 13:09:33.752633 30549 raft_consensus.cc:606] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Received request to transfer leadership to TS 9ce9922db6144b968eeb78946b314cd2
I20260709 13:09:33.755041 30397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:33.755612 30397 raft_consensus.cc:606] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:33.771023 30470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec"
dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:35994
I20260709 13:09:33.771414 30470 raft_consensus.cc:606] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:33.772336 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:33.773825 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:33.788419 31366 raft_consensus.cc:993] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:33.788816 31386 raft_consensus.cc:1081] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:33.790266 31137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44286
I20260709 13:09:33.790763 31137 raft_consensus.cc:493] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.791091 31137 raft_consensus.cc:3060] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.797194 31137 raft_consensus.cc:515] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:33.798671 31137 leader_election.cc:290] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:33.799312 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:33.799800 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631b500e93c247dc8c294f5c3921b854" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:33.799901 30397 raft_consensus.cc:3055] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:33.800443 30470 raft_consensus.cc:3060] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.800406 30397 raft_consensus.cc:740] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:33.805356 30397 consensus_queue.cc:260] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:33.806675 30397 raft_consensus.cc:3060] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.813223 30397 raft_consensus.cc:2468] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:33.816051 30470 raft_consensus.cc:2468] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 3.
I20260709 13:09:33.817116 31093 leader_election.cc:304] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbdb7dfefaa45db890b43f14b3867d8, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:33.818255 31360 raft_consensus.cc:2804] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:33.818670 31360 raft_consensus.cc:697] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:33.819468 31360 consensus_queue.cc:237] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:33.837230 30220 catalog_manager.cc:5697] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 2 to 3, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 3 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.864905 31413 raft_consensus.cc:993] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:33.865451 31190 raft_consensus.cc:1081] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:33.866784 31137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44300
I20260709 13:09:33.867168 31137 raft_consensus.cc:493] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.867385 31137 raft_consensus.cc:3060] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.873627 31137 raft_consensus.cc:515] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:33.875133 31137 leader_election.cc:290] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:33.875722 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:33.876178 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a49f967b754cf9b4fc400d9b7b6dec" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:33.876348 30397 raft_consensus.cc:3060] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.876776 30470 raft_consensus.cc:3055] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:33.877089 30470 raft_consensus.cc:740] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbdb7dfefaa45db890b43f14b3867d8, State: Running, Role: LEADER
I20260709 13:09:33.877832 30470 consensus_queue.cc:260] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:33.879035 30470 raft_consensus.cc:3060] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.883185 30397 raft_consensus.cc:2468] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:33.884305 31092 leader_election.cc:304] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:33.885082 31360 raft_consensus.cc:2804] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:33.885543 31360 raft_consensus.cc:697] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:33.886446 31360 consensus_queue.cc:237] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } }
I20260709 13:09:33.886216 30470 raft_consensus.cc:2468] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:33.898298 30220 catalog_manager.cc:5697] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 1 to 2, leader changed from 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.119354 31192 raft_consensus.cc:993] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc: : Instructing follower 9ce9922db6144b968eeb78946b314cd2 to start an election
I20260709 13:09:34.119863 31337 raft_consensus.cc:1081] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Signalling peer 9ce9922db6144b968eeb78946b314cd2 to start an election
I20260709 13:09:34.121484 30397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
 from {username='slave'} at 127.0.0.1:36150
I20260709 13:09:34.122012 30397 raft_consensus.cc:493] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.122382 30397 raft_consensus.cc:3060] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.126868 30397 raft_consensus.cc:515] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:34.128778 30397 leader_election.cc:290] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903), 746044612df94d4493276099e7ab6adc (127.20.53.132:41005)
I20260709 13:09:34.129395 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:34.129664 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3196a23ac17a4a778e547bb9727a327a" candidate_uuid: "9ce9922db6144b968eeb78946b314cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:34.129969 30475 raft_consensus.cc:3060] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.130141 30549 raft_consensus.cc:3055] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.130569 30549 raft_consensus.cc:740] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:34.131129 30549 consensus_queue.cc:260] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:34.131820 30549 raft_consensus.cc:3060] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.136623 30475 raft_consensus.cc:2468] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:34.137112 30549 raft_consensus.cc:2468] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce9922db6144b968eeb78946b314cd2 in term 2.
I20260709 13:09:34.138324 30366 leader_election.cc:304] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9ce9922db6144b968eeb78946b314cd2; no voters: 
I20260709 13:09:34.140337 31386 raft_consensus.cc:2804] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.141394 31386 raft_consensus.cc:697] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:34.142158 31386 consensus_queue.cc:237] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:34.151561 30222 catalog_manager.cc:5697] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 reported cstate change: term changed from 1 to 2, leader changed from 746044612df94d4493276099e7ab6adc (127.20.53.132) to 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "9ce9922db6144b968eeb78946b314cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.213842 30475 raft_consensus.cc:1275] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:34.216156 31336 consensus_queue.cc:1048] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:34.225459 30397 raft_consensus.cc:1275] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:34.226677 31336 consensus_queue.cc:1048] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:34.467315 30397 raft_consensus.cc:1275] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.468463 31360 consensus_queue.cc:1048] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.477218 30474 raft_consensus.cc:1275] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.480719 31360 consensus_queue.cc:1048] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.616999 30541 raft_consensus.cc:1275] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.618291 31401 consensus_queue.cc:1048] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.630590 30475 raft_consensus.cc:1275] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 9ce9922db6144b968eeb78946b314cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.632606 31386 consensus_queue.cc:1048] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.774642 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:34.825193 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:34.861956 30397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c"
dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
mode: GRACEFUL
new_leader_uuid: "746044612df94d4493276099e7ab6adc"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:09:34.862576 30397 raft_consensus.cc:606] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Received request to transfer leadership to TS 746044612df94d4493276099e7ab6adc
I20260709 13:09:34.863767 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:34.864882 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:35.187340 31439 raft_consensus.cc:993] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2: : Instructing follower 746044612df94d4493276099e7ab6adc to start an election
I20260709 13:09:35.188000 31439 raft_consensus.cc:1081] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Signalling peer 746044612df94d4493276099e7ab6adc to start an election
I20260709 13:09:35.189817 30549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c"
dest_uuid: "746044612df94d4493276099e7ab6adc"
 from {username='slave'} at 127.0.0.1:59984
I20260709 13:09:35.190357 30549 raft_consensus.cc:493] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.190671 30549 raft_consensus.cc:3060] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.197293 30549 raft_consensus.cc:515] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:35.200093 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:35.200085 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4915caf16db459c8af6f794aca6143c" candidate_uuid: "746044612df94d4493276099e7ab6adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbdb7dfefaa45db890b43f14b3867d8"
I20260709 13:09:35.201210 30397 raft_consensus.cc:3055] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.201601 30397 raft_consensus.cc:740] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ce9922db6144b968eeb78946b314cd2, State: Running, Role: LEADER
I20260709 13:09:35.201647 30475 raft_consensus.cc:3060] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.200716 30549 leader_election.cc:290] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Requested vote from peers 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987), 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903)
I20260709 13:09:35.202503 30397 consensus_queue.cc:260] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:35.203611 30397 raft_consensus.cc:3060] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.208151 30475 raft_consensus.cc:2468] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
I20260709 13:09:35.209436 30514 leader_election.cc:304] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 746044612df94d4493276099e7ab6adc, 9fbdb7dfefaa45db890b43f14b3867d8; no voters: 
I20260709 13:09:35.209731 30397 raft_consensus.cc:2468] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 746044612df94d4493276099e7ab6adc in term 2.
I20260709 13:09:35.210323 31337 raft_consensus.cc:2804] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.210801 31337 raft_consensus.cc:697] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Becoming Leader. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:35.211627 31337 consensus_queue.cc:237] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } }
I20260709 13:09:35.223891 30222 catalog_manager.cc:5697] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc reported cstate change: term changed from 1 to 2, leader changed from 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130) to 746044612df94d4493276099e7ab6adc (127.20.53.132). New cstate: current_term: 2 leader_uuid: "746044612df94d4493276099e7ab6adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.590977 30399 raft_consensus.cc:1275] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.592159 31438 consensus_queue.cc:1048] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.606947 30474 raft_consensus.cc:1275] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Refusing update from remote peer 746044612df94d4493276099e7ab6adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.608966 31337 consensus_queue.cc:1048] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbdb7dfefaa45db890b43f14b3867d8" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.865643 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:35.921517 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:35.964705 30541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a"
dest_uuid: "746044612df94d4493276099e7ab6adc"
mode: GRACEFUL
new_leader_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:58976
I20260709 13:09:35.965229 30541 raft_consensus.cc:606] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Received request to transfer leadership to TS d868b6e1c0be407dbc470002a447a620
I20260709 13:09:35.966310 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:35.967515 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:35.987777 31337 raft_consensus.cc:993] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc: : Instructing follower d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:35.988323 31337 raft_consensus.cc:1081] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Signalling peer d868b6e1c0be407dbc470002a447a620 to start an election
I20260709 13:09:35.989820 31137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a"
dest_uuid: "d868b6e1c0be407dbc470002a447a620"
 from {username='slave'} at 127.0.0.1:44312
I20260709 13:09:35.990324 31137 raft_consensus.cc:493] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.990653 31137 raft_consensus.cc:3060] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.996898 31137 raft_consensus.cc:515] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:35.998416 31137 leader_election.cc:290] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Requested vote from peers 746044612df94d4493276099e7ab6adc (127.20.53.132:41005), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:35.999256 30397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ce9922db6144b968eeb78946b314cd2"
I20260709 13:09:35.999825 30397 raft_consensus.cc:3060] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.005656 30541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168e34fb6e72416680e50fbf1f847b6a" candidate_uuid: "d868b6e1c0be407dbc470002a447a620" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "746044612df94d4493276099e7ab6adc"
I20260709 13:09:36.005705 30397 raft_consensus.cc:2468] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:36.006307 30541 raft_consensus.cc:3055] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.006606 30541 raft_consensus.cc:740] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 746044612df94d4493276099e7ab6adc, State: Running, Role: LEADER
I20260709 13:09:36.006981 31092 leader_election.cc:304] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620; no voters: 
I20260709 13:09:36.007408 30541 consensus_queue.cc:260] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:36.007778 31360 raft_consensus.cc:2804] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.008334 31360 raft_consensus.cc:697] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Becoming Leader. State: Replica: d868b6e1c0be407dbc470002a447a620, State: Running, Role: LEADER
I20260709 13:09:36.008409 30541 raft_consensus.cc:3060] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.009249 31360 consensus_queue.cc:237] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:36.014624 30541 raft_consensus.cc:2468] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d868b6e1c0be407dbc470002a447a620 in term 2.
I20260709 13:09:36.022022 30222 catalog_manager.cc:5697] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 reported cstate change: term changed from 1 to 2, leader changed from 746044612df94d4493276099e7ab6adc (127.20.53.132) to d868b6e1c0be407dbc470002a447a620 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "d868b6e1c0be407dbc470002a447a620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.475036 30397 raft_consensus.cc:1275] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.476151 31335 consensus_queue.cc:1048] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.493404 30549 raft_consensus.cc:1275] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Refusing update from remote peer d868b6e1c0be407dbc470002a447a620: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.495139 31461 consensus_queue.cc:1048] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.968406 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.008425 20694 tablet_server.cc:179] TabletServer@127.20.53.129:46147 shutting down...
W20260709 13:09:37.034452 30439 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 67 similar messages]
W20260709 13:09:37.038272 30439 consensus_peers.cc:597] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.048219 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:37.049412 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.050880 20694 raft_consensus.cc:2243] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.051543 20694 raft_consensus.cc:2272] T b3d42d01b36c4d8d97b27f7cb0a7d177 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.055063 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.056061 20694 raft_consensus.cc:2243] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.056624 20694 raft_consensus.cc:2272] T 5f7962a39d6c4a7f9cee77c26e3c6018 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.057061 30365 consensus_peers.cc:597] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.059516 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.060319 20694 raft_consensus.cc:2243] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.060727 20694 raft_consensus.cc:2272] T 2d1f795e00974bcc85806849556a3a35 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.062884 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.063470 20694 raft_consensus.cc:2243] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.064229 20694 raft_consensus.cc:2272] T 7b7681f8cd3041589fc1ba1729668b1f P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.066330 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.067097 20694 raft_consensus.cc:2243] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.067435 20694 raft_consensus.cc:2272] T 268b2be94e304b6089db69b7e298b414 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.069756 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.070640 20694 raft_consensus.cc:2243] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.071163 20694 raft_consensus.cc:2272] T c5e67aacbc9140e5acab54d159ff5200 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.073247 30513 consensus_peers.cc:597] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.074129 30365 consensus_peers.cc:597] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.074467 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.075289 20694 raft_consensus.cc:2243] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.076079 20694 raft_consensus.cc:2272] T 11632b693d5b414081e9b42a335cc646 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.078015 30365 consensus_peers.cc:597] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.078260 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.078989 20694 raft_consensus.cc:2243] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.079391 20694 raft_consensus.cc:2272] T 748b5efba5c6486ab5974a080fc1d298 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.081382 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.082046 20694 raft_consensus.cc:2243] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.082487 20694 raft_consensus.cc:2272] T 7a1c8338cdfb4acc80a508d622aaa2c0 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.085181 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.085887 20694 raft_consensus.cc:2243] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.086442 20694 raft_consensus.cc:2272] T fe391ca7cf224a87975e01e553aa19cc P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.089201 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.089818 20694 raft_consensus.cc:2243] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.090662 20694 raft_consensus.cc:2272] T f2a49f967b754cf9b4fc400d9b7b6dec P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.092808 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.093375 20694 raft_consensus.cc:2243] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.093756 20694 raft_consensus.cc:2272] T b80f0c101daa484bb62d6ec96d3357f4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.096527 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.097450 20694 raft_consensus.cc:2243] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.097934 20694 raft_consensus.cc:2272] T 797883f7836a4e6091473c791399388f P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.099838 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.100370 20694 raft_consensus.cc:2243] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.100737 20694 raft_consensus.cc:2272] T 5b58667a160f4c47bca188153bae9969 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.102680 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.103185 20694 raft_consensus.cc:2243] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.103564 20694 raft_consensus.cc:2272] T 5f2b6fea68dc4530a2e23485e5c6bbbf P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.105430 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.105962 20694 raft_consensus.cc:2243] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.106333 20694 raft_consensus.cc:2272] T 978a4cca1c0a4046aa9666eec4400b95 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.108444 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.108960 20694 raft_consensus.cc:2243] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.109347 20694 raft_consensus.cc:2272] T 3a853d771be841e38e285f5e9ba2b8a9 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.111197 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.111711 20694 raft_consensus.cc:2243] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.112406 20694 raft_consensus.cc:2272] T 0de7165657dd44b4821cb28eeb64824e P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.114327 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.114877 20694 raft_consensus.cc:2243] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.115293 20694 raft_consensus.cc:2272] T eb5f0e4a8947427fbf76e8880498a33e P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.117321 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.117911 20694 raft_consensus.cc:2243] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.118323 20694 raft_consensus.cc:2272] T 36116499b18c4347ab81d06dae391bde P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.120889 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.121654 20694 raft_consensus.cc:2243] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.122253 20694 raft_consensus.cc:2272] T 02f8d6b0a2c24237bfd34dc90265a90b P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.124702 20694 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:37.124617 30513 consensus_peers.cc:597] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.125677 20694 raft_consensus.cc:2243] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.126245 20694 raft_consensus.cc:2272] T 37c9a6a34931479d909d663f8b380d22 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.128651 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.129173 20694 raft_consensus.cc:2243] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.129899 20694 raft_consensus.cc:2272] T 5e5052554c804cfb88e8c770a62fcbf9 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.132198 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.133023 20694 raft_consensus.cc:2243] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.133538 20694 raft_consensus.cc:2272] T dc099b35daa949c5aa0039ec0e6570c4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.136118 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.136605 20694 raft_consensus.cc:2243] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.136932 20694 raft_consensus.cc:2272] T cdc31bc49093420ba42ce2487858ce2b P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.138927 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.139542 20694 raft_consensus.cc:2243] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.139945 20694 raft_consensus.cc:2272] T a5e11a3a73344f4f89bb1e70414ac6c1 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.142280 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.142800 20694 raft_consensus.cc:2243] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.143460 20694 raft_consensus.cc:2272] T dcad579e9c484c3cbb0c1352ef847b44 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.146137 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.147449 20694 raft_consensus.cc:2243] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.147903 20694 raft_consensus.cc:2272] T 3f3222ed63e245c29f20b9920f4ca4e4 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.150317 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.150853 20694 raft_consensus.cc:2243] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.151708 20694 raft_consensus.cc:2272] T a938526c3f4d4e7aaedba12e36fc5e25 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.154183 20694 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:37.154093 30365 consensus_peers.cc:597] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.154987 20694 raft_consensus.cc:2243] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.155660 20694 raft_consensus.cc:2272] T 3f2c0ec726e342608b2e4bbce2a6dd76 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.157580 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.158107 20694 raft_consensus.cc:2243] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.158545 20694 raft_consensus.cc:2272] T 1aa4872354f64208a9454aa62f5fa488 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.160388 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.160938 20694 raft_consensus.cc:2243] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.161319 20694 raft_consensus.cc:2272] T b7fed5fd32f04d9a9145de3f147b7d1a P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.163298 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.163830 20694 raft_consensus.cc:2243] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.164276 20694 raft_consensus.cc:2272] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.166285 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.166785 20694 raft_consensus.cc:2243] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.167513 20694 raft_consensus.cc:2272] T f5f14e3fbaa940a7a60f77290ba16ed2 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.169399 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.169916 20694 raft_consensus.cc:2243] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.170671 20694 raft_consensus.cc:2272] T 631b500e93c247dc8c294f5c3921b854 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.172448 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.172971 20694 raft_consensus.cc:2243] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.173365 20694 raft_consensus.cc:2272] T bea36533e01d4b6b83d15744c3b6ef1d P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.175313 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.175822 20694 raft_consensus.cc:2243] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.176560 20694 raft_consensus.cc:2272] T 168e34fb6e72416680e50fbf1f847b6a P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.178983 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.179495 20694 raft_consensus.cc:2243] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.180200 20694 raft_consensus.cc:2272] T efd931b10a3349438e3cc5b5d821ec37 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.182157 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.182937 20694 raft_consensus.cc:2243] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.183399 20694 raft_consensus.cc:2272] T 64ac125ecb5b491f9092fee90d68849c P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.185300 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.185745 20694 raft_consensus.cc:2243] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.186070 20694 raft_consensus.cc:2272] T 93781ed772e74585ac49edeea6eb0421 P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.188488 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.189118 20694 raft_consensus.cc:2243] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.189918 20694 raft_consensus.cc:2272] T f33c2293eacb4a2594938e734a24a3d4 P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.190434 30513 consensus_peers.cc:597] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.191824 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.192479 20694 raft_consensus.cc:2243] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.192808 20694 raft_consensus.cc:2272] T 70b2a45700e14c769022b4d7361c3dee P d868b6e1c0be407dbc470002a447a620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.194722 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.195274 20694 raft_consensus.cc:2243] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.195611 20694 raft_consensus.cc:2272] T da3877cc17044236b7955a08144da062 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.197551 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.197968 20694 raft_consensus.cc:2243] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.198676 20694 raft_consensus.cc:2272] T 287a40c43efc4dd499b573c0e9e2278b P d868b6e1c0be407dbc470002a447a620 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.200693 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:37.201120 20694 raft_consensus.cc:2243] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.201542 20694 raft_consensus.cc:2272] T 78821f2f4788465aa83d3e5c08880b46 P d868b6e1c0be407dbc470002a447a620 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.207255 30513 consensus_peers.cc:597] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.210338 30365 consensus_peers.cc:597] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.215727 30439 consensus_peers.cc:597] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.219893 30365 consensus_peers.cc:597] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.230118 30513 consensus_peers.cc:597] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.234301 30513 consensus_peers.cc:597] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.247263 30513 consensus_peers.cc:597] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.258569 30513 consensus_peers.cc:597] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.271862 20694 tablet_server.cc:196] TabletServer@127.20.53.129:46147 shutdown complete.
W20260709 13:09:37.275388 30365 consensus_peers.cc:597] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.291347 30513 consensus_peers.cc:597] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.291946 30513 consensus_peers.cc:597] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.293447 30513 consensus_peers.cc:597] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.321156 30439 consensus_peers.cc:597] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.326196 30365 consensus_peers.cc:597] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.327001 30513 consensus_peers.cc:597] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.337791 30365 consensus_peers.cc:597] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.351437 30439 consensus_peers.cc:597] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.353536 30439 consensus_peers.cc:597] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.356025 30439 consensus_peers.cc:597] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.368975 20694 tablet_server.cc:179] TabletServer@127.20.53.130:0 shutting down...
W20260709 13:09:37.380725 30439 consensus_peers.cc:597] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.408015 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:37.409309 20694 tablet_replica.cc:333] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.410717 20694 raft_consensus.cc:2243] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:37.411180 30439 consensus_peers.cc:597] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.411183 20694 raft_consensus.cc:2272] T f5f14e3fbaa940a7a60f77290ba16ed2 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.413866 20694 tablet_replica.cc:333] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.414538 20694 raft_consensus.cc:2243] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.414951 20694 raft_consensus.cc:2272] T 8c184374a9da4329ac0084e458ebe905 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.416769 20694 tablet_replica.cc:333] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.417331 20694 raft_consensus.cc:2243] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.417726 20694 raft_consensus.cc:2272] T 0de7165657dd44b4821cb28eeb64824e P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.419466 20694 tablet_replica.cc:333] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.420079 20694 raft_consensus.cc:2243] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.420564 20694 raft_consensus.cc:2272] T a938526c3f4d4e7aaedba12e36fc5e25 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.422344 20694 tablet_replica.cc:333] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.422894 20694 raft_consensus.cc:2243] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.423717 20694 raft_consensus.cc:2272] T fe391ca7cf224a87975e01e553aa19cc P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.425417 20694 tablet_replica.cc:333] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.425918 20694 raft_consensus.cc:2243] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.426342 20694 raft_consensus.cc:2272] T e0b1a3391a474c1d99afc49c8113990f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.428032 20694 tablet_replica.cc:333] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.428574 20694 raft_consensus.cc:2243] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.428951 20694 raft_consensus.cc:2272] T 13d9fab0b2994ae382f21e0c00690b67 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.430742 20694 tablet_replica.cc:333] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.431247 20694 raft_consensus.cc:2243] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.431734 20694 raft_consensus.cc:2272] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.433620 20694 tablet_replica.cc:333] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.434135 20694 raft_consensus.cc:2243] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.434568 20694 raft_consensus.cc:2272] T 5e5052554c804cfb88e8c770a62fcbf9 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.436182 20694 tablet_replica.cc:333] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.436679 20694 raft_consensus.cc:2243] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.437098 20694 raft_consensus.cc:2272] T dc099b35daa949c5aa0039ec0e6570c4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.438874 20694 tablet_replica.cc:333] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.439383 20694 raft_consensus.cc:2243] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.439780 20694 raft_consensus.cc:2272] T 0a08cc3a22a945c3bb034b67deb2b379 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.441661 20694 tablet_replica.cc:333] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.442215 20694 raft_consensus.cc:2243] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.442695 20694 raft_consensus.cc:2272] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.444592 20694 tablet_replica.cc:333] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.445139 20694 raft_consensus.cc:2243] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.445547 20694 raft_consensus.cc:2272] T 13d32a45402a4c35a2191d14f57bc155 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.447455 20694 tablet_replica.cc:333] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.448014 20694 raft_consensus.cc:2243] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.448457 20694 raft_consensus.cc:2272] T b80f0c101daa484bb62d6ec96d3357f4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.450256 20694 tablet_replica.cc:333] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.450780 20694 raft_consensus.cc:2243] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.451189 20694 raft_consensus.cc:2272] T 797883f7836a4e6091473c791399388f P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.452996 20694 tablet_replica.cc:333] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.453503 20694 raft_consensus.cc:2243] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.454349 20694 raft_consensus.cc:2272] T 93781ed772e74585ac49edeea6eb0421 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.456173 20694 tablet_replica.cc:333] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.456704 20694 raft_consensus.cc:2243] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.457420 20694 raft_consensus.cc:2272] T 64ac125ecb5b491f9092fee90d68849c P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.459307 20694 tablet_replica.cc:333] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.459841 20694 raft_consensus.cc:2243] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.460263 20694 raft_consensus.cc:2272] T 37c9a6a34931479d909d663f8b380d22 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.462208 20694 tablet_replica.cc:333] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.462944 20694 raft_consensus.cc:2243] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.463935 20694 raft_consensus.cc:2272] T eb5f0e4a8947427fbf76e8880498a33e P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.466639 20694 tablet_replica.cc:333] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.467171 20694 raft_consensus.cc:2243] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.467916 20694 raft_consensus.cc:2272] T 36116499b18c4347ab81d06dae391bde P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.469753 20694 tablet_replica.cc:333] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.470393 20694 raft_consensus.cc:2243] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.470824 20694 raft_consensus.cc:2272] T e4915caf16db459c8af6f794aca6143c P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.472837 20694 tablet_replica.cc:333] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.473395 20694 raft_consensus.cc:2243] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.473816 20694 raft_consensus.cc:2272] T c5e67aacbc9140e5acab54d159ff5200 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.475586 20694 tablet_replica.cc:333] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.476262 20694 raft_consensus.cc:2243] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.477093 20694 raft_consensus.cc:2272] T 3196a23ac17a4a778e547bb9727a327a P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.479326 20694 tablet_replica.cc:333] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.480074 20694 raft_consensus.cc:2243] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:37.480159 30439 consensus_peers.cc:597] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Couldn't send request to peer d868b6e1c0be407dbc470002a447a620. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.480868 20694 raft_consensus.cc:2272] T 3f3222ed63e245c29f20b9920f4ca4e4 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.483419 20694 tablet_replica.cc:333] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
W20260709 13:09:37.483479 30439 consensus_peers.cc:597] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.484185 20694 raft_consensus.cc:2243] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.484707 20694 raft_consensus.cc:2272] T 1aa4872354f64208a9454aa62f5fa488 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.486811 20694 tablet_replica.cc:333] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.487342 20694 raft_consensus.cc:2243] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.488093 20694 raft_consensus.cc:2272] T b7fed5fd32f04d9a9145de3f147b7d1a P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.490772 20694 tablet_replica.cc:333] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.491461 20694 raft_consensus.cc:2243] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.492441 20694 raft_consensus.cc:2272] T eb089b78d6b94082a36b55b40736d58b P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.493331 30439 consensus_peers.cc:597] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.493976 30439 consensus_peers.cc:597] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.494910 20694 tablet_replica.cc:333] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.495680 20694 raft_consensus.cc:2243] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.496150 20694 raft_consensus.cc:2272] T 631b500e93c247dc8c294f5c3921b854 P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.498947 20694 tablet_replica.cc:333] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.499642 20694 raft_consensus.cc:2243] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.500407 20694 raft_consensus.cc:2272] T bea36533e01d4b6b83d15744c3b6ef1d P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.503029 20694 tablet_replica.cc:333] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.503858 20694 raft_consensus.cc:2243] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.504757 20694 raft_consensus.cc:2272] T 78821f2f4788465aa83d3e5c08880b46 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.507143 20694 tablet_replica.cc:333] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.507638 20694 raft_consensus.cc:2243] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.508023 20694 raft_consensus.cc:2272] T 168e34fb6e72416680e50fbf1f847b6a P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.509732 20694 tablet_replica.cc:333] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.510313 20694 raft_consensus.cc:2243] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.510697 20694 raft_consensus.cc:2272] T efd931b10a3349438e3cc5b5d821ec37 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.512274 20694 tablet_replica.cc:333] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.512738 20694 raft_consensus.cc:2243] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.513535 20694 raft_consensus.cc:2272] T f575f3dfa76f49958385c22448272c61 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.515491 20694 tablet_replica.cc:333] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.515990 20694 raft_consensus.cc:2243] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.516680 20694 raft_consensus.cc:2272] T 3a853d771be841e38e285f5e9ba2b8a9 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.518450 20694 tablet_replica.cc:333] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.519058 20694 raft_consensus.cc:2243] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.519464 20694 raft_consensus.cc:2272] T f2a49f967b754cf9b4fc400d9b7b6dec P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.521399 20694 tablet_replica.cc:333] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.521938 20694 raft_consensus.cc:2243] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.522459 20694 raft_consensus.cc:2272] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.525070 20694 tablet_replica.cc:333] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.525691 20694 raft_consensus.cc:2243] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:37.525995 30513 consensus_peers.cc:597] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.526087 20694 raft_consensus.cc:2272] T dcad579e9c484c3cbb0c1352ef847b44 P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.528018 20694 tablet_replica.cc:333] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.528563 20694 raft_consensus.cc:2243] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.529498 20694 raft_consensus.cc:2272] T cdc31bc49093420ba42ce2487858ce2b P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.531108 30439 consensus_peers.cc:597] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.531728 20694 tablet_replica.cc:333] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.532308 20694 raft_consensus.cc:2243] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.533026 20694 raft_consensus.cc:2272] T 648581791a9940b1859861be5ff76dbb P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.534852 20694 tablet_replica.cc:333] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.535331 20694 raft_consensus.cc:2243] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.535714 20694 raft_consensus.cc:2272] T a3b774d24dc7436581485b454bbf956d P 9ce9922db6144b968eeb78946b314cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.537457 20694 tablet_replica.cc:333] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.538121 20694 raft_consensus.cc:2243] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.538661 20694 raft_consensus.cc:2272] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.539975 30439 consensus_peers.cc:597] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.541371 20694 tablet_replica.cc:333] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.542243 20694 raft_consensus.cc:2243] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.542820 20694 raft_consensus.cc:2272] T 7b7681f8cd3041589fc1ba1729668b1f P 9ce9922db6144b968eeb78946b314cd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.545862 20694 tablet_replica.cc:333] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.546516 20694 raft_consensus.cc:2243] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.546968 20694 raft_consensus.cc:2272] T 3651fee799e6451a8fe39b2c4b19eaaf P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.549485 20694 tablet_replica.cc:333] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2: stopping tablet replica
I20260709 13:09:37.550024 20694 raft_consensus.cc:2243] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.550529 20694 raft_consensus.cc:2272] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 9ce9922db6144b968eeb78946b314cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.568681 30439 consensus_peers.cc:597] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.623046 20694 tablet_server.cc:196] TabletServer@127.20.53.130:0 shutdown complete.
W20260709 13:09:37.637527 30513 consensus_peers.cc:597] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.643955 30439 consensus_peers.cc:597] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.697669 20694 tablet_server.cc:179] TabletServer@127.20.53.131:0 shutting down...
W20260709 13:09:37.705183 30514 consensus_peers.cc:597] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.743613 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:37.745915 20694 tablet_replica.cc:333] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.746770 20694 raft_consensus.cc:2243] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.747319 20694 raft_consensus.cc:2272] T 0de7165657dd44b4821cb28eeb64824e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.749930 20694 tablet_replica.cc:333] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.750701 20694 raft_consensus.cc:2243] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.751590 20694 raft_consensus.cc:2272] T 8c184374a9da4329ac0084e458ebe905 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.754225 20694 tablet_replica.cc:333] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
W20260709 13:09:37.754482 30439 consensus_peers.cc:597] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.754961 20694 raft_consensus.cc:2243] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.755540 20694 raft_consensus.cc:2272] T 3651fee799e6451a8fe39b2c4b19eaaf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.757684 20694 tablet_replica.cc:333] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.758380 20694 raft_consensus.cc:2243] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.758910 20694 raft_consensus.cc:2272] T 748b5efba5c6486ab5974a080fc1d298 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.761142 20694 tablet_replica.cc:333] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.761883 20694 raft_consensus.cc:2243] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.762341 20694 raft_consensus.cc:2272] T 2d1f795e00974bcc85806849556a3a35 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.764412 20694 tablet_replica.cc:333] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.764972 20694 raft_consensus.cc:2243] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.765913 20694 raft_consensus.cc:2272] T e0b1a3391a474c1d99afc49c8113990f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.768337 20694 tablet_replica.cc:333] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.768889 20694 raft_consensus.cc:2243] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.769373 20694 raft_consensus.cc:2272] T fe391ca7cf224a87975e01e553aa19cc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.772042 20694 tablet_replica.cc:333] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.772815 20694 raft_consensus.cc:2243] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.773831 20694 raft_consensus.cc:2272] T b80f0c101daa484bb62d6ec96d3357f4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.775957 20694 tablet_replica.cc:333] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.776465 20694 raft_consensus.cc:2243] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.777338 20694 raft_consensus.cc:2272] T 797883f7836a4e6091473c791399388f P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.779251 20694 tablet_replica.cc:333] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.779796 20694 raft_consensus.cc:2243] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.780519 20694 raft_consensus.cc:2272] T 13d32a45402a4c35a2191d14f57bc155 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.780664 30439 consensus_peers.cc:597] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.782312 20694 tablet_replica.cc:333] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.782907 20694 raft_consensus.cc:2243] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.783317 20694 raft_consensus.cc:2272] T 11632b693d5b414081e9b42a335cc646 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.784982 20694 tablet_replica.cc:333] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.785528 20694 raft_consensus.cc:2243] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.785904 20694 raft_consensus.cc:2272] T 5e5052554c804cfb88e8c770a62fcbf9 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.787669 20694 tablet_replica.cc:333] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.788216 20694 raft_consensus.cc:2243] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.788930 20694 raft_consensus.cc:2272] T dc099b35daa949c5aa0039ec0e6570c4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.790870 20694 tablet_replica.cc:333] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.791385 20694 raft_consensus.cc:2243] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.792850 20694 raft_consensus.cc:2272] T 0a08cc3a22a945c3bb034b67deb2b379 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.794770 20694 tablet_replica.cc:333] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.795327 20694 raft_consensus.cc:2243] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.795794 20694 raft_consensus.cc:2272] T 287a40c43efc4dd499b573c0e9e2278b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.797465 20694 tablet_replica.cc:333] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.797960 20694 raft_consensus.cc:2243] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.798364 20694 raft_consensus.cc:2272] T 5b58667a160f4c47bca188153bae9969 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.800182 20694 tablet_replica.cc:333] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.800881 20694 raft_consensus.cc:2243] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.801397 20694 raft_consensus.cc:2272] T 93781ed772e74585ac49edeea6eb0421 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.803907 20694 tablet_replica.cc:333] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.804612 20694 raft_consensus.cc:2243] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.805382 20694 raft_consensus.cc:2272] T 64ac125ecb5b491f9092fee90d68849c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.807791 20694 tablet_replica.cc:333] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.808537 20694 raft_consensus.cc:2243] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:37.808956 30514 consensus_peers.cc:597] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.809018 20694 raft_consensus.cc:2272] T 631b500e93c247dc8c294f5c3921b854 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.810968 30513 consensus_peers.cc:597] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.811748 20694 tablet_replica.cc:333] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.812270 20694 raft_consensus.cc:2243] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.812610 20694 raft_consensus.cc:2272] T eb089b78d6b94082a36b55b40736d58b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.814527 20694 tablet_replica.cc:333] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.815007 20694 raft_consensus.cc:2243] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.815660 20694 raft_consensus.cc:2272] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.817422 20694 tablet_replica.cc:333] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.817878 20694 raft_consensus.cc:2243] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.818576 20694 raft_consensus.cc:2272] T 978a4cca1c0a4046aa9666eec4400b95 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.820323 20694 tablet_replica.cc:333] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.820896 20694 raft_consensus.cc:2243] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.821595 20694 raft_consensus.cc:2272] T 13d9fab0b2994ae382f21e0c00690b67 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.823357 20694 tablet_replica.cc:333] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.823868 20694 raft_consensus.cc:2243] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.824244 20694 raft_consensus.cc:2272] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.825908 20694 tablet_replica.cc:333] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.826475 20694 raft_consensus.cc:2243] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.826890 20694 raft_consensus.cc:2272] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.828889 20694 tablet_replica.cc:333] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.829434 20694 raft_consensus.cc:2243] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.829838 20694 raft_consensus.cc:2272] T f575f3dfa76f49958385c22448272c61 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.832444 20694 tablet_replica.cc:333] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.832988 20694 raft_consensus.cc:2243] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.833374 20694 raft_consensus.cc:2272] T f2a49f967b754cf9b4fc400d9b7b6dec P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.835240 20694 tablet_replica.cc:333] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.835783 20694 raft_consensus.cc:2243] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.836185 20694 raft_consensus.cc:2272] T 268b2be94e304b6089db69b7e298b414 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.838069 20694 tablet_replica.cc:333] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.838653 20694 raft_consensus.cc:2243] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.839433 20694 raft_consensus.cc:2272] T c5e67aacbc9140e5acab54d159ff5200 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.841586 20694 tablet_replica.cc:333] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.842314 20694 raft_consensus.cc:2243] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.842789 20694 raft_consensus.cc:2272] T 3196a23ac17a4a778e547bb9727a327a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.845134 20694 tablet_replica.cc:333] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.845824 20694 raft_consensus.cc:2243] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.846365 20694 raft_consensus.cc:2272] T e4915caf16db459c8af6f794aca6143c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.847077 30514 consensus_peers.cc:597] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.848570 20694 tablet_replica.cc:333] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.849207 20694 raft_consensus.cc:2243] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.849685 20694 raft_consensus.cc:2272] T 70b2a45700e14c769022b4d7361c3dee P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.851776 20694 tablet_replica.cc:333] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.852403 20694 raft_consensus.cc:2243] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.853305 20694 raft_consensus.cc:2272] T da3877cc17044236b7955a08144da062 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.855732 20694 tablet_replica.cc:333] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.856484 20694 raft_consensus.cc:2243] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.856971 20694 raft_consensus.cc:2272] T f33c2293eacb4a2594938e734a24a3d4 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.858944 20694 tablet_replica.cc:333] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.859441 20694 raft_consensus.cc:2243] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.859875 20694 raft_consensus.cc:2272] T b7fed5fd32f04d9a9145de3f147b7d1a P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.861855 20694 tablet_replica.cc:333] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.862373 20694 raft_consensus.cc:2243] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.862700 20694 raft_consensus.cc:2272] T bea36533e01d4b6b83d15744c3b6ef1d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.864418 20694 tablet_replica.cc:333] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.864954 20694 raft_consensus.cc:2243] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.865314 20694 raft_consensus.cc:2272] T 36116499b18c4347ab81d06dae391bde P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.867056 20694 tablet_replica.cc:333] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.867479 20694 raft_consensus.cc:2243] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.868093 20694 raft_consensus.cc:2272] T 02f8d6b0a2c24237bfd34dc90265a90b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.869828 20694 tablet_replica.cc:333] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.870338 20694 raft_consensus.cc:2243] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.870968 20694 raft_consensus.cc:2272] T 8c9be44608c24a2d82c02ed55ba6fa7c P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.872656 20694 tablet_replica.cc:333] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.873056 20694 raft_consensus.cc:2243] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.873381 20694 raft_consensus.cc:2272] T a3b774d24dc7436581485b454bbf956d P 9fbdb7dfefaa45db890b43f14b3867d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.875027 20694 tablet_replica.cc:333] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.875566 20694 raft_consensus.cc:2243] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.876248 20694 raft_consensus.cc:2272] T 66bf446bd28a42eca1b83c5e74dbc6bc P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.877962 20694 tablet_replica.cc:333] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.878440 20694 raft_consensus.cc:2243] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.878777 20694 raft_consensus.cc:2272] T a5e11a3a73344f4f89bb1e70414ac6c1 P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.880391 20694 tablet_replica.cc:333] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.880774 20694 raft_consensus.cc:2243] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.881105 20694 raft_consensus.cc:2272] T cdc31bc49093420ba42ce2487858ce2b P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.883598 20694 tablet_replica.cc:333] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8: stopping tablet replica
I20260709 13:09:37.884083 20694 raft_consensus.cc:2243] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.884539 20694 raft_consensus.cc:2272] T 648581791a9940b1859861be5ff76dbb P 9fbdb7dfefaa45db890b43f14b3867d8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.888995 30513 consensus_peers.cc:597] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.919533 30514 consensus_peers.cc:597] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.927224 30513 consensus_peers.cc:597] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.938205 30513 consensus_peers.cc:597] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.944669 30513 consensus_peers.cc:597] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc -> Peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Couldn't send request to peer 9ce9922db6144b968eeb78946b314cd2. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.955314 20694 tablet_server.cc:196] TabletServer@127.20.53.131:0 shutdown complete.
W20260709 13:09:37.964039 30514 consensus_peers.cc:597] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.131:42903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.966737 30514 consensus_peers.cc:597] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.131:42903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.974974 30514 consensus_peers.cc:597] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.131:42903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.024880 20694 tablet_server.cc:179] TabletServer@127.20.53.132:0 shutting down...
W20260709 13:09:38.058943 30514 consensus_peers.cc:597] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.131:42903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.060670 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:38.061653 20694 tablet_replica.cc:333] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.062611 20694 raft_consensus.cc:2243] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.063544 20694 raft_consensus.cc:2272] T 1aa4872354f64208a9454aa62f5fa488 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.065450 20694 tablet_replica.cc:333] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.066044 20694 raft_consensus.cc:2243] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.066471 20694 raft_consensus.cc:2272] T f5f14e3fbaa940a7a60f77290ba16ed2 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.068492 20694 tablet_replica.cc:333] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.069242 20694 raft_consensus.cc:2243] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.069747 20694 raft_consensus.cc:2272] T 8c184374a9da4329ac0084e458ebe905 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:38.070883 30514 consensus_peers.cc:597] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.131:42903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.071660 20694 tablet_replica.cc:333] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.072263 20694 raft_consensus.cc:2243] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.073004 20694 raft_consensus.cc:2272] T 748b5efba5c6486ab5974a080fc1d298 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.074867 20694 tablet_replica.cc:333] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.075390 20694 raft_consensus.cc:2243] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.075800 20694 raft_consensus.cc:2272] T a938526c3f4d4e7aaedba12e36fc5e25 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.077471 20694 tablet_replica.cc:333] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.078092 20694 raft_consensus.cc:2243] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.078892 20694 raft_consensus.cc:2272] T 2d1f795e00974bcc85806849556a3a35 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.080601 20694 tablet_replica.cc:333] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.081094 20694 raft_consensus.cc:2243] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.081509 20694 raft_consensus.cc:2272] T e0b1a3391a474c1d99afc49c8113990f P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.083324 20694 tablet_replica.cc:333] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.083842 20694 raft_consensus.cc:2243] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.084228 20694 raft_consensus.cc:2272] T 11632b693d5b414081e9b42a335cc646 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.085860 20694 tablet_replica.cc:333] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.086428 20694 raft_consensus.cc:2243] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.086817 20694 raft_consensus.cc:2272] T 13d32a45402a4c35a2191d14f57bc155 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.088508 20694 tablet_replica.cc:333] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.089157 20694 raft_consensus.cc:2243] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.089591 20694 raft_consensus.cc:2272] T 0a08cc3a22a945c3bb034b67deb2b379 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.091324 20694 tablet_replica.cc:333] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.091821 20694 raft_consensus.cc:2243] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.092533 20694 raft_consensus.cc:2272] T 5b58667a160f4c47bca188153bae9969 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.094308 20694 tablet_replica.cc:333] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.095001 20694 raft_consensus.cc:2243] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.095501 20694 raft_consensus.cc:2272] T 3f2c0ec726e342608b2e4bbce2a6dd76 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.097939 20694 tablet_replica.cc:333] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.098690 20694 raft_consensus.cc:2243] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.099577 20694 raft_consensus.cc:2272] T 39c9c5d7bdc24f9f9f2b47e78c0b682e P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.101363 20694 tablet_replica.cc:333] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.101852 20694 raft_consensus.cc:2243] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.102603 20694 raft_consensus.cc:2272] T 37c9a6a34931479d909d663f8b380d22 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.104216 20694 tablet_replica.cc:333] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.104673 20694 raft_consensus.cc:2243] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.104998 20694 raft_consensus.cc:2272] T 3f3222ed63e245c29f20b9920f4ca4e4 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.106684 20694 tablet_replica.cc:333] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.107156 20694 raft_consensus.cc:2243] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.107483 20694 raft_consensus.cc:2272] T 13d9fab0b2994ae382f21e0c00690b67 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.109215 20694 tablet_replica.cc:333] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.109684 20694 raft_consensus.cc:2243] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.110432 20694 raft_consensus.cc:2272] T 5f7962a39d6c4a7f9cee77c26e3c6018 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.112201 20694 tablet_replica.cc:333] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.112694 20694 raft_consensus.cc:2243] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.113412 20694 raft_consensus.cc:2272] T b3d42d01b36c4d8d97b27f7cb0a7d177 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.115727 20694 tablet_replica.cc:333] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.116459 20694 raft_consensus.cc:2243] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.116963 20694 raft_consensus.cc:2272] T f575f3dfa76f49958385c22448272c61 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:38.118753 30514 consensus_peers.cc:597] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc -> Peer 9fbdb7dfefaa45db890b43f14b3867d8 (127.20.53.131:42903): Couldn't send request to peer 9fbdb7dfefaa45db890b43f14b3867d8. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.131:42903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.119298 20694 tablet_replica.cc:333] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.119889 20694 raft_consensus.cc:2243] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.120630 20694 raft_consensus.cc:2272] T 70b2a45700e14c769022b4d7361c3dee P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.121855 31474 raft_consensus.cc:493] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d868b6e1c0be407dbc470002a447a620)
I20260709 13:09:38.122351 31474 raft_consensus.cc:515] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746044612df94d4493276099e7ab6adc" member_type: VOTER last_known_addr { host: "127.20.53.132" port: 41005 } } peers { permanent_uuid: "d868b6e1c0be407dbc470002a447a620" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 46147 } } peers { permanent_uuid: "9ce9922db6144b968eeb78946b314cd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 32987 } }
I20260709 13:09:38.122982 20694 tablet_replica.cc:333] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.123819 20694 raft_consensus.cc:2243] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.124332 20694 raft_consensus.cc:2272] T da3877cc17044236b7955a08144da062 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.124397 31474 leader_election.cc:290] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147), 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987)
I20260709 13:09:38.126605 20694 tablet_replica.cc:333] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.127372 20694 raft_consensus.cc:2243] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.127874 20694 raft_consensus.cc:2272] T f33c2293eacb4a2594938e734a24a3d4 P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:38.129261 30513 leader_election.cc:336] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d868b6e1c0be407dbc470002a447a620 (127.20.53.129:46147): Network error: Client connection negotiation failed: client connection to 127.20.53.129:46147: connect: Connection refused (error 111)
W20260709 13:09:38.129916 30513 leader_election.cc:336] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9ce9922db6144b968eeb78946b314cd2 (127.20.53.130:32987): Network error: Client connection negotiation failed: client connection to 127.20.53.130:32987: connect: Connection refused (error 111)
I20260709 13:09:38.130204 20694 tablet_replica.cc:333] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.130263 30513 leader_election.cc:304] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746044612df94d4493276099e7ab6adc; no voters: 9ce9922db6144b968eeb78946b314cd2, d868b6e1c0be407dbc470002a447a620
I20260709 13:09:38.130956 20694 raft_consensus.cc:2243] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.130967 31474 raft_consensus.cc:2749] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:38.131963 20694 raft_consensus.cc:2272] T 268b2be94e304b6089db69b7e298b414 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.133638 20694 tablet_replica.cc:333] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.134130 20694 raft_consensus.cc:2243] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.134536 20694 raft_consensus.cc:2272] T 3196a23ac17a4a778e547bb9727a327a P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.136078 20694 tablet_replica.cc:333] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.136509 20694 raft_consensus.cc:2243] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.137202 20694 raft_consensus.cc:2272] T e4915caf16db459c8af6f794aca6143c P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.138839 20694 tablet_replica.cc:333] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.139266 20694 raft_consensus.cc:2243] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.139634 20694 raft_consensus.cc:2272] T 3a853d771be841e38e285f5e9ba2b8a9 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.141347 20694 tablet_replica.cc:333] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.141842 20694 raft_consensus.cc:2243] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.142274 20694 raft_consensus.cc:2272] T 287a40c43efc4dd499b573c0e9e2278b P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.143946 20694 tablet_replica.cc:333] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.144444 20694 raft_consensus.cc:2243] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.144865 20694 raft_consensus.cc:2272] T 78821f2f4788465aa83d3e5c08880b46 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.146631 20694 tablet_replica.cc:333] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.147119 20694 raft_consensus.cc:2243] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.147500 20694 raft_consensus.cc:2272] T eb089b78d6b94082a36b55b40736d58b P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.149158 20694 tablet_replica.cc:333] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.149649 20694 raft_consensus.cc:2243] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.150415 20694 raft_consensus.cc:2272] T 3651fee799e6451a8fe39b2c4b19eaaf P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.152040 20694 tablet_replica.cc:333] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.152536 20694 raft_consensus.cc:2243] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.153208 20694 raft_consensus.cc:2272] T 7a1c8338cdfb4acc80a508d622aaa2c0 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.155434 20694 tablet_replica.cc:333] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.155929 20694 raft_consensus.cc:2243] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.156620 20694 raft_consensus.cc:2272] T a3b774d24dc7436581485b454bbf956d P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.158391 20694 tablet_replica.cc:333] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.159091 20694 raft_consensus.cc:2243] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.159651 20694 raft_consensus.cc:2272] T 8c9be44608c24a2d82c02ed55ba6fa7c P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.162077 20694 tablet_replica.cc:333] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.162580 20694 raft_consensus.cc:2243] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.162923 20694 raft_consensus.cc:2272] T 7b7681f8cd3041589fc1ba1729668b1f P 746044612df94d4493276099e7ab6adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.164551 20694 tablet_replica.cc:333] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.164976 20694 raft_consensus.cc:2243] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.165303 20694 raft_consensus.cc:2272] T 168e34fb6e72416680e50fbf1f847b6a P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.167001 20694 tablet_replica.cc:333] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.167451 20694 raft_consensus.cc:2243] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.167799 20694 raft_consensus.cc:2272] T efd931b10a3349438e3cc5b5d821ec37 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.169322 20694 tablet_replica.cc:333] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.169740 20694 raft_consensus.cc:2243] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.170071 20694 raft_consensus.cc:2272] T eb5f0e4a8947427fbf76e8880498a33e P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.171834 20694 tablet_replica.cc:333] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.172245 20694 raft_consensus.cc:2243] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.172576 20694 raft_consensus.cc:2272] T 978a4cca1c0a4046aa9666eec4400b95 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.174114 20694 tablet_replica.cc:333] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.174619 20694 raft_consensus.cc:2243] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.174953 20694 raft_consensus.cc:2272] T 5f2b6fea68dc4530a2e23485e5c6bbbf P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.176556 20694 tablet_replica.cc:333] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.176959 20694 raft_consensus.cc:2243] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.177343 20694 raft_consensus.cc:2272] T 02f8d6b0a2c24237bfd34dc90265a90b P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.179108 20694 tablet_replica.cc:333] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.179503 20694 raft_consensus.cc:2243] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.180249 20694 raft_consensus.cc:2272] T a5e11a3a73344f4f89bb1e70414ac6c1 P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.182111 20694 tablet_replica.cc:333] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.182628 20694 raft_consensus.cc:2243] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.182956 20694 raft_consensus.cc:2272] T dcad579e9c484c3cbb0c1352ef847b44 P 746044612df94d4493276099e7ab6adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.184602 20694 tablet_replica.cc:333] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.185014 20694 raft_consensus.cc:2243] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.185340 20694 raft_consensus.cc:2272] T 648581791a9940b1859861be5ff76dbb P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.187096 20694 tablet_replica.cc:333] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc: stopping tablet replica
I20260709 13:09:38.187487 20694 raft_consensus.cc:2243] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.187820 20694 raft_consensus.cc:2272] T 66bf446bd28a42eca1b83c5e74dbc6bc P 746044612df94d4493276099e7ab6adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.251988 20694 tablet_server.cc:196] TabletServer@127.20.53.132:0 shutdown complete.
I20260709 13:09:38.310340 20694 master.cc:562] Master@127.20.53.190:42571 shutting down...
I20260709 13:09:38.337343 20694 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.337893 20694 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.338269 20694 tablet_replica.cc:333] T 00000000000000000000000000000000 P 22a0333f2b28492daaf1f583e7d477fc: stopping tablet replica
I20260709 13:09:38.359570 20694 master.cc:584] Master@127.20.53.190:42571 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (30986 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:09:38.447801 20694 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.53.190:41393
I20260709 13:09:38.448863 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:38.454658 31477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.454921 31478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.455569 31480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:38.456323 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:38.457366 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:38.457546 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:38.457742 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602578457708 us; error 0 us; skew 500 ppm
I20260709 13:09:38.458379 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:38.460687 20694 webserver.cc:533] Webserver started at http://127.20.53.190:32797/ using document root <none> and password file <none>
I20260709 13:09:38.461197 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:38.461429 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:38.461709 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:38.462847 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/master-0-root/instance:
uuid: "dd2e5a32511f418fbc2a5efef1cca404"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-r056"
I20260709 13:09:38.467584 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:09:38.470909 31485 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.471678 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:38.471968 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/master-0-root
uuid: "dd2e5a32511f418fbc2a5efef1cca404"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-r056"
I20260709 13:09:38.472268 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:38.508446 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:38.509641 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:38.547709 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.190:41393
I20260709 13:09:38.547811 31536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.190:41393 every 8 connection(s)
I20260709 13:09:38.551589 31537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:38.562142 31537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404: Bootstrap starting.
I20260709 13:09:38.566967 31537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.570993 31537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404: No bootstrap required, opened a new log
I20260709 13:09:38.573047 31537 raft_consensus.cc:359] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2e5a32511f418fbc2a5efef1cca404" member_type: VOTER }
I20260709 13:09:38.573423 31537 raft_consensus.cc:385] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.573657 31537 raft_consensus.cc:740] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2e5a32511f418fbc2a5efef1cca404, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.574342 31537 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2e5a32511f418fbc2a5efef1cca404" member_type: VOTER }
I20260709 13:09:38.574793 31537 raft_consensus.cc:399] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:38.575003 31537 raft_consensus.cc:493] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:38.575302 31537 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.579648 31537 raft_consensus.cc:515] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2e5a32511f418fbc2a5efef1cca404" member_type: VOTER }
I20260709 13:09:38.580128 31537 leader_election.cc:304] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd2e5a32511f418fbc2a5efef1cca404; no voters: 
I20260709 13:09:38.581229 31537 leader_election.cc:290] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:38.581674 31540 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.583077 31540 raft_consensus.cc:697] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 1 LEADER]: Becoming Leader. State: Replica: dd2e5a32511f418fbc2a5efef1cca404, State: Running, Role: LEADER
I20260709 13:09:38.583716 31540 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2e5a32511f418fbc2a5efef1cca404" member_type: VOTER }
I20260709 13:09:38.584054 31537 sys_catalog.cc:565] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:38.588019 31541 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd2e5a32511f418fbc2a5efef1cca404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2e5a32511f418fbc2a5efef1cca404" member_type: VOTER } }
I20260709 13:09:38.588769 31541 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:38.588059 31542 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd2e5a32511f418fbc2a5efef1cca404. Latest consensus state: current_term: 1 leader_uuid: "dd2e5a32511f418fbc2a5efef1cca404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2e5a32511f418fbc2a5efef1cca404" member_type: VOTER } }
I20260709 13:09:38.590129 31542 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:38.591389 31547 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:38.599053 31547 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:38.599992 20694 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:38.607409 31547 catalog_manager.cc:1383] Generated new cluster ID: 4b758c0c00de4ab583a460d4c5ff4ac0
I20260709 13:09:38.607684 31547 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:38.649078 31547 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:38.650337 31547 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:38.677193 31547 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404: Generated new TSK 0
I20260709 13:09:38.677803 31547 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:38.731184 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:38.736955 31558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.737913 31559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.740199 31561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:38.740262 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:38.741346 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:38.741566 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:38.741735 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602578741717 us; error 0 us; skew 500 ppm
I20260709 13:09:38.742337 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:38.744537 20694 webserver.cc:533] Webserver started at http://127.20.53.129:38449/ using document root <none> and password file <none>
I20260709 13:09:38.745042 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:38.745267 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:38.745524 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:38.746623 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-0-root/instance:
uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-r056"
I20260709 13:09:38.750799 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:38.753862 31566 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.754702 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:38.754941 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-r056"
I20260709 13:09:38.755179 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:38.792290 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:38.793474 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:38.795019 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:38.797302 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:38.797549 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.797819 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:38.797988 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.835986 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:40131
I20260709 13:09:38.836086 31628 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:40131 every 8 connection(s)
I20260709 13:09:38.841029 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:38.848043 31633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.850416 31634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:38.851085 20694 server_base.cc:1061] running on GCE node
W20260709 13:09:38.851642 31636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:38.852548 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:38.852840 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:38.853041 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602578853025 us; error 0 us; skew 500 ppm
I20260709 13:09:38.853617 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:38.856649 20694 webserver.cc:533] Webserver started at http://127.20.53.130:37457/ using document root <none> and password file <none>
I20260709 13:09:38.857254 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:38.857251 31629 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41393
I20260709 13:09:38.857511 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:38.857892 31629 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:38.857993 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:38.858781 31629 heartbeater.cc:507] Master 127.20.53.190:41393 requested a full tablet report, sending...
I20260709 13:09:38.859764 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-1-root/instance:
uuid: "ab45d114a3c44125abc8a351be1dcd62"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-r056"
I20260709 13:09:38.861637 31502 ts_manager.cc:194] Registered new tserver with Master: cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131)
I20260709 13:09:38.864319 31502 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39868
I20260709 13:09:38.866277 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:09:38.869649 31641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.870548 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:38.871003 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-1-root
uuid: "ab45d114a3c44125abc8a351be1dcd62"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-r056"
I20260709 13:09:38.871430 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:38.881263 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:38.882431 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:38.883749 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:38.886440 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:38.886710 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.886979 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:38.887171 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.925904 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.130:41827
I20260709 13:09:38.926030 31703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.130:41827 every 8 connection(s)
I20260709 13:09:38.930689 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:38.936808 31707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.937527 31708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.939586 31710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:38.940024 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:38.941340 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:38.941601 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:38.941816 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602578941797 us; error 0 us; skew 500 ppm
I20260709 13:09:38.942457 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:38.943112 31704 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41393
I20260709 13:09:38.943492 31704 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:38.944231 31704 heartbeater.cc:507] Master 127.20.53.190:41393 requested a full tablet report, sending...
I20260709 13:09:38.945060 20694 webserver.cc:533] Webserver started at http://127.20.53.131:34985/ using document root <none> and password file <none>
I20260709 13:09:38.945744 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:38.946020 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:38.946422 31502 ts_manager.cc:194] Registered new tserver with Master: ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:38.946374 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:38.978283 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-2-root/instance:
uuid: "56673ab87f844f7daa600bf0cb16a3f6"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-r056"
I20260709 13:09:38.978505 31502 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39872
I20260709 13:09:38.987509 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:38.991573 31716 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.992559 20694 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:09:38.992889 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-2-root
uuid: "56673ab87f844f7daa600bf0cb16a3f6"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-r056"
I20260709 13:09:38.993168 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:39.012758 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:39.014149 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:39.015987 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:39.018445 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:39.018679 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.018932 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:39.019117 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.059453 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.131:33039
I20260709 13:09:39.059557 31778 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.131:33039 every 8 connection(s)
I20260709 13:09:39.075412 31779 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41393
I20260709 13:09:39.075915 31779 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:39.076725 31779 heartbeater.cc:507] Master 127.20.53.190:41393 requested a full tablet report, sending...
I20260709 13:09:39.078768 31502 ts_manager.cc:194] Registered new tserver with Master: 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.079269 20694 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015973283s
I20260709 13:09:39.080312 31502 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39878
I20260709 13:09:39.106055 31502 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39886:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:39.109072 31502 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:39.188822 31594 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb6f7a7c48d445d947a3aa6bd1a16bd (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:39.189121 31593 tablet_service.cc:1511] Processing CreateTablet for tablet b3d669a917624febab97033403e2a807 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:39.190806 31594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb6f7a7c48d445d947a3aa6bd1a16bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.191537 31593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d669a917624febab97033403e2a807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.198822 31669 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb6f7a7c48d445d947a3aa6bd1a16bd (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:39.199569 31668 tablet_service.cc:1511] Processing CreateTablet for tablet b3d669a917624febab97033403e2a807 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:39.200493 31669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb6f7a7c48d445d947a3aa6bd1a16bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.201195 31668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d669a917624febab97033403e2a807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.205435 31592 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3c2c5cf291469987ddb3a9ea25227d (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:39.206979 31592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3c2c5cf291469987ddb3a9ea25227d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.213614 31667 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3c2c5cf291469987ddb3a9ea25227d (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:39.215126 31667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3c2c5cf291469987ddb3a9ea25227d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.215440 31666 tablet_service.cc:1511] Processing CreateTablet for tablet d0ea2a36fc0e458f87cfd8fb7f993933 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:39.217136 31666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ea2a36fc0e458f87cfd8fb7f993933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.218289 31591 tablet_service.cc:1511] Processing CreateTablet for tablet d0ea2a36fc0e458f87cfd8fb7f993933 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:39.220021 31591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ea2a36fc0e458f87cfd8fb7f993933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.231209 31744 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb6f7a7c48d445d947a3aa6bd1a16bd (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:39.232528 31744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb6f7a7c48d445d947a3aa6bd1a16bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.235399 31590 tablet_service.cc:1511] Processing CreateTablet for tablet 26b4977020e24cb4ad8ea744e3d858f2 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:39.236807 31590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b4977020e24cb4ad8ea744e3d858f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.238740 31743 tablet_service.cc:1511] Processing CreateTablet for tablet b3d669a917624febab97033403e2a807 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:39.240103 31743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d669a917624febab97033403e2a807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.243340 31742 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3c2c5cf291469987ddb3a9ea25227d (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:39.244738 31742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3c2c5cf291469987ddb3a9ea25227d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.247345 31741 tablet_service.cc:1511] Processing CreateTablet for tablet d0ea2a36fc0e458f87cfd8fb7f993933 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:39.249392 31664 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc8eae9083d41fa97d1bc5164749013 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:39.250870 31664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc8eae9083d41fa97d1bc5164749013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.248731 31741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ea2a36fc0e458f87cfd8fb7f993933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.256016 31665 tablet_service.cc:1511] Processing CreateTablet for tablet 26b4977020e24cb4ad8ea744e3d858f2 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:39.257472 31665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b4977020e24cb4ad8ea744e3d858f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.256016 31740 tablet_service.cc:1511] Processing CreateTablet for tablet 26b4977020e24cb4ad8ea744e3d858f2 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:39.266379 31740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b4977020e24cb4ad8ea744e3d858f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.274526 31589 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc8eae9083d41fa97d1bc5164749013 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:39.275931 31589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc8eae9083d41fa97d1bc5164749013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.279327 31739 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc8eae9083d41fa97d1bc5164749013 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:39.280723 31739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc8eae9083d41fa97d1bc5164749013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.289310 31588 tablet_service.cc:1511] Processing CreateTablet for tablet de472d0e84694ddcb8211372d6df7065 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:39.290766 31588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de472d0e84694ddcb8211372d6df7065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.301255 31664 tablet_service.cc:1511] Processing CreateTablet for tablet de472d0e84694ddcb8211372d6df7065 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:39.302839 31664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de472d0e84694ddcb8211372d6df7065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.306023 31738 tablet_service.cc:1511] Processing CreateTablet for tablet de472d0e84694ddcb8211372d6df7065 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:39.307446 31738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de472d0e84694ddcb8211372d6df7065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.315237 31794 tablet_bootstrap.cc:492] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.329473 31587 tablet_service.cc:1511] Processing CreateTablet for tablet dda8fbffbe494758b5a57a107b430bd7 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:39.330910 31587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda8fbffbe494758b5a57a107b430bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.335186 31669 tablet_service.cc:1511] Processing CreateTablet for tablet dda8fbffbe494758b5a57a107b430bd7 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:39.338306 31740 tablet_service.cc:1511] Processing CreateTablet for tablet dda8fbffbe494758b5a57a107b430bd7 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:39.342989 31795 tablet_bootstrap.cc:492] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:39.344794 31669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda8fbffbe494758b5a57a107b430bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.355202 31795 tablet_bootstrap.cc:654] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.361183 31740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda8fbffbe494758b5a57a107b430bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.372184 31796 tablet_bootstrap.cc:492] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
I20260709 13:09:39.372797 31794 tablet_bootstrap.cc:654] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.380924 31796 tablet_bootstrap.cc:654] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.389631 31594 tablet_service.cc:1511] Processing CreateTablet for tablet 2b0a356766e8475ca77a744b00a590f6 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:39.391434 31594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0a356766e8475ca77a744b00a590f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.398514 31738 tablet_service.cc:1511] Processing CreateTablet for tablet 2b0a356766e8475ca77a744b00a590f6 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:39.399868 31738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0a356766e8475ca77a744b00a590f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.401702 31667 tablet_service.cc:1511] Processing CreateTablet for tablet 6678a0f5e40841f78185ae5e68503250 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:39.403012 31667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6678a0f5e40841f78185ae5e68503250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.403451 31664 tablet_service.cc:1511] Processing CreateTablet for tablet 2b0a356766e8475ca77a744b00a590f6 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:39.403997 31740 tablet_service.cc:1511] Processing CreateTablet for tablet 6678a0f5e40841f78185ae5e68503250 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:39.404769 31664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0a356766e8475ca77a744b00a590f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.405260 31740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6678a0f5e40841f78185ae5e68503250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.409420 31794 tablet_bootstrap.cc:492] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.409997 31794 ts_tablet_manager.cc:1403] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.000s
I20260709 13:09:39.410389 31795 tablet_bootstrap.cc:492] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:39.410902 31795 ts_tablet_manager.cc:1403] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.008s
I20260709 13:09:39.413486 31794 raft_consensus.cc:359] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:39.421063 31794 raft_consensus.cc:385] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.399612 31587 tablet_service.cc:1511] Processing CreateTablet for tablet 6678a0f5e40841f78185ae5e68503250 (DEFAULT_TABLE table=test-workload [id=b1f4aa4721ce45a6baecebb5bc0c57be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:39.421550 31794 raft_consensus.cc:740] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.422248 31587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6678a0f5e40841f78185ae5e68503250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.422679 31794 consensus_queue.cc:260] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:39.414004 31795 raft_consensus.cc:359] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.426337 31795 raft_consensus.cc:385] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.426656 31795 raft_consensus.cc:740] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.427318 31795 consensus_queue.cc:260] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.415956 31796 tablet_bootstrap.cc:492] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:39.428660 31796 ts_tablet_manager.cc:1403] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.008s
I20260709 13:09:39.429541 31629 heartbeater.cc:499] Master 127.20.53.190:41393 was elected leader, sending a full tablet report...
I20260709 13:09:39.431803 31796 raft_consensus.cc:359] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:39.432535 31796 raft_consensus.cc:385] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.432884 31796 raft_consensus.cc:740] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.433755 31796 consensus_queue.cc:260] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:39.437223 31795 ts_tablet_manager.cc:1434] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.005s
I20260709 13:09:39.438537 31795 tablet_bootstrap.cc:492] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:39.439656 31801 raft_consensus.cc:493] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.440220 31801 raft_consensus.cc:515] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.452064 31794 ts_tablet_manager.cc:1434] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.042s	user 0.021s	sys 0.008s
I20260709 13:09:39.452482 31704 heartbeater.cc:499] Master 127.20.53.190:41393 was elected leader, sending a full tablet report...
I20260709 13:09:39.453354 31794 tablet_bootstrap.cc:492] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.459887 31794 tablet_bootstrap.cc:654] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.461467 31795 tablet_bootstrap.cc:654] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.470234 31801 leader_election.cc:290] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.476086 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:39.477234 31794 tablet_bootstrap.cc:492] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.477762 31794 ts_tablet_manager.cc:1403] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
W20260709 13:09:39.478572 31567 leader_election.cc:343] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.481618 31795 tablet_bootstrap.cc:492] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:39.481323 31794 raft_consensus.cc:359] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.482288 31794 raft_consensus.cc:385] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.482333 31795 ts_tablet_manager.cc:1403] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.005s
I20260709 13:09:39.482844 31794 raft_consensus.cc:740] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.484607 31794 consensus_queue.cc:260] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.487696 31794 ts_tablet_manager.cc:1434] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:39.488727 31794 tablet_bootstrap.cc:492] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.489070 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
W20260709 13:09:39.491184 31568 leader_election.cc:343] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.491653 31568 leader_election.cc:304] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:39.492874 31802 raft_consensus.cc:2749] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.494058 31779 heartbeater.cc:499] Master 127.20.53.190:41393 was elected leader, sending a full tablet report...
I20260709 13:09:39.494562 31796 ts_tablet_manager.cc:1434] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.066s	user 0.018s	sys 0.013s
I20260709 13:09:39.496150 31795 raft_consensus.cc:359] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.496730 31794 tablet_bootstrap.cc:654] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.496912 31795 raft_consensus.cc:385] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.497313 31795 raft_consensus.cc:740] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.498294 31796 tablet_bootstrap.cc:492] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
I20260709 13:09:39.505645 31796 tablet_bootstrap.cc:654] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.506497 31795 consensus_queue.cc:260] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.508553 31795 ts_tablet_manager.cc:1434] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:09:39.509038 31794 tablet_bootstrap.cc:492] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.509408 31795 tablet_bootstrap.cc:492] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:39.509624 31794 ts_tablet_manager.cc:1403] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:09:39.513109 31794 raft_consensus.cc:359] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.513919 31794 raft_consensus.cc:385] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.514271 31794 raft_consensus.cc:740] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.515193 31794 consensus_queue.cc:260] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.517926 31794 ts_tablet_manager.cc:1434] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:09:39.518657 31795 tablet_bootstrap.cc:654] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.519028 31794 tablet_bootstrap.cc:492] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.527025 31794 tablet_bootstrap.cc:654] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.539172 31794 tablet_bootstrap.cc:492] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.539731 31794 ts_tablet_manager.cc:1403] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 13:09:39.540856 31803 raft_consensus.cc:493] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.541600 31803 raft_consensus.cc:515] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:39.544271 31794 raft_consensus.cc:359] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.545148 31794 raft_consensus.cc:385] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.545487 31794 raft_consensus.cc:740] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.546753 31794 consensus_queue.cc:260] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.549497 31794 ts_tablet_manager.cc:1434] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:09:39.550660 31794 tablet_bootstrap.cc:492] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.557910 31794 tablet_bootstrap.cc:654] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.560777 31803 leader_election.cc:290] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
W20260709 13:09:39.564303 31780 tablet.cc:2406] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:39.567680 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb6f7a7c48d445d947a3aa6bd1a16bd" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
W20260709 13:09:39.569895 31720 leader_election.cc:343] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.583618 31796 tablet_bootstrap.cc:492] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:39.584295 31796 ts_tablet_manager.cc:1403] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.086s	user 0.033s	sys 0.046s
I20260709 13:09:39.585103 31794 tablet_bootstrap.cc:492] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.585706 31794 ts_tablet_manager.cc:1403] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.012s
I20260709 13:09:39.585790 31795 tablet_bootstrap.cc:492] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:39.586369 31795 ts_tablet_manager.cc:1403] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.011s
I20260709 13:09:39.587473 31796 raft_consensus.cc:359] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.588246 31796 raft_consensus.cc:385] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.588536 31796 raft_consensus.cc:740] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.589283 31796 consensus_queue.cc:260] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.589386 31794 raft_consensus.cc:359] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.590329 31794 raft_consensus.cc:385] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.590695 31794 raft_consensus.cc:740] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.591480 31796 ts_tablet_manager.cc:1434] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:09:39.591701 31794 consensus_queue.cc:260] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.592496 31796 tablet_bootstrap.cc:492] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
W20260709 13:09:39.594761 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:39.596854 31794 ts_tablet_manager.cc:1434] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:39.598114 31794 tablet_bootstrap.cc:492] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.600327 31796 tablet_bootstrap.cc:654] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.605966 31794 tablet_bootstrap.cc:654] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.606869 31795 raft_consensus.cc:359] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.607862 31795 raft_consensus.cc:385] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.608233 31795 raft_consensus.cc:740] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.609222 31795 consensus_queue.cc:260] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.610702 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb6f7a7c48d445d947a3aa6bd1a16bd" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:39.611340 31679 raft_consensus.cc:2468] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 0.
I20260709 13:09:39.612723 31717 leader_election.cc:304] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.613523 31803 raft_consensus.cc:2804] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.613962 31803 raft_consensus.cc:493] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.614310 31803 raft_consensus.cc:3060] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.614434 31794 tablet_bootstrap.cc:492] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.614903 31796 tablet_bootstrap.cc:492] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:39.615253 31794 ts_tablet_manager.cc:1403] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:09:39.615451 31796 ts_tablet_manager.cc:1403] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.002s
I20260709 13:09:39.613364 31795 ts_tablet_manager.cc:1434] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:09:39.618707 31794 raft_consensus.cc:359] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.618920 31796 raft_consensus.cc:359] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.619697 31796 raft_consensus.cc:385] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.620134 31796 raft_consensus.cc:740] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.621134 31796 consensus_queue.cc:260] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.622087 31803 raft_consensus.cc:515] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:39.625036 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb6f7a7c48d445d947a3aa6bd1a16bd" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
W20260709 13:09:39.626488 31720 leader_election.cc:343] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.619632 31794 raft_consensus.cc:385] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.629680 31795 tablet_bootstrap.cc:492] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:39.630455 31794 raft_consensus.cc:740] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.633939 31794 consensus_queue.cc:260] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.637641 31803 leader_election.cc:290] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:39.638551 31803 raft_consensus.cc:493] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.639122 31803 raft_consensus.cc:515] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.642866 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
I20260709 13:09:39.642869 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb6f7a7c48d445d947a3aa6bd1a16bd" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:39.644325 31679 raft_consensus.cc:3060] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.647001 31795 tablet_bootstrap.cc:654] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.651458 31794 ts_tablet_manager.cc:1434] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:09:39.651684 31796 ts_tablet_manager.cc:1434] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.025s
I20260709 13:09:39.652823 31796 tablet_bootstrap.cc:492] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
W20260709 13:09:39.655565 31720 leader_election.cc:343] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.660073 31796 tablet_bootstrap.cc:654] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.666023 31794 tablet_bootstrap.cc:492] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.670933 31803 leader_election.cc:290] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:39.671514 31679 raft_consensus.cc:2468] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:39.671584 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:39.672389 31678 raft_consensus.cc:2468] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 0.
I20260709 13:09:39.672962 31717 leader_election.cc:304] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.677388 31794 tablet_bootstrap.cc:654] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.678602 31802 raft_consensus.cc:493] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.679179 31802 raft_consensus.cc:515] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.682857 31717 leader_election.cc:304] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.682914 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:39.683632 31678 raft_consensus.cc:2468] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in term 0.
I20260709 13:09:39.684566 31817 raft_consensus.cc:2804] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.684762 31796 tablet_bootstrap.cc:492] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:39.685518 31816 raft_consensus.cc:2804] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.685639 31802 leader_election.cc:290] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.686017 31816 raft_consensus.cc:493] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.685636 31796 ts_tablet_manager.cc:1403] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.008s
I20260709 13:09:39.685552 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
I20260709 13:09:39.685150 31817 raft_consensus.cc:697] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:39.687628 31567 leader_election.cc:304] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:39.689050 31817 consensus_queue.cc:237] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:39.689733 31794 tablet_bootstrap.cc:492] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.690263 31794 ts_tablet_manager.cc:1403] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.006s
W20260709 13:09:39.690155 31568 leader_election.cc:343] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.691493 31802 raft_consensus.cc:2804] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.691402 31796 raft_consensus.cc:359] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.687629 31816 raft_consensus.cc:3060] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.692062 31802 raft_consensus.cc:493] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.701886 31795 tablet_bootstrap.cc:492] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:39.702667 31795 ts_tablet_manager.cc:1403] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.013s
I20260709 13:09:39.704034 31500 catalog_manager.cc:5697] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.698731 31802 raft_consensus.cc:3060] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.706077 31795 raft_consensus.cc:359] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.707211 31795 raft_consensus.cc:385] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.710121 31816 raft_consensus.cc:515] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.698549 31794 raft_consensus.cc:359] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.714501 31794 raft_consensus.cc:385] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.714829 31794 raft_consensus.cc:740] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.715655 31794 consensus_queue.cc:260] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.698858 31796 raft_consensus.cc:385] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.716790 31796 raft_consensus.cc:740] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.717178 31802 raft_consensus.cc:515] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.717639 31796 consensus_queue.cc:260] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.714069 31816 leader_election.cc:290] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:39.719264 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:39.720029 31679 raft_consensus.cc:3060] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.720157 31796 ts_tablet_manager.cc:1434] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:09:39.720507 31802 leader_election.cc:290] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 election: Requested vote from peers ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.720659 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:39.721290 31678 raft_consensus.cc:3060] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.722692 31794 ts_tablet_manager.cc:1434] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:09:39.723853 31794 tablet_bootstrap.cc:492] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.724746 31796 tablet_bootstrap.cc:492] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
I20260709 13:09:39.707647 31795 raft_consensus.cc:740] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.732474 31795 consensus_queue.cc:260] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.735069 31795 ts_tablet_manager.cc:1434] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:09:39.730405 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:39.736564 31604 raft_consensus.cc:3060] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.737799 31679 raft_consensus.cc:2468] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:39.738855 31796 tablet_bootstrap.cc:654] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.739163 31717 leader_election.cc:304] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: 
I20260709 13:09:39.740166 31816 raft_consensus.cc:2804] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.740692 31816 raft_consensus.cc:697] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:39.741621 31816 consensus_queue.cc:237] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.736172 31795 tablet_bootstrap.cc:492] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:39.748373 31794 tablet_bootstrap.cc:654] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.748785 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
W20260709 13:09:39.750754 31568 leader_election.cc:343] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.755935 31678 raft_consensus.cc:2468] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in term 1.
I20260709 13:09:39.757829 31567 leader_election.cc:304] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 56673ab87f844f7daa600bf0cb16a3f6
I20260709 13:09:39.758630 31800 raft_consensus.cc:493] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.759272 31802 raft_consensus.cc:2804] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.759824 31802 raft_consensus.cc:697] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 LEADER]: Becoming Leader. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Running, Role: LEADER
I20260709 13:09:39.759367 31800 raft_consensus.cc:515] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.760444 31604 raft_consensus.cc:2468] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:39.760651 31802 consensus_queue.cc:237] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.771209 31796 tablet_bootstrap.cc:492] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:39.766572 31800 leader_election.cc:290] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.771988 31796 ts_tablet_manager.cc:1403] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.012s
I20260709 13:09:39.780668 31796 raft_consensus.cc:359] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.781769 31796 raft_consensus.cc:385] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.782195 31796 raft_consensus.cc:740] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.785084 31795 tablet_bootstrap.cc:654] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.789233 31794 tablet_bootstrap.cc:492] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.789893 31794 ts_tablet_manager.cc:1403] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.008s
I20260709 13:09:39.792745 31802 raft_consensus.cc:493] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.793434 31802 raft_consensus.cc:515] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.783318 31796 consensus_queue.cc:260] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.797148 31794 raft_consensus.cc:359] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.797886 31794 raft_consensus.cc:385] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.798189 31794 raft_consensus.cc:740] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.799320 31796 ts_tablet_manager.cc:1434] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:09:39.799256 31794 consensus_queue.cc:260] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.800436 31796 tablet_bootstrap.cc:492] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
I20260709 13:09:39.801800 31794 ts_tablet_manager.cc:1434] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:39.802835 31794 tablet_bootstrap.cc:492] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.798722 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:39.805516 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
I20260709 13:09:39.805686 31678 raft_consensus.cc:2468] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in term 0.
W20260709 13:09:39.807091 31645 leader_election.cc:343] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.808337 31796 tablet_bootstrap.cc:654] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.808985 31794 tablet_bootstrap.cc:654] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.809445 31567 leader_election.cc:304] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:39.810318 31801 raft_consensus.cc:2804] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.810667 31801 raft_consensus.cc:493] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.810787 31802 leader_election.cc:290] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.811025 31801 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.815332 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
W20260709 13:09:39.816816 31568 leader_election.cc:343] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.819989 31501 catalog_manager.cc:5697] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129). New cstate: current_term: 1 leader_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.824357 31796 tablet_bootstrap.cc:492] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:39.824867 31796 ts_tablet_manager.cc:1403] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.011s
I20260709 13:09:39.825979 31794 tablet_bootstrap.cc:492] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.826493 31794 ts_tablet_manager.cc:1403] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.008s
I20260709 13:09:39.826913 31816 raft_consensus.cc:493] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.827384 31816 raft_consensus.cc:515] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.828017 31796 raft_consensus.cc:359] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.828747 31796 raft_consensus.cc:385] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.829031 31796 raft_consensus.cc:740] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.829423 31816 leader_election.cc:290] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:39.829823 31796 consensus_queue.cc:260] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.831875 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
I20260709 13:09:39.832406 31796 ts_tablet_manager.cc:1434] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:09:39.826035 31801 raft_consensus.cc:515] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.833400 31796 tablet_bootstrap.cc:492] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
I20260709 13:09:39.829754 31794 raft_consensus.cc:359] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.836050 31794 raft_consensus.cc:385] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.836321 31794 raft_consensus.cc:740] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.836539 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:39.836687 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:39.837105 31679 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.836977 31794 consensus_queue.cc:260] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.839587 31794 ts_tablet_manager.cc:1434] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:39.840240 31678 raft_consensus.cc:2393] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56673ab87f844f7daa600bf0cb16a3f6 in current term 1: Already voted for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in this term.
I20260709 13:09:39.840448 31794 tablet_bootstrap.cc:492] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62: Bootstrap starting.
I20260709 13:09:39.840549 31796 tablet_bootstrap.cc:654] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.841392 31717 leader_election.cc:304] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6; no voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.842738 31816 raft_consensus.cc:3060] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.844444 31679 raft_consensus.cc:2468] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in term 1.
I20260709 13:09:39.845657 31567 leader_election.cc:304] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:39.846505 31802 raft_consensus.cc:2804] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.846805 31794 tablet_bootstrap.cc:654] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.858191 31816 raft_consensus.cc:2749] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.861467 31796 tablet_bootstrap.cc:492] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:39.861842 31796 ts_tablet_manager.cc:1403] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.011s
I20260709 13:09:39.865162 31796 raft_consensus.cc:359] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.865861 31796 raft_consensus.cc:385] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.866156 31796 raft_consensus.cc:740] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.866446 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:39.867163 31801 leader_election.cc:290] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 election: Requested vote from peers ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.867066 31796 consensus_queue.cc:260] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.868140 31754 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.870775 31800 raft_consensus.cc:493] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.871464 31800 raft_consensus.cc:515] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.872816 31802 raft_consensus.cc:697] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 LEADER]: Becoming Leader. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Running, Role: LEADER
I20260709 13:09:39.873915 31802 consensus_queue.cc:237] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.875999 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
I20260709 13:09:39.876521 31754 raft_consensus.cc:2468] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in term 1.
W20260709 13:09:39.878252 31645 leader_election.cc:343] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.880146 31796 ts_tablet_manager.cc:1434] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:09:39.879789 31800 leader_election.cc:290] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.881505 31796 tablet_bootstrap.cc:492] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
I20260709 13:09:39.882927 31795 tablet_bootstrap.cc:492] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:39.883467 31795 ts_tablet_manager.cc:1403] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.148s	user 0.012s	sys 0.005s
I20260709 13:09:39.886709 31795 raft_consensus.cc:359] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:39.887379 31795 raft_consensus.cc:385] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.887668 31795 raft_consensus.cc:740] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.888367 31795 consensus_queue.cc:260] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:39.891132 31500 catalog_manager.cc:5697] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.892685 31796 tablet_bootstrap.cc:654] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.893281 31794 tablet_bootstrap.cc:492] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62: No bootstrap required, opened a new log
I20260709 13:09:39.893810 31794 ts_tablet_manager.cc:1403] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.025s
I20260709 13:09:39.900195 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
I20260709 13:09:39.900884 31754 raft_consensus.cc:2468] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 0.
I20260709 13:09:39.902029 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
I20260709 13:09:39.902272 31794 raft_consensus.cc:359] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.902753 31753 raft_consensus.cc:2468] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 0.
I20260709 13:09:39.903036 31794 raft_consensus.cc:385] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.903383 31794 raft_consensus.cc:740] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.903851 31643 leader_election.cc:304] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.904073 31794 consensus_queue.cc:260] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.905417 31800 raft_consensus.cc:2804] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.905827 31800 raft_consensus.cc:493] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.906448 31643 leader_election.cc:304] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.907307 31800 raft_consensus.cc:3060] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.905309 31501 catalog_manager.cc:5697] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129). New cstate: current_term: 1 leader_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.907317 31795 ts_tablet_manager.cc:1434] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:09:39.909298 31795 tablet_bootstrap.cc:492] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:39.913004 31816 raft_consensus.cc:493] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.913638 31816 raft_consensus.cc:515] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.917717 31800 raft_consensus.cc:515] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.919970 31800 leader_election.cc:290] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.920771 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:39.921164 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
I20260709 13:09:39.922070 31603 raft_consensus.cc:2468] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 0.
W20260709 13:09:39.922712 31645 leader_election.cc:343] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.923435 31842 raft_consensus.cc:2804] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.923918 31842 raft_consensus.cc:493] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.923602 31720 leader_election.cc:304] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:39.924762 31817 raft_consensus.cc:2804] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.925168 31817 raft_consensus.cc:493] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.925484 31817 raft_consensus.cc:3060] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.929724 31816 leader_election.cc:290] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:39.935321 31795 tablet_bootstrap.cc:654] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.933043 31817 raft_consensus.cc:515] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.937444 31840 raft_consensus.cc:493] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.938203 31794 ts_tablet_manager.cc:1434] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.013s
I20260709 13:09:39.938053 31840 raft_consensus.cc:515] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.939765 31817 leader_election.cc:290] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:39.939874 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:39.940722 31603 raft_consensus.cc:3060] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.941346 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
I20260709 13:09:39.944075 31800 raft_consensus.cc:493] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.944496 31840 leader_election.cc:290] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.944576 31800 raft_consensus.cc:515] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.949203 31796 tablet_bootstrap.cc:492] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:39.949718 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:39.955106 31796 ts_tablet_manager.cc:1403] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.074s	user 0.030s	sys 0.010s
I20260709 13:09:39.950810 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
I20260709 13:09:39.954381 31603 raft_consensus.cc:2468] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:39.956629 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
W20260709 13:09:39.956975 31645 leader_election.cc:343] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.957402 31754 raft_consensus.cc:2393] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab45d114a3c44125abc8a351be1dcd62 in current term 1: Already voted for candidate 56673ab87f844f7daa600bf0cb16a3f6 in this term.
I20260709 13:09:39.957509 31720 leader_election.cc:304] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:39.955206 31753 raft_consensus.cc:3060] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.958101 31800 leader_election.cc:290] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.924317 31842 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.958806 31817 raft_consensus.cc:2804] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.959484 31817 raft_consensus.cc:697] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:39.960340 31817 consensus_queue.cc:237] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.963829 31796 raft_consensus.cc:359] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.964752 31796 raft_consensus.cc:385] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.965087 31796 raft_consensus.cc:740] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.965597 31753 raft_consensus.cc:2468] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 1.
I20260709 13:09:39.966545 31842 raft_consensus.cc:515] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.968396 31842 leader_election.cc:290] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:39.969066 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:39.969547 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:39.968418 31796 consensus_queue.cc:260] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.970216 31679 raft_consensus.cc:2468] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 0.
I20260709 13:09:39.971550 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:39.971830 31796 ts_tablet_manager.cc:1434] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 13:09:39.972067 31679 raft_consensus.cc:3060] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.972914 31796 tablet_bootstrap.cc:492] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
W20260709 13:09:39.973083 31645 leader_election.cc:343] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.975343 31500 catalog_manager.cc:5697] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.979125 31796 tablet_bootstrap.cc:654] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.979364 31679 raft_consensus.cc:2468] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:39.979754 31795 tablet_bootstrap.cc:492] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:39.980315 31795 ts_tablet_manager.cc:1403] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.008s
I20260709 13:09:39.981220 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
I20260709 13:09:39.983438 31795 raft_consensus.cc:359] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.983939 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:39.984874 31753 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.987083 31643 leader_election.cc:304] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62; no voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.988744 31842 raft_consensus.cc:2749] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.990367 31643 leader_election.cc:304] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.991086 31795 raft_consensus.cc:385] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.992362 31753 raft_consensus.cc:2468] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 1.
I20260709 13:09:39.992550 31842 raft_consensus.cc:2804] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:39.991892 31643 leader_election.cc:343] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.993726 31842 raft_consensus.cc:697] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:39.993260 31795 raft_consensus.cc:740] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.994562 31643 leader_election.cc:304] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62; no voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.995328 31800 raft_consensus.cc:2749] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.995189 31842 consensus_queue.cc:237] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.995817 31796 tablet_bootstrap.cc:492] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:39.995445 31795 consensus_queue.cc:260] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:39.996342 31796 ts_tablet_manager.cc:1403] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 13:09:39.996562 31643 leader_election.cc:304] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:39.997453 31800 raft_consensus.cc:2804] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.997905 31800 raft_consensus.cc:697] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:39.998862 31800 consensus_queue.cc:237] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.000545 31796 raft_consensus.cc:359] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.001238 31796 raft_consensus.cc:385] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.001498 31796 raft_consensus.cc:740] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.002246 31796 consensus_queue.cc:260] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.004542 31796 ts_tablet_manager.cc:1434] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:40.005604 31795 ts_tablet_manager.cc:1434] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:40.005947 31796 tablet_bootstrap.cc:492] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6: Bootstrap starting.
I20260709 13:09:40.012190 31796 tablet_bootstrap.cc:654] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.018086 31795 tablet_bootstrap.cc:492] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:40.023157 31796 tablet_bootstrap.cc:492] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6: No bootstrap required, opened a new log
I20260709 13:09:40.023653 31796 ts_tablet_manager.cc:1403] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:09:40.026593 31795 tablet_bootstrap.cc:654] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.026255 31796 raft_consensus.cc:359] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.030069 31796 raft_consensus.cc:385] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.030385 31796 raft_consensus.cc:740] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.031062 31796 consensus_queue.cc:260] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.032896 31796 ts_tablet_manager.cc:1434] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:40.033628 31500 catalog_manager.cc:5697] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.035926 31795 tablet_bootstrap.cc:492] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:40.036458 31795 ts_tablet_manager.cc:1403] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.007s
I20260709 13:09:40.041127 31795 raft_consensus.cc:359] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.041687 31795 raft_consensus.cc:385] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.041926 31795 raft_consensus.cc:740] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.042738 31795 consensus_queue.cc:260] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.044823 31795 ts_tablet_manager.cc:1434] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:40.045814 31795 tablet_bootstrap.cc:492] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:40.047302 31501 catalog_manager.cc:5697] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.050856 31795 tablet_bootstrap.cc:654] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.055487 31795 tablet_bootstrap.cc:492] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:40.055892 31795 ts_tablet_manager.cc:1403] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:40.058367 31795 raft_consensus.cc:359] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.058967 31795 raft_consensus.cc:385] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.059201 31795 raft_consensus.cc:740] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.059813 31795 consensus_queue.cc:260] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.061849 31795 ts_tablet_manager.cc:1434] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:40.062811 31795 tablet_bootstrap.cc:492] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:40.068091 31795 tablet_bootstrap.cc:654] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.072224 31795 tablet_bootstrap.cc:492] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:40.072528 31795 ts_tablet_manager.cc:1403] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:09:40.073098 31802 raft_consensus.cc:493] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.073695 31802 raft_consensus.cc:515] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.074720 31795 raft_consensus.cc:359] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.075237 31795 raft_consensus.cc:385] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.075444 31795 raft_consensus.cc:740] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.075542 31802 leader_election.cc:290] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:40.076103 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:40.076563 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
I20260709 13:09:40.077168 31753 raft_consensus.cc:2393] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in current term 1: Already voted for candidate ab45d114a3c44125abc8a351be1dcd62 in this term.
I20260709 13:09:40.077221 31795 consensus_queue.cc:260] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.078075 31568 leader_election.cc:304] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:40.078855 31802 raft_consensus.cc:3060] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.079241 31816 raft_consensus.cc:493] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.079499 31795 ts_tablet_manager.cc:1434] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:09:40.079733 31816 raft_consensus.cc:515] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.080438 31795 tablet_bootstrap.cc:492] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:40.081758 31816 leader_election.cc:290] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:40.082525 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6678a0f5e40841f78185ae5e68503250" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
I20260709 13:09:40.082801 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6678a0f5e40841f78185ae5e68503250" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:40.083443 31679 raft_consensus.cc:2468] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 0.
W20260709 13:09:40.083886 31720 leader_election.cc:343] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.084637 31717 leader_election.cc:304] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:40.086351 31816 raft_consensus.cc:2804] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.086715 31816 raft_consensus.cc:493] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.087059 31816 raft_consensus.cc:3060] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.088994 31795 tablet_bootstrap.cc:654] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.089974 31802 raft_consensus.cc:2749] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.093465 31795 tablet_bootstrap.cc:492] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: No bootstrap required, opened a new log
I20260709 13:09:40.094137 31795 ts_tablet_manager.cc:1403] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.014s	user 0.002s	sys 0.008s
I20260709 13:09:40.093541 31816 raft_consensus.cc:515] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.096107 31816 leader_election.cc:290] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:40.096698 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6678a0f5e40841f78185ae5e68503250" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:40.096452 31795 raft_consensus.cc:359] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.097129 31795 raft_consensus.cc:385] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.097352 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6678a0f5e40841f78185ae5e68503250" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:40.097395 31795 raft_consensus.cc:740] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.097873 31679 raft_consensus.cc:3060] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.098276 31795 consensus_queue.cc:260] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.099169 31603 raft_consensus.cc:3060] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.100800 31795 ts_tablet_manager.cc:1434] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:40.104360 31679 raft_consensus.cc:2468] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:40.105414 31717 leader_election.cc:304] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: 
I20260709 13:09:40.105923 31603 raft_consensus.cc:2468] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:40.106060 31816 raft_consensus.cc:2804] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.106628 31816 raft_consensus.cc:697] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:40.108057 31816 consensus_queue.cc:237] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.115914 31501 catalog_manager.cc:5697] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.138123 31816 consensus_queue.cc:1048] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.146945 31603 raft_consensus.cc:3060] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.154845 31816 consensus_queue.cc:1048] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.213310 31816 raft_consensus.cc:493] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.213611 31802 consensus_queue.cc:1048] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.213837 31816 raft_consensus.cc:515] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.215864 31816 leader_election.cc:290] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:40.216460 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda8fbffbe494758b5a57a107b430bd7" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" is_pre_election: true
I20260709 13:09:40.217020 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda8fbffbe494758b5a57a107b430bd7" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:40.217126 31603 raft_consensus.cc:2468] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 0.
I20260709 13:09:40.217612 31678 raft_consensus.cc:2468] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 0.
I20260709 13:09:40.218578 31720 leader_election.cc:304] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:40.219568 31816 raft_consensus.cc:2804] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.219924 31816 raft_consensus.cc:493] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.220232 31816 raft_consensus.cc:3060] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.224923 31836 consensus_queue.cc:1048] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.227671 31816 raft_consensus.cc:515] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.229699 31816 leader_election.cc:290] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:40.230963 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda8fbffbe494758b5a57a107b430bd7" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:40.231561 31679 raft_consensus.cc:3060] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.233630 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda8fbffbe494758b5a57a107b430bd7" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:40.234275 31603 raft_consensus.cc:3060] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.238334 31679 raft_consensus.cc:2468] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:40.239498 31717 leader_election.cc:304] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: 
I20260709 13:09:40.240304 31803 raft_consensus.cc:2804] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.240932 31803 raft_consensus.cc:697] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:40.240257 31817 consensus_queue.cc:1048] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.241637 31603 raft_consensus.cc:2468] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:40.241779 31803 consensus_queue.cc:237] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.243265 31817 consensus_queue.cc:1048] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.255033 31501 catalog_manager.cc:5697] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.303646 31836 consensus_queue.cc:1048] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.313230 31802 consensus_queue.cc:1048] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.317005 31801 raft_consensus.cc:493] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.317649 31801 raft_consensus.cc:515] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.320070 31801 leader_election.cc:290] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:40.320945 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:40.321703 31679 raft_consensus.cc:2468] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in term 0.
I20260709 13:09:40.322539 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
I20260709 13:09:40.322796 31567 leader_election.cc:304] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:40.323197 31753 raft_consensus.cc:2468] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in term 0.
I20260709 13:09:40.324242 31801 raft_consensus.cc:2804] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.324604 31801 raft_consensus.cc:493] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.324947 31801 raft_consensus.cc:3060] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.330826 31801 raft_consensus.cc:515] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.332826 31801 leader_election.cc:290] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 election: Requested vote from peers ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:40.333571 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:40.333792 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:40.334120 31679 raft_consensus.cc:3060] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.334390 31753 raft_consensus.cc:3060] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.339385 31753 raft_consensus.cc:2468] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in term 1.
I20260709 13:09:40.339448 31679 raft_consensus.cc:2468] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in term 1.
I20260709 13:09:40.340397 31568 leader_election.cc:304] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:40.341109 31801 raft_consensus.cc:2804] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.341497 31801 raft_consensus.cc:697] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 LEADER]: Becoming Leader. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Running, Role: LEADER
I20260709 13:09:40.342103 31801 consensus_queue.cc:237] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.349472 31502 catalog_manager.cc:5697] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129). New cstate: current_term: 1 leader_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.387459 31842 consensus_queue.cc:1048] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.397933 31800 consensus_queue.cc:1048] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.481129 31801 raft_consensus.cc:493] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.481617 31801 raft_consensus.cc:515] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:40.483337 31801 leader_election.cc:290] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:40.484163 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:40.484342 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
I20260709 13:09:40.485055 31753 raft_consensus.cc:2393] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cadd8a1c131e4e6aab7cc0e8b728cc6b in current term 1: Already voted for candidate ab45d114a3c44125abc8a351be1dcd62 in this term.
I20260709 13:09:40.486049 31568 leader_election.cc:304] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:40.486683 31801 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.491343 31801 raft_consensus.cc:2749] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.502971 31803 consensus_queue.cc:1048] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.514159 31816 consensus_queue.cc:1048] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.574805 31800 consensus_queue.cc:1048] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.585417 31841 consensus_queue.cc:1048] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.609064 20694 ts_manager.cc:295] Set tserver state for cadd8a1c131e4e6aab7cc0e8b728cc6b to MAINTENANCE_MODE
I20260709 13:09:40.609907 20694 tablet_server.cc:179] TabletServer@127.20.53.129:0 shutting down...
I20260709 13:09:40.614068 31816 consensus_queue.cc:1048] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:40.641616 31720 consensus_peers.cc:597] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.647765 31720 consensus_peers.cc:597] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.651835 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:40.652623 20694 tablet_replica.cc:333] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.653198 20694 raft_consensus.cc:2243] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.653533 20694 raft_consensus.cc:2272] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.655329 20694 tablet_replica.cc:333] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.655822 20694 raft_consensus.cc:2243] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.656195 20694 raft_consensus.cc:2272] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.658098 20694 tablet_replica.cc:333] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.658844 20694 raft_consensus.cc:2243] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.659319 20694 raft_consensus.cc:2272] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.661954 20694 tablet_replica.cc:333] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.662695 20694 raft_consensus.cc:2243] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.663206 20694 raft_consensus.cc:2272] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.663857 31720 consensus_peers.cc:597] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.665803 20694 tablet_replica.cc:333] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.666590 20694 raft_consensus.cc:2243] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.666987 20694 raft_consensus.cc:2272] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.668982 20694 tablet_replica.cc:333] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.669521 20694 raft_consensus.cc:2243] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.670069 20694 pending_rounds.cc:70] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Trying to abort 1 pending ops.
I20260709 13:09:40.670298 20694 pending_rounds.cc:77] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636169087700992 op_type: NO_OP noop_request { }
I20260709 13:09:40.670603 20694 raft_consensus.cc:2889] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:40.670871 20694 raft_consensus.cc:2272] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.672880 20694 tablet_replica.cc:333] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.673450 20694 raft_consensus.cc:2243] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.674261 20694 raft_consensus.cc:2272] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.676127 20694 tablet_replica.cc:333] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.676641 20694 raft_consensus.cc:2243] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:40.677376 20694 raft_consensus.cc:2272] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.679325 20694 tablet_replica.cc:333] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.679811 20694 raft_consensus.cc:2243] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.680195 20694 raft_consensus.cc:2272] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.682237 20694 tablet_replica.cc:333] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: stopping tablet replica
I20260709 13:09:40.682682 20694 raft_consensus.cc:2243] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.683064 20694 raft_consensus.cc:2272] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:40.697526 31568 connection.cc:466] server connection from 127.0.0.1:35270 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35270 (request call id 25) could send its response
W20260709 13:09:40.698520 31720 consensus_peers.cc:597] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: recv got EOF from 127.20.53.129:40131 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.713438 20694 tablet_server.cc:196] TabletServer@127.20.53.129:0 shutdown complete.
I20260709 13:09:40.825750 31816 consensus_queue.cc:1048] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:40.894157 31645 consensus_peers.cc:597] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.984350 31720 consensus_peers.cc:597] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.214097 31645 consensus_peers.cc:597] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.621284 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:41.728237 31841 raft_consensus.cc:493] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cadd8a1c131e4e6aab7cc0e8b728cc6b)
I20260709 13:09:41.728736 31841 raft_consensus.cc:515] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:41.730402 31841 leader_election.cc:290] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:41.731437 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
W20260709 13:09:41.734050 31645 leader_election.cc:336] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111)
I20260709 13:09:41.734495 31645 leader_election.cc:304] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62; no voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:41.735108 31841 raft_consensus.cc:2749] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:41.813149 31841 raft_consensus.cc:493] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cadd8a1c131e4e6aab7cc0e8b728cc6b)
I20260709 13:09:41.813627 31841 raft_consensus.cc:515] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:41.815279 31841 leader_election.cc:290] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:41.816249 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
I20260709 13:09:41.816823 31753 raft_consensus.cc:2468] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 1.
I20260709 13:09:41.817687 31643 leader_election.cc:304] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: 
I20260709 13:09:41.818387 31841 raft_consensus.cc:2804] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:41.818686 31841 raft_consensus.cc:493] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cadd8a1c131e4e6aab7cc0e8b728cc6b)
I20260709 13:09:41.818967 31841 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:41.819072 31645 leader_election.cc:336] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111)
I20260709 13:09:41.824851 31841 raft_consensus.cc:515] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:41.826406 31841 leader_election.cc:290] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:41.827334 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:41.828008 31753 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:41.830400 31645 leader_election.cc:336] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111)
I20260709 13:09:41.833772 31753 raft_consensus.cc:2468] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:41.835140 31643 leader_election.cc:304] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:41.836018 31841 raft_consensus.cc:2804] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:41.836598 31841 raft_consensus.cc:697] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:41.837455 31841 consensus_queue.cc:237] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:41.844692 31502 catalog_manager.cc:5697] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 1 to 2, leader changed from cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.991194 31841 raft_consensus.cc:493] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.991814 31841 raft_consensus.cc:515] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:41.993798 31841 leader_election.cc:290] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:41.994949 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6" is_pre_election: true
I20260709 13:09:41.995617 31753 raft_consensus.cc:2468] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 1.
I20260709 13:09:41.996563 31643 leader_election.cc:304] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: 
I20260709 13:09:41.997323 31841 raft_consensus.cc:2804] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:41.997646 31841 raft_consensus.cc:493] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:41.997694 31645 leader_election.cc:336] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111)
I20260709 13:09:41.997936 31841 raft_consensus.cc:3060] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.003624 31841 raft_consensus.cc:515] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:42.005220 31841 leader_election.cc:290] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:42.006350 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:42.006938 31753 raft_consensus.cc:3060] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:42.008366 31645 leader_election.cc:336] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111)
I20260709 13:09:42.012079 31753 raft_consensus.cc:2468] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:42.013065 31643 leader_election.cc:304] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:42.013682 31841 raft_consensus.cc:2804] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:42.014213 31841 raft_consensus.cc:697] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:42.014824 31841 consensus_queue.cc:237] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:42.021733 31502 catalog_manager.cc:5697] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 1 to 2, leader changed from cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:42.155884 31645 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111) [suppressed 105 similar messages]
I20260709 13:09:42.160295 31817 raft_consensus.cc:493] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cadd8a1c131e4e6aab7cc0e8b728cc6b)
I20260709 13:09:42.160759 31817 raft_consensus.cc:515] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:42.162353 31817 leader_election.cc:290] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:42.163441 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62" is_pre_election: true
I20260709 13:09:42.164014 31679 raft_consensus.cc:2468] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 1.
I20260709 13:09:42.165012 31717 leader_election.cc:304] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: 
W20260709 13:09:42.165789 31720 leader_election.cc:336] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111)
I20260709 13:09:42.165798 31817 raft_consensus.cc:2804] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:42.166433 31817 raft_consensus.cc:493] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cadd8a1c131e4e6aab7cc0e8b728cc6b)
I20260709 13:09:42.166766 31817 raft_consensus.cc:3060] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.171432 31817 raft_consensus.cc:515] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:42.172978 31817 leader_election.cc:290] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:42.174093 31679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:42.174691 31679 raft_consensus.cc:3060] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:42.176450 31720 leader_election.cc:336] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111)
I20260709 13:09:42.179946 31679 raft_consensus.cc:2468] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 2.
I20260709 13:09:42.180953 31717 leader_election.cc:304] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:42.181614 31817 raft_consensus.cc:2804] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:42.181943 31817 raft_consensus.cc:697] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:42.182723 31817 consensus_queue.cc:237] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:42.189375 31502 catalog_manager.cc:5697] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 1 to 2, leader changed from cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129) to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.343899 31753 raft_consensus.cc:1275] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.345340 31841 consensus_queue.cc:1048] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:42.361994 31645 consensus_peers.cc:597] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.462724 31645 consensus_peers.cc:597] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.570370 31753 raft_consensus.cc:1275] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:42.571820 31889 consensus_queue.cc:1048] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.571975 31679 raft_consensus.cc:1275] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.573275 31817 consensus_queue.cc:1048] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:42.598343 31720 consensus_peers.cc:597] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.622418 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:42.870714 31720 consensus_peers.cc:597] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:43.023860 31720 consensus_peers.cc:597] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:43.080188 31720 consensus_peers.cc:597] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:43.156432 31720 consensus_peers.cc:597] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:43.511291 31645 consensus_peers.cc:597] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:43.534291 31645 consensus_peers.cc:597] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:43.565230 31720 consensus_peers.cc:597] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:43.623481 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:44.624507 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:44.665038 31645 consensus_peers.cc:597] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.131119 31720 consensus_peers.cc:597] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.138968 31645 consensus_peers.cc:597] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:45.259231 31720 consensus_peers.cc:597] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:45.379446 31720 consensus_peers.cc:597] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:45.512658 31720 consensus_peers.cc:597] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:45.625527 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:45.696403 31645 consensus_peers.cc:597] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:45.732192 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:45.738808 31896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:45.738942 31897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:45.741133 31899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:45.741959 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:45.743489 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:45.743718 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:45.743908 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602585743891 us; error 0 us; skew 500 ppm
I20260709 13:09:45.744451 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:45.746858 20694 webserver.cc:533] Webserver started at http://127.20.53.129:38449/ using document root <none> and password file <none>
I20260709 13:09:45.747327 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:45.747534 20694 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:45.751011 20694 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:09:45.754504 31904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:45.755321 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:45.755661 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
format_stamp: "Formatted at 2026-07-09 13:09:38 on dist-test-slave-r056"
I20260709 13:09:45.755956 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:45.768726 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:45.769933 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:45.771428 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:45.776999 31912 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:09:45.778287 31720 consensus_peers.cc:597] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:45.778735 31720 consensus_peers.cc:597] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:45.829421 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:09:45.829752 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.002s	sys 0.001s
I20260709 13:09:45.829972 20694 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:09:45.834395 31912 tablet_bootstrap.cc:492] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:45.844358 31912 tablet_bootstrap.cc:492] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:45.845211 31912 tablet_bootstrap.cc:492] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:45.845901 31912 ts_tablet_manager.cc:1403] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:09:45.848763 31912 raft_consensus.cc:359] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.849367 31912 raft_consensus.cc:740] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.850096 31912 consensus_queue.cc:260] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.852397 31912 ts_tablet_manager.cc:1434] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:45.853104 31912 tablet_bootstrap.cc:492] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:45.865833 20694 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:09:45.866065 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.036s	user 0.033s	sys 0.000s
I20260709 13:09:45.866214 31912 tablet_bootstrap.cc:492] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:45.867216 31912 tablet_bootstrap.cc:492] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:45.867838 31912 ts_tablet_manager.cc:1403] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:09:45.869953 31912 raft_consensus.cc:359] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.870669 31912 raft_consensus.cc:740] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.871467 31912 consensus_queue.cc:260] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.873641 31912 ts_tablet_manager.cc:1434] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:45.874588 31912 tablet_bootstrap.cc:492] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:45.889377 31912 tablet_bootstrap.cc:492] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:45.890153 31912 tablet_bootstrap.cc:492] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:45.890888 31912 ts_tablet_manager.cc:1403] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:09:45.893750 31912 raft_consensus.cc:359] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.894570 31912 raft_consensus.cc:740] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.895745 31912 consensus_queue.cc:260] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.899109 31912 ts_tablet_manager.cc:1434] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:09:45.900156 31912 tablet_bootstrap.cc:492] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:45.919072 31912 tablet_bootstrap.cc:492] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:45.920307 31912 tablet_bootstrap.cc:492] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:45.921157 31912 ts_tablet_manager.cc:1403] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:09:45.924538 31912 raft_consensus.cc:359] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.925292 31912 raft_consensus.cc:740] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.926270 31912 consensus_queue.cc:260] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.928447 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:40131
I20260709 13:09:45.928522 31973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:40131 every 8 connection(s)
I20260709 13:09:45.928689 31912 ts_tablet_manager.cc:1434] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:45.929924 31912 tablet_bootstrap.cc:492] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:45.934405 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:45.954420 31912 tablet_bootstrap.cc:492] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:45.955402 31912 tablet_bootstrap.cc:492] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:45.956012 31912 ts_tablet_manager.cc:1403] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.012s
I20260709 13:09:45.958680 31912 raft_consensus.cc:359] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:45.959504 31912 raft_consensus.cc:740] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.960403 31912 consensus_queue.cc:260] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:45.960955 31753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
mode: GRACEFUL
new_leader_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:09:45.961779 31753 raft_consensus.cc:606] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Received request to transfer leadership to TS ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:45.962529 31912 ts_tablet_manager.cc:1434] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:45.963459 31912 tablet_bootstrap.cc:492] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:45.965211 31974 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41393
I20260709 13:09:45.965637 31974 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:45.966373 31974 heartbeater.cc:507] Master 127.20.53.190:41393 requested a full tablet report, sending...
I20260709 13:09:45.972585 31502 ts_manager.cc:194] Re-registered known tserver with Master: cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131)
I20260709 13:09:45.976075 31678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
mode: GRACEFUL
new_leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:38694
I20260709 13:09:45.976600 31678 raft_consensus.cc:606] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Received request to transfer leadership to TS 56673ab87f844f7daa600bf0cb16a3f6
I20260709 13:09:45.978669 31912 tablet_bootstrap.cc:492] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:45.979692 31912 tablet_bootstrap.cc:492] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:45.980062 31754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3d669a917624febab97033403e2a807"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
mode: GRACEFUL
new_leader_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:09:45.980396 31912 ts_tablet_manager.cc:1403] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:09:45.980603 31754 raft_consensus.cc:606] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Received request to transfer leadership to TS ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:45.981844 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:45.982633 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:45.983088 31912 raft_consensus.cc:359] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.983218 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:45.984145 31912 raft_consensus.cc:740] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.985028 31912 consensus_queue.cc:260] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:45.987210 31912 ts_tablet_manager.cc:1434] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:45.987993 31912 tablet_bootstrap.cc:492] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:45.988098 31502 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33120
I20260709 13:09:45.991469 31974 heartbeater.cc:499] Master 127.20.53.190:41393 was elected leader, sending a full tablet report...
I20260709 13:09:46.001399 31912 tablet_bootstrap.cc:492] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.002419 31912 tablet_bootstrap.cc:492] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:46.003103 31912 ts_tablet_manager.cc:1403] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:09:46.005574 31912 raft_consensus.cc:359] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.006318 31912 raft_consensus.cc:740] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.007037 31912 consensus_queue.cc:260] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.009193 31912 ts_tablet_manager.cc:1434] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:46.009940 31912 tablet_bootstrap.cc:492] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:46.019804 31894 raft_consensus.cc:993] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62: : Instructing follower 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:46.021075 31984 raft_consensus.cc:1081] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Signalling peer 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:46.022790 31754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:45044
I20260709 13:09:46.023025 31912 tablet_bootstrap.cc:492] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.023453 31754 raft_consensus.cc:493] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:46.023874 31754 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.023996 31912 tablet_bootstrap.cc:492] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:46.024753 31912 ts_tablet_manager.cc:1403] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 13:09:46.026692 31912 raft_consensus.cc:359] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.027177 31912 raft_consensus.cc:740] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.027756 31912 consensus_queue.cc:260] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.029608 31912 ts_tablet_manager.cc:1434] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:46.030368 31912 tablet_bootstrap.cc:492] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:46.030324 31754 raft_consensus.cc:515] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.032970 31754 leader_election.cc:290] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:46.035383 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:46.035948 31678 raft_consensus.cc:3055] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.036262 31678 raft_consensus.cc:740] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:46.037040 31678 consensus_queue.cc:260] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.038014 31678 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.038563 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
W20260709 13:09:46.039940 31720 leader_election.cc:343] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.044169 31678 raft_consensus.cc:2468] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 2.
I20260709 13:09:46.046756 31717 leader_election.cc:304] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, ab45d114a3c44125abc8a351be1dcd62; no voters: cadd8a1c131e4e6aab7cc0e8b728cc6b
I20260709 13:09:46.047027 31912 tablet_bootstrap.cc:492] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.048097 31912 tablet_bootstrap.cc:492] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:46.048040 31910 raft_consensus.cc:2804] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.048795 31910 raft_consensus.cc:697] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:46.048954 31912 ts_tablet_manager.cc:1403] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:09:46.049633 31910 consensus_queue.cc:237] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.051251 31912 raft_consensus.cc:359] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.051887 31912 raft_consensus.cc:740] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.052500 31912 consensus_queue.cc:260] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.054605 31912 ts_tablet_manager.cc:1434] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:46.055410 31912 tablet_bootstrap.cc:492] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap starting.
I20260709 13:09:46.069931 31912 tablet_bootstrap.cc:492] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.070858 31912 tablet_bootstrap.cc:492] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Bootstrap complete.
I20260709 13:09:46.071503 31912 ts_tablet_manager.cc:1403] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:09:46.073856 31912 raft_consensus.cc:359] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.074546 31912 raft_consensus.cc:740] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadd8a1c131e4e6aab7cc0e8b728cc6b, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.075119 31912 consensus_queue.cc:260] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.075881 31502 catalog_manager.cc:5697] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 1 to 2, leader changed from ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130) to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:46.076788 31912 ts_tablet_manager.cc:1434] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:46.113660 31948 raft_consensus.cc:3060] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.114039 31947 raft_consensus.cc:3060] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.119217 31947 pending_rounds.cc:85] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Aborting all ops after (but not including) 0
I20260709 13:09:46.119451 31947 pending_rounds.cc:107] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:46.119725 31947 raft_consensus.cc:2889] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:46.296423 31910 raft_consensus.cc:993] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6: : Instructing follower ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:46.296881 31895 raft_consensus.cc:1081] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Signalling peer ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:46.298293 31678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:09:46.298789 31678 raft_consensus.cc:493] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:46.299105 31678 raft_consensus.cc:3060] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.304419 31678 raft_consensus.cc:515] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.305904 31678 leader_election.cc:290] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:46.306882 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:46.306974 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:46.307471 31754 raft_consensus.cc:3055] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.307588 31947 raft_consensus.cc:3060] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.307756 31754 raft_consensus.cc:740] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:46.308492 31754 consensus_queue.cc:260] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.309428 31754 raft_consensus.cc:3060] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.312687 31947 raft_consensus.cc:2468] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:46.313799 31645 leader_election.cc:304] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:46.314536 31984 raft_consensus.cc:2804] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.315006 31984 raft_consensus.cc:697] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:46.315635 31754 raft_consensus.cc:2468] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:46.315828 31984 consensus_queue.cc:237] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.321653 31947 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.323076 31502 catalog_manager.cc:5697] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 1 to 2, leader changed from 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.358096 31910 raft_consensus.cc:993] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6: : Instructing follower ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:46.358541 31895 raft_consensus.cc:1081] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Signalling peer ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:46.359930 31678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3d669a917624febab97033403e2a807"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:09:46.360421 31678 raft_consensus.cc:493] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:46.360699 31678 raft_consensus.cc:3060] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.365721 31678 raft_consensus.cc:515] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.367250 31678 leader_election.cc:290] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:46.368113 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:46.368412 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:46.368763 31947 raft_consensus.cc:3060] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.369010 31754 raft_consensus.cc:3055] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.369343 31754 raft_consensus.cc:740] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:46.370186 31754 consensus_queue.cc:260] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.371413 31754 raft_consensus.cc:3060] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.375792 31947 raft_consensus.cc:2468] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:46.376952 31645 leader_election.cc:304] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:46.377656 31984 raft_consensus.cc:2804] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.378149 31984 raft_consensus.cc:697] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:46.378232 31754 raft_consensus.cc:2468] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:46.379086 31984 consensus_queue.cc:237] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:46.386222 31499 catalog_manager.cc:5697] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 1 to 2, leader changed from 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.511430 31678 raft_consensus.cc:1275] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.512609 31895 consensus_queue.cc:1048] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.521659 31947 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.528826 31947 raft_consensus.cc:1275] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.529907 31895 consensus_queue.cc:1048] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:46.626586 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:46.815161 31754 raft_consensus.cc:1275] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.816466 32007 consensus_queue.cc:1048] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.826334 31947 raft_consensus.cc:1275] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.827844 32009 consensus_queue.cc:1048] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.925367 31947 raft_consensus.cc:1275] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.926505 32009 consensus_queue.cc:1048] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.934546 31754 raft_consensus.cc:1275] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.935928 32009 consensus_queue.cc:1048] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.992893 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:46.999934 31678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
mode: GRACEFUL
new_leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:38694
I20260709 13:09:47.000418 31678 raft_consensus.cc:606] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Received request to transfer leadership to TS 56673ab87f844f7daa600bf0cb16a3f6
I20260709 13:09:47.002781 31754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
mode: GRACEFUL
new_leader_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:09:47.003288 31754 raft_consensus.cc:606] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Received request to transfer leadership to TS ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:47.005602 31678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3d669a917624febab97033403e2a807"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
mode: GRACEFUL
new_leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:38694
I20260709 13:09:47.006065 31678 raft_consensus.cc:606] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Received request to transfer leadership to TS 56673ab87f844f7daa600bf0cb16a3f6
I20260709 13:09:47.007025 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:47.007437 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:47.007936 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:47.309537 32007 raft_consensus.cc:993] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62: : Instructing follower 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:47.310134 31894 raft_consensus.cc:1081] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Signalling peer 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:47.311489 31754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:45044
I20260709 13:09:47.311896 31754 raft_consensus.cc:493] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.312137 31754 raft_consensus.cc:3060] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.318245 31754 raft_consensus.cc:515] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:47.319710 31754 leader_election.cc:290] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 3 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:47.320541 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:47.320765 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b4977020e24cb4ad8ea744e3d858f2" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:47.321168 31947 raft_consensus.cc:3060] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.321362 31678 raft_consensus.cc:3055] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:47.321749 31678 raft_consensus.cc:740] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:47.322595 31678 consensus_queue.cc:260] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:47.323544 31678 raft_consensus.cc:3060] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.326265 31947 raft_consensus.cc:2468] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 3.
I20260709 13:09:47.327323 31720 leader_election.cc:304] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:47.327965 31910 raft_consensus.cc:2804] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:47.328439 31910 raft_consensus.cc:697] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:47.328645 31678 raft_consensus.cc:2468] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 3.
I20260709 13:09:47.329272 31910 consensus_queue.cc:237] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:47.335274 31502 catalog_manager.cc:5697] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 2 to 3, leader changed from ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130) to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.471762 32009 raft_consensus.cc:993] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62: : Instructing follower 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:47.472251 31894 raft_consensus.cc:1081] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Signalling peer 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:47.473905 31754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3d669a917624febab97033403e2a807"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:45044
I20260709 13:09:47.474527 31754 raft_consensus.cc:493] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.474897 31754 raft_consensus.cc:3060] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.480062 31754 raft_consensus.cc:515] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:47.481796 31754 leader_election.cc:290] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 3 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:47.482548 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:47.482842 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d669a917624febab97033403e2a807" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:47.483234 31947 raft_consensus.cc:3060] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.483428 31678 raft_consensus.cc:3055] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:47.483807 31678 raft_consensus.cc:740] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:47.484663 31678 consensus_queue.cc:260] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:47.485891 31678 raft_consensus.cc:3060] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.490300 31947 raft_consensus.cc:2468] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 3.
I20260709 13:09:47.491468 31720 leader_election.cc:304] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:47.492168 31910 raft_consensus.cc:2804] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:47.492616 31678 raft_consensus.cc:2468] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 3.
I20260709 13:09:47.492647 31910 raft_consensus.cc:697] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:47.493737 31910 consensus_queue.cc:237] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:47.499310 31502 catalog_manager.cc:5697] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 2 to 3, leader changed from ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130) to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.521391 31895 raft_consensus.cc:993] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6: : Instructing follower ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:47.521826 31910 raft_consensus.cc:1081] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Signalling peer ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:47.523172 31678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:09:47.523671 31678 raft_consensus.cc:493] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.523990 31678 raft_consensus.cc:3060] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.529613 31678 raft_consensus.cc:515] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:47.531540 31678 leader_election.cc:290] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 3 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:47.532179 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:47.532447 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3c2c5cf291469987ddb3a9ea25227d" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:47.532796 31947 raft_consensus.cc:3060] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.533031 31754 raft_consensus.cc:3055] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:47.533388 31754 raft_consensus.cc:740] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:47.534010 31754 consensus_queue.cc:260] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:47.534965 31754 raft_consensus.cc:3060] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:47.537750 31947 raft_consensus.cc:2468] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 3.
I20260709 13:09:47.538763 31645 leader_election.cc:304] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:47.539381 31894 raft_consensus.cc:2804] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:47.539769 31894 raft_consensus.cc:697] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 3 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:47.540478 31894 consensus_queue.cc:237] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:47.540699 31754 raft_consensus.cc:2468] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 3.
I20260709 13:09:47.546567 31502 catalog_manager.cc:5697] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 2 to 3, leader changed from 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 3 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:47.627733 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:47.762236 31947 raft_consensus.cc:1275] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:47.763628 31910 consensus_queue.cc:1048] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:47.778509 31678 raft_consensus.cc:1275] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:47.780118 32019 consensus_queue.cc:1048] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:47.966547 31678 raft_consensus.cc:1275] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:47.967773 32019 consensus_queue.cc:1048] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:47.976019 31947 raft_consensus.cc:1275] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:47.977749 31910 consensus_queue.cc:1048] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:48.008939 31754 raft_consensus.cc:1275] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:48.010226 31894 consensus_queue.cc:1048] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:48.014199 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:48.023376 31947 raft_consensus.cc:1275] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:48.024924 32026 consensus_queue.cc:1048] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:48.027756 31754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eb6f7a7c48d445d947a3aa6bd1a16bd"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
mode: GRACEFUL
new_leader_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:09:48.028354 31754 raft_consensus.cc:606] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Received request to transfer leadership to TS ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:48.031546 31754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dda8fbffbe494758b5a57a107b430bd7"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
mode: GRACEFUL
new_leader_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:09:48.032128 31754 raft_consensus.cc:606] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Received request to transfer leadership to TS ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:48.034512 31678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
mode: GRACEFUL
new_leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:38694
I20260709 13:09:48.035069 31678 raft_consensus.cc:606] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Received request to transfer leadership to TS 56673ab87f844f7daa600bf0cb16a3f6
I20260709 13:09:48.036262 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:48.036856 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:48.037532 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:48.248476 31895 raft_consensus.cc:993] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6: : Instructing follower ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:48.248899 32019 raft_consensus.cc:1081] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Signalling peer ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:48.250353 31678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dda8fbffbe494758b5a57a107b430bd7"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:09:48.250801 31678 raft_consensus.cc:493] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.251058 31678 raft_consensus.cc:3060] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.256462 31678 raft_consensus.cc:515] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:48.257874 31678 leader_election.cc:290] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:48.258589 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda8fbffbe494758b5a57a107b430bd7" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:48.258783 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda8fbffbe494758b5a57a107b430bd7" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:48.259361 31754 raft_consensus.cc:3055] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.259145 31947 raft_consensus.cc:3060] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.259711 31754 raft_consensus.cc:740] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:48.260480 31754 consensus_queue.cc:260] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:48.261410 31754 raft_consensus.cc:3060] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.264415 31947 raft_consensus.cc:2468] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:48.265357 31645 leader_election.cc:304] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:48.265991 32026 raft_consensus.cc:2804] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.266304 31754 raft_consensus.cc:2468] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:48.266443 32026 raft_consensus.cc:697] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:48.267315 32026 consensus_queue.cc:237] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:48.273327 31499 catalog_manager.cc:5697] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 1 to 2, leader changed from 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.338034 31894 raft_consensus.cc:993] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62: : Instructing follower 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:48.338469 32026 raft_consensus.cc:1081] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Signalling peer 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:48.339762 31754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:45044
I20260709 13:09:48.340236 31754 raft_consensus.cc:493] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.340533 31754 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.345322 31754 raft_consensus.cc:515] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:48.346851 31754 leader_election.cc:290] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 3 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:48.347595 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:48.347797 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:48.348212 31947 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.348400 31678 raft_consensus.cc:3055] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:48.348735 31678 raft_consensus.cc:740] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:48.349366 31678 consensus_queue.cc:260] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:48.350239 31678 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.352968 31947 raft_consensus.cc:2468] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 3.
I20260709 13:09:48.354040 31720 leader_election.cc:304] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:48.354496 31678 raft_consensus.cc:2468] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 3.
I20260709 13:09:48.354897 32019 raft_consensus.cc:2804] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:48.355379 32019 raft_consensus.cc:697] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:48.356127 32019 consensus_queue.cc:237] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:48.362901 31499 catalog_manager.cc:5697] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 2 to 3, leader changed from ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130) to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.367723 31895 raft_consensus.cc:993] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6: : Instructing follower ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:48.368183 32019 raft_consensus.cc:1081] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Signalling peer ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:48.369524 31678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eb6f7a7c48d445d947a3aa6bd1a16bd"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:09:48.370020 31678 raft_consensus.cc:493] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.370380 31678 raft_consensus.cc:3060] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.375341 31678 raft_consensus.cc:515] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:48.377357 31678 leader_election.cc:290] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:48.377614 31947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb6f7a7c48d445d947a3aa6bd1a16bd" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:48.377913 31754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb6f7a7c48d445d947a3aa6bd1a16bd" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:48.378299 31947 raft_consensus.cc:3060] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.378638 31754 raft_consensus.cc:3055] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.378945 31754 raft_consensus.cc:740] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:48.379626 31754 consensus_queue.cc:260] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:48.380533 31754 raft_consensus.cc:3060] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.383589 31947 raft_consensus.cc:2468] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:48.384671 31645 leader_election.cc:304] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:48.385376 32026 raft_consensus.cc:2804] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.385777 31754 raft_consensus.cc:2468] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 2.
I20260709 13:09:48.385844 32026 raft_consensus.cc:697] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:48.386889 32026 consensus_queue.cc:237] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } }
I20260709 13:09:48.393450 31499 catalog_manager.cc:5697] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 1 to 2, leader changed from 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:48.628763 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:48.824748 31947 raft_consensus.cc:1275] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.826094 32034 consensus_queue.cc:1048] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.836189 31754 raft_consensus.cc:1275] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.838266 32034 consensus_queue.cc:1048] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.896175 31947 raft_consensus.cc:1275] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:48.897331 31895 consensus_queue.cc:1048] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:48.907099 31678 raft_consensus.cc:1275] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:48.908354 31895 consensus_queue.cc:1048] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:48.965732 31754 raft_consensus.cc:1275] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.967036 31894 consensus_queue.cc:1048] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.970464 31948 raft_consensus.cc:1275] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.971768 31894 consensus_queue.cc:1048] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.045931 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.060640 31678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
mode: GRACEFUL
new_leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:38694
I20260709 13:09:49.061306 31678 raft_consensus.cc:606] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Received request to transfer leadership to TS 56673ab87f844f7daa600bf0cb16a3f6
I20260709 13:09:49.064492 31754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
mode: GRACEFUL
new_leader_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:09:49.064970 31754 raft_consensus.cc:606] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Received request to transfer leadership to TS ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:49.067521 31678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
mode: GRACEFUL
new_leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:38694
I20260709 13:09:49.067925 31678 raft_consensus.cc:606] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Received request to transfer leadership to TS 56673ab87f844f7daa600bf0cb16a3f6
I20260709 13:09:49.068935 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:49.069334 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:49.069962 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.084065 31894 raft_consensus.cc:993] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62: : Instructing follower 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:49.084748 32034 raft_consensus.cc:1081] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Signalling peer 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:49.086424 31753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:45044
I20260709 13:09:49.086920 31753 raft_consensus.cc:493] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.087247 31753 raft_consensus.cc:3060] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.095204 31753 raft_consensus.cc:515] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:49.097289 31753 leader_election.cc:290] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:49.098399 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:49.098472 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:49.099485 31678 raft_consensus.cc:3055] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.099601 31948 raft_consensus.cc:3060] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.099853 31678 raft_consensus.cc:740] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:49.101074 31678 consensus_queue.cc:260] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:49.102746 31678 raft_consensus.cc:3060] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.109789 31948 raft_consensus.cc:2468] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 2.
I20260709 13:09:49.111133 31720 leader_election.cc:304] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:49.111972 31895 raft_consensus.cc:2804] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.111969 31678 raft_consensus.cc:2468] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 2.
I20260709 13:09:49.112782 31895 raft_consensus.cc:697] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:49.114140 31895 consensus_queue.cc:237] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:49.121919 31499 catalog_manager.cc:5697] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 1 to 2, leader changed from ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130) to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.361824 31894 raft_consensus.cc:993] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62: : Instructing follower 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:49.362300 32034 raft_consensus.cc:1081] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Signalling peer 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:49.363803 31753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:45044
I20260709 13:09:49.364285 31753 raft_consensus.cc:493] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.364614 31753 raft_consensus.cc:3060] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.369776 31753 raft_consensus.cc:515] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:49.371484 31753 leader_election.cc:290] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 3 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:49.372133 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:49.372485 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0a356766e8475ca77a744b00a590f6" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:49.372989 31948 raft_consensus.cc:3060] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.373092 31678 raft_consensus.cc:3055] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:49.373504 31678 raft_consensus.cc:740] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:49.374459 31678 consensus_queue.cc:260] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:49.375397 31678 raft_consensus.cc:3060] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.378286 31948 raft_consensus.cc:2468] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 3.
I20260709 13:09:49.379457 31720 leader_election.cc:304] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:49.380227 31895 raft_consensus.cc:2804] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.380687 31895 raft_consensus.cc:697] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:49.380968 31678 raft_consensus.cc:2468] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 3.
I20260709 13:09:49.381862 31895 consensus_queue.cc:237] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:49.390795 31499 catalog_manager.cc:5697] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 2 to 3, leader changed from ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130) to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 3 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.453948 31910 raft_consensus.cc:993] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6: : Instructing follower ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:49.454537 32051 raft_consensus.cc:1081] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Signalling peer ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:49.455974 31678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:09:49.456410 31678 raft_consensus.cc:493] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.456740 31678 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.461360 31678 raft_consensus.cc:515] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:49.462818 31678 leader_election.cc:290] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 3 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:49.463865 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:49.463965 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:49.464542 31948 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.464608 31753 raft_consensus.cc:3055] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:49.465054 31753 raft_consensus.cc:740] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:49.465969 31753 consensus_queue.cc:260] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:49.467128 31753 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.469552 31948 raft_consensus.cc:2468] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 3.
I20260709 13:09:49.470623 31645 leader_election.cc:304] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:49.471504 32034 raft_consensus.cc:2804] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.471942 32034 raft_consensus.cc:697] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 3 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:49.472982 32034 consensus_queue.cc:237] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:49.473351 31753 raft_consensus.cc:2468] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 3.
I20260709 13:09:49.480680 31499 catalog_manager.cc:5697] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 2 to 3, leader changed from 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 3 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.601908 31948 raft_consensus.cc:1275] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.603349 32051 consensus_queue.cc:1048] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.613818 31678 raft_consensus.cc:1275] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.615595 31895 consensus_queue.cc:1048] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:49.629791 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:49.868146 31678 raft_consensus.cc:1275] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:49.869485 31910 consensus_queue.cc:1048] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.871717 31948 raft_consensus.cc:1275] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:49.872987 31910 consensus_queue.cc:1048] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.890079 31753 raft_consensus.cc:1275] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:49.891871 32034 consensus_queue.cc:1048] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.904347 31948 raft_consensus.cc:1275] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:49.910329 32034 consensus_queue.cc:1048] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:50.076297 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.082964 31678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
mode: GRACEFUL
new_leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:38694
I20260709 13:09:50.083468 31678 raft_consensus.cc:606] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 3 LEADER]: Received request to transfer leadership to TS 56673ab87f844f7daa600bf0cb16a3f6
I20260709 13:09:50.085837 31753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
mode: GRACEFUL
new_leader_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:09:50.086306 31753 raft_consensus.cc:606] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Received request to transfer leadership to TS ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:50.088362 31753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
mode: GRACEFUL
new_leader_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:09:50.088762 31753 raft_consensus.cc:606] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Received request to transfer leadership to TS ab45d114a3c44125abc8a351be1dcd62
I20260709 13:09:50.089767 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:50.090335 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:50.090848 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.228888 32051 raft_consensus.cc:993] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6: : Instructing follower ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:50.229434 32061 raft_consensus.cc:1081] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Signalling peer ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:50.230927 31678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:09:50.231413 31678 raft_consensus.cc:493] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.231745 31678 raft_consensus.cc:3060] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.237147 31678 raft_consensus.cc:515] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:50.238726 31678 leader_election.cc:290] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 3 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:50.239454 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:50.239763 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ea2a36fc0e458f87cfd8fb7f993933" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:50.240091 31948 raft_consensus.cc:3060] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.240306 31753 raft_consensus.cc:3055] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:50.240700 31753 raft_consensus.cc:740] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:50.241266 31753 consensus_queue.cc:260] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:50.242085 31753 raft_consensus.cc:3060] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.245434 31948 raft_consensus.cc:2468] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 3.
I20260709 13:09:50.246438 31645 leader_election.cc:304] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:50.246929 31753 raft_consensus.cc:2468] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 3.
I20260709 13:09:50.247216 32064 raft_consensus.cc:2804] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:50.247735 32064 raft_consensus.cc:697] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 3 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:50.248759 32064 consensus_queue.cc:237] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:50.255015 31499 catalog_manager.cc:5697] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 2 to 3, leader changed from 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 3 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.364773 32063 raft_consensus.cc:993] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62: : Instructing follower 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:50.365231 32064 raft_consensus.cc:1081] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 3 LEADER]: Signalling peer 56673ab87f844f7daa600bf0cb16a3f6 to start an election
I20260709 13:09:50.366601 31753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013"
dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
 from {username='slave'} at 127.0.0.1:45044
I20260709 13:09:50.367048 31753 raft_consensus.cc:493] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.367314 31753 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.371775 31753 raft_consensus.cc:515] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:50.373272 31753 leader_election.cc:290] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 4 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827)
I20260709 13:09:50.374266 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:50.374408 31678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc8eae9083d41fa97d1bc5164749013" candidate_uuid: "56673ab87f844f7daa600bf0cb16a3f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
I20260709 13:09:50.374908 31948 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.374967 31678 raft_consensus.cc:3055] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:50.375392 31678 raft_consensus.cc:740] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:50.375959 31678 consensus_queue.cc:260] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:50.376798 31678 raft_consensus.cc:3060] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.380019 31948 raft_consensus.cc:2468] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 4.
I20260709 13:09:50.381078 31720 leader_election.cc:304] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56673ab87f844f7daa600bf0cb16a3f6, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:50.381776 32061 raft_consensus.cc:2804] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:50.381906 31678 raft_consensus.cc:2468] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56673ab87f844f7daa600bf0cb16a3f6 in term 4.
I20260709 13:09:50.382244 32061 raft_consensus.cc:697] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 4 LEADER]: Becoming Leader. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:50.383059 32061 consensus_queue.cc:237] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:50.389464 31499 catalog_manager.cc:5697] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 reported cstate change: term changed from 3 to 4, leader changed from ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130) to 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131). New cstate: current_term: 4 leader_uuid: "56673ab87f844f7daa600bf0cb16a3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.437045 32061 raft_consensus.cc:993] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6: : Instructing follower ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:50.437528 32051 raft_consensus.cc:1081] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Signalling peer ab45d114a3c44125abc8a351be1dcd62 to start an election
I20260709 13:09:50.438922 31678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065"
dest_uuid: "ab45d114a3c44125abc8a351be1dcd62"
 from {username='slave'} at 127.0.0.1:41648
I20260709 13:09:50.439356 31678 raft_consensus.cc:493] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.439637 31678 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.444540 31678 raft_consensus.cc:515] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:50.445863 31678 leader_election.cc:290] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 4 election: Requested vote from peers cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131), 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131:33039)
I20260709 13:09:50.446825 31948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b"
I20260709 13:09:50.447006 31753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de472d0e84694ddcb8211372d6df7065" candidate_uuid: "ab45d114a3c44125abc8a351be1dcd62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "56673ab87f844f7daa600bf0cb16a3f6"
I20260709 13:09:50.447413 31948 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.447664 31753 raft_consensus.cc:3055] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:50.448024 31753 raft_consensus.cc:740] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56673ab87f844f7daa600bf0cb16a3f6, State: Running, Role: LEADER
I20260709 13:09:50.448814 31753 consensus_queue.cc:260] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:50.449834 31753 raft_consensus.cc:3060] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.453217 31948 raft_consensus.cc:2468] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 4.
I20260709 13:09:50.454288 31645 leader_election.cc:304] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab45d114a3c44125abc8a351be1dcd62, cadd8a1c131e4e6aab7cc0e8b728cc6b; no voters: 
I20260709 13:09:50.454991 32064 raft_consensus.cc:2804] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:50.455505 32064 raft_consensus.cc:697] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 4 LEADER]: Becoming Leader. State: Replica: ab45d114a3c44125abc8a351be1dcd62, State: Running, Role: LEADER
I20260709 13:09:50.456691 31753 raft_consensus.cc:2468] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab45d114a3c44125abc8a351be1dcd62 in term 4.
I20260709 13:09:50.456585 32064 consensus_queue.cc:237] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } }
I20260709 13:09:50.464334 31499 catalog_manager.cc:5697] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 reported cstate change: term changed from 3 to 4, leader changed from 56673ab87f844f7daa600bf0cb16a3f6 (127.20.53.131) to ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130). New cstate: current_term: 4 leader_uuid: "ab45d114a3c44125abc8a351be1dcd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:50.630884 31550 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:50.690944 31948 raft_consensus.cc:1275] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:50.692261 32064 consensus_queue.cc:1048] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:50.701319 31753 raft_consensus.cc:1275] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:50.703044 32064 consensus_queue.cc:1048] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:50.779819 31678 raft_consensus.cc:1275] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 4 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:50.781123 32051 consensus_queue.cc:1048] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab45d114a3c44125abc8a351be1dcd62" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:50.788322 31948 raft_consensus.cc:1275] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 4 FOLLOWER]: Refusing update from remote peer 56673ab87f844f7daa600bf0cb16a3f6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:50.790047 32076 consensus_queue.cc:1048] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:50.886518 31948 raft_consensus.cc:1275] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 4 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:50.887732 32064 consensus_queue.cc:1048] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cadd8a1c131e4e6aab7cc0e8b728cc6b" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:50.897127 31753 raft_consensus.cc:1275] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 4 FOLLOWER]: Refusing update from remote peer ab45d114a3c44125abc8a351be1dcd62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:50.899410 32064 consensus_queue.cc:1048] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56673ab87f844f7daa600bf0cb16a3f6" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 33039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:51.096730 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.125299 20694 tablet_server.cc:179] TabletServer@127.20.53.129:40131 shutting down...
I20260709 13:09:51.149313 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:51.150133 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.151086 20694 raft_consensus.cc:2243] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.151623 20694 raft_consensus.cc:2272] T 26b4977020e24cb4ad8ea744e3d858f2 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.154690 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.155380 20694 raft_consensus.cc:2243] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.155820 20694 raft_consensus.cc:2272] T 5fc8eae9083d41fa97d1bc5164749013 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.158743 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.159235 20694 raft_consensus.cc:2243] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.159647 20694 raft_consensus.cc:2272] T 3b3c2c5cf291469987ddb3a9ea25227d P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.161831 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.162354 20694 raft_consensus.cc:2243] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.162737 20694 raft_consensus.cc:2272] T 2b0a356766e8475ca77a744b00a590f6 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.164824 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.165364 20694 raft_consensus.cc:2243] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.165766 20694 raft_consensus.cc:2272] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.167773 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.168251 20694 raft_consensus.cc:2243] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.168632 20694 raft_consensus.cc:2272] T 6678a0f5e40841f78185ae5e68503250 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.170787 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.171262 20694 raft_consensus.cc:2243] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.171682 20694 raft_consensus.cc:2272] T dda8fbffbe494758b5a57a107b430bd7 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.173825 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.174407 20694 raft_consensus.cc:2243] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.174777 20694 raft_consensus.cc:2272] T de472d0e84694ddcb8211372d6df7065 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.177184 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.177630 20694 raft_consensus.cc:2243] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.178097 20694 raft_consensus.cc:2272] T b3d669a917624febab97033403e2a807 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.180222 20694 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:51.180624 20694 raft_consensus.cc:2243] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.181023 20694 raft_consensus.cc:2272] T d0ea2a36fc0e458f87cfd8fb7f993933 P cadd8a1c131e4e6aab7cc0e8b728cc6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.214056 20694 tablet_server.cc:196] TabletServer@127.20.53.129:40131 shutdown complete.
I20260709 13:09:51.239373 20694 tablet_server.cc:179] TabletServer@127.20.53.130:0 shutting down...
W20260709 13:09:51.257925 31645 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111) [suppressed 79 similar messages]
W20260709 13:09:51.264166 31645 consensus_peers.cc:597] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:51.264586 31645 consensus_peers.cc:597] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.267247 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:51.267949 20694 tablet_replica.cc:333] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.268613 20694 raft_consensus.cc:2243] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.269308 20694 raft_consensus.cc:2272] T 6678a0f5e40841f78185ae5e68503250 P ab45d114a3c44125abc8a351be1dcd62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.271672 20694 tablet_replica.cc:333] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.272306 20694 raft_consensus.cc:2243] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.273180 20694 raft_consensus.cc:2272] T dda8fbffbe494758b5a57a107b430bd7 P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.276079 20694 tablet_replica.cc:333] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.276590 20694 raft_consensus.cc:2243] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.277351 20694 raft_consensus.cc:2272] T de472d0e84694ddcb8211372d6df7065 P ab45d114a3c44125abc8a351be1dcd62 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.279850 20694 tablet_replica.cc:333] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.280400 20694 raft_consensus.cc:2243] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.280809 20694 raft_consensus.cc:2272] T 2b0a356766e8475ca77a744b00a590f6 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.282807 20694 tablet_replica.cc:333] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.283295 20694 raft_consensus.cc:2243] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.284189 20694 raft_consensus.cc:2272] T 3b3c2c5cf291469987ddb3a9ea25227d P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.286505 20694 tablet_replica.cc:333] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.287022 20694 raft_consensus.cc:2243] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.287591 20694 raft_consensus.cc:2272] T 26b4977020e24cb4ad8ea744e3d858f2 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.290608 20694 tablet_replica.cc:333] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.291235 20694 raft_consensus.cc:2243] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.291740 20694 raft_consensus.cc:2272] T b3d669a917624febab97033403e2a807 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:51.293429 31717 consensus_peers.cc:597] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer ab45d114a3c44125abc8a351be1dcd62 (127.20.53.130:41827): Couldn't send request to peer ab45d114a3c44125abc8a351be1dcd62. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.294432 20694 tablet_replica.cc:333] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.295017 20694 raft_consensus.cc:2243] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.295753 20694 raft_consensus.cc:2272] T d0ea2a36fc0e458f87cfd8fb7f993933 P ab45d114a3c44125abc8a351be1dcd62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.298082 20694 tablet_replica.cc:333] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.298636 20694 raft_consensus.cc:2243] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.299050 20694 raft_consensus.cc:2272] T 5fc8eae9083d41fa97d1bc5164749013 P ab45d114a3c44125abc8a351be1dcd62 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.301450 20694 tablet_replica.cc:333] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62: stopping tablet replica
I20260709 13:09:51.301946 20694 raft_consensus.cc:2243] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.302765 20694 raft_consensus.cc:2272] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P ab45d114a3c44125abc8a351be1dcd62 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:51.316643 31720 consensus_peers.cc:597] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:51.331760 31720 consensus_peers.cc:597] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.337049 20694 tablet_server.cc:196] TabletServer@127.20.53.130:0 shutdown complete.
I20260709 13:09:51.359910 20694 tablet_server.cc:179] TabletServer@127.20.53.131:0 shutting down...
W20260709 13:09:51.367102 31720 consensus_peers.cc:597] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 -> Peer cadd8a1c131e4e6aab7cc0e8b728cc6b (127.20.53.129:40131): Couldn't send request to peer cadd8a1c131e4e6aab7cc0e8b728cc6b. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:40131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.386744 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:51.387490 20694 tablet_replica.cc:333] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.388175 20694 raft_consensus.cc:2243] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.389040 20694 raft_consensus.cc:2272] T 6678a0f5e40841f78185ae5e68503250 P 56673ab87f844f7daa600bf0cb16a3f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.391396 20694 tablet_replica.cc:333] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.391992 20694 raft_consensus.cc:2243] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.392460 20694 raft_consensus.cc:2272] T dda8fbffbe494758b5a57a107b430bd7 P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.394742 20694 tablet_replica.cc:333] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.395267 20694 raft_consensus.cc:2243] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.395655 20694 raft_consensus.cc:2272] T de472d0e84694ddcb8211372d6df7065 P 56673ab87f844f7daa600bf0cb16a3f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.398772 20694 tablet_replica.cc:333] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.399325 20694 raft_consensus.cc:2243] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.400064 20694 raft_consensus.cc:2272] T 5fc8eae9083d41fa97d1bc5164749013 P 56673ab87f844f7daa600bf0cb16a3f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.402599 20694 tablet_replica.cc:333] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.403133 20694 raft_consensus.cc:2243] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.403553 20694 raft_consensus.cc:2272] T d0ea2a36fc0e458f87cfd8fb7f993933 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.405889 20694 tablet_replica.cc:333] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.406471 20694 raft_consensus.cc:2243] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.407289 20694 raft_consensus.cc:2272] T b3d669a917624febab97033403e2a807 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.409252 20694 tablet_replica.cc:333] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.409904 20694 raft_consensus.cc:2243] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.410866 20694 raft_consensus.cc:2272] T 26b4977020e24cb4ad8ea744e3d858f2 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.412868 20694 tablet_replica.cc:333] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.413306 20694 raft_consensus.cc:2243] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.413931 20694 raft_consensus.cc:2272] T 2b0a356766e8475ca77a744b00a590f6 P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.415803 20694 tablet_replica.cc:333] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.416240 20694 raft_consensus.cc:2243] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.416611 20694 raft_consensus.cc:2272] T 3b3c2c5cf291469987ddb3a9ea25227d P 56673ab87f844f7daa600bf0cb16a3f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.418490 20694 tablet_replica.cc:333] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6: stopping tablet replica
I20260709 13:09:51.418892 20694 raft_consensus.cc:2243] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:51.419296 20694 raft_consensus.cc:2272] T 8eb6f7a7c48d445d947a3aa6bd1a16bd P 56673ab87f844f7daa600bf0cb16a3f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.449468 20694 tablet_server.cc:196] TabletServer@127.20.53.131:0 shutdown complete.
I20260709 13:09:51.475692 20694 master.cc:562] Master@127.20.53.190:41393 shutting down...
I20260709 13:09:51.501807 20694 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:51.502372 20694 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:51.502663 20694 tablet_replica.cc:333] T 00000000000000000000000000000000 P dd2e5a32511f418fbc2a5efef1cca404: stopping tablet replica
I20260709 13:09:51.523061 20694 master.cc:584] Master@127.20.53.190:41393 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13118 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:09:51.566294 20694 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.53.190:35561
I20260709 13:09:51.567443 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:51.573173 32088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:51.573246 32087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:51.574234 32090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:51.574520 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:51.575474 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:51.575645 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:51.575754 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602591575743 us; error 0 us; skew 500 ppm
I20260709 13:09:51.576238 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:51.578708 20694 webserver.cc:533] Webserver started at http://127.20.53.190:33107/ using document root <none> and password file <none>
I20260709 13:09:51.579154 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:51.579301 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:51.579511 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:51.580543 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/master-0-root/instance:
uuid: "7beb2e23bfd74420804f3d001ea9fbef"
format_stamp: "Formatted at 2026-07-09 13:09:51 on dist-test-slave-r056"
I20260709 13:09:51.584673 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:09:51.587759 32095 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:51.588480 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:51.588711 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/master-0-root
uuid: "7beb2e23bfd74420804f3d001ea9fbef"
format_stamp: "Formatted at 2026-07-09 13:09:51 on dist-test-slave-r056"
I20260709 13:09:51.588936 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:51.615566 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:51.616675 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:51.659160 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.190:35561
I20260709 13:09:51.659271 32146 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.190:35561 every 8 connection(s)
I20260709 13:09:51.663051 32147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.673645 32147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef: Bootstrap starting.
I20260709 13:09:51.678345 32147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.682322 32147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef: No bootstrap required, opened a new log
I20260709 13:09:51.684403 32147 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7beb2e23bfd74420804f3d001ea9fbef" member_type: VOTER }
I20260709 13:09:51.684829 32147 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.685050 32147 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7beb2e23bfd74420804f3d001ea9fbef, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.685607 32147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7beb2e23bfd74420804f3d001ea9fbef" member_type: VOTER }
I20260709 13:09:51.686043 32147 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:51.686297 32147 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:51.686569 32147 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.691069 32147 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7beb2e23bfd74420804f3d001ea9fbef" member_type: VOTER }
I20260709 13:09:51.691597 32147 leader_election.cc:304] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7beb2e23bfd74420804f3d001ea9fbef; no voters: 
I20260709 13:09:51.692728 32147 leader_election.cc:290] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:51.693142 32150 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.694484 32150 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 1 LEADER]: Becoming Leader. State: Replica: 7beb2e23bfd74420804f3d001ea9fbef, State: Running, Role: LEADER
I20260709 13:09:51.695171 32150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7beb2e23bfd74420804f3d001ea9fbef" member_type: VOTER }
I20260709 13:09:51.695621 32147 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:51.697949 32152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7beb2e23bfd74420804f3d001ea9fbef. Latest consensus state: current_term: 1 leader_uuid: "7beb2e23bfd74420804f3d001ea9fbef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7beb2e23bfd74420804f3d001ea9fbef" member_type: VOTER } }
I20260709 13:09:51.698009 32151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7beb2e23bfd74420804f3d001ea9fbef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7beb2e23bfd74420804f3d001ea9fbef" member_type: VOTER } }
I20260709 13:09:51.698709 32152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:51.698791 32151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:51.701256 32155 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:51.709287 32155 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:51.710258 20694 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:51.717921 32155 catalog_manager.cc:1383] Generated new cluster ID: f9273881318b428ab0b2538645086fbc
I20260709 13:09:51.718242 32155 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:51.742836 32155 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:51.744009 32155 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:51.754231 32155 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef: Generated new TSK 0
I20260709 13:09:51.754772 32155 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:51.777026 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:51.782902 32168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:51.784183 32169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:51.785804 20694 server_base.cc:1061] running on GCE node
W20260709 13:09:51.786499 32171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:51.787379 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:51.787559 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:51.787683 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602591787671 us; error 0 us; skew 500 ppm
I20260709 13:09:51.788141 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:51.790546 20694 webserver.cc:533] Webserver started at http://127.20.53.129:46335/ using document root <none> and password file <none>
I20260709 13:09:51.791052 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:51.791213 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:51.791419 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:51.792433 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-0-root/instance:
uuid: "f1f084891fd74fee98f7664f797e38bf"
format_stamp: "Formatted at 2026-07-09 13:09:51 on dist-test-slave-r056"
I20260709 13:09:51.796823 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:51.800267 32176 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:51.801049 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:51.801302 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "f1f084891fd74fee98f7664f797e38bf"
format_stamp: "Formatted at 2026-07-09 13:09:51 on dist-test-slave-r056"
I20260709 13:09:51.801540 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:51.825932 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:51.827127 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:51.828495 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:51.830806 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:51.830976 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:51.831291 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:51.831436 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:51.870500 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:36659
I20260709 13:09:51.870584 32238 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:36659 every 8 connection(s)
I20260709 13:09:51.875671 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:51.883301 32243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:51.883778 32244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:51.886428 20694 server_base.cc:1061] running on GCE node
W20260709 13:09:51.887285 32246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:51.888509 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:51.888792 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:51.889003 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602591888986 us; error 0 us; skew 500 ppm
I20260709 13:09:51.889444 32239 heartbeater.cc:344] Connected to a master server at 127.20.53.190:35561
I20260709 13:09:51.889667 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:51.889900 32239 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:51.890856 32239 heartbeater.cc:507] Master 127.20.53.190:35561 requested a full tablet report, sending...
I20260709 13:09:51.892372 20694 webserver.cc:533] Webserver started at http://127.20.53.130:33745/ using document root <none> and password file <none>
I20260709 13:09:51.893002 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:51.893234 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:51.893559 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:51.893437 32112 ts_manager.cc:194] Registered new tserver with Master: f1f084891fd74fee98f7664f797e38bf (127.20.53.129:36659)
I20260709 13:09:51.895228 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-1-root/instance:
uuid: "f88abb99249744fb9fb6dddd6b969bd2"
format_stamp: "Formatted at 2026-07-09 13:09:51 on dist-test-slave-r056"
I20260709 13:09:51.896018 32112 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44470
I20260709 13:09:51.900322 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:09:51.903775 32251 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:51.904639 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:51.904999 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-1-root
uuid: "f88abb99249744fb9fb6dddd6b969bd2"
format_stamp: "Formatted at 2026-07-09 13:09:51 on dist-test-slave-r056"
I20260709 13:09:51.905279 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:51.919822 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:51.920984 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:51.922492 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:51.924840 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:51.925071 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:51.925356 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:51.925508 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:51.969640 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.130:41863
I20260709 13:09:51.969749 32313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.130:41863 every 8 connection(s)
I20260709 13:09:51.975011 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:51.983122 32317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:51.984607 32318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:51.988420 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:51.989769 32314 heartbeater.cc:344] Connected to a master server at 127.20.53.190:35561
W20260709 13:09:51.989820 32320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:51.990443 32314 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:51.991107 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:51.991268 32314 heartbeater.cc:507] Master 127.20.53.190:35561 requested a full tablet report, sending...
W20260709 13:09:51.991345 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:51.991604 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602591991588 us; error 0 us; skew 500 ppm
I20260709 13:09:51.992383 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:51.993304 32112 ts_manager.cc:194] Registered new tserver with Master: f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863)
I20260709 13:09:51.994903 32112 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44478
I20260709 13:09:51.995172 20694 webserver.cc:533] Webserver started at http://127.20.53.131:34229/ using document root <none> and password file <none>
I20260709 13:09:51.995821 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:51.996080 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:51.996408 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:51.997766 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-2-root/instance:
uuid: "ba84bb8af2ee40b79d4ce926958b2656"
format_stamp: "Formatted at 2026-07-09 13:09:51 on dist-test-slave-r056"
I20260709 13:09:52.002449 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:52.005901 32325 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:52.006736 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:52.007071 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-2-root
uuid: "ba84bb8af2ee40b79d4ce926958b2656"
format_stamp: "Formatted at 2026-07-09 13:09:51 on dist-test-slave-r056"
I20260709 13:09:52.007328 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602266622664-20694-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:52.043627 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:52.044855 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:52.046312 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:52.048485 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:52.048717 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:52.048964 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:52.049141 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:52.088686 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.131:43533
I20260709 13:09:52.088838 32387 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.131:43533 every 8 connection(s)
I20260709 13:09:52.102015 32388 heartbeater.cc:344] Connected to a master server at 127.20.53.190:35561
I20260709 13:09:52.102510 32388 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:52.103307 32388 heartbeater.cc:507] Master 127.20.53.190:35561 requested a full tablet report, sending...
I20260709 13:09:52.105129 32112 ts_manager.cc:194] Registered new tserver with Master: ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533)
I20260709 13:09:52.105360 20694 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013348543s
I20260709 13:09:52.107004 32112 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44490
I20260709 13:09:52.129683 32112 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44502:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:52.131839 32112 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:52.194644 32204 tablet_service.cc:1511] Processing CreateTablet for tablet 5129c364c77d4587b6b661f3ced9de9f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=82a5a49ffea24337bea5c9cfadfd9318]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:52.194963 32203 tablet_service.cc:1511] Processing CreateTablet for tablet 13070603d33146f7ba602cb29fac11c7 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=82a5a49ffea24337bea5c9cfadfd9318]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:52.196230 32204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5129c364c77d4587b6b661f3ced9de9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.196026 32278 tablet_service.cc:1511] Processing CreateTablet for tablet 13070603d33146f7ba602cb29fac11c7 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=82a5a49ffea24337bea5c9cfadfd9318]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:52.196887 32203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13070603d33146f7ba602cb29fac11c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.197322 32278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13070603d33146f7ba602cb29fac11c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.200604 32279 tablet_service.cc:1511] Processing CreateTablet for tablet 5129c364c77d4587b6b661f3ced9de9f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=82a5a49ffea24337bea5c9cfadfd9318]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:52.201967 32279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5129c364c77d4587b6b661f3ced9de9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.206060 32353 tablet_service.cc:1511] Processing CreateTablet for tablet 5129c364c77d4587b6b661f3ced9de9f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=82a5a49ffea24337bea5c9cfadfd9318]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:52.207430 32353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5129c364c77d4587b6b661f3ced9de9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.219734 32352 tablet_service.cc:1511] Processing CreateTablet for tablet 13070603d33146f7ba602cb29fac11c7 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=82a5a49ffea24337bea5c9cfadfd9318]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:52.221138 32352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13070603d33146f7ba602cb29fac11c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.221976 32403 tablet_bootstrap.cc:492] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2: Bootstrap starting.
I20260709 13:09:52.228891 32403 tablet_bootstrap.cc:654] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.239419 32404 tablet_bootstrap.cc:492] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf: Bootstrap starting.
I20260709 13:09:52.244035 32406 tablet_bootstrap.cc:492] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656: Bootstrap starting.
I20260709 13:09:52.244406 32403 tablet_bootstrap.cc:492] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2: No bootstrap required, opened a new log
I20260709 13:09:52.244989 32403 ts_tablet_manager.cc:1403] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:09:52.247090 32404 tablet_bootstrap.cc:654] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.247720 32403 raft_consensus.cc:359] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.248343 32403 raft_consensus.cc:385] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.248590 32403 raft_consensus.cc:740] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88abb99249744fb9fb6dddd6b969bd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.249236 32403 consensus_queue.cc:260] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.251814 32406 tablet_bootstrap.cc:654] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.251999 32403 ts_tablet_manager.cc:1434] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:52.252521 32314 heartbeater.cc:499] Master 127.20.53.190:35561 was elected leader, sending a full tablet report...
I20260709 13:09:52.252887 32404 tablet_bootstrap.cc:492] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf: No bootstrap required, opened a new log
I20260709 13:09:52.253129 32403 tablet_bootstrap.cc:492] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2: Bootstrap starting.
I20260709 13:09:52.253410 32404 ts_tablet_manager.cc:1403] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf: Time spent bootstrapping tablet: real 0.014s	user 0.000s	sys 0.013s
I20260709 13:09:52.256709 32404 raft_consensus.cc:359] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.257422 32406 tablet_bootstrap.cc:492] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656: No bootstrap required, opened a new log
I20260709 13:09:52.257987 32406 ts_tablet_manager.cc:1403] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656: Time spent bootstrapping tablet: real 0.014s	user 0.014s	sys 0.000s
I20260709 13:09:52.257979 32404 raft_consensus.cc:385] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.259554 32404 raft_consensus.cc:740] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.260360 32403 tablet_bootstrap.cc:654] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.260520 32404 consensus_queue.cc:260] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.262288 32406 raft_consensus.cc:359] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:52.263095 32406 raft_consensus.cc:385] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.263338 32239 heartbeater.cc:499] Master 127.20.53.190:35561 was elected leader, sending a full tablet report...
I20260709 13:09:52.263406 32406 raft_consensus.cc:740] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba84bb8af2ee40b79d4ce926958b2656, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.264396 32406 consensus_queue.cc:260] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:52.268421 32404 ts_tablet_manager.cc:1434] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:09:52.269712 32404 tablet_bootstrap.cc:492] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf: Bootstrap starting.
I20260709 13:09:52.280083 32388 heartbeater.cc:499] Master 127.20.53.190:35561 was elected leader, sending a full tablet report...
I20260709 13:09:52.280702 32406 ts_tablet_manager.cc:1434] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.013s
I20260709 13:09:52.280800 32403 tablet_bootstrap.cc:492] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2: No bootstrap required, opened a new log
I20260709 13:09:52.281177 32404 tablet_bootstrap.cc:654] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.281428 32403 ts_tablet_manager.cc:1403] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.012s
I20260709 13:09:52.282081 32406 tablet_bootstrap.cc:492] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656: Bootstrap starting.
I20260709 13:09:52.284612 32403 raft_consensus.cc:359] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:52.285369 32403 raft_consensus.cc:385] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.285666 32403 raft_consensus.cc:740] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88abb99249744fb9fb6dddd6b969bd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.286599 32403 consensus_queue.cc:260] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:52.289050 32403 ts_tablet_manager.cc:1434] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:52.291359 32406 tablet_bootstrap.cc:654] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.292424 32404 tablet_bootstrap.cc:492] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf: No bootstrap required, opened a new log
I20260709 13:09:52.292950 32404 ts_tablet_manager.cc:1403] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:09:52.295966 32404 raft_consensus.cc:359] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:52.296669 32404 raft_consensus.cc:385] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.296995 32404 raft_consensus.cc:740] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.297767 32404 consensus_queue.cc:260] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:52.299154 32406 tablet_bootstrap.cc:492] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656: No bootstrap required, opened a new log
I20260709 13:09:52.299692 32406 ts_tablet_manager.cc:1403] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.010s
I20260709 13:09:52.299804 32404 ts_tablet_manager.cc:1434] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:52.302438 32406 raft_consensus.cc:359] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.302968 32406 raft_consensus.cc:385] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.303205 32406 raft_consensus.cc:740] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba84bb8af2ee40b79d4ce926958b2656, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.303970 32406 consensus_queue.cc:260] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.306177 32406 ts_tablet_manager.cc:1434] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:52.352849 32410 raft_consensus.cc:493] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.353420 32410 raft_consensus.cc:515] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.355461 32410 leader_election.cc:290] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863), ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533)
I20260709 13:09:52.365579 32289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13070603d33146f7ba602cb29fac11c7" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2" is_pre_election: true
I20260709 13:09:52.366412 32289 raft_consensus.cc:2468] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 0.
I20260709 13:09:52.366684 32363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13070603d33146f7ba602cb29fac11c7" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656" is_pre_election: true
I20260709 13:09:52.367311 32363 raft_consensus.cc:2468] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 0.
I20260709 13:09:52.367368 32180 leader_election.cc:304] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f1f084891fd74fee98f7664f797e38bf, f88abb99249744fb9fb6dddd6b969bd2; no voters: 
I20260709 13:09:52.368224 32410 raft_consensus.cc:2804] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.368577 32410 raft_consensus.cc:493] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.368865 32410 raft_consensus.cc:3060] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.373893 32410 raft_consensus.cc:515] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.375510 32410 leader_election.cc:290] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 1 election: Requested vote from peers f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863), ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533)
I20260709 13:09:52.376190 32289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13070603d33146f7ba602cb29fac11c7" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2"
I20260709 13:09:52.376519 32363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13070603d33146f7ba602cb29fac11c7" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656"
I20260709 13:09:52.376791 32289 raft_consensus.cc:3060] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.377097 32363 raft_consensus.cc:3060] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.384505 32289 raft_consensus.cc:2468] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 1.
I20260709 13:09:52.384531 32363 raft_consensus.cc:2468] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 1.
I20260709 13:09:52.385846 32179 leader_election.cc:304] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba84bb8af2ee40b79d4ce926958b2656, f1f084891fd74fee98f7664f797e38bf; no voters: 
I20260709 13:09:52.386584 32410 raft_consensus.cc:2804] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.387576 32410 raft_consensus.cc:697] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Becoming Leader. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Running, Role: LEADER
I20260709 13:09:52.388247 32410 consensus_queue.cc:237] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.395211 32112 catalog_manager.cc:5697] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf reported cstate change: term changed from 0 to 1, leader changed from <none> to f1f084891fd74fee98f7664f797e38bf (127.20.53.129). New cstate: current_term: 1 leader_uuid: "f1f084891fd74fee98f7664f797e38bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.567028 32412 raft_consensus.cc:493] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.567528 32412 raft_consensus.cc:515] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:52.569499 32412 leader_election.cc:290] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f084891fd74fee98f7664f797e38bf (127.20.53.129:36659), f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863)
I20260709 13:09:52.578187 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5129c364c77d4587b6b661f3ced9de9f" candidate_uuid: "ba84bb8af2ee40b79d4ce926958b2656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f084891fd74fee98f7664f797e38bf" is_pre_election: true
I20260709 13:09:52.578946 32214 raft_consensus.cc:2468] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba84bb8af2ee40b79d4ce926958b2656 in term 0.
I20260709 13:09:52.579641 32289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5129c364c77d4587b6b661f3ced9de9f" candidate_uuid: "ba84bb8af2ee40b79d4ce926958b2656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2" is_pre_election: true
I20260709 13:09:52.580201 32289 raft_consensus.cc:2468] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba84bb8af2ee40b79d4ce926958b2656 in term 0.
I20260709 13:09:52.580169 32326 leader_election.cc:304] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba84bb8af2ee40b79d4ce926958b2656, f1f084891fd74fee98f7664f797e38bf; no voters: 
I20260709 13:09:52.581137 32412 raft_consensus.cc:2804] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.581511 32412 raft_consensus.cc:493] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.581849 32412 raft_consensus.cc:3060] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.586819 32412 raft_consensus.cc:515] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:52.588478 32412 leader_election.cc:290] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [CANDIDATE]: Term 1 election: Requested vote from peers f1f084891fd74fee98f7664f797e38bf (127.20.53.129:36659), f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863)
I20260709 13:09:52.589170 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5129c364c77d4587b6b661f3ced9de9f" candidate_uuid: "ba84bb8af2ee40b79d4ce926958b2656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f084891fd74fee98f7664f797e38bf"
I20260709 13:09:52.589476 32289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5129c364c77d4587b6b661f3ced9de9f" candidate_uuid: "ba84bb8af2ee40b79d4ce926958b2656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2"
I20260709 13:09:52.589798 32214 raft_consensus.cc:3060] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.590059 32289 raft_consensus.cc:3060] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.596902 32214 raft_consensus.cc:2468] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba84bb8af2ee40b79d4ce926958b2656 in term 1.
I20260709 13:09:52.596902 32289 raft_consensus.cc:2468] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba84bb8af2ee40b79d4ce926958b2656 in term 1.
I20260709 13:09:52.598124 32329 leader_election.cc:304] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba84bb8af2ee40b79d4ce926958b2656, f88abb99249744fb9fb6dddd6b969bd2; no voters: 
I20260709 13:09:52.598805 32412 raft_consensus.cc:2804] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.599723 32412 raft_consensus.cc:697] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 1 LEADER]: Becoming Leader. State: Replica: ba84bb8af2ee40b79d4ce926958b2656, State: Running, Role: LEADER
I20260709 13:09:52.600533 32412 consensus_queue.cc:237] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:52.606999 32112 catalog_manager.cc:5697] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131). New cstate: current_term: 1 leader_uuid: "ba84bb8af2ee40b79d4ce926958b2656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.667944 32112 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44510:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:52.669896 32112 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:52.691699 32204 tablet_service.cc:1511] Processing CreateTablet for tablet 9c49bb8c37e64c869a4da01e70ddc83e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=002abacb8603496c8604d10ca8fc4afb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:52.693045 32204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c49bb8c37e64c869a4da01e70ddc83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.693549 32278 tablet_service.cc:1511] Processing CreateTablet for tablet 9c49bb8c37e64c869a4da01e70ddc83e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=002abacb8603496c8604d10ca8fc4afb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:52.694854 32278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c49bb8c37e64c869a4da01e70ddc83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.695405 32353 tablet_service.cc:1511] Processing CreateTablet for tablet 9c49bb8c37e64c869a4da01e70ddc83e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=002abacb8603496c8604d10ca8fc4afb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:09:52.696658 32353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c49bb8c37e64c869a4da01e70ddc83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.696684 32203 tablet_service.cc:1511] Processing CreateTablet for tablet 12988b09969d4bed9853dda1a970d3d0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=002abacb8603496c8604d10ca8fc4afb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:52.698323 32203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12988b09969d4bed9853dda1a970d3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.699445 32279 tablet_service.cc:1511] Processing CreateTablet for tablet 12988b09969d4bed9853dda1a970d3d0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=002abacb8603496c8604d10ca8fc4afb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:52.700637 32279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12988b09969d4bed9853dda1a970d3d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:52.705420 32160 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:52.715418 32406 tablet_bootstrap.cc:492] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656: Bootstrap starting.
I20260709 13:09:52.717456 32352 tablet_service.cc:1511] Processing CreateTablet for tablet 12988b09969d4bed9853dda1a970d3d0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=002abacb8603496c8604d10ca8fc4afb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:09:52.718746 32352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12988b09969d4bed9853dda1a970d3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.721372 32404 tablet_bootstrap.cc:492] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf: Bootstrap starting.
I20260709 13:09:52.722330 32406 tablet_bootstrap.cc:654] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.723560 32403 tablet_bootstrap.cc:492] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2: Bootstrap starting.
I20260709 13:09:52.727706 32404 tablet_bootstrap.cc:654] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.729890 32403 tablet_bootstrap.cc:654] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.736040 32404 tablet_bootstrap.cc:492] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf: No bootstrap required, opened a new log
I20260709 13:09:52.736528 32404 ts_tablet_manager.cc:1403] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:09:52.739475 32404 raft_consensus.cc:359] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.740186 32404 raft_consensus.cc:385] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.740455 32404 raft_consensus.cc:740] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.741508 32403 tablet_bootstrap.cc:492] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2: No bootstrap required, opened a new log
I20260709 13:09:52.741179 32404 consensus_queue.cc:260] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.742190 32403 ts_tablet_manager.cc:1403] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.003s
I20260709 13:09:52.743857 32404 ts_tablet_manager.cc:1434] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:09:52.744897 32404 tablet_bootstrap.cc:492] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf: Bootstrap starting.
I20260709 13:09:52.745282 32403 raft_consensus.cc:359] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.746099 32403 raft_consensus.cc:385] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.746502 32403 raft_consensus.cc:740] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88abb99249744fb9fb6dddd6b969bd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.746655 32406 tablet_bootstrap.cc:492] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656: No bootstrap required, opened a new log
I20260709 13:09:52.747257 32406 ts_tablet_manager.cc:1403] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.009s
I20260709 13:09:52.747536 32403 consensus_queue.cc:260] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.750212 32406 raft_consensus.cc:359] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.749903 32403 ts_tablet_manager.cc:1434] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:09:52.750958 32406 raft_consensus.cc:385] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.751289 32406 raft_consensus.cc:740] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba84bb8af2ee40b79d4ce926958b2656, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.751994 32403 tablet_bootstrap.cc:492] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2: Bootstrap starting.
I20260709 13:09:52.752238 32406 consensus_queue.cc:260] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.754653 32406 ts_tablet_manager.cc:1434] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:09:52.755686 32406 tablet_bootstrap.cc:492] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656: Bootstrap starting.
I20260709 13:09:52.759668 32403 tablet_bootstrap.cc:654] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.752022 32404 tablet_bootstrap.cc:654] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.762022 32406 tablet_bootstrap.cc:654] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.786835 32403 tablet_bootstrap.cc:492] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2: No bootstrap required, opened a new log
I20260709 13:09:52.787014 32406 tablet_bootstrap.cc:492] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656: No bootstrap required, opened a new log
I20260709 13:09:52.787308 32403 ts_tablet_manager.cc:1403] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.008s
I20260709 13:09:52.787492 32404 tablet_bootstrap.cc:492] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf: No bootstrap required, opened a new log
I20260709 13:09:52.788160 32404 ts_tablet_manager.cc:1403] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.012s
I20260709 13:09:52.787562 32406 ts_tablet_manager.cc:1403] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.016s
I20260709 13:09:52.789762 32403 raft_consensus.cc:359] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.790548 32403 raft_consensus.cc:385] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.790819 32403 raft_consensus.cc:740] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88abb99249744fb9fb6dddd6b969bd2, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.790634 32404 raft_consensus.cc:359] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.791497 32404 raft_consensus.cc:385] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.791829 32404 raft_consensus.cc:740] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.791582 32403 consensus_queue.cc:260] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.792618 32404 consensus_queue.cc:260] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.793910 32403 ts_tablet_manager.cc:1434] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:52.793128 32406 raft_consensus.cc:359] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.795250 32406 raft_consensus.cc:385] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.795554 32406 raft_consensus.cc:740] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba84bb8af2ee40b79d4ce926958b2656, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.796320 32406 consensus_queue.cc:260] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.797786 32404 ts_tablet_manager.cc:1434] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:52.798931 32406 ts_tablet_manager.cc:1434] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:09:52.913318 32410 consensus_queue.cc:1048] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.926998 32408 raft_consensus.cc:493] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.927652 32408 raft_consensus.cc:515] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.932310 32434 consensus_queue.cc:1048] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:52.935149 32408 leader_election.cc:290] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f084891fd74fee98f7664f797e38bf (127.20.53.129:36659), ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533)
I20260709 13:09:52.940016 32434 raft_consensus.cc:493] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.941339 32434 raft_consensus.cc:515] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.943715 32434 leader_election.cc:290] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863), ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533)
I20260709 13:09:52.946058 32288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12988b09969d4bed9853dda1a970d3d0" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2" is_pre_election: true
I20260709 13:09:52.946336 32363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12988b09969d4bed9853dda1a970d3d0" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656" is_pre_election: true
I20260709 13:09:52.946784 32288 raft_consensus.cc:2468] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 0.
I20260709 13:09:52.946926 32363 raft_consensus.cc:2468] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 0.
I20260709 13:09:52.947968 32180 leader_election.cc:304] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f1f084891fd74fee98f7664f797e38bf, f88abb99249744fb9fb6dddd6b969bd2; no voters: 
I20260709 13:09:52.949216 32434 raft_consensus.cc:2804] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.949736 32434 raft_consensus.cc:493] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.950448 32434 raft_consensus.cc:3060] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.955112 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c49bb8c37e64c869a4da01e70ddc83e" candidate_uuid: "f88abb99249744fb9fb6dddd6b969bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f084891fd74fee98f7664f797e38bf" is_pre_election: true
I20260709 13:09:52.955879 32214 raft_consensus.cc:2468] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f88abb99249744fb9fb6dddd6b969bd2 in term 0.
I20260709 13:09:52.957199 32252 leader_election.cc:304] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f1f084891fd74fee98f7664f797e38bf, f88abb99249744fb9fb6dddd6b969bd2; no voters: 
I20260709 13:09:52.958047 32408 raft_consensus.cc:2804] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.958488 32408 raft_consensus.cc:493] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.958856 32408 raft_consensus.cc:3060] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.960006 32434 raft_consensus.cc:515] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.963425 32434 leader_election.cc:290] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 1 election: Requested vote from peers f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863), ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533)
I20260709 13:09:52.963989 32363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12988b09969d4bed9853dda1a970d3d0" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656"
I20260709 13:09:52.964610 32363 raft_consensus.cc:3060] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.964248 32289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12988b09969d4bed9853dda1a970d3d0" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2"
I20260709 13:09:52.965315 32289 raft_consensus.cc:3060] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.966876 32408 raft_consensus.cc:515] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.970753 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c49bb8c37e64c869a4da01e70ddc83e" candidate_uuid: "f88abb99249744fb9fb6dddd6b969bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f084891fd74fee98f7664f797e38bf"
I20260709 13:09:52.971381 32214 raft_consensus.cc:3060] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.971496 32363 raft_consensus.cc:2468] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 1.
I20260709 13:09:52.972886 32179 leader_election.cc:304] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba84bb8af2ee40b79d4ce926958b2656, f1f084891fd74fee98f7664f797e38bf; no voters: 
I20260709 13:09:52.974705 32289 raft_consensus.cc:2468] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 1.
I20260709 13:09:52.973416 32408 leader_election.cc:290] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [CANDIDATE]: Term 1 election: Requested vote from peers f1f084891fd74fee98f7664f797e38bf (127.20.53.129:36659), ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533)
I20260709 13:09:52.974592 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c49bb8c37e64c869a4da01e70ddc83e" candidate_uuid: "f88abb99249744fb9fb6dddd6b969bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656"
I20260709 13:09:52.974309 32362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c49bb8c37e64c869a4da01e70ddc83e" candidate_uuid: "f88abb99249744fb9fb6dddd6b969bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656" is_pre_election: true
I20260709 13:09:52.975502 32361 raft_consensus.cc:3060] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.975704 32434 raft_consensus.cc:2804] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.976940 32434 raft_consensus.cc:697] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Becoming Leader. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Running, Role: LEADER
I20260709 13:09:52.977947 32434 consensus_queue.cc:237] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.979916 32214 raft_consensus.cc:2468] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88abb99249744fb9fb6dddd6b969bd2 in term 1.
I20260709 13:09:52.981171 32252 leader_election.cc:304] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f1f084891fd74fee98f7664f797e38bf, f88abb99249744fb9fb6dddd6b969bd2; no voters: 
I20260709 13:09:52.982138 32408 raft_consensus.cc:2804] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.984314 32408 raft_consensus.cc:697] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 1 LEADER]: Becoming Leader. State: Replica: f88abb99249744fb9fb6dddd6b969bd2, State: Running, Role: LEADER
I20260709 13:09:52.984405 32361 raft_consensus.cc:2468] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88abb99249744fb9fb6dddd6b969bd2 in term 1.
I20260709 13:09:52.985282 32408 consensus_queue.cc:237] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:52.987071 32112 catalog_manager.cc:5697] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf reported cstate change: term changed from 0 to 1, leader changed from <none> to f1f084891fd74fee98f7664f797e38bf (127.20.53.129). New cstate: current_term: 1 leader_uuid: "f1f084891fd74fee98f7664f797e38bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.994697 32111 catalog_manager.cc:5697] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "f88abb99249744fb9fb6dddd6b969bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.015928 32412 consensus_queue.cc:1048] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.026404 32412 consensus_queue.cc:1048] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.044409 32361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5129c364c77d4587b6b661f3ced9de9f"
dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656"
mode: GRACEFUL
new_leader_uuid: "f1f084891fd74fee98f7664f797e38bf"
 from {username='slave'} at 127.0.0.1:53378
I20260709 13:09:53.044900 32361 raft_consensus.cc:606] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 1 LEADER]: Received request to transfer leadership to TS f1f084891fd74fee98f7664f797e38bf
I20260709 13:09:53.057206 32214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13070603d33146f7ba602cb29fac11c7"
dest_uuid: "f1f084891fd74fee98f7664f797e38bf"
mode: GRACEFUL
new_leader_uuid: "ba84bb8af2ee40b79d4ce926958b2656"
 from {username='slave'} at 127.0.0.1:36932
I20260709 13:09:53.057716 32214 raft_consensus.cc:606] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Received request to transfer leadership to TS ba84bb8af2ee40b79d4ce926958b2656
I20260709 13:09:53.069876 32289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c49bb8c37e64c869a4da01e70ddc83e"
dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2"
mode: GRACEFUL
new_leader_uuid: "f1f084891fd74fee98f7664f797e38bf"
 from {username='slave'} at 127.0.0.1:34362
I20260709 13:09:53.070387 32289 raft_consensus.cc:606] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 1 LEADER]: Received request to transfer leadership to TS f1f084891fd74fee98f7664f797e38bf
I20260709 13:09:53.418757 32434 consensus_queue.cc:1048] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.428736 32435 consensus_queue.cc:1048] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.462263 32408 consensus_queue.cc:1048] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.472827 32444 consensus_queue.cc:1048] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.481185 32453 raft_consensus.cc:993] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2: : Instructing follower f1f084891fd74fee98f7664f797e38bf to start an election
I20260709 13:09:53.481640 32453 raft_consensus.cc:1081] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 1 LEADER]: Signalling peer f1f084891fd74fee98f7664f797e38bf to start an election
I20260709 13:09:53.483331 32214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c49bb8c37e64c869a4da01e70ddc83e"
dest_uuid: "f1f084891fd74fee98f7664f797e38bf"
 from {username='slave'} at 127.0.0.1:36928
I20260709 13:09:53.483991 32214 raft_consensus.cc:493] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.484409 32214 raft_consensus.cc:3060] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.491159 32214 raft_consensus.cc:515] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:53.493675 32214 leader_election.cc:290] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 2 election: Requested vote from peers f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863), ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533)
I20260709 13:09:53.494397 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c49bb8c37e64c869a4da01e70ddc83e" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656"
I20260709 13:09:53.495090 32361 raft_consensus.cc:3060] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.496630 32289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c49bb8c37e64c869a4da01e70ddc83e" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2"
I20260709 13:09:53.497298 32289 raft_consensus.cc:3055] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.497727 32289 raft_consensus.cc:740] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f88abb99249744fb9fb6dddd6b969bd2, State: Running, Role: LEADER
I20260709 13:09:53.498690 32289 consensus_queue.cc:260] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:53.500355 32289 raft_consensus.cc:3060] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.502818 32361 raft_consensus.cc:2468] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 2.
I20260709 13:09:53.504058 32179 leader_election.cc:304] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba84bb8af2ee40b79d4ce926958b2656, f1f084891fd74fee98f7664f797e38bf; no voters: 
I20260709 13:09:53.504966 32435 raft_consensus.cc:2804] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:53.505432 32435 raft_consensus.cc:697] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 2 LEADER]: Becoming Leader. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Running, Role: LEADER
I20260709 13:09:53.506146 32435 consensus_queue.cc:237] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:53.507230 32289 raft_consensus.cc:2468] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 2.
I20260709 13:09:53.512157 32109 catalog_manager.cc:5697] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf reported cstate change: term changed from 1 to 2, leader changed from f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130) to f1f084891fd74fee98f7664f797e38bf (127.20.53.129). New cstate: current_term: 2 leader_uuid: "f1f084891fd74fee98f7664f797e38bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.529994 32434 raft_consensus.cc:993] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf: : Instructing follower ba84bb8af2ee40b79d4ce926958b2656 to start an election
I20260709 13:09:53.530560 32435 raft_consensus.cc:1081] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Signalling peer ba84bb8af2ee40b79d4ce926958b2656 to start an election
I20260709 13:09:53.532078 32361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13070603d33146f7ba602cb29fac11c7"
dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656"
 from {username='slave'} at 127.0.0.1:53360
I20260709 13:09:53.532660 32361 raft_consensus.cc:493] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.532994 32361 raft_consensus.cc:3060] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.538357 32361 raft_consensus.cc:515] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:53.540104 32361 leader_election.cc:290] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [CANDIDATE]: Term 2 election: Requested vote from peers f1f084891fd74fee98f7664f797e38bf (127.20.53.129:36659), f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863)
I20260709 13:09:53.540746 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13070603d33146f7ba602cb29fac11c7" candidate_uuid: "ba84bb8af2ee40b79d4ce926958b2656" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f084891fd74fee98f7664f797e38bf"
I20260709 13:09:53.541246 32289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13070603d33146f7ba602cb29fac11c7" candidate_uuid: "ba84bb8af2ee40b79d4ce926958b2656" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2"
I20260709 13:09:53.541399 32214 raft_consensus.cc:3055] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.541831 32214 raft_consensus.cc:740] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Running, Role: LEADER
I20260709 13:09:53.541880 32289 raft_consensus.cc:3060] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.542773 32214 consensus_queue.cc:260] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:53.544003 32214 raft_consensus.cc:3060] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.548924 32289 raft_consensus.cc:2468] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba84bb8af2ee40b79d4ce926958b2656 in term 2.
I20260709 13:09:53.550236 32329 leader_election.cc:304] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba84bb8af2ee40b79d4ce926958b2656, f88abb99249744fb9fb6dddd6b969bd2; no voters: 
I20260709 13:09:53.550593 32214 raft_consensus.cc:2468] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba84bb8af2ee40b79d4ce926958b2656 in term 2.
I20260709 13:09:53.551033 32447 raft_consensus.cc:2804] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:53.551968 32447 raft_consensus.cc:697] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 2 LEADER]: Becoming Leader. State: Replica: ba84bb8af2ee40b79d4ce926958b2656, State: Running, Role: LEADER
I20260709 13:09:53.552755 32447 consensus_queue.cc:237] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:53.558221 32109 catalog_manager.cc:5697] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 reported cstate change: term changed from 1 to 2, leader changed from f1f084891fd74fee98f7664f797e38bf (127.20.53.129) to ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131). New cstate: current_term: 2 leader_uuid: "ba84bb8af2ee40b79d4ce926958b2656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.583602 32459 raft_consensus.cc:993] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656: : Instructing follower f1f084891fd74fee98f7664f797e38bf to start an election
I20260709 13:09:53.584218 32460 raft_consensus.cc:1081] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 1 LEADER]: Signalling peer f1f084891fd74fee98f7664f797e38bf to start an election
I20260709 13:09:53.585886 32214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5129c364c77d4587b6b661f3ced9de9f"
dest_uuid: "f1f084891fd74fee98f7664f797e38bf"
 from {username='slave'} at 127.0.0.1:36914
I20260709 13:09:53.586426 32214 raft_consensus.cc:493] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.586790 32214 raft_consensus.cc:3060] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.591784 32214 raft_consensus.cc:515] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:53.593281 32214 leader_election.cc:290] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 2 election: Requested vote from peers ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533), f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130:41863)
I20260709 13:09:53.594314 32289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5129c364c77d4587b6b661f3ced9de9f" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2"
I20260709 13:09:53.594595 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5129c364c77d4587b6b661f3ced9de9f" candidate_uuid: "f1f084891fd74fee98f7664f797e38bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656"
I20260709 13:09:53.594950 32289 raft_consensus.cc:3060] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.595163 32361 raft_consensus.cc:3055] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.595522 32361 raft_consensus.cc:740] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba84bb8af2ee40b79d4ce926958b2656, State: Running, Role: LEADER
I20260709 13:09:53.596364 32361 consensus_queue.cc:260] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:53.597666 32361 raft_consensus.cc:3060] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.601749 32289 raft_consensus.cc:2468] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 2.
I20260709 13:09:53.603018 32180 leader_election.cc:304] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f1f084891fd74fee98f7664f797e38bf, f88abb99249744fb9fb6dddd6b969bd2; no voters: 
I20260709 13:09:53.603773 32435 raft_consensus.cc:2804] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:53.604208 32361 raft_consensus.cc:2468] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f084891fd74fee98f7664f797e38bf in term 2.
I20260709 13:09:53.604203 32435 raft_consensus.cc:697] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 2 LEADER]: Becoming Leader. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Running, Role: LEADER
I20260709 13:09:53.605497 32435 consensus_queue.cc:237] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } }
I20260709 13:09:53.611840 32109 catalog_manager.cc:5697] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf reported cstate change: term changed from 1 to 2, leader changed from ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131) to f1f084891fd74fee98f7664f797e38bf (127.20.53.129). New cstate: current_term: 2 leader_uuid: "f1f084891fd74fee98f7664f797e38bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.786614 20694 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:09:53.788149 20694 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:09:53.788556 20694 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:09:53.800086 32214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12988b09969d4bed9853dda1a970d3d0"
dest_uuid: "f1f084891fd74fee98f7664f797e38bf"
mode: GRACEFUL
new_leader_uuid: "f88abb99249744fb9fb6dddd6b969bd2"
 from {username='slave'} at 127.0.0.1:36942
I20260709 13:09:53.800648 32214 raft_consensus.cc:606] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Received request to transfer leadership to TS f88abb99249744fb9fb6dddd6b969bd2
I20260709 13:09:53.801775 20694 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:09:53.874668 32434 raft_consensus.cc:993] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf: : Instructing follower f88abb99249744fb9fb6dddd6b969bd2 to start an election
I20260709 13:09:53.875151 32435 raft_consensus.cc:1081] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Signalling peer f88abb99249744fb9fb6dddd6b969bd2 to start an election
I20260709 13:09:53.876662 32289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12988b09969d4bed9853dda1a970d3d0"
dest_uuid: "f88abb99249744fb9fb6dddd6b969bd2"
 from {username='slave'} at 127.0.0.1:34338
I20260709 13:09:53.877219 32289 raft_consensus.cc:493] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.877592 32289 raft_consensus.cc:3060] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.883510 32289 raft_consensus.cc:515] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:53.885617 32289 leader_election.cc:290] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [CANDIDATE]: Term 2 election: Requested vote from peers f1f084891fd74fee98f7664f797e38bf (127.20.53.129:36659), ba84bb8af2ee40b79d4ce926958b2656 (127.20.53.131:43533)
I20260709 13:09:53.885887 32214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12988b09969d4bed9853dda1a970d3d0" candidate_uuid: "f88abb99249744fb9fb6dddd6b969bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f084891fd74fee98f7664f797e38bf"
I20260709 13:09:53.886123 32361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12988b09969d4bed9853dda1a970d3d0" candidate_uuid: "f88abb99249744fb9fb6dddd6b969bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba84bb8af2ee40b79d4ce926958b2656"
I20260709 13:09:53.886801 32361 raft_consensus.cc:3060] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.886772 32214 raft_consensus.cc:3055] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.887430 32214 raft_consensus.cc:740] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1f084891fd74fee98f7664f797e38bf, State: Running, Role: LEADER
I20260709 13:09:53.888249 32214 consensus_queue.cc:260] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:53.889510 32214 raft_consensus.cc:3060] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.893987 32361 raft_consensus.cc:2468] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88abb99249744fb9fb6dddd6b969bd2 in term 2.
I20260709 13:09:53.895238 32254 leader_election.cc:304] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba84bb8af2ee40b79d4ce926958b2656, f88abb99249744fb9fb6dddd6b969bd2; no voters: 
I20260709 13:09:53.896091 32454 raft_consensus.cc:2804] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:53.896481 32214 raft_consensus.cc:2468] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88abb99249744fb9fb6dddd6b969bd2 in term 2.
I20260709 13:09:53.896595 32454 raft_consensus.cc:697] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 2 LEADER]: Becoming Leader. State: Replica: f88abb99249744fb9fb6dddd6b969bd2, State: Running, Role: LEADER
I20260709 13:09:53.897488 32454 consensus_queue.cc:237] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } }
I20260709 13:09:53.903712 32109 catalog_manager.cc:5697] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 reported cstate change: term changed from 1 to 2, leader changed from f1f084891fd74fee98f7664f797e38bf (127.20.53.129) to f88abb99249744fb9fb6dddd6b969bd2 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "f88abb99249744fb9fb6dddd6b969bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f084891fd74fee98f7664f797e38bf" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 36659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f88abb99249744fb9fb6dddd6b969bd2" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 41863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba84bb8af2ee40b79d4ce926958b2656" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 43533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.933946 20694 tablet_server.cc:179] TabletServer@127.20.53.129:0 shutting down...
I20260709 13:09:53.954753 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:53.955351 20694 tablet_replica.cc:333] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf: stopping tablet replica
I20260709 13:09:53.955897 20694 raft_consensus.cc:2243] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.956306 20694 raft_consensus.cc:2272] T 12988b09969d4bed9853dda1a970d3d0 P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.958398 20694 tablet_replica.cc:333] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf: stopping tablet replica
I20260709 13:09:53.958873 20694 raft_consensus.cc:2243] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.959404 20694 pending_rounds.cc:70] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf: Trying to abort 1 pending ops.
I20260709 13:09:53.959551 20694 pending_rounds.cc:77] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636223009042432 op_type: NO_OP noop_request { }
I20260709 13:09:53.959800 20694 raft_consensus.cc:2889] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:53.960014 20694 raft_consensus.cc:2272] T 9c49bb8c37e64c869a4da01e70ddc83e P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.962061 20694 tablet_replica.cc:333] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf: stopping tablet replica
I20260709 13:09:53.962601 20694 raft_consensus.cc:2243] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:53.963119 20694 pending_rounds.cc:70] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf: Trying to abort 1 pending ops.
I20260709 13:09:53.963267 20694 pending_rounds.cc:77] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636223416049664 op_type: NO_OP noop_request { }
I20260709 13:09:53.963483 20694 raft_consensus.cc:2889] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:53.963692 20694 raft_consensus.cc:2272] T 5129c364c77d4587b6b661f3ced9de9f P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.965683 20694 tablet_replica.cc:333] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf: stopping tablet replica
I20260709 13:09:53.966107 20694 raft_consensus.cc:2243] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:53.966498 20694 raft_consensus.cc:2272] T 13070603d33146f7ba602cb29fac11c7 P f1f084891fd74fee98f7664f797e38bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:53.989557 20694 tablet_server.cc:196] TabletServer@127.20.53.129:0 shutdown complete.
I20260709 13:09:54.000667 20694 tablet_server.cc:179] TabletServer@127.20.53.130:0 shutting down...
I20260709 13:09:54.020730 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:54.021359 20694 tablet_replica.cc:333] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2: stopping tablet replica
I20260709 13:09:54.021909 20694 raft_consensus.cc:2243] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.022573 20694 pending_rounds.cc:70] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2: Trying to abort 1 pending ops.
I20260709 13:09:54.022728 20694 pending_rounds.cc:77] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636224611876864 op_type: NO_OP noop_request { }
I20260709 13:09:54.022964 20694 raft_consensus.cc:2889] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:54.023178 20694 raft_consensus.cc:2272] T 12988b09969d4bed9853dda1a970d3d0 P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.025427 20694 tablet_replica.cc:333] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2: stopping tablet replica
I20260709 13:09:54.025897 20694 raft_consensus.cc:2243] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.026336 20694 raft_consensus.cc:2272] T 9c49bb8c37e64c869a4da01e70ddc83e P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.028455 20694 tablet_replica.cc:333] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2: stopping tablet replica
I20260709 13:09:54.028896 20694 raft_consensus.cc:2243] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.029235 20694 raft_consensus.cc:2272] T 5129c364c77d4587b6b661f3ced9de9f P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.031023 20694 tablet_replica.cc:333] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2: stopping tablet replica
I20260709 13:09:54.031441 20694 raft_consensus.cc:2243] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.031772 20694 raft_consensus.cc:2272] T 13070603d33146f7ba602cb29fac11c7 P f88abb99249744fb9fb6dddd6b969bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.052740 20694 tablet_server.cc:196] TabletServer@127.20.53.130:0 shutdown complete.
I20260709 13:09:54.064518 20694 tablet_server.cc:179] TabletServer@127.20.53.131:0 shutting down...
I20260709 13:09:54.082451 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:54.083050 20694 tablet_replica.cc:333] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656: stopping tablet replica
I20260709 13:09:54.083572 20694 raft_consensus.cc:2243] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.083984 20694 raft_consensus.cc:2272] T 12988b09969d4bed9853dda1a970d3d0 P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.086877 20694 tablet_replica.cc:333] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656: stopping tablet replica
I20260709 13:09:54.087436 20694 raft_consensus.cc:2243] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.087878 20694 raft_consensus.cc:2272] T 9c49bb8c37e64c869a4da01e70ddc83e P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.090349 20694 tablet_replica.cc:333] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656: stopping tablet replica
I20260709 13:09:54.090869 20694 raft_consensus.cc:2243] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.091509 20694 pending_rounds.cc:70] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656: Trying to abort 1 pending ops.
I20260709 13:09:54.091719 20694 pending_rounds.cc:77] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636223198662656 op_type: NO_OP noop_request { }
I20260709 13:09:54.092015 20694 raft_consensus.cc:2889] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:54.092320 20694 raft_consensus.cc:2272] T 13070603d33146f7ba602cb29fac11c7 P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.094452 20694 tablet_replica.cc:333] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656: stopping tablet replica
I20260709 13:09:54.094954 20694 raft_consensus.cc:2243] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:54.095361 20694 raft_consensus.cc:2272] T 5129c364c77d4587b6b661f3ced9de9f P ba84bb8af2ee40b79d4ce926958b2656 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.116415 20694 tablet_server.cc:196] TabletServer@127.20.53.131:0 shutdown complete.
I20260709 13:09:54.128499 20694 master.cc:562] Master@127.20.53.190:35561 shutting down...
I20260709 13:09:54.160857 20694 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:54.161427 20694 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:54.161746 20694 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7beb2e23bfd74420804f3d001ea9fbef: stopping tablet replica
I20260709 13:09:54.179551 20694 master.cc:584] Master@127.20.53.190:35561 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2639 ms)
[----------] 6 tests from LeaderRebalancerTest (327425 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:09:54.205737 20694 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.53.190:41279
I20260709 13:09:54.206910 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.211591 32463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.213191 32464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.213227 32466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.214046 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:54.214800 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.214970 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.215081 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602594215070 us; error 0 us; skew 500 ppm
I20260709 13:09:54.215526 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.217595 20694 webserver.cc:533] Webserver started at http://127.20.53.190:40343/ using document root <none> and password file <none>
I20260709 13:09:54.218005 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.218149 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.218641 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.219587 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/master-0-root/instance:
uuid: "4858c09d1e3c4963aa1e70677fe20969"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-r056"
I20260709 13:09:54.223696 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:09:54.226812 32471 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.227633 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:54.227913 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/master-0-root
uuid: "4858c09d1e3c4963aa1e70677fe20969"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-r056"
I20260709 13:09:54.228189 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.237592 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.238572 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:54.272320 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.190:41279
I20260709 13:09:54.272606 32522 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.190:41279 every 8 connection(s)
I20260709 13:09:54.276300 32523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.286918 32523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969: Bootstrap starting.
I20260709 13:09:54.291488 32523 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.295498 32523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969: No bootstrap required, opened a new log
I20260709 13:09:54.297541 32523 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4858c09d1e3c4963aa1e70677fe20969" member_type: VOTER }
I20260709 13:09:54.297921 32523 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.298105 32523 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4858c09d1e3c4963aa1e70677fe20969, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.298766 32523 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4858c09d1e3c4963aa1e70677fe20969" member_type: VOTER }
I20260709 13:09:54.299190 32523 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:54.299391 32523 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:54.299614 32523 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.304311 32523 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4858c09d1e3c4963aa1e70677fe20969" member_type: VOTER }
I20260709 13:09:54.304764 32523 leader_election.cc:304] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4858c09d1e3c4963aa1e70677fe20969; no voters: 
I20260709 13:09:54.305770 32523 leader_election.cc:290] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:54.306102 32526 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.307569 32526 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 1 LEADER]: Becoming Leader. State: Replica: 4858c09d1e3c4963aa1e70677fe20969, State: Running, Role: LEADER
I20260709 13:09:54.308197 32526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4858c09d1e3c4963aa1e70677fe20969" member_type: VOTER }
I20260709 13:09:54.308952 32523 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:54.311102 32527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4858c09d1e3c4963aa1e70677fe20969" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4858c09d1e3c4963aa1e70677fe20969" member_type: VOTER } }
I20260709 13:09:54.311129 32528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4858c09d1e3c4963aa1e70677fe20969. Latest consensus state: current_term: 1 leader_uuid: "4858c09d1e3c4963aa1e70677fe20969" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4858c09d1e3c4963aa1e70677fe20969" member_type: VOTER } }
I20260709 13:09:54.311857 32527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:54.311905 32528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:54.318032 32532 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:54.322698 32532 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:54.324540 20694 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:54.330945 32532 catalog_manager.cc:1383] Generated new cluster ID: e4bc7ec9a7d34b92b5da4b11487f73a8
I20260709 13:09:54.331212 32532 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:54.351480 32532 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:54.352736 32532 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:54.365116 32532 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969: Generated new TSK 0
I20260709 13:09:54.365710 32532 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:54.390852 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.396742 32544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.397559 32545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.399806 20694 server_base.cc:1061] running on GCE node
W20260709 13:09:54.399891 32547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.401027 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.401255 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.401432 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602594401414 us; error 0 us; skew 500 ppm
I20260709 13:09:54.401954 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.404100 20694 webserver.cc:533] Webserver started at http://127.20.53.129:43647/ using document root <none> and password file <none>
I20260709 13:09:54.404598 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.404800 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.405072 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.406124 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-0-root/instance:
uuid: "89be383f09f54ca8872d0be17a56d5ed"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-r056"
I20260709 13:09:54.410414 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:09:54.413558 32552 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.414376 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:54.414665 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "89be383f09f54ca8872d0be17a56d5ed"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-r056"
I20260709 13:09:54.414933 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.436939 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.438001 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:54.439405 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:54.441562 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:54.441774 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.442024 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:54.442209 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.478844 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:34193
I20260709 13:09:54.478966 32614 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:34193 every 8 connection(s)
I20260709 13:09:54.483608 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.491058 32619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.493037 32620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.495374 32622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.495647 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:54.496738 32615 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41279
I20260709 13:09:54.497180 32615 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:54.497490 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.497781 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.497985 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602594497966 us; error 0 us; skew 500 ppm
I20260709 13:09:54.498054 32615 heartbeater.cc:507] Master 127.20.53.190:41279 requested a full tablet report, sending...
I20260709 13:09:54.498811 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.500509 32488 ts_manager.cc:194] Registered new tserver with Master: 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193)
I20260709 13:09:54.501277 20694 webserver.cc:533] Webserver started at http://127.20.53.130:34149/ using document root <none> and password file <none>
I20260709 13:09:54.501802 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.501982 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.502302 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.502566 32488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33426
I20260709 13:09:54.503451 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-1-root/instance:
uuid: "72a878e935014cb8955c9f64f6101fb4"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-r056"
I20260709 13:09:54.508227 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:09:54.511286 32627 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.512010 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:54.512369 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-1-root
uuid: "72a878e935014cb8955c9f64f6101fb4"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-r056"
I20260709 13:09:54.512657 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.534299 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.535334 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:54.536779 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:54.538872 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:54.539090 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.539320 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:54.539489 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.575814 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.130:40277
I20260709 13:09:54.575919 32689 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.130:40277 every 8 connection(s)
I20260709 13:09:54.580386 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.587791 32693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.588758 32694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.590612 32696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.591477 20694 server_base.cc:1061] running on GCE node
I20260709 13:09:54.591924 32690 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41279
I20260709 13:09:54.592341 32690 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:54.592461 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.592764 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.592943 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602594592909 us; error 0 us; skew 500 ppm
I20260709 13:09:54.593137 32690 heartbeater.cc:507] Master 127.20.53.190:41279 requested a full tablet report, sending...
I20260709 13:09:54.593604 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.595448 32488 ts_manager.cc:194] Registered new tserver with Master: 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:54.596356 20694 webserver.cc:533] Webserver started at http://127.20.53.131:34761/ using document root <none> and password file <none>
I20260709 13:09:54.597011 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.597241 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.597236 32488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33432
I20260709 13:09:54.597833 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.599098 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-2-root/instance:
uuid: "d6e008eb0c464fdcb51bf031e95747ff"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-r056"
I20260709 13:09:54.603163 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:09:54.606135 32701 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.606942 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:54.607226 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-2-root
uuid: "d6e008eb0c464fdcb51bf031e95747ff"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-r056"
I20260709 13:09:54.607481 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602266622664-20694-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.635306 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.636389 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:54.637702 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:54.639854 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:54.640091 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.640326 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:54.640499 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.676678 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.131:42115
I20260709 13:09:54.676780 32763 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.131:42115 every 8 connection(s)
I20260709 13:09:54.689978 32764 heartbeater.cc:344] Connected to a master server at 127.20.53.190:41279
I20260709 13:09:54.690496 32764 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:54.691149 32764 heartbeater.cc:507] Master 127.20.53.190:41279 requested a full tablet report, sending...
I20260709 13:09:54.693125 32488 ts_manager.cc:194] Registered new tserver with Master: d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:54.694151 20694 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014403418s
I20260709 13:09:54.694723 32488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33440
I20260709 13:09:54.718001 32488 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33450:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:54.720515 32488 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:54.780440 32580 tablet_service.cc:1511] Processing CreateTablet for tablet d3e17bdfe31546f2978b0736a6e90c81 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:54.781845 32580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e17bdfe31546f2978b0736a6e90c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.783959 32579 tablet_service.cc:1511] Processing CreateTablet for tablet 96fe33ac241d4a17ae3ff2cac2e69154 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:54.785357 32579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96fe33ac241d4a17ae3ff2cac2e69154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.786628 32729 tablet_service.cc:1511] Processing CreateTablet for tablet d3e17bdfe31546f2978b0736a6e90c81 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:54.788039 32729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e17bdfe31546f2978b0736a6e90c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.787722 32578 tablet_service.cc:1511] Processing CreateTablet for tablet ee5f19c965c143288f7ac543ae7ed457 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:54.789068 32578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5f19c965c143288f7ac543ae7ed457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.791234 32728 tablet_service.cc:1511] Processing CreateTablet for tablet 96fe33ac241d4a17ae3ff2cac2e69154 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:54.792557 32728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96fe33ac241d4a17ae3ff2cac2e69154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.796072 32577 tablet_service.cc:1511] Processing CreateTablet for tablet 759a110f9adc49a2a115b82bacb3a5db (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:54.797465 32577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 759a110f9adc49a2a115b82bacb3a5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.797961 32726 tablet_service.cc:1511] Processing CreateTablet for tablet 759a110f9adc49a2a115b82bacb3a5db (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:54.799268 32726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 759a110f9adc49a2a115b82bacb3a5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.805474 32655 tablet_service.cc:1511] Processing CreateTablet for tablet d3e17bdfe31546f2978b0736a6e90c81 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:54.806792 32655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e17bdfe31546f2978b0736a6e90c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.808023 32575 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfc63f610db441897ead29829844c64 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:54.809384 32575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfc63f610db441897ead29829844c64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.810988 32576 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd6f57fa411407bb4e96c52bdba6a38 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:54.811187 32653 tablet_service.cc:1511] Processing CreateTablet for tablet ee5f19c965c143288f7ac543ae7ed457 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:54.812366 32576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd6f57fa411407bb4e96c52bdba6a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.813407 32652 tablet_service.cc:1511] Processing CreateTablet for tablet 759a110f9adc49a2a115b82bacb3a5db (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:54.812367 32653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5f19c965c143288f7ac543ae7ed457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.816860 32650 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfc63f610db441897ead29829844c64 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:54.819197 32725 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd6f57fa411407bb4e96c52bdba6a38 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:54.827550 32652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 759a110f9adc49a2a115b82bacb3a5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.827951 32651 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd6f57fa411407bb4e96c52bdba6a38 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:54.829278 32651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd6f57fa411407bb4e96c52bdba6a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.829998 32725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd6f57fa411407bb4e96c52bdba6a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.825598 32654 tablet_service.cc:1511] Processing CreateTablet for tablet 96fe33ac241d4a17ae3ff2cac2e69154 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:54.814563 32727 tablet_service.cc:1511] Processing CreateTablet for tablet ee5f19c965c143288f7ac543ae7ed457 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:54.832401 32727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5f19c965c143288f7ac543ae7ed457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.835111 32723 tablet_service.cc:1511] Processing CreateTablet for tablet 65bdb4ae94fe4639b500b49905248d33 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:54.838644 32724 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfc63f610db441897ead29829844c64 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:54.838687 32723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bdb4ae94fe4639b500b49905248d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.843619 32724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfc63f610db441897ead29829844c64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.844228 32649 tablet_service.cc:1511] Processing CreateTablet for tablet 65bdb4ae94fe4639b500b49905248d33 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:54.847123 32648 tablet_service.cc:1511] Processing CreateTablet for tablet 6969a626fc02497cacd42d4650bd9f5a (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:54.853967 32722 tablet_service.cc:1511] Processing CreateTablet for tablet 6969a626fc02497cacd42d4650bd9f5a (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:54.855712 32722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6969a626fc02497cacd42d4650bd9f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.859923 32574 tablet_service.cc:1511] Processing CreateTablet for tablet 65bdb4ae94fe4639b500b49905248d33 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:54.861701 32574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bdb4ae94fe4639b500b49905248d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.863590 32573 tablet_service.cc:1511] Processing CreateTablet for tablet 6969a626fc02497cacd42d4650bd9f5a (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:54.865383 32573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6969a626fc02497cacd42d4650bd9f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.867568 32572 tablet_service.cc:1511] Processing CreateTablet for tablet a7f4349baaa1435c8412f5134a4f9321 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:54.869832 32650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfc63f610db441897ead29829844c64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.870837 32572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f4349baaa1435c8412f5134a4f9321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.871135 32648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6969a626fc02497cacd42d4650bd9f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.872323 32649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bdb4ae94fe4639b500b49905248d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.891371 32654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96fe33ac241d4a17ae3ff2cac2e69154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.896878   311 tablet_bootstrap.cc:492] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:54.902045 32647 tablet_service.cc:1511] Processing CreateTablet for tablet a7f4349baaa1435c8412f5134a4f9321 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:54.902118 32721 tablet_service.cc:1511] Processing CreateTablet for tablet a7f4349baaa1435c8412f5134a4f9321 (DEFAULT_TABLE table=test-workload [id=2f1e5f63344248408f1b20b9880fb2d1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:54.918406 32721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f4349baaa1435c8412f5134a4f9321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.926476 32647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f4349baaa1435c8412f5134a4f9321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:54.926877   312 tablet_bootstrap.cc:492] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:54.941536   312 tablet_bootstrap.cc:654] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.955333   311 tablet_bootstrap.cc:654] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.973831   313 tablet_bootstrap.cc:492] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:54.977159   312 tablet_bootstrap.cc:492] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:54.977864   312 ts_tablet_manager.cc:1403] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:09:54.982522   313 tablet_bootstrap.cc:654] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.988492   311 tablet_bootstrap.cc:492] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:54.988909   311 ts_tablet_manager.cc:1403] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.021s
I20260709 13:09:54.989828   312 raft_consensus.cc:359] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:54.990934   312 raft_consensus.cc:385] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.991304   312 raft_consensus.cc:740] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.991276   311 raft_consensus.cc:359] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:54.992172   311 raft_consensus.cc:385] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.992497   311 raft_consensus.cc:740] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.993229   311 consensus_queue.cc:260] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:54.992717   312 consensus_queue.cc:260] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:54.998025   313 tablet_bootstrap.cc:492] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:54.998721   313 ts_tablet_manager.cc:1403] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 13:09:55.002099 32615 heartbeater.cc:499] Master 127.20.53.190:41279 was elected leader, sending a full tablet report...
I20260709 13:09:55.003234 32690 heartbeater.cc:499] Master 127.20.53.190:41279 was elected leader, sending a full tablet report...
I20260709 13:09:55.003636   312 ts_tablet_manager.cc:1434] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:09:55.004595   312 tablet_bootstrap.cc:492] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:55.006399   313 raft_consensus.cc:359] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.007112   313 raft_consensus.cc:385] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.007390   313 raft_consensus.cc:740] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.008219   313 consensus_queue.cc:260] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.008967   311 ts_tablet_manager.cc:1434] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.005s
I20260709 13:09:55.010243   311 tablet_bootstrap.cc:492] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:55.016224   311 tablet_bootstrap.cc:654] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.017699   313 ts_tablet_manager.cc:1434] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.007s
I20260709 13:09:55.018484 32764 heartbeater.cc:499] Master 127.20.53.190:41279 was elected leader, sending a full tablet report...
I20260709 13:09:55.020558   312 tablet_bootstrap.cc:654] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.026469   313 tablet_bootstrap.cc:492] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:55.029170   312 tablet_bootstrap.cc:492] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:55.029706   312 ts_tablet_manager.cc:1403] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:09:55.030992   311 tablet_bootstrap.cc:492] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:55.031569   311 ts_tablet_manager.cc:1403] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 13:09:55.032470   312 raft_consensus.cc:359] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.033232   312 raft_consensus.cc:385] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.033532   312 raft_consensus.cc:740] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.034413   312 consensus_queue.cc:260] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.034595   311 raft_consensus.cc:359] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.035400   311 raft_consensus.cc:385] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.035750   311 raft_consensus.cc:740] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.036561   311 consensus_queue.cc:260] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.037709   313 tablet_bootstrap.cc:654] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.038887   312 ts_tablet_manager.cc:1434] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:55.039017   311 ts_tablet_manager.cc:1434] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:55.039958   312 tablet_bootstrap.cc:492] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:55.040032   311 tablet_bootstrap.cc:492] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:55.045801   311 tablet_bootstrap.cc:654] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.046283   312 tablet_bootstrap.cc:654] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.049011   313 tablet_bootstrap.cc:492] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:55.049801   313 ts_tablet_manager.cc:1403] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 13:09:55.052632   313 raft_consensus.cc:359] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.053324   313 raft_consensus.cc:385] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.053627   313 raft_consensus.cc:740] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.054508   313 consensus_queue.cc:260] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.056813   313 ts_tablet_manager.cc:1434] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:09:55.057807   313 tablet_bootstrap.cc:492] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:55.071658   311 tablet_bootstrap.cc:492] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:55.073498   311 ts_tablet_manager.cc:1403] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.007s
I20260709 13:09:55.074520   313 tablet_bootstrap.cc:654] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.076380   311 raft_consensus.cc:359] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.076970   311 raft_consensus.cc:385] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.077178   311 raft_consensus.cc:740] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.071702   312 tablet_bootstrap.cc:492] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:55.078336   312 ts_tablet_manager.cc:1403] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.008s
I20260709 13:09:55.080542   313 tablet_bootstrap.cc:492] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:55.081182   313 ts_tablet_manager.cc:1403] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 13:09:55.082038   312 raft_consensus.cc:359] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.082706   312 raft_consensus.cc:385] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.082899   312 raft_consensus.cc:740] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.083500   312 consensus_queue.cc:260] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.084367   313 raft_consensus.cc:359] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.085084   313 raft_consensus.cc:385] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.085201   312 ts_tablet_manager.cc:1434] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:09:55.085419   313 raft_consensus.cc:740] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.086331   312 tablet_bootstrap.cc:492] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:55.086246   313 consensus_queue.cc:260] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.086464   311 consensus_queue.cc:260] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.088477   313 ts_tablet_manager.cc:1434] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:55.089488   313 tablet_bootstrap.cc:492] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:55.091413   311 ts_tablet_manager.cc:1434] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 13:09:55.092504   311 tablet_bootstrap.cc:492] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:55.095485   313 tablet_bootstrap.cc:654] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.098107   311 tablet_bootstrap.cc:654] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.098107   312 tablet_bootstrap.cc:654] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.107676   313 tablet_bootstrap.cc:492] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:55.108296   313 ts_tablet_manager.cc:1403] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:09:55.115631   313 raft_consensus.cc:359] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.120994   313 raft_consensus.cc:385] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.121367   313 raft_consensus.cc:740] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.122092   313 consensus_queue.cc:260] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.122488   312 tablet_bootstrap.cc:492] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:55.123284   312 ts_tablet_manager.cc:1403] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.008s
I20260709 13:09:55.125833   311 tablet_bootstrap.cc:492] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:55.126190   313 ts_tablet_manager.cc:1434] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 13:09:55.126457   311 ts_tablet_manager.cc:1403] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.019s
I20260709 13:09:55.126144   312 raft_consensus.cc:359] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.127044   312 raft_consensus.cc:385] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.127369   313 tablet_bootstrap.cc:492] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:55.127379   312 raft_consensus.cc:740] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.128413   312 consensus_queue.cc:260] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.130574   312 ts_tablet_manager.cc:1434] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:55.131603   312 tablet_bootstrap.cc:492] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:55.132822   311 raft_consensus.cc:359] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.136065   311 raft_consensus.cc:385] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.136412   311 raft_consensus.cc:740] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.137554   313 tablet_bootstrap.cc:654] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.138616   312 tablet_bootstrap.cc:654] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.139794   319 raft_consensus.cc:493] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.140293   319 raft_consensus.cc:515] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.137326   311 consensus_queue.cc:260] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.144074   312 tablet_bootstrap.cc:492] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:55.144605   312 ts_tablet_manager.cc:1403] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:09:55.146077   319 leader_election.cc:290] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:55.147467   312 raft_consensus.cc:359] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.148016   312 raft_consensus.cc:385] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.148200   312 raft_consensus.cc:740] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.148818   312 consensus_queue.cc:260] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.151063   312 ts_tablet_manager.cc:1434] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:55.154129   317 raft_consensus.cc:493] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.152078   312 tablet_bootstrap.cc:492] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:55.154654   317 raft_consensus.cc:515] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.160583   317 leader_election.cc:290] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.174757   311 ts_tablet_manager.cc:1434] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 13:09:55.175930   311 tablet_bootstrap.cc:492] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:55.188483   317 raft_consensus.cc:493] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.189182   312 tablet_bootstrap.cc:654] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.189074   317 raft_consensus.cc:515] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.191188   317 leader_election.cc:290] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.192699   313 tablet_bootstrap.cc:492] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:55.195355   311 tablet_bootstrap.cc:654] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.195498   313 ts_tablet_manager.cc:1403] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.020s
I20260709 13:09:55.195808 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:55.196758 32590 raft_consensus.cc:2468] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:09:55.198987 32702 leader_election.cc:304] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.200124   319 raft_consensus.cc:2804] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.200526   319 raft_consensus.cc:493] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.200935   319 raft_consensus.cc:3060] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.202845 32665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.203553 32665 raft_consensus.cc:2468] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:09:55.206275   317 raft_consensus.cc:493] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.206774   317 raft_consensus.cc:515] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.210047 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fe33ac241d4a17ae3ff2cac2e69154" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.209240   317 leader_election.cc:290] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.215551 32739 raft_consensus.cc:2468] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.210829 32738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.217430   313 raft_consensus.cc:359] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.217670   319 raft_consensus.cc:515] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.218333   313 raft_consensus.cc:385] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.219125   313 raft_consensus.cc:740] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.219229 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.219727 32738 raft_consensus.cc:2393] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89be383f09f54ca8872d0be17a56d5ed in current term 1: Already voted for candidate d6e008eb0c464fdcb51bf031e95747ff in this term.
I20260709 13:09:55.218806 32556 leader_election.cc:304] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.220320   313 consensus_queue.cc:260] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
W20260709 13:09:55.221556 32556 leader_election.cc:343] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.221614   317 raft_consensus.cc:2804] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.222154   317 raft_consensus.cc:493] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.222661   317 raft_consensus.cc:3060] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.226037   312 tablet_bootstrap.cc:492] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:55.226601   312 ts_tablet_manager.cc:1403] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.020s
I20260709 13:09:55.229588   312 raft_consensus.cc:359] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.230436   312 raft_consensus.cc:385] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.230721   312 raft_consensus.cc:740] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.231448   312 consensus_queue.cc:260] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.235373   312 ts_tablet_manager.cc:1434] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:55.236315   312 tablet_bootstrap.cc:492] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:55.238281   311 tablet_bootstrap.cc:492] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:55.238981   318 raft_consensus.cc:493] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.239645   318 raft_consensus.cc:515] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.238961   311 ts_tablet_manager.cc:1403] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.007s
I20260709 13:09:55.249217   318 leader_election.cc:290] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.231408   317 raft_consensus.cc:515] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.267186   319 leader_election.cc:290] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:55.271860 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:55.272713 32590 raft_consensus.cc:3060] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.277083   311 raft_consensus.cc:359] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.280025   317 leader_election.cc:290] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.280771   317 raft_consensus.cc:493] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.281313   317 raft_consensus.cc:515] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.282572   312 tablet_bootstrap.cc:654] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.282437 32738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fe33ac241d4a17ae3ff2cac2e69154" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:55.283363 32738 raft_consensus.cc:3060] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.286394   311 raft_consensus.cc:385] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.293368   318 raft_consensus.cc:493] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.293111   311 raft_consensus.cc:740] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.297705   318 raft_consensus.cc:515] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.299278   317 leader_election.cc:290] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.300489   318 leader_election.cc:290] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.300765   311 consensus_queue.cc:260] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.301347 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e17bdfe31546f2978b0736a6e90c81" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.302017 32739 raft_consensus.cc:2468] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.303148   311 ts_tablet_manager.cc:1434] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260709 13:09:55.303273 32556 leader_election.cc:304] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.304181   311 tablet_bootstrap.cc:492] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:55.307132 32665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fe33ac241d4a17ae3ff2cac2e69154" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.307483 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.307737 32665 raft_consensus.cc:2468] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.308149 32664 raft_consensus.cc:2468] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.309309 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.309724 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:55.310366 32664 raft_consensus.cc:3060] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.310704 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fe33ac241d4a17ae3ff2cac2e69154" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:55.311307 32662 raft_consensus.cc:3060] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.314587 32555 leader_election.cc:304] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:09:55.314654 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e17bdfe31546f2978b0736a6e90c81" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.315579 32661 raft_consensus.cc:2468] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.310022 32663 raft_consensus.cc:2468] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.317003 32590 raft_consensus.cc:2468] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:09:55.318245 32702 leader_election.cc:304] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
W20260709 13:09:55.319936 32536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:55.319969   337 raft_consensus.cc:2804] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.321192 32738 raft_consensus.cc:2468] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 1.
I20260709 13:09:55.321537   337 raft_consensus.cc:697] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:09:55.322458 32556 leader_election.cc:304] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.318444   313 ts_tablet_manager.cc:1434] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.123s	user 0.013s	sys 0.023s
I20260709 13:09:55.322620   337 consensus_queue.cc:237] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.323964   313 tablet_bootstrap.cc:492] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:55.324980 32662 raft_consensus.cc:2468] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 1.
I20260709 13:09:55.326823   341 raft_consensus.cc:2804] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.327312   341 raft_consensus.cc:493] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.327733   341 raft_consensus.cc:3060] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.321781 32664 raft_consensus.cc:2468] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:09:55.329767   317 raft_consensus.cc:2764] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:55.335186   311 tablet_bootstrap.cc:654] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.335644   317 raft_consensus.cc:2804] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.336221   317 raft_consensus.cc:697] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:09:55.337064   317 consensus_queue.cc:237] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.339874 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fe33ac241d4a17ae3ff2cac2e69154" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:55.340617   313 tablet_bootstrap.cc:654] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.341678 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:55.342335 32590 raft_consensus.cc:2468] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:09:55.344076 32628 leader_election.cc:304] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:09:55.345242   318 raft_consensus.cc:2804] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.345708   318 raft_consensus.cc:493] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.346192   318 raft_consensus.cc:3060] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.352936   313 tablet_bootstrap.cc:492] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:55.353503   313 ts_tablet_manager.cc:1403] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 13:09:55.356029   319 raft_consensus.cc:493] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.356560   319 raft_consensus.cc:515] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.356424   318 raft_consensus.cc:515] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.358978   319 leader_election.cc:290] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:55.360996 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.362090 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
W20260709 13:09:55.363966 32702 leader_election.cc:343] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:55.364823 32704 leader_election.cc:343] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.365249 32704 leader_election.cc:304] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6e008eb0c464fdcb51bf031e95747ff; no voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:09:55.366338   319 raft_consensus.cc:2749] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.366904   318 leader_election.cc:290] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.363253 32487 catalog_manager.cc:5697] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 1 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.367538 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:55.368152 32590 raft_consensus.cc:3060] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.376617 32590 raft_consensus.cc:2468] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:09:55.377900 32628 leader_election.cc:304] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:09:55.378737   318 raft_consensus.cc:2804] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.367501   313 raft_consensus.cc:359] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.379552   318 raft_consensus.cc:697] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:09:55.380733   318 consensus_queue.cc:237] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.379709   313 raft_consensus.cc:385] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.383879   313 raft_consensus.cc:740] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.384909   313 consensus_queue.cc:260] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.385246   341 raft_consensus.cc:515] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.386180 32738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fe33ac241d4a17ae3ff2cac2e69154" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.386976 32738 raft_consensus.cc:2393] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a878e935014cb8955c9f64f6101fb4 in current term 1: Already voted for candidate 89be383f09f54ca8872d0be17a56d5ed in this term.
I20260709 13:09:55.387893   313 ts_tablet_manager.cc:1434] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:09:55.387981 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.388908   313 tablet_bootstrap.cc:492] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:55.389312 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:55.390146   312 tablet_bootstrap.cc:492] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:55.390739   312 ts_tablet_manager.cc:1403] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.155s	user 0.043s	sys 0.036s
W20260709 13:09:55.391335 32555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.130:40277, user_credentials={real_user=slave}} blocked reactor thread for 76985.7us
I20260709 13:09:55.391402 32631 leader_election.cc:304] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4; no voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff
W20260709 13:09:55.392853 32631 leader_election.cc:343] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:55.393702 32631 leader_election.cc:343] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.393733 32555 leader_election.cc:304] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:09:55.394837   338 raft_consensus.cc:2749] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.395501   343 raft_consensus.cc:2764] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:55.395326   312 raft_consensus.cc:359] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.396423   312 raft_consensus.cc:385] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.396817   312 raft_consensus.cc:740] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.398967   341 leader_election.cc:290] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.399477 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e17bdfe31546f2978b0736a6e90c81" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:55.400121 32664 raft_consensus.cc:3060] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.400298 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e17bdfe31546f2978b0736a6e90c81" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:55.400910 32737 raft_consensus.cc:3060] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.405257   313 tablet_bootstrap.cc:654] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.402761   312 consensus_queue.cc:260] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.410583 32664 raft_consensus.cc:2468] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 1.
I20260709 13:09:55.410933   312 ts_tablet_manager.cc:1434] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:55.410599 32737 raft_consensus.cc:2468] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 1.
I20260709 13:09:55.411836 32555 leader_election.cc:304] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:09:55.412137   312 tablet_bootstrap.cc:492] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:55.413007   341 raft_consensus.cc:2804] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.413535   341 raft_consensus.cc:697] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:09:55.414824   341 consensus_queue.cc:237] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.417883 32487 catalog_manager.cc:5697] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.420451   312 tablet_bootstrap.cc:654] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.420989   311 tablet_bootstrap.cc:492] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:55.421483   311 ts_tablet_manager.cc:1403] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.020s
I20260709 13:09:55.424285   311 raft_consensus.cc:359] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.424947   311 raft_consensus.cc:385] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.425220   311 raft_consensus.cc:740] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.425978   311 consensus_queue.cc:260] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.428188   311 ts_tablet_manager.cc:1434] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:55.429134   311 tablet_bootstrap.cc:492] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:55.434321   313 tablet_bootstrap.cc:492] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:55.434834   313 ts_tablet_manager.cc:1403] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.000s
I20260709 13:09:55.435611   311 tablet_bootstrap.cc:654] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.437988   313 raft_consensus.cc:359] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.438925   313 raft_consensus.cc:385] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.439253   313 raft_consensus.cc:740] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.440037   313 consensus_queue.cc:260] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.441058   312 tablet_bootstrap.cc:492] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:55.441536   312 ts_tablet_manager.cc:1403] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 13:09:55.442593   313 ts_tablet_manager.cc:1434] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:55.443590   313 tablet_bootstrap.cc:492] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:55.444052   312 raft_consensus.cc:359] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.444737   312 raft_consensus.cc:385] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.444993   312 raft_consensus.cc:740] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.451077   313 tablet_bootstrap.cc:654] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.451344   311 tablet_bootstrap.cc:492] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:55.451845   311 ts_tablet_manager.cc:1403] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:09:55.455050   311 raft_consensus.cc:359] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.455747   311 raft_consensus.cc:385] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.456035   311 raft_consensus.cc:740] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.457440   341 raft_consensus.cc:493] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.445677   312 consensus_queue.cc:260] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.458002   341 raft_consensus.cc:515] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.459522   312 ts_tablet_manager.cc:1434] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:09:55.460421   341 leader_election.cc:290] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.460423   312 tablet_bootstrap.cc:492] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:55.456883   311 consensus_queue.cc:260] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.462824   311 ts_tablet_manager.cc:1434] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:09:55.464113   311 tablet_bootstrap.cc:492] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:55.465984 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc63f610db441897ead29829844c64" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.466671 32737 raft_consensus.cc:2468] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.469195   312 tablet_bootstrap.cc:654] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.470463   311 tablet_bootstrap.cc:654] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.471092 32556 leader_election.cc:304] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.461860 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc63f610db441897ead29829844c64" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.472066   341 raft_consensus.cc:2804] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.472445   341 raft_consensus.cc:493] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.472899   341 raft_consensus.cc:3060] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.477514 32487 catalog_manager.cc:5697] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 1 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.472393 32664 raft_consensus.cc:2468] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.479290 32487 catalog_manager.cc:5697] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 1 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.483290   341 raft_consensus.cc:515] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.484933   312 tablet_bootstrap.cc:492] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:55.485590   312 ts_tablet_manager.cc:1403] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 13:09:55.490988 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc63f610db441897ead29829844c64" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:55.491782 32737 raft_consensus.cc:3060] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.493155 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc63f610db441897ead29829844c64" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:55.493937 32664 raft_consensus.cc:3060] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.497426   341 leader_election.cc:290] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.507484   312 raft_consensus.cc:359] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.508158 32664 raft_consensus.cc:2468] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 1.
I20260709 13:09:55.508183   312 raft_consensus.cc:385] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.509047   312 raft_consensus.cc:740] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.509539   313 tablet_bootstrap.cc:492] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:55.510044   313 ts_tablet_manager.cc:1403] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.067s	user 0.038s	sys 0.018s
I20260709 13:09:55.509799   312 consensus_queue.cc:260] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.511547 32737 raft_consensus.cc:2468] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 1.
I20260709 13:09:55.512683 32555 leader_election.cc:304] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:09:55.512892   311 tablet_bootstrap.cc:492] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:55.514062   311 ts_tablet_manager.cc:1403] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.023s
I20260709 13:09:55.515506   313 raft_consensus.cc:359] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.516196   313 raft_consensus.cc:385] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.516499   313 raft_consensus.cc:740] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.517134   313 consensus_queue.cc:260] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.518709   311 raft_consensus.cc:359] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.519008   313 ts_tablet_manager.cc:1434] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:55.519526   311 raft_consensus.cc:385] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.519874   311 raft_consensus.cc:740] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.520238   313 tablet_bootstrap.cc:492] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:55.520586   312 ts_tablet_manager.cc:1434] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 13:09:55.520617   311 consensus_queue.cc:260] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.522902   311 ts_tablet_manager.cc:1434] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:55.523814   311 tablet_bootstrap.cc:492] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:55.526492   313 tablet_bootstrap.cc:654] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.519003   341 raft_consensus.cc:2804] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.528844   341 raft_consensus.cc:697] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:09:55.529922   311 tablet_bootstrap.cc:654] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.529922   341 consensus_queue.cc:237] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.546355   337 raft_consensus.cc:493] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.546813   337 raft_consensus.cc:515] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.548514   337 leader_election.cc:290] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:55.549238 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:55.549715 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.548038 32486 catalog_manager.cc:5697] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 1 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.551669   311 tablet_bootstrap.cc:492] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:55.550089 32590 raft_consensus.cc:2393] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6e008eb0c464fdcb51bf031e95747ff in current term 1: Already voted for candidate 72a878e935014cb8955c9f64f6101fb4 in this term.
I20260709 13:09:55.552439   311 ts_tablet_manager.cc:1403] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 13:09:55.552687   313 tablet_bootstrap.cc:492] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:55.553166   313 ts_tablet_manager.cc:1403] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.011s
I20260709 13:09:55.553188 32702 leader_election.cc:304] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6e008eb0c464fdcb51bf031e95747ff; no voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:09:55.554193   337 raft_consensus.cc:3060] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.554822   311 raft_consensus.cc:359] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.555486   311 raft_consensus.cc:385] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.555733   311 raft_consensus.cc:740] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.555910   313 raft_consensus.cc:359] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.556599   313 raft_consensus.cc:385] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.556358   311 consensus_queue.cc:260] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.556883   313 raft_consensus.cc:740] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.557698   313 consensus_queue.cc:260] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.558461   311 ts_tablet_manager.cc:1434] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:55.559870   313 ts_tablet_manager.cc:1434] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:55.561343   337 raft_consensus.cc:2749] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.562409   318 raft_consensus.cc:493] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.562902   318 raft_consensus.cc:515] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.564983   318 leader_election.cc:290] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.565502 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6f57fa411407bb4e96c52bdba6a38" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:55.566138 32590 raft_consensus.cc:2468] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:09:55.566416 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6f57fa411407bb4e96c52bdba6a38" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.567013 32737 raft_consensus.cc:2468] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:09:55.567982 32631 leader_election.cc:304] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.568740   318 raft_consensus.cc:2804] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.569124   318 raft_consensus.cc:493] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.569398   318 raft_consensus.cc:3060] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.574661   318 raft_consensus.cc:515] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.576189   318 leader_election.cc:290] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.576881 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6f57fa411407bb4e96c52bdba6a38" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:55.577091 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6f57fa411407bb4e96c52bdba6a38" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:55.577404 32590 raft_consensus.cc:3060] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.577740 32737 raft_consensus.cc:3060] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.582325 32590 raft_consensus.cc:2468] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:09:55.582751 32737 raft_consensus.cc:2468] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:09:55.583314 32628 leader_election.cc:304] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:09:55.584165   318 raft_consensus.cc:2804] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.584626   318 raft_consensus.cc:697] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:09:55.585387   318 consensus_queue.cc:237] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.591974 32488 catalog_manager.cc:5697] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.693912   318 raft_consensus.cc:493] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.694520   318 raft_consensus.cc:515] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.696290   318 leader_election.cc:290] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.697306 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f4349baaa1435c8412f5134a4f9321" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.697306 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f4349baaa1435c8412f5134a4f9321" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:55.698320 32737 raft_consensus.cc:2468] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:09:55.698417 32590 raft_consensus.cc:2468] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:09:55.699419 32631 leader_election.cc:304] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.700134   318 raft_consensus.cc:2804] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.700500   318 raft_consensus.cc:493] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.700801   318 raft_consensus.cc:3060] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.701151   337 raft_consensus.cc:493] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.701592   337 raft_consensus.cc:515] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.703156   337 leader_election.cc:290] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:55.703946 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6969a626fc02497cacd42d4650bd9f5a" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:55.704265 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6969a626fc02497cacd42d4650bd9f5a" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.704504 32590 raft_consensus.cc:2468] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:09:55.704948 32664 raft_consensus.cc:2468] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:09:55.705475 32702 leader_election.cc:304] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.706684   337 raft_consensus.cc:2804] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.707000   337 raft_consensus.cc:493] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.707273   337 raft_consensus.cc:3060] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.707600   318 raft_consensus.cc:515] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.709234   318 leader_election.cc:290] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.710275 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f4349baaa1435c8412f5134a4f9321" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:55.710157 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f4349baaa1435c8412f5134a4f9321" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:55.710912 32737 raft_consensus.cc:3060] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.711007 32590 raft_consensus.cc:3060] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.713780   337 raft_consensus.cc:515] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.715816 32737 raft_consensus.cc:2468] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:09:55.716228   337 leader_election.cc:290] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:55.716545 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6969a626fc02497cacd42d4650bd9f5a" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:55.717080 32589 raft_consensus.cc:3060] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.717738 32590 raft_consensus.cc:2468] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:09:55.721684 32589 raft_consensus.cc:2468] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:09:55.722985 32628 leader_election.cc:304] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:09:55.723387 32702 leader_election.cc:304] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.723618   318 raft_consensus.cc:2804] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.724156   318 raft_consensus.cc:697] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:09:55.724184   337 raft_consensus.cc:2804] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.724231 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6969a626fc02497cacd42d4650bd9f5a" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:55.725091   337 raft_consensus.cc:697] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:09:55.725107 32664 raft_consensus.cc:3060] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.725931   337 consensus_queue.cc:237] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.731555 32664 raft_consensus.cc:2468] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:09:55.725174   318 consensus_queue.cc:237] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.734097 32488 catalog_manager.cc:5697] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 1 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.740073 32486 catalog_manager.cc:5697] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.810963   343 consensus_queue.cc:1048] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.813621   343 consensus_queue.cc:1048] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.829876   343 consensus_queue.cc:1048] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:55.842760   341 consensus_queue.cc:1048] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:55.844573   341 raft_consensus.cc:493] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.845168   341 raft_consensus.cc:515] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.847790   341 leader_election.cc:290] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.853183 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.854122   318 raft_consensus.cc:493] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.854835   318 raft_consensus.cc:515] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.856815 32737 raft_consensus.cc:2468] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.857074 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:55.858035   318 leader_election.cc:290] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.857981 32556 leader_election.cc:304] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.858369 32664 raft_consensus.cc:2468] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
I20260709 13:09:55.858961   343 raft_consensus.cc:2804] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.859334   343 raft_consensus.cc:493] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.859702   343 raft_consensus.cc:3060] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.860169 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:09:55.860841 32737 raft_consensus.cc:2468] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:09:55.861963 32631 leader_election.cc:304] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:55.862833   318 raft_consensus.cc:2804] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.863197   318 raft_consensus.cc:493] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.863104 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:55.863970   318 raft_consensus.cc:3060] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.867756   343 raft_consensus.cc:515] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.868947 32589 raft_consensus.cc:2393] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a878e935014cb8955c9f64f6101fb4 in current term 1: Already voted for candidate 89be383f09f54ca8872d0be17a56d5ed in this term.
I20260709 13:09:55.872017 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:55.872918 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:55.873546 32739 raft_consensus.cc:3060] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.873672   318 raft_consensus.cc:515] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.874292   343 leader_election.cc:290] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.874887 32664 raft_consensus.cc:2393] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89be383f09f54ca8872d0be17a56d5ed in current term 1: Already voted for candidate 72a878e935014cb8955c9f64f6101fb4 in this term.
I20260709 13:09:55.877959   318 leader_election.cc:290] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:55.878547 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:55.878592 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:55.879592 32589 raft_consensus.cc:2393] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a878e935014cb8955c9f64f6101fb4 in current term 1: Already voted for candidate 89be383f09f54ca8872d0be17a56d5ed in this term.
I20260709 13:09:55.880594 32628 leader_election.cc:304] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4; no voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:09:55.881258   318 raft_consensus.cc:2749] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.881932 32739 raft_consensus.cc:2468] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 1.
I20260709 13:09:55.882887 32556 leader_election.cc:304] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 72a878e935014cb8955c9f64f6101fb4
I20260709 13:09:55.883459   343 raft_consensus.cc:2804] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.883909   343 raft_consensus.cc:697] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:09:55.884627   343 consensus_queue.cc:237] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:55.888535   337 consensus_queue.cc:1048] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.892275 32488 catalog_manager.cc:5697] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 1 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.900570   319 consensus_queue.cc:1048] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.918900   343 consensus_queue.cc:1048] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.928778   341 consensus_queue.cc:1048] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.934056   318 consensus_queue.cc:1048] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.949290   318 consensus_queue.cc:1048] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.970417 32739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
mode: GRACEFUL
new_leader_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:40610
I20260709 13:09:55.970916 32739 raft_consensus.cc:606] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Received request to transfer leadership to TS 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:09:55.982807 32664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
mode: GRACEFUL
new_leader_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:58964
I20260709 13:09:55.983312 32664 raft_consensus.cc:606] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Received request to transfer leadership to TS 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:09:55.998039 32589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dfc63f610db441897ead29829844c64"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
mode: GRACEFUL
new_leader_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:50826
I20260709 13:09:55.998627 32589 raft_consensus.cc:606] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Received request to transfer leadership to TS 72a878e935014cb8955c9f64f6101fb4
I20260709 13:09:56.003715 32589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
mode: GRACEFUL
new_leader_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:50826
I20260709 13:09:56.004217 32589 raft_consensus.cc:606] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Received request to transfer leadership to TS 72a878e935014cb8955c9f64f6101fb4
I20260709 13:09:56.009119 32739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6969a626fc02497cacd42d4650bd9f5a"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
mode: GRACEFUL
new_leader_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:40610
I20260709 13:09:56.009594 32739 raft_consensus.cc:606] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Received request to transfer leadership to TS 72a878e935014cb8955c9f64f6101fb4
I20260709 13:09:56.014410 32664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7f4349baaa1435c8412f5134a4f9321"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
mode: GRACEFUL
new_leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:58964
I20260709 13:09:56.014894 32664 raft_consensus.cc:606] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Received request to transfer leadership to TS d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:09:56.136504   318 consensus_queue.cc:1048] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.146971   318 consensus_queue.cc:1048] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.152899   318 consensus_queue.cc:1048] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.155450   338 raft_consensus.cc:993] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4: : Instructing follower d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:09:56.155917   318 raft_consensus.cc:1081] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Signalling peer d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:09:56.157371 32739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7f4349baaa1435c8412f5134a4f9321"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:09:56.157855 32739 raft_consensus.cc:493] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.158195 32739 raft_consensus.cc:3060] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.166606 32739 raft_consensus.cc:515] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.167582   338 consensus_queue.cc:1048] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.173099 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f4349baaa1435c8412f5134a4f9321" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:56.173436 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f4349baaa1435c8412f5134a4f9321" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:56.173666 32589 raft_consensus.cc:3060] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.174068 32664 raft_consensus.cc:3055] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:56.174427 32664 raft_consensus.cc:740] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:09:56.175190 32664 consensus_queue.cc:260] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.176268 32664 raft_consensus.cc:3060] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.180652 32589 raft_consensus.cc:2468] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 2.
I20260709 13:09:56.181305 32739 leader_election.cc:290] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 2 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:56.181885 32702 leader_election.cc:304] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:56.182833   376 raft_consensus.cc:2804] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:56.183306   376 raft_consensus.cc:697] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 2 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:09:56.184197   376 consensus_queue.cc:237] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.185003 32664 raft_consensus.cc:2468] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 2.
I20260709 13:09:56.195338 32486 catalog_manager.cc:5697] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 1 to 2, leader changed from 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130) to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 2 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.254560   376 consensus_queue.cc:1048] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.261670   319 raft_consensus.cc:993] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff: : Instructing follower 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:09:56.262193   337 raft_consensus.cc:1081] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Signalling peer 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:09:56.264012 32662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6969a626fc02497cacd42d4650bd9f5a"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:58944
I20260709 13:09:56.265061 32662 raft_consensus.cc:493] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.265475 32662 raft_consensus.cc:3060] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.269167   319 consensus_queue.cc:1048] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.272814 32662 raft_consensus.cc:515] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.277870 32662 leader_election.cc:290] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:56.278918 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6969a626fc02497cacd42d4650bd9f5a" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:56.279549 32590 raft_consensus.cc:3060] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.282588 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6969a626fc02497cacd42d4650bd9f5a" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:56.283203 32737 raft_consensus.cc:3055] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:56.283483 32737 raft_consensus.cc:740] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:09:56.284287 32737 consensus_queue.cc:260] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.285234 32737 raft_consensus.cc:3060] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.291069 32737 raft_consensus.cc:2468] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 2.
I20260709 13:09:56.291122 32590 raft_consensus.cc:2468] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 2.
I20260709 13:09:56.292450 32628 leader_election.cc:304] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:09:56.293252   338 raft_consensus.cc:2804] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:56.293731   338 raft_consensus.cc:697] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:09:56.294250   376 raft_consensus.cc:993] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff: : Instructing follower 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:09:56.294757   319 raft_consensus.cc:1081] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Signalling peer 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:09:56.294567   338 consensus_queue.cc:237] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.296475 32589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:50804
I20260709 13:09:56.297048 32589 raft_consensus.cc:493] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.297400 32589 raft_consensus.cc:3060] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.302690 32589 raft_consensus.cc:515] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.303058 32485 catalog_manager.cc:5697] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 1 to 2, leader changed from d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131) to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.304934 32589 leader_election.cc:290] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:56.305598 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:56.305601 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:56.306314 32664 raft_consensus.cc:3060] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.306488 32737 raft_consensus.cc:3055] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:56.306915 32737 raft_consensus.cc:740] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:09:56.307719 32737 consensus_queue.cc:260] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.308971 32737 raft_consensus.cc:3060] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.311630   341 consensus_queue.cc:1048] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.314344 32664 raft_consensus.cc:2468] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:09:56.315446 32555 leader_election.cc:304] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:09:56.315852 32737 raft_consensus.cc:2468] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:09:56.316406   341 raft_consensus.cc:2804] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:56.317055   341 raft_consensus.cc:697] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:09:56.317906   341 consensus_queue.cc:237] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.319459   343 raft_consensus.cc:993] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed: : Instructing follower 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:09:56.319900   344 raft_consensus.cc:1081] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Signalling peer 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:09:56.323975 32664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:58952
I20260709 13:09:56.324528 32664 raft_consensus.cc:493] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.324918 32664 raft_consensus.cc:3060] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.328390 32488 catalog_manager.cc:5697] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 1 to 2, leader changed from d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131) to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 2 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.330132 32664 raft_consensus.cc:515] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.331866   317 consensus_queue.cc:1048] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.332296 32664 leader_election.cc:290] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:56.332971 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:56.333550 32589 raft_consensus.cc:3055] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:56.333825 32589 raft_consensus.cc:740] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:09:56.334626 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65bdb4ae94fe4639b500b49905248d33" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:56.335112 32662 raft_consensus.cc:1240] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Rejecting Update request from peer 89be383f09f54ca8872d0be17a56d5ed for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:56.334753 32589 consensus_queue.cc:260] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.335786 32589 raft_consensus.cc:3060] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.343034 32589 raft_consensus.cc:2468] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 2.
I20260709 13:09:56.344203 32628 leader_election.cc:304] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:09:56.345343   338 raft_consensus.cc:2804] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:56.345808   338 raft_consensus.cc:697] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:09:56.346681   338 consensus_queue.cc:237] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.356740 32486 catalog_manager.cc:5697] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 1 to 2, leader changed from 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129) to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.360020   341 raft_consensus.cc:993] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed: : Instructing follower 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:09:56.360519   317 raft_consensus.cc:1081] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Signalling peer 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:09:56.362910 32662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dfc63f610db441897ead29829844c64"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:58952
I20260709 13:09:56.363360 32662 raft_consensus.cc:493] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.363668 32662 raft_consensus.cc:3060] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.369094 32662 raft_consensus.cc:515] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.370644 32662 leader_election.cc:290] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:56.371371 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc63f610db441897ead29829844c64" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:56.371666 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfc63f610db441897ead29829844c64" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:56.372027 32589 raft_consensus.cc:3055] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:56.372287 32737 raft_consensus.cc:3060] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.372394 32589 raft_consensus.cc:740] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:09:56.373292 32589 consensus_queue.cc:260] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.374569 32589 raft_consensus.cc:3060] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.379268 32737 raft_consensus.cc:2468] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 2.
I20260709 13:09:56.380491 32631 leader_election.cc:304] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:56.381371   387 raft_consensus.cc:2804] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:56.381214 32589 raft_consensus.cc:2468] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 2.
I20260709 13:09:56.381928   387 raft_consensus.cc:697] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:09:56.382820   387 consensus_queue.cc:237] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.388630 32488 catalog_manager.cc:5697] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 1 to 2, leader changed from 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129) to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.462387   338 raft_consensus.cc:993] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4: : Instructing follower 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:09:56.462845   387 raft_consensus.cc:1081] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Signalling peer 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:09:56.464255 32589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:50816
I20260709 13:09:56.464696 32589 raft_consensus.cc:493] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.464941 32589 raft_consensus.cc:3060] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.470904 32589 raft_consensus.cc:515] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.473256 32589 leader_election.cc:290] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:09:56.474327 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:09:56.475019 32662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "759a110f9adc49a2a115b82bacb3a5db" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:56.475246 32737 raft_consensus.cc:3060] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.475657 32662 raft_consensus.cc:3055] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:56.476017 32662 raft_consensus.cc:740] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:09:56.476754 32662 consensus_queue.cc:260] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.477679 32662 raft_consensus.cc:3060] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.480472 32737 raft_consensus.cc:2468] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:09:56.481462 32556 leader_election.cc:304] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:56.482263   317 raft_consensus.cc:2804] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:56.482570 32662 raft_consensus.cc:2468] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:09:56.482753   317 raft_consensus.cc:697] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:09:56.483834   317 consensus_queue.cc:237] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:56.490346 32488 catalog_manager.cc:5697] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 1 to 2, leader changed from 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130) to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 2 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.725973 32589 raft_consensus.cc:1275] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.727166   387 consensus_queue.cc:1048] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.729696 32737 raft_consensus.cc:3060] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.737887 32737 raft_consensus.cc:1275] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.739482   338 consensus_queue.cc:1048] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.747397 32737 raft_consensus.cc:1275] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.748556   338 consensus_queue.cc:1048] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.759460 32589 raft_consensus.cc:1275] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.761186   387 consensus_queue.cc:1048] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.796250 32662 raft_consensus.cc:1275] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.797542   376 consensus_queue.cc:1048] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.805895 32589 raft_consensus.cc:1275] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.807294   376 consensus_queue.cc:1048] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.828555 32590 raft_consensus.cc:1275] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.829926   387 consensus_queue.cc:1048] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.836830 32737 raft_consensus.cc:1275] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.839406   318 consensus_queue.cc:1048] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.877987 32662 raft_consensus.cc:1275] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.879374   344 consensus_queue.cc:1048] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.886832 32737 raft_consensus.cc:1275] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.888114 32664 raft_consensus.cc:1275] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.889869   341 consensus_queue.cc:1048] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.890667   344 consensus_queue.cc:1048] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.900225 32737 raft_consensus.cc:1275] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:56.903635   317 consensus_queue.cc:1048] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.083528 32486 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33458:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:59.087293 32486 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:59.153057 32573 tablet_service.cc:1511] Processing CreateTablet for tablet 3738d926afd6449da5e2def78cb4d0a9 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:59.154024 32648 tablet_service.cc:1511] Processing CreateTablet for tablet 3738d926afd6449da5e2def78cb4d0a9 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:59.155546 32573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3738d926afd6449da5e2def78cb4d0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.155962 32648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3738d926afd6449da5e2def78cb4d0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.159407 32649 tablet_service.cc:1511] Processing CreateTablet for tablet 65ca7289e349400ab78aa4a3fb0ef331 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:59.159883 32576 tablet_service.cc:1511] Processing CreateTablet for tablet 65ca7289e349400ab78aa4a3fb0ef331 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:59.160990 32649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ca7289e349400ab78aa4a3fb0ef331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.161654 32576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ca7289e349400ab78aa4a3fb0ef331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.168568 32721 tablet_service.cc:1511] Processing CreateTablet for tablet 3738d926afd6449da5e2def78cb4d0a9 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:59.169346 32722 tablet_service.cc:1511] Processing CreateTablet for tablet 65ca7289e349400ab78aa4a3fb0ef331 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:59.170332 32721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3738d926afd6449da5e2def78cb4d0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.171299 32722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ca7289e349400ab78aa4a3fb0ef331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.187899 32572 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee583e84f56436db93c1d1860e1a4e7 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:59.189608 32572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee583e84f56436db93c1d1860e1a4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.190758 32726 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee583e84f56436db93c1d1860e1a4e7 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:59.187901 32650 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee583e84f56436db93c1d1860e1a4e7 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:59.192410 32726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee583e84f56436db93c1d1860e1a4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.192754 32650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee583e84f56436db93c1d1860e1a4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.193027 32647 tablet_service.cc:1511] Processing CreateTablet for tablet d6171e8e160f428eb51ead9aaf020ee1 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:59.194438 32647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6171e8e160f428eb51ead9aaf020ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.196450 32575 tablet_service.cc:1511] Processing CreateTablet for tablet d6171e8e160f428eb51ead9aaf020ee1 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:59.197891 32575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6171e8e160f428eb51ead9aaf020ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.208003 32725 tablet_service.cc:1511] Processing CreateTablet for tablet d6171e8e160f428eb51ead9aaf020ee1 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:59.209640 32725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6171e8e160f428eb51ead9aaf020ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.214529 32574 tablet_service.cc:1511] Processing CreateTablet for tablet d8776e1b066d4903aa3929b1ca820c74 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:59.216077 32574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8776e1b066d4903aa3929b1ca820c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.223979 32724 tablet_service.cc:1511] Processing CreateTablet for tablet d8776e1b066d4903aa3929b1ca820c74 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:59.225533 32724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8776e1b066d4903aa3929b1ca820c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.227885 32649 tablet_service.cc:1511] Processing CreateTablet for tablet d8776e1b066d4903aa3929b1ca820c74 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:59.229359 32649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8776e1b066d4903aa3929b1ca820c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.232649   413 tablet_bootstrap.cc:492] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:59.241971   413 tablet_bootstrap.cc:654] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.301421   414 tablet_bootstrap.cc:492] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:59.373641   414 tablet_bootstrap.cc:654] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.381892   413 tablet_bootstrap.cc:492] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:59.382750   413 ts_tablet_manager.cc:1403] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.151s	user 0.035s	sys 0.022s
I20260709 13:09:59.387096   413 raft_consensus.cc:359] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.388096   413 raft_consensus.cc:385] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.388489   413 raft_consensus.cc:740] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
W20260709 13:09:59.388573 32536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:59.389461   413 consensus_queue.cc:260] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
W20260709 13:09:59.394899 32702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.129:34193, user_credentials={real_user=slave}} blocked reactor thread for 184827us
I20260709 13:09:59.398789   413 ts_tablet_manager.cc:1434] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:09:59.403118   413 tablet_bootstrap.cc:492] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:59.414995   414 tablet_bootstrap.cc:492] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:59.415729   414 ts_tablet_manager.cc:1403] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.009s
I20260709 13:09:59.429708   416 tablet_bootstrap.cc:492] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:59.442313   416 tablet_bootstrap.cc:654] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.449987   416 tablet_bootstrap.cc:492] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:59.450641   416 ts_tablet_manager.cc:1403] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.009s
I20260709 13:09:59.454289   416 raft_consensus.cc:359] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.455070   416 raft_consensus.cc:385] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.455423   416 raft_consensus.cc:740] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.456224   416 consensus_queue.cc:260] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.460280   416 ts_tablet_manager.cc:1434] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:09:59.461485   416 tablet_bootstrap.cc:492] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:59.469673   416 tablet_bootstrap.cc:654] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.477679   416 tablet_bootstrap.cc:492] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:59.478223   416 ts_tablet_manager.cc:1403] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.012s
I20260709 13:09:59.482964   416 raft_consensus.cc:359] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.483815   416 raft_consensus.cc:385] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.484134   416 raft_consensus.cc:740] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.485000   416 consensus_queue.cc:260] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.487988   416 ts_tablet_manager.cc:1434] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:59.488754   416 tablet_bootstrap.cc:492] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:59.489758 32576 tablet_service.cc:1511] Processing CreateTablet for tablet b62b37d34f614dc5bc07f8f2bec031de (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:59.490572 32573 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5357057b284fe6b68dfa449e0cb18f (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:59.491309 32576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62b37d34f614dc5bc07f8f2bec031de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.491554 32572 tablet_service.cc:1511] Processing CreateTablet for tablet 9b839ad053044fbbaedf17523ee7a341 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:59.491948 32573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5357057b284fe6b68dfa449e0cb18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.489840 32575 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9e198036084209af8b351ae8ae6c3c (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:59.492822 32572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b839ad053044fbbaedf17523ee7a341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.495443 32575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9e198036084209af8b351ae8ae6c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.497556   416 tablet_bootstrap.cc:654] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.512173   416 tablet_bootstrap.cc:492] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:59.512718   416 ts_tablet_manager.cc:1403] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 13:09:59.514374   414 raft_consensus.cc:359] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.515288   414 raft_consensus.cc:385] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.515661   414 raft_consensus.cc:740] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.515807   416 raft_consensus.cc:359] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.516635   416 raft_consensus.cc:385] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.517185   416 raft_consensus.cc:740] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.516669   414 consensus_queue.cc:260] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.518056   416 consensus_queue.cc:260] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.520684   414 ts_tablet_manager.cc:1434] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.105s	user 0.012s	sys 0.000s
I20260709 13:09:59.526932   416 ts_tablet_manager.cc:1434] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:59.528040   416 tablet_bootstrap.cc:492] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:59.533882   414 tablet_bootstrap.cc:492] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:59.544281   416 tablet_bootstrap.cc:654] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.550390   414 tablet_bootstrap.cc:654] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.557770   416 tablet_bootstrap.cc:492] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:59.558398   416 ts_tablet_manager.cc:1403] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.001s
I20260709 13:09:59.558629   414 tablet_bootstrap.cc:492] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:59.559152   414 ts_tablet_manager.cc:1403] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.011s
I20260709 13:09:59.561069 32724 tablet_service.cc:1511] Processing CreateTablet for tablet b62b37d34f614dc5bc07f8f2bec031de (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:59.561502   416 raft_consensus.cc:359] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.562356   416 raft_consensus.cc:385] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.562469 32724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62b37d34f614dc5bc07f8f2bec031de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.562222   414 raft_consensus.cc:359] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.562760   416 raft_consensus.cc:740] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.563072   414 raft_consensus.cc:385] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.563400   414 raft_consensus.cc:740] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.563617   416 consensus_queue.cc:260] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.564165   414 consensus_queue.cc:260] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.566339   416 ts_tablet_manager.cc:1434] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:59.562032 32726 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5357057b284fe6b68dfa449e0cb18f (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:59.567715   416 tablet_bootstrap.cc:492] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:59.568148 32726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5357057b284fe6b68dfa449e0cb18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.564230 32725 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9e198036084209af8b351ae8ae6c3c (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:59.574337 32725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9e198036084209af8b351ae8ae6c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.582144   413 tablet_bootstrap.cc:654] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.589928   416 tablet_bootstrap.cc:654] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.595062 32721 tablet_service.cc:1511] Processing CreateTablet for tablet 9b839ad053044fbbaedf17523ee7a341 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:59.596537 32721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b839ad053044fbbaedf17523ee7a341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.607863   420 raft_consensus.cc:493] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.608618   420 raft_consensus.cc:515] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
W20260709 13:09:59.612285 32472 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.53.129:34193, user_credentials={real_user=slave}} blocked reactor thread for 60468.2us
I20260709 13:09:59.631783 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:59.632866 32590 raft_consensus.cc:2468] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:09:59.634545 32702 leader_election.cc:304] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:59.636126   412 raft_consensus.cc:2804] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.636581   412 raft_consensus.cc:493] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.636987   412 raft_consensus.cc:3060] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.638729   420 leader_election.cc:290] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:59.640774 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:59.641525 32664 raft_consensus.cc:2468] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:09:59.677021   413 tablet_bootstrap.cc:492] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:59.677619   413 ts_tablet_manager.cc:1403] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.275s	user 0.040s	sys 0.020s
I20260709 13:09:59.681572   413 raft_consensus.cc:359] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.682569   413 raft_consensus.cc:385] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.683112   413 raft_consensus.cc:740] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.683916   399 raft_consensus.cc:493] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.684120   413 consensus_queue.cc:260] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.684458   399 raft_consensus.cc:515] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.688345 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:59.688724   416 tablet_bootstrap.cc:492] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:59.687065   399 leader_election.cc:290] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:59.689569 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:59.690378 32590 raft_consensus.cc:2468] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:09:59.690490   413 ts_tablet_manager.cc:1434] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:09:59.691847   413 tablet_bootstrap.cc:492] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:59.691962 32702 leader_election.cc:304] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:59.689603   416 ts_tablet_manager.cc:1403] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.122s	user 0.021s	sys 0.033s
W20260709 13:09:59.694064 32704 leader_election.cc:343] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.695078   399 raft_consensus.cc:2804] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.695713   399 raft_consensus.cc:493] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.696192   399 raft_consensus.cc:3060] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.697611   416 raft_consensus.cc:359] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.698666   416 raft_consensus.cc:385] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.699088   416 raft_consensus.cc:740] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.700079   416 consensus_queue.cc:260] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.704157   416 ts_tablet_manager.cc:1434] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:09:59.708076   420 raft_consensus.cc:493] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.708772   420 raft_consensus.cc:515] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.711539   420 leader_election.cc:290] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:59.712509 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:59.713160   416 tablet_bootstrap.cc:492] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:59.714274 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:59.715042 32664 raft_consensus.cc:2468] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:09:59.716295 32704 leader_election.cc:304] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:59.717060   420 raft_consensus.cc:2804] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.717500   420 raft_consensus.cc:493] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:59.717578 32702 leader_election.cc:343] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.717963   420 raft_consensus.cc:3060] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.720786   413 tablet_bootstrap.cc:654] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.735285   416 tablet_bootstrap.cc:654] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.743920   413 tablet_bootstrap.cc:492] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:59.753774 32649 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9e198036084209af8b351ae8ae6c3c (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:59.754078 32650 tablet_service.cc:1511] Processing CreateTablet for tablet b62b37d34f614dc5bc07f8f2bec031de (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:59.744172   399 raft_consensus.cc:515] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.755472 32649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9e198036084209af8b351ae8ae6c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.759042   416 tablet_bootstrap.cc:492] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:59.760152   416 ts_tablet_manager.cc:1403] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.000s
I20260709 13:09:59.756845   420 raft_consensus.cc:515] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.762012   399 leader_election.cc:290] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:59.744755   412 raft_consensus.cc:515] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.764197 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:59.761972   420 leader_election.cc:290] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:59.765743   416 raft_consensus.cc:359] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.766635   416 raft_consensus.cc:385] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.767012   416 raft_consensus.cc:740] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.767046 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:59.767413   414 ts_tablet_manager.cc:1434] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.208s	user 0.043s	sys 0.079s
I20260709 13:09:59.767756 32661 raft_consensus.cc:3060] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.765743   412 leader_election.cc:290] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:59.768167   416 consensus_queue.cc:260] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
W20260709 13:09:59.769853 32704 leader_election.cc:343] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.770723 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:09:59.771311 32663 raft_consensus.cc:3060] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.774422 32588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:59.775388 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
W20260709 13:09:59.775719 32702 leader_election.cc:343] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.775986 32589 raft_consensus.cc:3060] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.777447 32650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62b37d34f614dc5bc07f8f2bec031de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.785584   416 ts_tablet_manager.cc:1434] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 13:09:59.786741   416 tablet_bootstrap.cc:492] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:59.788025   414 tablet_bootstrap.cc:492] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:59.793733   416 tablet_bootstrap.cc:654] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.794615   412 raft_consensus.cc:493] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.794957   414 tablet_bootstrap.cc:654] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.795162   412 raft_consensus.cc:515] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.797458   412 leader_election.cc:290] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:59.756161   413 ts_tablet_manager.cc:1403] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.003s
I20260709 13:09:59.801139 32588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
W20260709 13:09:59.802742 32702 leader_election.cc:343] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.774704 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:09:59.802966 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:09:59.803845 32590 raft_consensus.cc:3060] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.804744 32704 leader_election.cc:343] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.804967 32663 raft_consensus.cc:2468] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:09:59.805249 32704 leader_election.cc:304] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6e008eb0c464fdcb51bf031e95747ff; no voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:09:59.806501   412 raft_consensus.cc:2749] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.807693 32704 leader_election.cc:304] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:09:59.808576   412 raft_consensus.cc:2804] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.809098   412 raft_consensus.cc:697] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:09:59.810178   412 consensus_queue.cc:237] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.810463   420 raft_consensus.cc:493] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.811122   420 raft_consensus.cc:515] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.813154   420 leader_election.cc:290] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:09:59.815332 32588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8776e1b066d4903aa3929b1ca820c74" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:09:59.815564 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8776e1b066d4903aa3929b1ca820c74" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
W20260709 13:09:59.816843 32702 leader_election.cc:343] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:59.818775 32704 leader_election.cc:343] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.818753 32648 tablet_service.cc:1511] Processing CreateTablet for tablet 9b839ad053044fbbaedf17523ee7a341 (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:59.819548 32704 leader_election.cc:304] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6e008eb0c464fdcb51bf031e95747ff; no voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:09:59.820592 32648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b839ad053044fbbaedf17523ee7a341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.820815   420 raft_consensus.cc:2749] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.822806 32647 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5357057b284fe6b68dfa449e0cb18f (DEFAULT_TABLE table=soft_deleted_table [id=76638bee208349a1a717f99d31faecb3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:59.824462 32647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5357057b284fe6b68dfa449e0cb18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.829123   413 raft_consensus.cc:359] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.840749 32661 raft_consensus.cc:2468] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:09:59.845610 32704 leader_election.cc:304] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:09:59.843034 32589 raft_consensus.cc:2468] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:09:59.843842 32590 raft_consensus.cc:2468] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:09:59.844508   413 raft_consensus.cc:385] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.846962   420 raft_consensus.cc:2804] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.848836   420 raft_consensus.cc:697] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:09:59.849690   420 consensus_queue.cc:237] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.854645 32702 leader_election.cc:304] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 72a878e935014cb8955c9f64f6101fb4
I20260709 13:09:59.856060   399 raft_consensus.cc:2804] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.861526   416 tablet_bootstrap.cc:492] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:59.862076   416 ts_tablet_manager.cc:1403] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.076s	user 0.005s	sys 0.014s
I20260709 13:09:59.865841   416 raft_consensus.cc:359] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.866796   416 raft_consensus.cc:385] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.867252   416 raft_consensus.cc:740] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.854210   413 raft_consensus.cc:740] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.868257   416 consensus_queue.cc:260] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.868688   413 consensus_queue.cc:260] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.871534   416 ts_tablet_manager.cc:1434] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:59.873569   416 tablet_bootstrap.cc:492] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:59.879980   413 ts_tablet_manager.cc:1434] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.001s
I20260709 13:09:59.881153   413 tablet_bootstrap.cc:492] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:59.888029 32487 catalog_manager.cc:5697] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 1 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.890270   414 tablet_bootstrap.cc:492] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:59.891040   414 ts_tablet_manager.cc:1403] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.122s	user 0.043s	sys 0.024s
I20260709 13:09:59.890157 32487 catalog_manager.cc:5697] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 1 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.891707   399 raft_consensus.cc:697] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:09:59.895130   399 consensus_queue.cc:237] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.896500   416 tablet_bootstrap.cc:654] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.903527   414 raft_consensus.cc:359] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.905112   414 raft_consensus.cc:385] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.905563   414 raft_consensus.cc:740] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.896660   413 tablet_bootstrap.cc:654] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.910338   414 consensus_queue.cc:260] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.925854   414 ts_tablet_manager.cc:1434] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:09:59.926851   414 tablet_bootstrap.cc:492] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:59.928911   416 tablet_bootstrap.cc:492] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:09:59.929508   416 ts_tablet_manager.cc:1403] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.011s
I20260709 13:09:59.930210   413 tablet_bootstrap.cc:492] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:59.930819   413 ts_tablet_manager.cc:1403] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.019s
I20260709 13:09:59.933218   416 raft_consensus.cc:359] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.936668   416 raft_consensus.cc:385] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.936921   414 tablet_bootstrap.cc:654] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.937033   416 raft_consensus.cc:740] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.933945   413 raft_consensus.cc:359] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.937923   413 raft_consensus.cc:385] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.938285   413 raft_consensus.cc:740] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.939075   413 consensus_queue.cc:260] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.941635   413 ts_tablet_manager.cc:1434] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:09:59.942155   416 consensus_queue.cc:260] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.944422   416 ts_tablet_manager.cc:1434] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:09:59.945377   416 tablet_bootstrap.cc:492] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff: Bootstrap starting.
I20260709 13:09:59.949769   414 tablet_bootstrap.cc:492] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:59.950351   414 ts_tablet_manager.cc:1403] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 13:09:59.950774   413 tablet_bootstrap.cc:492] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:59.953516   414 raft_consensus.cc:359] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.954238   414 raft_consensus.cc:385] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.954566   414 raft_consensus.cc:740] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.959196   416 tablet_bootstrap.cc:654] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.963773   413 tablet_bootstrap.cc:654] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.956180   414 consensus_queue.cc:260] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.968122   414 ts_tablet_manager.cc:1434] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:09:59.969156   414 tablet_bootstrap.cc:492] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:09:59.974378 32486 catalog_manager.cc:5697] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 1 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.975967   414 tablet_bootstrap.cc:654] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.984861   413 tablet_bootstrap.cc:492] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:09:59.985503   413 ts_tablet_manager.cc:1403] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.006s
I20260709 13:09:59.988600   413 raft_consensus.cc:359] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.989387   413 raft_consensus.cc:385] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.989728   413 raft_consensus.cc:740] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.990546   413 consensus_queue.cc:260] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:09:59.993463   413 ts_tablet_manager.cc:1434] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:09:59.994115   414 tablet_bootstrap.cc:492] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:09:59.994589   413 tablet_bootstrap.cc:492] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:09:59.994760   414 ts_tablet_manager.cc:1403] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.006s
I20260709 13:10:00.000036   425 raft_consensus.cc:493] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.000465   425 raft_consensus.cc:515] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.002095   413 tablet_bootstrap.cc:654] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.002756   425 leader_election.cc:290] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.004351 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:10:00.005172 32590 raft_consensus.cc:2393] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a878e935014cb8955c9f64f6101fb4 in current term 1: Already voted for candidate d6e008eb0c464fdcb51bf031e95747ff in this term.
I20260709 13:10:00.009884   416 tablet_bootstrap.cc:492] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff: No bootstrap required, opened a new log
I20260709 13:10:00.009886 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:10:00.010612   416 ts_tablet_manager.cc:1403] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.006s
I20260709 13:10:00.011941 32631 leader_election.cc:304] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4; no voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:10:00.012696   425 raft_consensus.cc:3060] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.013670   414 raft_consensus.cc:359] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.013737   416 raft_consensus.cc:359] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.014685   414 raft_consensus.cc:385] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.014825   416 raft_consensus.cc:385] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.015128   414 raft_consensus.cc:740] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.015261   416 raft_consensus.cc:740] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.016214   416 consensus_queue.cc:260] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.016244   414 consensus_queue.cc:260] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.018806   416 ts_tablet_manager.cc:1434] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:00.020026   425 raft_consensus.cc:2749] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.031142   414 ts_tablet_manager.cc:1434] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:10:00.032171   414 tablet_bootstrap.cc:492] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:10:00.039269   425 raft_consensus.cc:493] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.039842   425 raft_consensus.cc:515] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.041044   413 tablet_bootstrap.cc:492] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:10:00.041700   413 ts_tablet_manager.cc:1403] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.020s
I20260709 13:10:00.044332 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8776e1b066d4903aa3929b1ca820c74" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
W20260709 13:10:00.045902 32628 leader_election.cc:343] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.046332   413 raft_consensus.cc:359] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.047215   413 raft_consensus.cc:385] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.047556   413 raft_consensus.cc:740] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.048662   425 leader_election.cc:290] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.049774 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8776e1b066d4903aa3929b1ca820c74" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:10:00.050551 32739 raft_consensus.cc:2468] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:10:00.048331   413 consensus_queue.cc:260] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.051680 32631 leader_election.cc:304] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:10:00.049512   414 tablet_bootstrap.cc:654] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.053401   413 ts_tablet_manager.cc:1434] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:00.054325   425 raft_consensus.cc:2804] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.054591   413 tablet_bootstrap.cc:492] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:10:00.054831   425 raft_consensus.cc:493] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.055296   425 raft_consensus.cc:3060] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.063192   413 tablet_bootstrap.cc:654] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.063902   425 raft_consensus.cc:515] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.070262 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8776e1b066d4903aa3929b1ca820c74" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:00.070571 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8776e1b066d4903aa3929b1ca820c74" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.071135 32739 raft_consensus.cc:3060] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:00.071713 32628 leader_election.cc:343] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.074726   413 tablet_bootstrap.cc:492] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:10:00.075309   413 ts_tablet_manager.cc:1403] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.013s
I20260709 13:10:00.078758   425 leader_election.cc:290] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.078629   413 raft_consensus.cc:359] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.079597   413 raft_consensus.cc:385] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.079923   413 raft_consensus.cc:740] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.080528 32739 raft_consensus.cc:2468] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:10:00.080721   413 consensus_queue.cc:260] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.081890 32631 leader_election.cc:304] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:10:00.083138   414 tablet_bootstrap.cc:492] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:10:00.083069   425 raft_consensus.cc:2804] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.083878   425 raft_consensus.cc:697] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:10:00.083801   414 ts_tablet_manager.cc:1403] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.000s
I20260709 13:10:00.086063   413 ts_tablet_manager.cc:1434] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 13:10:00.086436   399 raft_consensus.cc:493] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.087216   413 tablet_bootstrap.cc:492] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:10:00.086938   399 raft_consensus.cc:515] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.089128   399 leader_election.cc:290] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:10:00.090886 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9e198036084209af8b351ae8ae6c3c" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:10:00.091511 32590 raft_consensus.cc:2468] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:10:00.092834 32702 leader_election.cc:304] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.094401   413 tablet_bootstrap.cc:654] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.094345 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9e198036084209af8b351ae8ae6c3c" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
W20260709 13:10:00.096061 32704 leader_election.cc:343] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.096529   425 consensus_queue.cc:237] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.097069   399 raft_consensus.cc:2804] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.097648   399 raft_consensus.cc:493] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.098052   399 raft_consensus.cc:3060] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.107954   414 raft_consensus.cc:359] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.108799   414 raft_consensus.cc:385] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.110493   414 raft_consensus.cc:740] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.111248   414 consensus_queue.cc:260] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.113425   399 raft_consensus.cc:515] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.114008 32486 catalog_manager.cc:5697] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.116344 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9e198036084209af8b351ae8ae6c3c" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:00.116914 32590 raft_consensus.cc:3060] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.115604   399 leader_election.cc:290] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:10:00.123060   414 ts_tablet_manager.cc:1434] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:10:00.123479 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9e198036084209af8b351ae8ae6c3c" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:00.124071 32661 raft_consensus.cc:3060] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.125233   414 tablet_bootstrap.cc:492] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:10:00.125806   413 tablet_bootstrap.cc:492] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:10:00.126345   413 ts_tablet_manager.cc:1403] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.019s
I20260709 13:10:00.129192   413 raft_consensus.cc:359] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.129899   413 raft_consensus.cc:385] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.130203   413 raft_consensus.cc:740] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.130913   413 consensus_queue.cc:260] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.131789   425 raft_consensus.cc:493] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.132284   425 raft_consensus.cc:515] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.133137   413 ts_tablet_manager.cc:1434] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:00.134250   425 leader_election.cc:290] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.134991   413 tablet_bootstrap.cc:492] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed: Bootstrap starting.
I20260709 13:10:00.135485 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:10:00.136128 32737 raft_consensus.cc:2468] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:10:00.136237 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:10:00.136914 32589 raft_consensus.cc:2468] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:10:00.137317 32631 leader_election.cc:304] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.138193   425 raft_consensus.cc:2804] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.138561   425 raft_consensus.cc:493] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.138895   425 raft_consensus.cc:3060] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.135485   414 tablet_bootstrap.cc:654] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.142128   413 tablet_bootstrap.cc:654] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.144111 32590 raft_consensus.cc:2468] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:10:00.145342 32702 leader_election.cc:304] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.146205   399 raft_consensus.cc:2804] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.146063   425 raft_consensus.cc:515] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.146715   399 raft_consensus.cc:697] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:00.147554   399 consensus_queue.cc:237] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.153646 32661 raft_consensus.cc:2468] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:10:00.156131   425 leader_election.cc:290] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.156904 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.157467 32737 raft_consensus.cc:3060] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.158557   398 raft_consensus.cc:493] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.159029   398 raft_consensus.cc:515] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.161192   398 leader_election.cc:290] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.164052 32738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:10:00.165515   431 raft_consensus.cc:493] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.165904 32737 raft_consensus.cc:2468] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:10:00.166074   431 raft_consensus.cc:515] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.167711 32631 leader_election.cc:304] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.168746   426 raft_consensus.cc:2804] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.169184 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8776e1b066d4903aa3929b1ca820c74" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:10:00.171077 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:10:00.169201   426 raft_consensus.cc:697] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:10:00.171821 32661 raft_consensus.cc:2393] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89be383f09f54ca8872d0be17a56d5ed in current term 1: Already voted for candidate d6e008eb0c464fdcb51bf031e95747ff in this term.
I20260709 13:10:00.172489   426 consensus_queue.cc:237] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.173381   431 leader_election.cc:290] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.175096 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:00.177497 32590 raft_consensus.cc:3060] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.178774 32556 leader_election.cc:304] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed; no voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:10:00.181277 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8776e1b066d4903aa3929b1ca820c74" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:10:00.182119 32739 raft_consensus.cc:2393] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89be383f09f54ca8872d0be17a56d5ed in current term 1: Already voted for candidate 72a878e935014cb8955c9f64f6101fb4 in this term.
I20260709 13:10:00.180318   431 raft_consensus.cc:3060] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.187613 32486 catalog_manager.cc:5697] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 1 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.190305   398 raft_consensus.cc:493] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.190562 32556 leader_election.cc:304] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed; no voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:10:00.190868   398 raft_consensus.cc:515] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.191519   422 raft_consensus.cc:3060] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.193154   398 leader_election.cc:290] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.194911 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5357057b284fe6b68dfa449e0cb18f" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:10:00.197049 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5357057b284fe6b68dfa449e0cb18f" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:10:00.197713 32739 raft_consensus.cc:2468] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 0.
W20260709 13:10:00.197810 32555 leader_election.cc:343] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.205015 32556 leader_election.cc:304] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 72a878e935014cb8955c9f64f6101fb4
I20260709 13:10:00.207650   398 raft_consensus.cc:2804] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.209803   413 tablet_bootstrap.cc:492] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed: No bootstrap required, opened a new log
I20260709 13:10:00.208813   398 raft_consensus.cc:493] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.210412   413 ts_tablet_manager.cc:1403] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.022s
I20260709 13:10:00.210549   398 raft_consensus.cc:3060] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.212940 32485 catalog_manager.cc:5697] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.222517   422 raft_consensus.cc:2749] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.223673   398 raft_consensus.cc:515] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.225131   431 raft_consensus.cc:2749] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.219918   413 raft_consensus.cc:359] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.225921   413 raft_consensus.cc:385] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.226226   413 raft_consensus.cc:740] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.227080   413 consensus_queue.cc:260] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.227793 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5357057b284fe6b68dfa449e0cb18f" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:00.229154   413 ts_tablet_manager.cc:1434] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
W20260709 13:10:00.229192 32555 leader_election.cc:343] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.233108   414 tablet_bootstrap.cc:492] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:10:00.233657   414 ts_tablet_manager.cc:1403] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.023s
I20260709 13:10:00.235543 32590 raft_consensus.cc:2468] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:10:00.236531   398 leader_election.cc:290] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.236697   414 raft_consensus.cc:359] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.237416   414 raft_consensus.cc:385] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.237924   414 raft_consensus.cc:740] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.238775 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5357057b284fe6b68dfa449e0cb18f" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.238902   414 consensus_queue.cc:260] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.239508 32739 raft_consensus.cc:3060] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.241582   414 ts_tablet_manager.cc:1434] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:10:00.242741   414 tablet_bootstrap.cc:492] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:10:00.249393   414 tablet_bootstrap.cc:654] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.258370 32739 raft_consensus.cc:2468] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 1.
I20260709 13:10:00.259718 32556 leader_election.cc:304] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 72a878e935014cb8955c9f64f6101fb4
I20260709 13:10:00.260552   398 raft_consensus.cc:2804] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.261045   398 raft_consensus.cc:697] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:10:00.261878   398 consensus_queue.cc:237] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.262418   414 tablet_bootstrap.cc:492] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:10:00.262955   414 ts_tablet_manager.cc:1403] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:10:00.267676   414 raft_consensus.cc:359] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.268424   414 raft_consensus.cc:385] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.268780   414 raft_consensus.cc:740] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.269471   414 consensus_queue.cc:260] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.271320   414 ts_tablet_manager.cc:1434] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:00.271265 32486 catalog_manager.cc:5697] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 1 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.272423   414 tablet_bootstrap.cc:492] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4: Bootstrap starting.
I20260709 13:10:00.278774   414 tablet_bootstrap.cc:654] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.284111   414 tablet_bootstrap.cc:492] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4: No bootstrap required, opened a new log
I20260709 13:10:00.284502   414 ts_tablet_manager.cc:1403] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:10:00.286332   414 raft_consensus.cc:359] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.286859   414 raft_consensus.cc:385] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.287056   414 raft_consensus.cc:740] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.287549   414 consensus_queue.cc:260] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.289134   414 ts_tablet_manager.cc:1434] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:00.317355   399 consensus_queue.cc:1048] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.318485   425 raft_consensus.cc:493] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.319049   425 raft_consensus.cc:515] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.321148   425 leader_election.cc:290] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.322114 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b37d34f614dc5bc07f8f2bec031de" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:10:00.322937 32590 raft_consensus.cc:2468] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:10:00.323526 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b37d34f614dc5bc07f8f2bec031de" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff" is_pre_election: true
I20260709 13:10:00.324223 32739 raft_consensus.cc:2468] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 0.
I20260709 13:10:00.324344 32628 leader_election.cc:304] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:10:00.325376   425 raft_consensus.cc:2804] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.325773   425 raft_consensus.cc:493] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.326125   425 raft_consensus.cc:3060] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.330826   420 consensus_queue.cc:1048] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.332046   399 raft_consensus.cc:493] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.332551   399 raft_consensus.cc:515] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.334014   425 raft_consensus.cc:515] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.336370 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b839ad053044fbbaedf17523ee7a341" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4" is_pre_election: true
I20260709 13:10:00.337335 32663 raft_consensus.cc:2468] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:10:00.337617   425 leader_election.cc:290] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.337671 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b839ad053044fbbaedf17523ee7a341" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed" is_pre_election: true
I20260709 13:10:00.338891 32589 raft_consensus.cc:2468] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 0.
I20260709 13:10:00.340502 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b37d34f614dc5bc07f8f2bec031de" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:00.340809 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b37d34f614dc5bc07f8f2bec031de" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.341032 32702 leader_election.cc:304] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.341681 32739 raft_consensus.cc:3060] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.341961   420 raft_consensus.cc:2804] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.342562   420 raft_consensus.cc:493] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.343003   420 raft_consensus.cc:3060] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.341069 32589 raft_consensus.cc:3060] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.345054   399 leader_election.cc:290] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:10:00.352547   438 consensus_queue.cc:1048] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:00.353368 32739 raft_consensus.cc:2468] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:10:00.353914   438 consensus_queue.cc:1048] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:00.354966 32631 leader_election.cc:304] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.356467   425 raft_consensus.cc:2804] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.356932   425 raft_consensus.cc:697] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:10:00.361652   425 consensus_queue.cc:237] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.366237 32589 raft_consensus.cc:2468] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 1.
I20260709 13:10:00.369443   420 raft_consensus.cc:515] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.372390 32587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b839ad053044fbbaedf17523ee7a341" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:00.373004 32587 raft_consensus.cc:3060] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.377619   420 leader_election.cc:290] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:10:00.377861   399 consensus_queue.cc:1048] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.380479 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b839ad053044fbbaedf17523ee7a341" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:00.381098 32661 raft_consensus.cc:3060] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.382103 32587 raft_consensus.cc:2468] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:10:00.383615 32702 leader_election.cc:304] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.384469   399 raft_consensus.cc:2804] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.384935   399 raft_consensus.cc:697] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:00.385722   399 consensus_queue.cc:237] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.391713 32661 raft_consensus.cc:2468] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 1.
I20260709 13:10:00.398799   420 consensus_queue.cc:1048] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:00.398020 32536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:00.407835 32486 catalog_manager.cc:5697] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 1 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.408776 32488 catalog_manager.cc:5697] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 1 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:00.427204 32611 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5ee0 after lost signal to thread 20697
W20260709 13:10:00.428454 32611 debug-util.cc:398] Leaking SignalData structure 0x7b080017dbe0 after lost signal to thread 32522
W20260709 13:10:00.429798 32611 debug-util.cc:398] Leaking SignalData structure 0x7b08000d21a0 after lost signal to thread 32614
W20260709 13:10:00.430997 32611 debug-util.cc:398] Leaking SignalData structure 0x7b080008d760 after lost signal to thread 32689
W20260709 13:10:00.431942 32611 debug-util.cc:398] Leaking SignalData structure 0x7b0800385180 after lost signal to thread 32763
I20260709 13:10:00.513293 32739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
mode: GRACEFUL
new_leader_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:40610
I20260709 13:10:00.514158 32739 raft_consensus.cc:606] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Received request to transfer leadership to TS 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:10:00.519565 32739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
mode: GRACEFUL
new_leader_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:40610
I20260709 13:10:00.520256 32739 raft_consensus.cc:606] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Received request to transfer leadership to TS 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:10:00.525323 32739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
mode: GRACEFUL
new_leader_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:40610
I20260709 13:10:00.525810 32739 raft_consensus.cc:606] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Received request to transfer leadership to TS 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:10:00.530514 32663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
mode: GRACEFUL
new_leader_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:58964
I20260709 13:10:00.530989 32663 raft_consensus.cc:606] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Received request to transfer leadership to TS 89be383f09f54ca8872d0be17a56d5ed
I20260709 13:10:00.537300   420 consensus_queue.cc:1048] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.538477 32739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c9e198036084209af8b351ae8ae6c3c"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
mode: GRACEFUL
new_leader_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:40610
I20260709 13:10:00.539112 32739 raft_consensus.cc:606] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Received request to transfer leadership to TS 72a878e935014cb8955c9f64f6101fb4
I20260709 13:10:00.549731 32739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b839ad053044fbbaedf17523ee7a341"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
mode: GRACEFUL
new_leader_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:40610
I20260709 13:10:00.550923   399 raft_consensus.cc:993] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff: : Instructing follower 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:10:00.551259 32739 raft_consensus.cc:606] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Received request to transfer leadership to TS 72a878e935014cb8955c9f64f6101fb4
I20260709 13:10:00.551514   399 raft_consensus.cc:1081] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Signalling peer 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:10:00.556346 32664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c9e198036084209af8b351ae8ae6c3c"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:58944
I20260709 13:10:00.556941 32664 raft_consensus.cc:493] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.557199 32664 raft_consensus.cc:3060] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.560925 32588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a5357057b284fe6b68dfa449e0cb18f"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
mode: GRACEFUL
new_leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:50826
I20260709 13:10:00.561610 32588 raft_consensus.cc:606] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Received request to transfer leadership to TS d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:10:00.563639   399 consensus_queue.cc:1048] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.569520 32664 raft_consensus.cc:515] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.572621 32588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9e198036084209af8b351ae8ae6c3c" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:00.573194 32588 raft_consensus.cc:3060] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.582738 32664 leader_election.cc:290] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.583259 32588 raft_consensus.cc:2468] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 2.
I20260709 13:10:00.583909 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9e198036084209af8b351ae8ae6c3c" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.584578 32739 raft_consensus.cc:3055] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.584911 32739 raft_consensus.cc:740] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:00.585125 32628 leader_election.cc:304] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:10:00.585952   425 raft_consensus.cc:2804] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.585780 32739 consensus_queue.cc:260] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.586462   425 raft_consensus.cc:697] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:10:00.587137 32739 raft_consensus.cc:3060] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.587316   425 consensus_queue.cc:237] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.596972 32488 catalog_manager.cc:5697] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 1 to 2, leader changed from d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131) to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.600883 32739 raft_consensus.cc:2468] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 2.
I20260709 13:10:00.643821   398 consensus_queue.cc:1048] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.651319   422 raft_consensus.cc:993] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed: : Instructing follower d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:00.651852   422 raft_consensus.cc:1081] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Signalling peer d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:00.654516 32739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a5357057b284fe6b68dfa449e0cb18f"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:40592
I20260709 13:10:00.655117 32739 raft_consensus.cc:493] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.655529 32739 raft_consensus.cc:3060] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.655825 32664 raft_consensus.cc:3060] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.664578 32739 raft_consensus.cc:515] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.665848 32737 raft_consensus.cc:1240] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Rejecting Update request from peer 89be383f09f54ca8872d0be17a56d5ed for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:00.667867 32588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5357057b284fe6b68dfa449e0cb18f" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:00.668588 32588 raft_consensus.cc:3055] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.668932 32588 raft_consensus.cc:740] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:10:00.669418   398 consensus_queue.cc:1048] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:00.670553   431 consensus_queue.cc:1059] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.673084 32588 consensus_queue.cc:260] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.674218 32588 raft_consensus.cc:3060] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.680250 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5357057b284fe6b68dfa449e0cb18f" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:00.680928 32663 raft_consensus.cc:3060] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.685153 32739 leader_election.cc:290] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 2 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:10:00.688851 32663 raft_consensus.cc:2468] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 2.
I20260709 13:10:00.690280 32588 raft_consensus.cc:2468] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 2.
I20260709 13:10:00.691323 32704 leader_election.cc:304] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.692242   399 raft_consensus.cc:2804] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.692744   399 raft_consensus.cc:697] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 2 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:00.693516   399 consensus_queue.cc:237] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.701392 32486 catalog_manager.cc:5697] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 1 to 2, leader changed from 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129) to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 2 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.718410   425 consensus_queue.cc:1048] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.726706   426 consensus_queue.cc:1048] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.734036   425 consensus_queue.cc:1048] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.755376   427 raft_consensus.cc:993] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4: : Instructing follower 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:10:00.755900   427 raft_consensus.cc:1081] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Signalling peer 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:10:00.758302 32588 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:50816
I20260709 13:10:00.759641 32588 raft_consensus.cc:493] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.760044 32588 raft_consensus.cc:3060] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.767073   425 consensus_queue.cc:1048] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.768028 32588 raft_consensus.cc:515] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.771160   399 consensus_queue.cc:1048] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.781683 32663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:00.782243 32588 leader_election.cc:290] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.782296 32663 raft_consensus.cc:3055] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.783118 32663 raft_consensus.cc:740] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:10:00.783965 32663 consensus_queue.cc:260] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.785017 32663 raft_consensus.cc:3060] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.786391 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6171e8e160f428eb51ead9aaf020ee1" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.798439 32737 raft_consensus.cc:3060] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.795610   420 raft_consensus.cc:993] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff: : Instructing follower 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:10:00.796507   399 consensus_queue.cc:1048] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.802759   420 raft_consensus.cc:1081] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Signalling peer 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:10:00.804903 32590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:50804
I20260709 13:10:00.807125 32590 raft_consensus.cc:493] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.807554 32590 raft_consensus.cc:3060] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.813124 32737 raft_consensus.cc:2468] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:10:00.819137   425 consensus_queue.cc:1048] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:00.822808 32663 raft_consensus.cc:2468] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:10:00.826519 32556 leader_election.cc:304] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.827414   398 raft_consensus.cc:2804] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.827880   398 raft_consensus.cc:697] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:10:00.828692   398 consensus_queue.cc:237] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.834622 32590 raft_consensus.cc:515] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.841038 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:00.841643 32664 raft_consensus.cc:3060] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.838346   438 raft_consensus.cc:993] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff: : Instructing follower 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:10:00.846869   438 raft_consensus.cc:1081] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Signalling peer 72a878e935014cb8955c9f64f6101fb4 to start an election
I20260709 13:10:00.850724 32661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b839ad053044fbbaedf17523ee7a341"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
 from {username='slave'} at 127.0.0.1:58944
I20260709 13:10:00.851251 32661 raft_consensus.cc:493] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.851927 32661 raft_consensus.cc:3060] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.854656 32664 raft_consensus.cc:2468] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:10:00.857026 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.859261 32737 raft_consensus.cc:3055] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.859565 32737 raft_consensus.cc:740] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:00.860339 32737 consensus_queue.cc:260] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.861285 32737 raft_consensus.cc:3060] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.861745   399 raft_consensus.cc:993] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff: : Instructing follower 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:10:00.862205   399 raft_consensus.cc:1081] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Signalling peer 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:10:00.863243 32486 catalog_manager.cc:5697] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 1 to 2, leader changed from 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130) to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 2 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.864045 32589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:50804
I20260709 13:10:00.857717   425 consensus_queue.cc:1048] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.864605 32589 raft_consensus.cc:493] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.864976 32589 raft_consensus.cc:3060] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.872985 32663 raft_consensus.cc:1240] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Rejecting Update request from peer d6e008eb0c464fdcb51bf031e95747ff for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:00.872226 32661 raft_consensus.cc:515] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.858618 32590 leader_election.cc:290] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.876799 32555 leader_election.cc:304] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:10:00.878192   398 raft_consensus.cc:2804] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.878250 32738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b839ad053044fbbaedf17523ee7a341" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.878919 32738 raft_consensus.cc:3055] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.879009   398 raft_consensus.cc:697] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:10:00.879268 32738 raft_consensus.cc:740] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:00.879720 32737 raft_consensus.cc:2468] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:10:00.880147 32738 consensus_queue.cc:260] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.879971   398 consensus_queue.cc:237] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.881311 32738 raft_consensus.cc:3060] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.884373 32661 leader_election.cc:290] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.891661 32589 raft_consensus.cc:515] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.895022 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b839ad053044fbbaedf17523ee7a341" candidate_uuid: "72a878e935014cb8955c9f64f6101fb4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:00.895792 32590 raft_consensus.cc:3060] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.897866 32738 raft_consensus.cc:2468] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 2.
I20260709 13:10:00.899439 32631 leader_election.cc:304] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.900315   425 raft_consensus.cc:2804] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.900765   425 raft_consensus.cc:697] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Becoming Leader. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:10:00.901584   425 consensus_queue.cc:237] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.902554 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:00.905099 32589 leader_election.cc:290] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.905364 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee583e84f56436db93c1d1860e1a4e7" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.903915 32661 raft_consensus.cc:3060] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.906030 32739 raft_consensus.cc:3055] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.906400 32739 raft_consensus.cc:740] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:00.907186 32739 consensus_queue.cc:260] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.908515 32739 raft_consensus.cc:3060] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.913714 32661 raft_consensus.cc:2468] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:10:00.915767 32739 raft_consensus.cc:2468] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:10:00.916653 32555 leader_election.cc:304] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, 89be383f09f54ca8872d0be17a56d5ed; no voters: 
I20260709 13:10:00.915354 32590 raft_consensus.cc:2468] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a878e935014cb8955c9f64f6101fb4 in term 2.
I20260709 13:10:00.916162 32487 catalog_manager.cc:5697] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 reported cstate change: term changed from 1 to 2, leader changed from d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131) to 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130). New cstate: current_term: 2 leader_uuid: "72a878e935014cb8955c9f64f6101fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.917917   398 raft_consensus.cc:2804] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.919034   398 raft_consensus.cc:697] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:10:00.919934   398 consensus_queue.cc:237] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.922475 32485 catalog_manager.cc:5697] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 1 to 2, leader changed from d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131) to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 2 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.946390 32485 catalog_manager.cc:5697] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 1 to 2, leader changed from d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131) to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 2 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.954186   438 raft_consensus.cc:993] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff: : Instructing follower 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:10:00.954686   420 raft_consensus.cc:1081] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Signalling peer 89be383f09f54ca8872d0be17a56d5ed to start an election
I20260709 13:10:00.956219 32590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
 from {username='slave'} at 127.0.0.1:50804
I20260709 13:10:00.956710 32590 raft_consensus.cc:493] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.957037 32590 raft_consensus.cc:3060] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.961655 32590 raft_consensus.cc:515] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.963137 32590 leader_election.cc:290] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Requested vote from peers 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277), d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131:42115)
I20260709 13:10:00.963855 32661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:00.964574 32661 raft_consensus.cc:3060] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.964658 32739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ca7289e349400ab78aa4a3fb0ef331" candidate_uuid: "89be383f09f54ca8872d0be17a56d5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
I20260709 13:10:00.965356 32739 raft_consensus.cc:3055] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.965687 32739 raft_consensus.cc:740] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:00.966485 32739 consensus_queue.cc:260] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.967407 32739 raft_consensus.cc:3060] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.971933 32739 raft_consensus.cc:2468] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:10:00.972401 32661 raft_consensus.cc:2468] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89be383f09f54ca8872d0be17a56d5ed in term 2.
I20260709 13:10:00.972875 32556 leader_election.cc:304] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:00.974398   398 raft_consensus.cc:2804] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.974972   398 raft_consensus.cc:697] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Becoming Leader. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:10:00.976423   398 consensus_queue.cc:237] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:00.984198 32486 catalog_manager.cc:5697] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed reported cstate change: term changed from 1 to 2, leader changed from d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131) to 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129). New cstate: current_term: 2 leader_uuid: "89be383f09f54ca8872d0be17a56d5ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.146415 32661 raft_consensus.cc:1275] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.147874   420 consensus_queue.cc:1048] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.150309 32590 raft_consensus.cc:1275] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.152158   425 consensus_queue.cc:1048] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.157882 32589 raft_consensus.cc:1275] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.160552   438 consensus_queue.cc:1048] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.173640 32739 raft_consensus.cc:1275] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.175052   427 consensus_queue.cc:1048] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.307634 32661 raft_consensus.cc:1275] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.309118   398 consensus_queue.cc:1048] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.319156 32739 raft_consensus.cc:1275] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.323285   398 consensus_queue.cc:1048] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.323644 32664 raft_consensus.cc:1275] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.325904 32661 raft_consensus.cc:1275] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.327085   398 consensus_queue.cc:1048] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.328151   485 consensus_queue.cc:1048] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.346029 32739 raft_consensus.cc:1275] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.347805   422 consensus_queue.cc:1048] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:01.364843 32738 raft_consensus.cc:1275] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.366452   398 consensus_queue.cc:1048] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.372740 32590 raft_consensus.cc:1275] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.379590   486 consensus_queue.cc:1048] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.389678 32738 raft_consensus.cc:1275] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 72a878e935014cb8955c9f64f6101fb4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.391336   426 consensus_queue.cc:1048] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.403034 32739 raft_consensus.cc:1275] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.404625   398 consensus_queue.cc:1048] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.417002 32661 raft_consensus.cc:1275] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer 89be383f09f54ca8872d0be17a56d5ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.418740   422 consensus_queue.cc:1048] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.565373 32485 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33458:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:03.586895 32485 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33458:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:03.685849 20694 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:10:03.734195 32556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42115, user_credentials={real_user=slave}} blocked reactor thread for 56408.9us
W20260709 13:10:03.797291   514 log.cc:927] Time spent T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
W20260709 13:10:03.800311   517 log.cc:927] Time spent T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:10:03.847954   536 tablet.cc:1724] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:03.916013 32616 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:65ca7289e349400ab78aa4a3fb0ef331)
I20260709 13:10:03.891355   543 tablet.cc:1724] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:03.926671 32616 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:65ca7289e349400ab78aa4a3fb0ef331)
W20260709 13:10:03.927531 32616 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:65ca7289e349400ab78aa4a3fb0ef331)
W20260709 13:10:03.929409 32556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42115, user_credentials={real_user=slave}} blocked reactor thread for 48281.9us
I20260709 13:10:03.947659   549 tablet.cc:1724] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:03.951116   545 tablet.cc:1724] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:03.931835   542 tablet.cc:1724] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:03.882318   534 tablet.cc:1724] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:03.967589   554 tablet.cc:1724] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:03.936070   546 tablet.cc:1724] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:03.998178 32556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:42115, user_credentials={real_user=slave}} blocked reactor thread for 67599.4us
I20260709 13:10:04.020753   550 tablet.cc:1724] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.033282   552 tablet.cc:1724] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.014350   543 tablet.cc:1724] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.038257   555 tablet.cc:1724] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.058243   534 tablet.cc:1724] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.059633   546 tablet.cc:1724] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.066474 32587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
mode: GRACEFUL
new_leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:48240
I20260709 13:10:04.067126 32587 raft_consensus.cc:606] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Received request to transfer leadership to TS d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:10:04.069613   513 raft_consensus.cc:993] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed: : Instructing follower d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:04.070071   513 raft_consensus.cc:1081] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Signalling peer d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:04.076193 32737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:40592
I20260709 13:10:04.076709 32737 raft_consensus.cc:493] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.077064 32737 raft_consensus.cc:3060] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.061326   542 tablet.cc:1724] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.084844 32737 raft_consensus.cc:515] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.087828 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:04.088340 32664 raft_consensus.cc:3060] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.089020   554 tablet.cc:1724] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.080487   536 tablet.cc:1724] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.093600 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3738d926afd6449da5e2def78cb4d0a9" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:04.094139 32590 raft_consensus.cc:3055] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:04.080353   557 tablet.cc:1724] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.095041 32590 raft_consensus.cc:740] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:10:04.098111 32664 raft_consensus.cc:2468] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 3.
I20260709 13:10:04.099201 32737 leader_election.cc:290] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 3 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:10:04.101245 32704 leader_election.cc:304] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:04.102128   438 raft_consensus.cc:2804] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:04.102631   438 raft_consensus.cc:697] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 3 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:04.103430   438 consensus_queue.cc:237] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.107496 32590 consensus_queue.cc:260] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.110232 32590 raft_consensus.cc:3060] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.115672   557 tablet.cc:1724] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.115736   552 tablet.cc:1724] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.121589 32487 catalog_manager.cc:5697] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 2 to 3, leader changed from 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129) to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 3 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.130023   545 tablet.cc:1724] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.130744   546 tablet.cc:1724] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.137578   543 tablet.cc:1724] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.159840   552 tablet.cc:1724] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.156167   546 tablet.cc:1724] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.172932   534 tablet.cc:1724] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.178670 32590 raft_consensus.cc:2468] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 3.
I20260709 13:10:04.190604 32664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b62b37d34f614dc5bc07f8f2bec031de"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
mode: GRACEFUL
new_leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:38922
I20260709 13:10:04.191202 32664 raft_consensus.cc:606] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Received request to transfer leadership to TS d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:10:04.193550 20694 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:04.194304 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:04.209277 32664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fd6f57fa411407bb4e96c52bdba6a38"
dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
mode: GRACEFUL
new_leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:38922
I20260709 13:10:04.209993 32664 raft_consensus.cc:606] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Received request to transfer leadership to TS d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:10:04.202157   552 tablet.cc:1724] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:04.219084 32590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457"
dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
mode: GRACEFUL
new_leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:48240
I20260709 13:10:04.220168 32590 raft_consensus.cc:606] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Received request to transfer leadership to TS d6e008eb0c464fdcb51bf031e95747ff
I20260709 13:10:04.227403 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:04.228153 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:04.249457 32486 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969: soft_deleted_table [id=76638bee208349a1a717f99d31faecb3] alter complete (version 1)
I20260709 13:10:04.327205   553 raft_consensus.cc:993] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed: : Instructing follower d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:04.327697   553 raft_consensus.cc:1081] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Signalling peer d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:04.329123 32737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:40592
I20260709 13:10:04.329625 32737 raft_consensus.cc:493] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.329929 32737 raft_consensus.cc:3060] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.334633 32737 raft_consensus.cc:515] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.336014 32737 leader_election.cc:290] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 3 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:10:04.336984 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:04.336910 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5f19c965c143288f7ac543ae7ed457" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:04.337723 32664 raft_consensus.cc:3060] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.337853 32590 raft_consensus.cc:3055] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:04.338335 32590 raft_consensus.cc:740] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89be383f09f54ca8872d0be17a56d5ed, State: Running, Role: LEADER
I20260709 13:10:04.339155 32590 consensus_queue.cc:260] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.341070 32590 raft_consensus.cc:3060] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.343655 32664 raft_consensus.cc:2468] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 3.
I20260709 13:10:04.344756 32704 leader_election.cc:304] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a878e935014cb8955c9f64f6101fb4, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:04.345575   520 raft_consensus.cc:2804] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:04.346045   520 raft_consensus.cc:697] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 3 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:04.346977   520 consensus_queue.cc:237] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.349119 32590 raft_consensus.cc:2468] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 3.
I20260709 13:10:04.358899 32487 catalog_manager.cc:5697] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 2 to 3, leader changed from 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129) to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 3 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.410989   522 raft_consensus.cc:993] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4: : Instructing follower d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:04.411582   528 raft_consensus.cc:1081] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Signalling peer d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:04.413115 32737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fd6f57fa411407bb4e96c52bdba6a38"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:10:04.413774 32737 raft_consensus.cc:493] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.414143 32737 raft_consensus.cc:3060] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.422276 32737 raft_consensus.cc:515] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.424516 32737 leader_election.cc:290] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 2 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:10:04.425192 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6f57fa411407bb4e96c52bdba6a38" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:04.425595 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6f57fa411407bb4e96c52bdba6a38" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:04.426841 32590 raft_consensus.cc:3060] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.426965 32664 raft_consensus.cc:3055] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:04.427501 32664 raft_consensus.cc:740] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:10:04.428366 32664 consensus_queue.cc:260] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.429804 32664 raft_consensus.cc:3060] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.431581 32590 raft_consensus.cc:2468] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 2.
I20260709 13:10:04.432785 32702 leader_election.cc:304] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:04.433481   520 raft_consensus.cc:2804] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:04.434648   520 raft_consensus.cc:697] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 2 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:04.435542   520 consensus_queue.cc:237] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.437232 32664 raft_consensus.cc:2468] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 2.
I20260709 13:10:04.444221 32487 catalog_manager.cc:5697] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 1 to 2, leader changed from 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130) to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 2 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.450707   522 raft_consensus.cc:993] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4: : Instructing follower d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:04.451260   522 raft_consensus.cc:1081] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Signalling peer d6e008eb0c464fdcb51bf031e95747ff to start an election
I20260709 13:10:04.453550 32738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b62b37d34f614dc5bc07f8f2bec031de"
dest_uuid: "d6e008eb0c464fdcb51bf031e95747ff"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:10:04.454402 32738 raft_consensus.cc:493] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.454876 32738 raft_consensus.cc:3060] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.463407 32738 raft_consensus.cc:515] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.465900 32738 leader_election.cc:290] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 2 election: Requested vote from peers 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193), 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277)
I20260709 13:10:04.466344 32590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b37d34f614dc5bc07f8f2bec031de" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "89be383f09f54ca8872d0be17a56d5ed"
I20260709 13:10:04.467031 32590 raft_consensus.cc:3060] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.466948 32664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b37d34f614dc5bc07f8f2bec031de" candidate_uuid: "d6e008eb0c464fdcb51bf031e95747ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "72a878e935014cb8955c9f64f6101fb4"
I20260709 13:10:04.468778 32664 raft_consensus.cc:3055] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:04.469122 32664 raft_consensus.cc:740] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72a878e935014cb8955c9f64f6101fb4, State: Running, Role: LEADER
I20260709 13:10:04.470005 32664 consensus_queue.cc:260] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.471218 32664 raft_consensus.cc:3060] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.475226 32590 raft_consensus.cc:2468] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 2.
I20260709 13:10:04.476246 32702 leader_election.cc:304] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89be383f09f54ca8872d0be17a56d5ed, d6e008eb0c464fdcb51bf031e95747ff; no voters: 
I20260709 13:10:04.477408   520 raft_consensus.cc:2804] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:04.478018   520 raft_consensus.cc:697] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 2 LEADER]: Becoming Leader. State: Replica: d6e008eb0c464fdcb51bf031e95747ff, State: Running, Role: LEADER
I20260709 13:10:04.478451 32664 raft_consensus.cc:2468] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e008eb0c464fdcb51bf031e95747ff in term 2.
I20260709 13:10:04.479079   520 consensus_queue.cc:237] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } }
I20260709 13:10:04.492031 32487 catalog_manager.cc:5697] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff reported cstate change: term changed from 1 to 2, leader changed from 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130) to d6e008eb0c464fdcb51bf031e95747ff (127.20.53.131). New cstate: current_term: 2 leader_uuid: "d6e008eb0c464fdcb51bf031e95747ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e008eb0c464fdcb51bf031e95747ff" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 42115 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.505548 32664 raft_consensus.cc:1275] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 3 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:04.506664   520 consensus_queue.cc:1048] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.517503 32590 raft_consensus.cc:1275] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 3 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:04.519901   563 consensus_queue.cc:1048] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.749282 32590 raft_consensus.cc:1275] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 3 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:04.750535   438 consensus_queue.cc:1048] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.752948 32664 raft_consensus.cc:1275] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 3 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:04.754419   563 consensus_queue.cc:1048] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.879318 32590 raft_consensus.cc:1275] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.880676   570 consensus_queue.cc:1048] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.892877 32664 raft_consensus.cc:1275] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.895294   438 consensus_queue.cc:1048] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:05.034696 32664 raft_consensus.cc:1275] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:05.035985   438 consensus_queue.cc:1048] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a878e935014cb8955c9f64f6101fb4" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.043434 32590 raft_consensus.cc:1275] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Refusing update from remote peer d6e008eb0c464fdcb51bf031e95747ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:05.045881   563 consensus_queue.cc:1048] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "89be383f09f54ca8872d0be17a56d5ed" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.294922 20694 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:05.303850 20694 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:05.304400 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:05.313114 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:05.313659 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:06.342211 20694 tablet_server.cc:179] TabletServer@127.20.53.129:0 shutting down...
W20260709 13:10:06.366140 32628 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:10:06.372885 32702 consensus_peers.cc:597] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff -> Peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Couldn't send request to peer 89be383f09f54ca8872d0be17a56d5ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.373013 32628 consensus_peers.cc:597] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 -> Peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Couldn't send request to peer 89be383f09f54ca8872d0be17a56d5ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.373245 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.374083 20694 tablet_replica.cc:333] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.374740 20694 raft_consensus.cc:2243] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.375221 20694 raft_consensus.cc:2272] T d8776e1b066d4903aa3929b1ca820c74 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.376993 20694 tablet_replica.cc:333] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.377561 20694 raft_consensus.cc:2243] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.377970 20694 raft_consensus.cc:2272] T 9b839ad053044fbbaedf17523ee7a341 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.379659 20694 tablet_replica.cc:333] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.380172 20694 raft_consensus.cc:2243] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.380554 20694 raft_consensus.cc:2272] T b62b37d34f614dc5bc07f8f2bec031de P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.382225 20694 tablet_replica.cc:333] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.382735 20694 raft_consensus.cc:2243] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.383131 20694 raft_consensus.cc:2272] T 3c9e198036084209af8b351ae8ae6c3c P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.384724 20694 tablet_replica.cc:333] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.385226 20694 raft_consensus.cc:2243] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.385624 20694 raft_consensus.cc:2272] T 9a5357057b284fe6b68dfa449e0cb18f P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.387363 20694 tablet_replica.cc:333] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.387866 20694 raft_consensus.cc:2243] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.388581 20694 raft_consensus.cc:2272] T d6171e8e160f428eb51ead9aaf020ee1 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.390309 20694 tablet_replica.cc:333] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.390852 20694 raft_consensus.cc:2243] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.391557 20694 raft_consensus.cc:2272] T 96fe33ac241d4a17ae3ff2cac2e69154 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.393517 20694 tablet_replica.cc:333] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.394007 20694 raft_consensus.cc:2243] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.394456 20694 raft_consensus.cc:2272] T 6969a626fc02497cacd42d4650bd9f5a P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.396522 20694 tablet_replica.cc:333] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.397027 20694 raft_consensus.cc:2243] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.397727 20694 raft_consensus.cc:2272] T 4ee583e84f56436db93c1d1860e1a4e7 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.399518 20694 tablet_replica.cc:333] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.400035 20694 raft_consensus.cc:2243] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.400478 20694 raft_consensus.cc:2272] T 65bdb4ae94fe4639b500b49905248d33 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.402438 20694 tablet_replica.cc:333] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.402944 20694 raft_consensus.cc:2243] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.403347 20694 raft_consensus.cc:2272] T 3fd6f57fa411407bb4e96c52bdba6a38 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.405162 20694 tablet_replica.cc:333] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.405678 20694 raft_consensus.cc:2243] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.406102 20694 raft_consensus.cc:2272] T ee5f19c965c143288f7ac543ae7ed457 P 89be383f09f54ca8872d0be17a56d5ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.408111 20694 tablet_replica.cc:333] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.408648 20694 raft_consensus.cc:2243] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.409425 20694 raft_consensus.cc:2272] T d3e17bdfe31546f2978b0736a6e90c81 P 89be383f09f54ca8872d0be17a56d5ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.411638 20694 tablet_replica.cc:333] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.412247 20694 raft_consensus.cc:2243] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.413072 20694 raft_consensus.cc:2272] T 65ca7289e349400ab78aa4a3fb0ef331 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.413991 32628 consensus_peers.cc:597] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 -> Peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Couldn't send request to peer 89be383f09f54ca8872d0be17a56d5ed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.415170 20694 tablet_replica.cc:333] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.415714 20694 raft_consensus.cc:2243] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.416368 20694 raft_consensus.cc:2272] T 759a110f9adc49a2a115b82bacb3a5db P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.418239 20694 tablet_replica.cc:333] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.418759 20694 raft_consensus.cc:2243] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.419143 20694 raft_consensus.cc:2272] T 2dfc63f610db441897ead29829844c64 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.421021 20694 tablet_replica.cc:333] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.421435 20694 raft_consensus.cc:2243] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.421753 20694 raft_consensus.cc:2272] T 3738d926afd6449da5e2def78cb4d0a9 P 89be383f09f54ca8872d0be17a56d5ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.423419 20694 tablet_replica.cc:333] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed: stopping tablet replica
I20260709 13:10:06.423888 20694 raft_consensus.cc:2243] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.424245 20694 raft_consensus.cc:2272] T a7f4349baaa1435c8412f5134a4f9321 P 89be383f09f54ca8872d0be17a56d5ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.489310 20694 tablet_server.cc:196] TabletServer@127.20.53.129:0 shutdown complete.
W20260709 13:10:06.498848 32702 consensus_peers.cc:597] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff -> Peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Couldn't send request to peer 89be383f09f54ca8872d0be17a56d5ed. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:34193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.517720 32628 consensus_peers.cc:597] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 -> Peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Couldn't send request to peer 89be383f09f54ca8872d0be17a56d5ed. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:34193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.528820 20694 tablet_server.cc:179] TabletServer@127.20.53.130:0 shutting down...
W20260709 13:10:06.550685 32702 consensus_peers.cc:597] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff -> Peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Couldn't send request to peer 89be383f09f54ca8872d0be17a56d5ed. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:34193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.559551 32704 consensus_peers.cc:597] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff -> Peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Couldn't send request to peer 72a878e935014cb8955c9f64f6101fb4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.561460 32628 consensus_peers.cc:597] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 -> Peer 89be383f09f54ca8872d0be17a56d5ed (127.20.53.129:34193): Couldn't send request to peer 89be383f09f54ca8872d0be17a56d5ed. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:34193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.567548 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.568245 20694 tablet_replica.cc:333] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.568837 20694 raft_consensus.cc:2243] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.569612 20694 raft_consensus.cc:2272] T 9b839ad053044fbbaedf17523ee7a341 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.571527 20694 tablet_replica.cc:333] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.572085 20694 raft_consensus.cc:2243] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.572494 20694 raft_consensus.cc:2272] T b62b37d34f614dc5bc07f8f2bec031de P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.574144 20694 tablet_replica.cc:333] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.574699 20694 raft_consensus.cc:2243] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.575121 20694 raft_consensus.cc:2272] T 9a5357057b284fe6b68dfa449e0cb18f P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.576727 20694 tablet_replica.cc:333] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.577244 20694 raft_consensus.cc:2243] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.577951 20694 raft_consensus.cc:2272] T 3c9e198036084209af8b351ae8ae6c3c P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.579692 20694 tablet_replica.cc:333] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.580200 20694 raft_consensus.cc:2243] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.580926 20694 raft_consensus.cc:2272] T d8776e1b066d4903aa3929b1ca820c74 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.582752 20694 tablet_replica.cc:333] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.583304 20694 raft_consensus.cc:2243] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.583743 20694 raft_consensus.cc:2272] T 4ee583e84f56436db93c1d1860e1a4e7 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.585458 20694 tablet_replica.cc:333] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.585979 20694 raft_consensus.cc:2243] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.586408 20694 raft_consensus.cc:2272] T d6171e8e160f428eb51ead9aaf020ee1 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.588174 20694 tablet_replica.cc:333] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.588738 20694 raft_consensus.cc:2243] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.589169 20694 raft_consensus.cc:2272] T 759a110f9adc49a2a115b82bacb3a5db P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.591214 20694 tablet_replica.cc:333] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.591742 20694 raft_consensus.cc:2243] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.592487 20694 raft_consensus.cc:2272] T 2dfc63f610db441897ead29829844c64 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.594591 20694 tablet_replica.cc:333] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.595101 20694 raft_consensus.cc:2243] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.595510 20694 raft_consensus.cc:2272] T 65ca7289e349400ab78aa4a3fb0ef331 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.597105 20694 tablet_replica.cc:333] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.597663 20694 raft_consensus.cc:2243] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.598079 20694 raft_consensus.cc:2272] T 96fe33ac241d4a17ae3ff2cac2e69154 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.600061 20694 tablet_replica.cc:333] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.600569 20694 raft_consensus.cc:2243] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.601310 20694 raft_consensus.cc:2272] T 6969a626fc02497cacd42d4650bd9f5a P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.603339 20694 tablet_replica.cc:333] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.603835 20694 raft_consensus.cc:2243] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.604594 20694 raft_consensus.cc:2272] T 65bdb4ae94fe4639b500b49905248d33 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.606478 20694 tablet_replica.cc:333] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.606979 20694 raft_consensus.cc:2243] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.607376 20694 raft_consensus.cc:2272] T ee5f19c965c143288f7ac543ae7ed457 P 72a878e935014cb8955c9f64f6101fb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.609202 20694 tablet_replica.cc:333] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.609705 20694 raft_consensus.cc:2243] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.610114 20694 raft_consensus.cc:2272] T d3e17bdfe31546f2978b0736a6e90c81 P 72a878e935014cb8955c9f64f6101fb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.611990 20694 tablet_replica.cc:333] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.612551 20694 raft_consensus.cc:2243] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.612946 20694 raft_consensus.cc:2272] T 3fd6f57fa411407bb4e96c52bdba6a38 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.614759 20694 tablet_replica.cc:333] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.615223 20694 raft_consensus.cc:2243] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.615638 20694 raft_consensus.cc:2272] T 3738d926afd6449da5e2def78cb4d0a9 P 72a878e935014cb8955c9f64f6101fb4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.617264 20694 tablet_replica.cc:333] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4: stopping tablet replica
I20260709 13:10:06.617717 20694 raft_consensus.cc:2243] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.618141 20694 raft_consensus.cc:2272] T a7f4349baaa1435c8412f5134a4f9321 P 72a878e935014cb8955c9f64f6101fb4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.655930 20694 tablet_server.cc:196] TabletServer@127.20.53.130:0 shutdown complete.
W20260709 13:10:06.688175 32704 consensus_peers.cc:597] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff -> Peer 72a878e935014cb8955c9f64f6101fb4 (127.20.53.130:40277): Couldn't send request to peer 72a878e935014cb8955c9f64f6101fb4. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.130:40277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.689384 20694 tablet_server.cc:179] TabletServer@127.20.53.131:0 shutting down...
I20260709 13:10:06.722322 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.723021 20694 tablet_replica.cc:333] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.723685 20694 raft_consensus.cc:2243] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.724555 20694 raft_consensus.cc:2272] T b62b37d34f614dc5bc07f8f2bec031de P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.726727 20694 tablet_replica.cc:333] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.727525 20694 raft_consensus.cc:2243] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.727959 20694 raft_consensus.cc:2272] T 9b839ad053044fbbaedf17523ee7a341 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.729749 20694 tablet_replica.cc:333] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.730327 20694 raft_consensus.cc:2243] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.731050 20694 raft_consensus.cc:2272] T 9a5357057b284fe6b68dfa449e0cb18f P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.732854 20694 tablet_replica.cc:333] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.733376 20694 raft_consensus.cc:2243] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.733837 20694 raft_consensus.cc:2272] T 3c9e198036084209af8b351ae8ae6c3c P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.735699 20694 tablet_replica.cc:333] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.736213 20694 raft_consensus.cc:2243] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.736605 20694 raft_consensus.cc:2272] T d8776e1b066d4903aa3929b1ca820c74 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.738390 20694 tablet_replica.cc:333] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.738888 20694 raft_consensus.cc:2243] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.739612 20694 raft_consensus.cc:2272] T 3738d926afd6449da5e2def78cb4d0a9 P d6e008eb0c464fdcb51bf031e95747ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.741520 20694 tablet_replica.cc:333] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.742038 20694 raft_consensus.cc:2243] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.742520 20694 raft_consensus.cc:2272] T 4ee583e84f56436db93c1d1860e1a4e7 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.744258 20694 tablet_replica.cc:333] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.744837 20694 raft_consensus.cc:2243] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.745237 20694 raft_consensus.cc:2272] T 2dfc63f610db441897ead29829844c64 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.747296 20694 tablet_replica.cc:333] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.747814 20694 raft_consensus.cc:2243] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.748209 20694 raft_consensus.cc:2272] T 759a110f9adc49a2a115b82bacb3a5db P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.750098 20694 tablet_replica.cc:333] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.750694 20694 raft_consensus.cc:2243] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.751087 20694 raft_consensus.cc:2272] T 65ca7289e349400ab78aa4a3fb0ef331 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.752841 20694 tablet_replica.cc:333] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.753348 20694 raft_consensus.cc:2243] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.753733 20694 raft_consensus.cc:2272] T d6171e8e160f428eb51ead9aaf020ee1 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.755447 20694 tablet_replica.cc:333] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.755930 20694 raft_consensus.cc:2243] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.756703 20694 raft_consensus.cc:2272] T a7f4349baaa1435c8412f5134a4f9321 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.758807 20694 tablet_replica.cc:333] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.759368 20694 raft_consensus.cc:2243] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.759750 20694 raft_consensus.cc:2272] T 96fe33ac241d4a17ae3ff2cac2e69154 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.761765 20694 tablet_replica.cc:333] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.762359 20694 raft_consensus.cc:2243] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.762758 20694 raft_consensus.cc:2272] T 6969a626fc02497cacd42d4650bd9f5a P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.764667 20694 tablet_replica.cc:333] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.765120 20694 raft_consensus.cc:2243] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.765817 20694 raft_consensus.cc:2272] T 3fd6f57fa411407bb4e96c52bdba6a38 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.767684 20694 tablet_replica.cc:333] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.768127 20694 raft_consensus.cc:2243] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.768502 20694 raft_consensus.cc:2272] T d3e17bdfe31546f2978b0736a6e90c81 P d6e008eb0c464fdcb51bf031e95747ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.770437 20694 tablet_replica.cc:333] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.770879 20694 raft_consensus.cc:2243] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.771574 20694 raft_consensus.cc:2272] T ee5f19c965c143288f7ac543ae7ed457 P d6e008eb0c464fdcb51bf031e95747ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.773339 20694 tablet_replica.cc:333] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff: stopping tablet replica
I20260709 13:10:06.773758 20694 raft_consensus.cc:2243] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.774127 20694 raft_consensus.cc:2272] T 65bdb4ae94fe4639b500b49905248d33 P d6e008eb0c464fdcb51bf031e95747ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.813277 20694 tablet_server.cc:196] TabletServer@127.20.53.131:0 shutdown complete.
I20260709 13:10:06.845476 20694 master.cc:562] Master@127.20.53.190:41279 shutting down...
I20260709 13:10:06.868227 20694 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.868772 20694 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.869067 20694 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4858c09d1e3c4963aa1e70677fe20969: stopping tablet replica
I20260709 13:10:06.889582 20694 master.cc:584] Master@127.20.53.190:41279 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12736 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:06.943153 20694 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.53.190:37137
I20260709 13:10:06.944211 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:06.949554   582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.950258   583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.950606   585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:06.951324 20694 server_base.cc:1061] running on GCE node
I20260709 13:10:06.952342 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:06.952538 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:06.952708 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602606952673 us; error 0 us; skew 500 ppm
I20260709 13:10:06.953217 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:06.955749 20694 webserver.cc:533] Webserver started at http://127.20.53.190:44027/ using document root <none> and password file <none>
I20260709 13:10:06.956233 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:06.956413 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:06.956708 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:06.957798 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/master-0-root/instance:
uuid: "8e5b0904b04e44a88164b43a769eba20"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r056"
I20260709 13:10:06.962612 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:10:06.966022   590 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.966811 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:06.967089 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/master-0-root
uuid: "8e5b0904b04e44a88164b43a769eba20"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r056"
I20260709 13:10:06.967338 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:06.979183 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:06.980314 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.021142 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.190:37137
I20260709 13:10:07.021255   641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.190:37137 every 8 connection(s)
I20260709 13:10:07.024922   642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.035334   642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20: Bootstrap starting.
I20260709 13:10:07.039841   642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.043803   642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20: No bootstrap required, opened a new log
I20260709 13:10:07.045828   642 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b0904b04e44a88164b43a769eba20" member_type: VOTER }
I20260709 13:10:07.046183   642 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.046448   642 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5b0904b04e44a88164b43a769eba20, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.046934   642 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b0904b04e44a88164b43a769eba20" member_type: VOTER }
I20260709 13:10:07.047384   642 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:07.047566   642 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:07.047770   642 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.052066   642 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b0904b04e44a88164b43a769eba20" member_type: VOTER }
I20260709 13:10:07.052492   642 leader_election.cc:304] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e5b0904b04e44a88164b43a769eba20; no voters: 
I20260709 13:10:07.053509   642 leader_election.cc:290] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:07.053825   645 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.055186   645 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 1 LEADER]: Becoming Leader. State: Replica: 8e5b0904b04e44a88164b43a769eba20, State: Running, Role: LEADER
I20260709 13:10:07.055804   645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b0904b04e44a88164b43a769eba20" member_type: VOTER }
I20260709 13:10:07.056380   642 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:07.060593   647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e5b0904b04e44a88164b43a769eba20. Latest consensus state: current_term: 1 leader_uuid: "8e5b0904b04e44a88164b43a769eba20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b0904b04e44a88164b43a769eba20" member_type: VOTER } }
I20260709 13:10:07.060724   646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e5b0904b04e44a88164b43a769eba20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5b0904b04e44a88164b43a769eba20" member_type: VOTER } }
I20260709 13:10:07.061769   647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:07.061785   646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:07.064883   652 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:07.070261   652 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:07.072499 20694 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:07.078990   652 catalog_manager.cc:1383] Generated new cluster ID: f446f706f4f042c09ae563f8bfe9bfc8
I20260709 13:10:07.079257   652 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:07.097064   652 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:07.098340   652 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:07.114249   652 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20: Generated new TSK 0
I20260709 13:10:07.114867   652 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:07.138897 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.145025   663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.145867   664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.148659 20694 server_base.cc:1061] running on GCE node
W20260709 13:10:07.149441   666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.150455 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.150635 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.150851 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602607150815 us; error 0 us; skew 500 ppm
I20260709 13:10:07.151389 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.153563 20694 webserver.cc:533] Webserver started at http://127.20.53.129:34287/ using document root <none> and password file <none>
I20260709 13:10:07.154031 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.154239 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.154533 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.155622 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-0-root/instance:
uuid: "bd9a363b972040448b83c054f8ec1c49"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-r056"
I20260709 13:10:07.160006 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:10:07.163086   671 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.163800 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:10:07.164083 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-0-root
uuid: "bd9a363b972040448b83c054f8ec1c49"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-r056"
I20260709 13:10:07.164335 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.185024 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.186241 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.187695 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:07.189930 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:07.190157 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.190451 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:07.190636 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.229401 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.129:43503
I20260709 13:10:07.229513   733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.129:43503 every 8 connection(s)
I20260709 13:10:07.234372 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.240710   738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.241545   739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.244742 20694 server_base.cc:1061] running on GCE node
W20260709 13:10:07.245330   741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.246491 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.246755 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.246954 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602607246937 us; error 0 us; skew 500 ppm
I20260709 13:10:07.247721 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.248319   734 heartbeater.cc:344] Connected to a master server at 127.20.53.190:37137
I20260709 13:10:07.248742   734 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:07.249576   734 heartbeater.cc:507] Master 127.20.53.190:37137 requested a full tablet report, sending...
I20260709 13:10:07.250360 20694 webserver.cc:533] Webserver started at http://127.20.53.130:44211/ using document root <none> and password file <none>
I20260709 13:10:07.251034 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.251291 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.251602 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.251910   607 ts_manager.cc:194] Registered new tserver with Master: bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503)
I20260709 13:10:07.253075 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-1-root/instance:
uuid: "0920d2f774f14e05961d4af4689dd22c"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-r056"
I20260709 13:10:07.254472   607 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58738
I20260709 13:10:07.258462 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:10:07.261777   746 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.262543 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:07.262825 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-1-root
uuid: "0920d2f774f14e05961d4af4689dd22c"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-r056"
I20260709 13:10:07.263113 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.292301 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.293376 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.294726 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:07.296804 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:07.297034 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.297272 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:07.297441 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.336380 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.130:33457
I20260709 13:10:07.336481   808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.130:33457 every 8 connection(s)
I20260709 13:10:07.341007 20694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.348419   812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.350131   813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.352909   815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.353574 20694 server_base.cc:1061] running on GCE node
I20260709 13:10:07.354486   809 heartbeater.cc:344] Connected to a master server at 127.20.53.190:37137
I20260709 13:10:07.354779 20694 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:07.354918   809 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:07.355100 20694 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.355325 20694 hybrid_clock.cc:648] HybridClock initialized: now 1783602607355307 us; error 0 us; skew 500 ppm
I20260709 13:10:07.355839   809 heartbeater.cc:507] Master 127.20.53.190:37137 requested a full tablet report, sending...
I20260709 13:10:07.356129 20694 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.358115   607 ts_manager.cc:194] Registered new tserver with Master: 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:07.358911 20694 webserver.cc:533] Webserver started at http://127.20.53.131:32901/ using document root <none> and password file <none>
I20260709 13:10:07.359444 20694 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.359671 20694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.359750   607 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58742
I20260709 13:10:07.360019 20694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.361538 20694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-2-root/instance:
uuid: "932f8c79c2f948328f8084f7e69845bf"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-r056"
I20260709 13:10:07.366241 20694 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:07.369762   820 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.370569 20694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:07.370882 20694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-2-root
uuid: "932f8c79c2f948328f8084f7e69845bf"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-r056"
I20260709 13:10:07.371189 20694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskgIALnR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602266622664-20694-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.391428 20694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:07.392549 20694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:07.393962 20694 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:07.396116 20694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:07.396350 20694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.396595 20694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:07.396780 20694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.435413 20694 rpc_server.cc:307] RPC server started. Bound to: 127.20.53.131:34643
I20260709 13:10:07.435585   882 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.53.131:34643 every 8 connection(s)
I20260709 13:10:07.449357   883 heartbeater.cc:344] Connected to a master server at 127.20.53.190:37137
I20260709 13:10:07.449872   883 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:07.450672   883 heartbeater.cc:507] Master 127.20.53.190:37137 requested a full tablet report, sending...
I20260709 13:10:07.452747   607 ts_manager.cc:194] Registered new tserver with Master: 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:07.453235 20694 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014658289s
I20260709 13:10:07.454244   607 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58754
I20260709 13:10:07.479478   607 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58766:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:07.481827   607 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:07.556752   848 tablet_service.cc:1511] Processing CreateTablet for tablet a9aaf50aca194185bd1d3ecb6368763f (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:07.558667   774 tablet_service.cc:1511] Processing CreateTablet for tablet a9aaf50aca194185bd1d3ecb6368763f (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:07.560053   774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9aaf50aca194185bd1d3ecb6368763f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.563632   843 tablet_service.cc:1511] Processing CreateTablet for tablet 17f08d6500ef4a30a3a7932a9be8403f (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:07.563872   846 tablet_service.cc:1511] Processing CreateTablet for tablet 22bf5ddd67b84506b0e7f385f47139f5 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:07.567337   844 tablet_service.cc:1511] Processing CreateTablet for tablet af1a5523ed8d4da9ad0559069a6d1116 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:07.569204   845 tablet_service.cc:1511] Processing CreateTablet for tablet 1f24b4f3428140d0904166a3f7d53166 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:07.559641   847 tablet_service.cc:1511] Processing CreateTablet for tablet 3a3f9ad8b43a4f0893222f9de7142fc4 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:07.571587   848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9aaf50aca194185bd1d3ecb6368763f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.572324   845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f24b4f3428140d0904166a3f7d53166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.574501   843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f08d6500ef4a30a3a7932a9be8403f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.575196   844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1a5523ed8d4da9ad0559069a6d1116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.578531   847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a3f9ad8b43a4f0893222f9de7142fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.579694   773 tablet_service.cc:1511] Processing CreateTablet for tablet 3a3f9ad8b43a4f0893222f9de7142fc4 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:07.581066   773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a3f9ad8b43a4f0893222f9de7142fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.581938   846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22bf5ddd67b84506b0e7f385f47139f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.582252   841 tablet_service.cc:1511] Processing CreateTablet for tablet 03d71eb6224348439b68ae13789dbfdc (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:07.583653   841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d71eb6224348439b68ae13789dbfdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.580130   842 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5a8c4732a2400491fef0a2182dc175 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:07.587898   840 tablet_service.cc:1511] Processing CreateTablet for tablet b98bf747fd014814a18bb58429c4d505 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:07.588007   842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5a8c4732a2400491fef0a2182dc175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.590806   840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98bf747fd014814a18bb58429c4d505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.591866   772 tablet_service.cc:1511] Processing CreateTablet for tablet 22bf5ddd67b84506b0e7f385f47139f5 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:07.593262   772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22bf5ddd67b84506b0e7f385f47139f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.603888   771 tablet_service.cc:1511] Processing CreateTablet for tablet 1f24b4f3428140d0904166a3f7d53166 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:07.605280   771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f24b4f3428140d0904166a3f7d53166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.615849   770 tablet_service.cc:1511] Processing CreateTablet for tablet af1a5523ed8d4da9ad0559069a6d1116 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:07.617400   770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1a5523ed8d4da9ad0559069a6d1116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.627561   899 tablet_bootstrap.cc:492] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:07.627343   769 tablet_service.cc:1511] Processing CreateTablet for tablet 17f08d6500ef4a30a3a7932a9be8403f (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:07.631865   769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f08d6500ef4a30a3a7932a9be8403f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.632611   767 tablet_service.cc:1511] Processing CreateTablet for tablet 03d71eb6224348439b68ae13789dbfdc (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:07.633893   767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d71eb6224348439b68ae13789dbfdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.630053   768 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5a8c4732a2400491fef0a2182dc175 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:07.634997   768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5a8c4732a2400491fef0a2182dc175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.652314   766 tablet_service.cc:1511] Processing CreateTablet for tablet b98bf747fd014814a18bb58429c4d505 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:07.653704   766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98bf747fd014814a18bb58429c4d505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.655994   899 tablet_bootstrap.cc:654] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.661522   699 tablet_service.cc:1511] Processing CreateTablet for tablet a9aaf50aca194185bd1d3ecb6368763f (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:07.662911   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9aaf50aca194185bd1d3ecb6368763f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.667454   696 tablet_service.cc:1511] Processing CreateTablet for tablet 1f24b4f3428140d0904166a3f7d53166 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:07.668771   696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f24b4f3428140d0904166a3f7d53166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.670611   695 tablet_service.cc:1511] Processing CreateTablet for tablet af1a5523ed8d4da9ad0559069a6d1116 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:07.671850   695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1a5523ed8d4da9ad0559069a6d1116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.675666   697 tablet_service.cc:1511] Processing CreateTablet for tablet 22bf5ddd67b84506b0e7f385f47139f5 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:07.677949   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22bf5ddd67b84506b0e7f385f47139f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.683840   693 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5a8c4732a2400491fef0a2182dc175 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:07.684731   694 tablet_service.cc:1511] Processing CreateTablet for tablet 17f08d6500ef4a30a3a7932a9be8403f (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:07.685192   693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5a8c4732a2400491fef0a2182dc175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.686966   698 tablet_service.cc:1511] Processing CreateTablet for tablet 3a3f9ad8b43a4f0893222f9de7142fc4 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:07.688721   692 tablet_service.cc:1511] Processing CreateTablet for tablet 03d71eb6224348439b68ae13789dbfdc (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:07.687242   691 tablet_service.cc:1511] Processing CreateTablet for tablet b98bf747fd014814a18bb58429c4d505 (DEFAULT_TABLE table=test-workload [id=2624f72ef6434ee3bd441ca479b04570]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:07.686017   694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f08d6500ef4a30a3a7932a9be8403f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.698851   691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98bf747fd014814a18bb58429c4d505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.700524   692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d71eb6224348439b68ae13789dbfdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.702543   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a3f9ad8b43a4f0893222f9de7142fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.741283   898 tablet_bootstrap.cc:492] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:07.750293   898 tablet_bootstrap.cc:654] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.769376   898 tablet_bootstrap.cc:492] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:07.769959   898 ts_tablet_manager.cc:1403] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.011s
I20260709 13:10:07.771382   902 tablet_bootstrap.cc:492] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:07.772887   898 raft_consensus.cc:359] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:07.773712   898 raft_consensus.cc:385] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.774051   898 raft_consensus.cc:740] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.780495   898 consensus_queue.cc:260] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:07.782151   899 tablet_bootstrap.cc:492] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:07.782855   899 ts_tablet_manager.cc:1403] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.156s	user 0.054s	sys 0.064s
I20260709 13:10:07.791085   899 raft_consensus.cc:359] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.791882   899 raft_consensus.cc:385] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.792204   899 raft_consensus.cc:740] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.793049   899 consensus_queue.cc:260] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.797187   902 tablet_bootstrap.cc:654] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.799906   809 heartbeater.cc:499] Master 127.20.53.190:37137 was elected leader, sending a full tablet report...
I20260709 13:10:07.800369   898 ts_tablet_manager.cc:1434] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.017s
I20260709 13:10:07.801460   898 tablet_bootstrap.cc:492] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:07.807581   898 tablet_bootstrap.cc:654] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.813174   902 tablet_bootstrap.cc:492] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:07.813802   902 ts_tablet_manager.cc:1403] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.009s
I20260709 13:10:07.815866   899 ts_tablet_manager.cc:1434] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.021s
I20260709 13:10:07.816601   883 heartbeater.cc:499] Master 127.20.53.190:37137 was elected leader, sending a full tablet report...
I20260709 13:10:07.816934   899 tablet_bootstrap.cc:492] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:07.817319   898 tablet_bootstrap.cc:492] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:07.817900   898 ts_tablet_manager.cc:1403] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:10:07.820892   898 raft_consensus.cc:359] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.821738   898 raft_consensus.cc:385] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.822021   898 raft_consensus.cc:740] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.822835   899 tablet_bootstrap.cc:654] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.822722   898 consensus_queue.cc:260] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.823181   902 raft_consensus.cc:359] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.823947   902 raft_consensus.cc:385] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.824239   902 raft_consensus.cc:740] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.824891   898 ts_tablet_manager.cc:1434] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:10:07.824950   902 consensus_queue.cc:260] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.826292   898 tablet_bootstrap.cc:492] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:07.832665   898 tablet_bootstrap.cc:654] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.832901   903 raft_consensus.cc:493] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.833375   903 raft_consensus.cc:515] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.836155   734 heartbeater.cc:499] Master 127.20.53.190:37137 was elected leader, sending a full tablet report...
I20260709 13:10:07.839820   903 leader_election.cc:290] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:07.843586   898 tablet_bootstrap.cc:492] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:07.844126   898 ts_tablet_manager.cc:1403] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 13:10:07.850494   898 raft_consensus.cc:359] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.852587   898 raft_consensus.cc:385] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.852895   898 raft_consensus.cc:740] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.854926   898 consensus_queue.cc:260] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.857101   898 ts_tablet_manager.cc:1434] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:07.858135   898 tablet_bootstrap.cc:492] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:07.858479   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f08d6500ef4a30a3a7932a9be8403f" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
W20260709 13:10:07.860628   748 leader_election.cc:343] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.865799   902 ts_tablet_manager.cc:1434] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.052s	user 0.014s	sys 0.005s
I20260709 13:10:07.867074   902 tablet_bootstrap.cc:492] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:07.871917   898 tablet_bootstrap.cc:654] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.873219   899 tablet_bootstrap.cc:492] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:07.873675   902 tablet_bootstrap.cc:654] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.873833   899 ts_tablet_manager.cc:1403] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.024s
I20260709 13:10:07.877256   898 tablet_bootstrap.cc:492] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:07.877049   899 raft_consensus.cc:359] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:07.877758   898 ts_tablet_manager.cc:1403] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 13:10:07.877887   899 raft_consensus.cc:385] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.878366   899 raft_consensus.cc:740] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.879315   899 consensus_queue.cc:260] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:07.880729   898 raft_consensus.cc:359] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.881520   898 raft_consensus.cc:385] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.881819   898 raft_consensus.cc:740] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.881929   899 ts_tablet_manager.cc:1434] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:07.883108   899 tablet_bootstrap.cc:492] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:07.882777   898 consensus_queue.cc:260] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.885237   898 ts_tablet_manager.cc:1434] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:07.886308   898 tablet_bootstrap.cc:492] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:07.889873   899 tablet_bootstrap.cc:654] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.891983   898 tablet_bootstrap.cc:654] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.903973   898 tablet_bootstrap.cc:492] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:07.904618   898 ts_tablet_manager.cc:1403] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 13:10:07.908360   898 raft_consensus.cc:359] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.909272   898 raft_consensus.cc:385] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.909655   898 raft_consensus.cc:740] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.911665   898 consensus_queue.cc:260] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.912808   899 tablet_bootstrap.cc:492] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:07.913437   899 ts_tablet_manager.cc:1403] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 13:10:07.915849   898 ts_tablet_manager.cc:1434] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:10:07.916508   899 raft_consensus.cc:359] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.916978   898 tablet_bootstrap.cc:492] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:07.917373   899 raft_consensus.cc:385] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.917754   899 raft_consensus.cc:740] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.918653   899 consensus_queue.cc:260] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.922784   899 ts_tablet_manager.cc:1434] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:10:07.923820   899 tablet_bootstrap.cc:492] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:07.923900   898 tablet_bootstrap.cc:654] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.932211   899 tablet_bootstrap.cc:654] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.938678   898 tablet_bootstrap.cc:492] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:07.939175   898 ts_tablet_manager.cc:1403] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:10:07.942029   898 raft_consensus.cc:359] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.942754   898 raft_consensus.cc:385] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.943079   898 raft_consensus.cc:740] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.944024   898 consensus_queue.cc:260] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.947264   899 tablet_bootstrap.cc:492] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:07.947690   898 ts_tablet_manager.cc:1434] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:07.947882   899 ts_tablet_manager.cc:1403] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:10:07.948812   898 tablet_bootstrap.cc:492] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:07.951035   899 raft_consensus.cc:359] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.951810   899 raft_consensus.cc:385] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.952168   899 raft_consensus.cc:740] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.953338   899 consensus_queue.cc:260] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.955226   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f08d6500ef4a30a3a7932a9be8403f" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:07.955919   858 raft_consensus.cc:2468] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:07.956117   898 tablet_bootstrap.cc:654] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.957343   749 leader_election.cc:304] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:07.958597   903 raft_consensus.cc:2804] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.959043   903 raft_consensus.cc:493] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.959462   903 raft_consensus.cc:3060] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.978147   899 ts_tablet_manager.cc:1434] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:10:07.979832   899 tablet_bootstrap.cc:492] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:07.970232   903 raft_consensus.cc:515] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:07.989019   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f08d6500ef4a30a3a7932a9be8403f" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
W20260709 13:10:07.990971   748 leader_election.cc:343] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.993289   903 leader_election.cc:290] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:07.993827   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f08d6500ef4a30a3a7932a9be8403f" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:07.994542   858 raft_consensus.cc:3060] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.995699   902 tablet_bootstrap.cc:492] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:07.996279   902 ts_tablet_manager.cc:1403] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.130s	user 0.033s	sys 0.085s
I20260709 13:10:07.996425   898 tablet_bootstrap.cc:492] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:07.996645   899 tablet_bootstrap.cc:654] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.997045   898 ts_tablet_manager.cc:1403] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.048s	user 0.028s	sys 0.017s
I20260709 13:10:07.999732   902 raft_consensus.cc:359] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.000881   902 raft_consensus.cc:385] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.001332   902 raft_consensus.cc:740] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.002406   902 consensus_queue.cc:260] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.003834   904 raft_consensus.cc:493] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.005753   858 raft_consensus.cc:2468] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.003674   898 raft_consensus.cc:359] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.007184   898 raft_consensus.cc:385] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.007042   904 raft_consensus.cc:515] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.005620   902 ts_tablet_manager.cc:1434] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:10:08.007587   898 raft_consensus.cc:740] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.008659   902 tablet_bootstrap.cc:492] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:08.008529   898 consensus_queue.cc:260] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.010916   749 leader_election.cc:304] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:08.011201   898 ts_tablet_manager.cc:1434] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:10:08.012363   898 tablet_bootstrap.cc:492] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:08.017302   920 raft_consensus.cc:2804] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.017720   903 raft_consensus.cc:493] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.018254   902 tablet_bootstrap.cc:654] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.018692   898 tablet_bootstrap.cc:654] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.018266   903 raft_consensus.cc:515] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.025233   920 raft_consensus.cc:697] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:08.027334   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5a8c4732a2400491fef0a2182dc175" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:08.027776   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5a8c4732a2400491fef0a2182dc175" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:08.028012   709 raft_consensus.cc:2468] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.029263   748 leader_election.cc:304] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
W20260709 13:10:08.030036   749 leader_election.cc:343] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.026230   920 consensus_queue.cc:237] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.033772   921 raft_consensus.cc:2804] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.034222   921 raft_consensus.cc:493] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.034529   921 raft_consensus.cc:3060] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.030192   904 leader_election.cc:290] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:08.025919   903 leader_election.cc:290] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.041393   899 tablet_bootstrap.cc:492] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:08.041958   899 ts_tablet_manager.cc:1403] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.001s
I20260709 13:10:08.042193   902 tablet_bootstrap.cc:492] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:08.042728   902 ts_tablet_manager.cc:1403] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.015s
I20260709 13:10:08.042975   898 tablet_bootstrap.cc:492] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:08.043434   898 ts_tablet_manager.cc:1403] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.019s
I20260709 13:10:08.045030   899 raft_consensus.cc:359] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.045776   899 raft_consensus.cc:385] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.046077   899 raft_consensus.cc:740] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.046190   898 raft_consensus.cc:359] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.052063   898 raft_consensus.cc:385] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.052357   898 raft_consensus.cc:740] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.052284   899 consensus_queue.cc:260] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.053346   898 consensus_queue.cc:260] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.054139   921 raft_consensus.cc:515] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.055572   898 ts_tablet_manager.cc:1434] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:10:08.055744   920 raft_consensus.cc:493] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.056568   898 tablet_bootstrap.cc:492] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:08.056368   920 raft_consensus.cc:515] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.056998   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5a8c4732a2400491fef0a2182dc175" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:08.057590   709 raft_consensus.cc:3060] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.061409   920 leader_election.cc:290] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.061957   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bf5ddd67b84506b0e7f385f47139f5" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:08.062336   708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bf5ddd67b84506b0e7f385f47139f5" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
W20260709 13:10:08.063537   749 leader_election.cc:343] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:08.064030   748 leader_election.cc:343] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.064471   748 leader_election.cc:304] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c; no voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:08.064917   603 catalog_manager.cc:5697] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 1 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.066495   899 ts_tablet_manager.cc:1434] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.009s
I20260709 13:10:08.067001   920 raft_consensus.cc:2749] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:08.067981   655 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:08.070910   709 raft_consensus.cc:2468] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.072144   748 leader_election.cc:304] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.062621   898 tablet_bootstrap.cc:654] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.073004   920 raft_consensus.cc:2804] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.073604   903 raft_consensus.cc:493] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.074103   903 raft_consensus.cc:515] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.075035   899 tablet_bootstrap.cc:492] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:08.045980   902 raft_consensus.cc:359] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:08.076093   902 raft_consensus.cc:385] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.076143   903 leader_election.cc:290] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.076624   902 raft_consensus.cc:740] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.077524   902 consensus_queue.cc:260] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:08.078154   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d71eb6224348439b68ae13789dbfdc" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:08.078816   858 raft_consensus.cc:2468] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.080026   749 leader_election.cc:304] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:08.080329   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:08.081027   903 raft_consensus.cc:2804] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.081152   709 raft_consensus.cc:2468] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:08.082573   822 leader_election.cc:304] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.082751   708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d71eb6224348439b68ae13789dbfdc" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:08.083189   921 leader_election.cc:290] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.083828   904 raft_consensus.cc:2804] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.084260   904 raft_consensus.cc:493] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.084646   904 raft_consensus.cc:3060] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.086712   920 raft_consensus.cc:697] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:08.087842   899 tablet_bootstrap.cc:654] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.088119   920 consensus_queue.cc:237] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.092267   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5a8c4732a2400491fef0a2182dc175" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.092927   858 raft_consensus.cc:3060] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.082571   902 ts_tablet_manager.cc:1434] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:10:08.097513   902 tablet_bootstrap.cc:492] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:08.102506   927 raft_consensus.cc:493] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.103974   784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:08.104262   927 raft_consensus.cc:515] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.105351   784 raft_consensus.cc:2468] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
W20260709 13:10:08.106613   748 leader_election.cc:343] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.081423   903 raft_consensus.cc:493] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.107540   903 raft_consensus.cc:3060] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.108664   927 leader_election.cc:290] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.109349   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:08.111114   708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:08.111797   708 raft_consensus.cc:2468] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.113091   902 tablet_bootstrap.cc:654] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.113843   748 leader_election.cc:304] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.118590   899 tablet_bootstrap.cc:492] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:08.119112   899 ts_tablet_manager.cc:1403] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 13:10:08.121070   904 raft_consensus.cc:515] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.122263   857 raft_consensus.cc:2393] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0920d2f774f14e05961d4af4689dd22c in current term 1: Already voted for candidate 932f8c79c2f948328f8084f7e69845bf in this term.
I20260709 13:10:08.128499   858 raft_consensus.cc:2468] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.123255   920 raft_consensus.cc:2804] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.122109   899 raft_consensus.cc:359] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.124368   708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:08.130645   920 raft_consensus.cc:493] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.130847   708 raft_consensus.cc:3060] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.131060   920 raft_consensus.cc:3060] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.137763   708 raft_consensus.cc:2468] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:08.139031   822 leader_election.cc:304] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.142840   904 leader_election.cc:290] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:08.143626   904 raft_consensus.cc:2804] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.144191   904 raft_consensus.cc:697] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:08.145226   904 consensus_queue.cc:237] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.137809   920 raft_consensus.cc:515] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.149137   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:08.150200   709 raft_consensus.cc:2393] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0920d2f774f14e05961d4af4689dd22c in current term 1: Already voted for candidate 932f8c79c2f948328f8084f7e69845bf in this term.
I20260709 13:10:08.150770   899 raft_consensus.cc:385] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.151098   899 raft_consensus.cc:740] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.151935   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.153342   749 leader_election.cc:304] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c; no voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:08.154596   927 raft_consensus.cc:2749] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:08.154739   784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:08.155577   784 raft_consensus.cc:2393] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 932f8c79c2f948328f8084f7e69845bf in current term 1: Already voted for candidate 0920d2f774f14e05961d4af4689dd22c in this term.
I20260709 13:10:08.154044   899 consensus_queue.cc:260] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.156445   920 leader_election.cc:290] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.141999   903 raft_consensus.cc:515] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.159544   898 tablet_bootstrap.cc:492] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:08.159778   899 ts_tablet_manager.cc:1434] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.040s	user 0.001s	sys 0.006s
I20260709 13:10:08.162012   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d71eb6224348439b68ae13789dbfdc" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:08.162878   899 tablet_bootstrap.cc:492] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
W20260709 13:10:08.163501   748 leader_election.cc:343] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:08.164388   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d71eb6224348439b68ae13789dbfdc" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.161383   903 leader_election.cc:290] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.164975   858 raft_consensus.cc:3060] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.161697   898 ts_tablet_manager.cc:1403] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.105s	user 0.041s	sys 0.039s
I20260709 13:10:08.170188   898 raft_consensus.cc:359] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.170692   902 tablet_bootstrap.cc:492] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:08.170845   898 raft_consensus.cc:385] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.171260   898 raft_consensus.cc:740] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.171344   902 ts_tablet_manager.cc:1403] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.026s
I20260709 13:10:08.174081   899 tablet_bootstrap.cc:654] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.174466   902 raft_consensus.cc:359] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.175200   902 raft_consensus.cc:385] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.175503   902 raft_consensus.cc:740] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.176280   902 consensus_queue.cc:260] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.177773   605 catalog_manager.cc:5697] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 1 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.179246   898 consensus_queue.cc:260] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.180702   902 ts_tablet_manager.cc:1434] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:08.181354   903 raft_consensus.cc:493] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.181596   898 ts_tablet_manager.cc:1434] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:10:08.181792   902 tablet_bootstrap.cc:492] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:08.177837   858 raft_consensus.cc:2468] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.181980   903 raft_consensus.cc:515] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:08.183458   749 leader_election.cc:304] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:08.184579   920 raft_consensus.cc:2804] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.185046   920 raft_consensus.cc:697] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:08.185900   920 consensus_queue.cc:237] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.189033   902 tablet_bootstrap.cc:654] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.191414   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aaf50aca194185bd1d3ecb6368763f" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:08.192051   858 raft_consensus.cc:2468] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.193271   749 leader_election.cc:304] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:08.194073   927 raft_consensus.cc:2804] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.194767   927 raft_consensus.cc:493] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.195194   927 raft_consensus.cc:3060] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.207489   603 catalog_manager.cc:5697] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 1 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.210959   903 leader_election.cc:290] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643), bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503)
I20260709 13:10:08.205606   927 raft_consensus.cc:515] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:08.211633   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aaf50aca194185bd1d3ecb6368763f" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:08.212265   709 raft_consensus.cc:2468] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.216179   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aaf50aca194185bd1d3ecb6368763f" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.216912   858 raft_consensus.cc:3060] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.217731   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aaf50aca194185bd1d3ecb6368763f" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:08.218312   709 raft_consensus.cc:3060] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.224453   709 raft_consensus.cc:2468] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.225108   927 leader_election.cc:290] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643), bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503)
I20260709 13:10:08.225543   748 leader_election.cc:304] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.226760   927 raft_consensus.cc:2804] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.227275   927 raft_consensus.cc:697] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:08.228374   902 tablet_bootstrap.cc:492] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:08.228406   899 tablet_bootstrap.cc:492] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:08.228276   927 consensus_queue.cc:237] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:08.229094   902 ts_tablet_manager.cc:1403] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.004s
I20260709 13:10:08.229159   899 ts_tablet_manager.cc:1403] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.020s
I20260709 13:10:08.232177   902 raft_consensus.cc:359] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.232795   858 raft_consensus.cc:2468] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.232972   902 raft_consensus.cc:385] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.233395   902 raft_consensus.cc:740] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.232816   899 raft_consensus.cc:359] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.234421   899 raft_consensus.cc:385] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.234120   902 consensus_queue.cc:260] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.230010   603 catalog_manager.cc:5697] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 1 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.236351   902 ts_tablet_manager.cc:1434] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:08.237320   902 tablet_bootstrap.cc:492] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:08.234747   899 raft_consensus.cc:740] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.241106   899 consensus_queue.cc:260] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.243456   899 ts_tablet_manager.cc:1434] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:10:08.243667   902 tablet_bootstrap.cc:654] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.244482   899 tablet_bootstrap.cc:492] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:08.250100   902 tablet_bootstrap.cc:492] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:08.250675   902 ts_tablet_manager.cc:1403] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.005s
I20260709 13:10:08.251493   899 tablet_bootstrap.cc:654] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.253562   902 raft_consensus.cc:359] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.254406   902 raft_consensus.cc:385] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.254784   902 raft_consensus.cc:740] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.255573   902 consensus_queue.cc:260] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.257941   902 ts_tablet_manager.cc:1434] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:10:08.257954   899 tablet_bootstrap.cc:492] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:08.258737   899 ts_tablet_manager.cc:1403] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.002s
I20260709 13:10:08.259151   902 tablet_bootstrap.cc:492] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:08.259111   602 catalog_manager.cc:5697] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 1 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.261220   899 raft_consensus.cc:359] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.261883   899 raft_consensus.cc:385] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.262144   899 raft_consensus.cc:740] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.262895   899 consensus_queue.cc:260] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.264572   899 ts_tablet_manager.cc:1434] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:10:08.265578   899 tablet_bootstrap.cc:492] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:08.266199   902 tablet_bootstrap.cc:654] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.270869   927 raft_consensus.cc:493] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.272188   899 tablet_bootstrap.cc:654] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.272172   927 raft_consensus.cc:515] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.274928   927 leader_election.cc:290] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.271662   920 raft_consensus.cc:493] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.275964   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:08.275830   920 raft_consensus.cc:515] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.276659   858 raft_consensus.cc:2468] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.277675   749 leader_election.cc:304] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:08.278154   920 leader_election.cc:290] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.278688   920 raft_consensus.cc:2804] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.279026   920 raft_consensus.cc:493] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.279363   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a5523ed8d4da9ad0559069a6d1116" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:08.279987   858 raft_consensus.cc:2468] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.281150   749 leader_election.cc:304] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:08.281368   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:08.279408   920 raft_consensus.cc:3060] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.282025   927 raft_consensus.cc:2804] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.282382   708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a5523ed8d4da9ad0559069a6d1116" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:08.282651   927 raft_consensus.cc:493] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.283020   927 raft_consensus.cc:3060] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.283104   708 raft_consensus.cc:2468] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.282028   709 raft_consensus.cc:2468] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.287791   920 raft_consensus.cc:515] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.289958   920 leader_election.cc:290] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.289759   927 raft_consensus.cc:515] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.290249   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:08.290524   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.290844   709 raft_consensus.cc:3060] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.290977   858 raft_consensus.cc:3060] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.292881   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a5523ed8d4da9ad0559069a6d1116" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.293465   857 raft_consensus.cc:3060] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.295982   899 tablet_bootstrap.cc:492] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:08.296476   899 ts_tablet_manager.cc:1403] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:10:08.296432   858 raft_consensus.cc:2468] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.297619   709 raft_consensus.cc:2468] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.297683   749 leader_election.cc:304] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:08.301707   902 tablet_bootstrap.cc:492] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:08.303785   920 raft_consensus.cc:2804] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.304081   902 ts_tablet_manager.cc:1403] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.008s
I20260709 13:10:08.298624   708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a5523ed8d4da9ad0559069a6d1116" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:08.304628   920 raft_consensus.cc:697] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:08.304828   708 raft_consensus.cc:3060] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.305454   920 consensus_queue.cc:237] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.299588   899 raft_consensus.cc:359] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.306874   899 raft_consensus.cc:385] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.307191   899 raft_consensus.cc:740] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.307296   927 leader_election.cc:290] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.307195   902 raft_consensus.cc:359] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.308562   902 raft_consensus.cc:385] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.308040   899 consensus_queue.cc:260] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.308873   902 raft_consensus.cc:740] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.300933   857 raft_consensus.cc:2468] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.310621   749 leader_election.cc:304] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:08.311597   927 raft_consensus.cc:2804] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.311818   708 raft_consensus.cc:2468] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.312942   927 raft_consensus.cc:697] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:08.313910   899 ts_tablet_manager.cc:1434] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 13:10:08.313771   927 consensus_queue.cc:237] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.317027   902 consensus_queue.cc:260] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.319489   902 ts_tablet_manager.cc:1434] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:10:08.320361   902 tablet_bootstrap.cc:492] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:08.328588   902 tablet_bootstrap.cc:654] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.333137   902 tablet_bootstrap.cc:492] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:08.332691   606 catalog_manager.cc:5697] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 1 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.333597   902 ts_tablet_manager.cc:1403] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:10:08.335740   902 raft_consensus.cc:359] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.336288   902 raft_consensus.cc:385] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.336498   902 raft_consensus.cc:740] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.337044   902 consensus_queue.cc:260] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.338955   902 ts_tablet_manager.cc:1434] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:08.339799   902 tablet_bootstrap.cc:492] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:08.341879   908 raft_consensus.cc:493] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.342415   908 raft_consensus.cc:515] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.344671   902 tablet_bootstrap.cc:654] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.346472   602 catalog_manager.cc:5697] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 1 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.354133   908 leader_election.cc:290] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.363907   902 tablet_bootstrap.cc:492] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:08.364459   902 ts_tablet_manager.cc:1403] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.000s
I20260709 13:10:08.366648   902 raft_consensus.cc:359] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.367286   902 raft_consensus.cc:385] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.367559   902 raft_consensus.cc:740] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.368287   902 consensus_queue.cc:260] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.370285   902 ts_tablet_manager.cc:1434] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:08.370093   784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bf5ddd67b84506b0e7f385f47139f5" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:08.370805   784 raft_consensus.cc:2468] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 0.
I20260709 13:10:08.371723   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bf5ddd67b84506b0e7f385f47139f5" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:08.371804   673 leader_election.cc:304] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.372534   857 raft_consensus.cc:2468] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 0.
I20260709 13:10:08.372743   908 raft_consensus.cc:2804] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.373229   908 raft_consensus.cc:493] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.373554   908 raft_consensus.cc:3060] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.379642   908 raft_consensus.cc:515] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.381299   908 leader_election.cc:290] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.381850   784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bf5ddd67b84506b0e7f385f47139f5" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:08.382134   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bf5ddd67b84506b0e7f385f47139f5" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.382397   784 raft_consensus.cc:3060] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.382668   857 raft_consensus.cc:3060] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.387243   857 raft_consensus.cc:2468] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 1.
I20260709 13:10:08.387254   784 raft_consensus.cc:2468] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 1.
I20260709 13:10:08.388243   674 leader_election.cc:304] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.388899   908 raft_consensus.cc:2804] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.389683   908 raft_consensus.cc:697] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:08.390527   908 consensus_queue.cc:237] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.397024   602 catalog_manager.cc:5697] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.477844   920 raft_consensus.cc:493] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.478577   920 raft_consensus.cc:515] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.480453   920 leader_election.cc:290] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.481300   708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98bf747fd014814a18bb58429c4d505" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:08.481446   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98bf747fd014814a18bb58429c4d505" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:08.482043   708 raft_consensus.cc:2468] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.482205   857 raft_consensus.cc:2468] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:08.483296   748 leader_election.cc:304] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.484009   920 raft_consensus.cc:2804] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:08.484426   920 raft_consensus.cc:493] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.484745   920 raft_consensus.cc:3060] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.490463   920 raft_consensus.cc:515] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.492293   920 leader_election.cc:290] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.492995   708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98bf747fd014814a18bb58429c4d505" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:08.493372   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98bf747fd014814a18bb58429c4d505" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.493563   708 raft_consensus.cc:3060] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.494001   857 raft_consensus.cc:3060] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.498751   708 raft_consensus.cc:2468] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.499107   857 raft_consensus.cc:2468] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:08.499807   748 leader_election.cc:304] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.500620   920 raft_consensus.cc:2804] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.501094   920 raft_consensus.cc:697] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:08.501978   920 consensus_queue.cc:237] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.508881   602 catalog_manager.cc:5697] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 1 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.560168   920 consensus_queue.cc:1048] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.572293   708 raft_consensus.cc:3060] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.572432   927 consensus_queue.cc:1048] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.583443   921 consensus_queue.cc:1048] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.587889   920 consensus_queue.cc:1048] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.609292   904 consensus_queue.cc:1048] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.636775   934 consensus_queue.cc:1048] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.640045   784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9aaf50aca194185bd1d3ecb6368763f"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
mode: GRACEFUL
new_leader_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:58642
I20260709 13:10:08.642196   784 raft_consensus.cc:606] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Received request to transfer leadership to TS bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:08.648002   784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
mode: GRACEFUL
new_leader_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:58642
I20260709 13:10:08.648515   784 raft_consensus.cc:606] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Received request to transfer leadership to TS bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:08.656438   927 consensus_queue.cc:1048] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.664047   708 raft_consensus.cc:3060] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.667917   920 raft_consensus.cc:993] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c: : Instructing follower bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:08.668431   857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
mode: GRACEFUL
new_leader_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:10:08.668493   920 raft_consensus.cc:1081] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Signalling peer bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:08.669098   857 raft_consensus.cc:606] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Received request to transfer leadership to TS bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:08.673727   706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9aaf50aca194185bd1d3ecb6368763f"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:57044
I20260709 13:10:08.674391   706 raft_consensus.cc:493] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.674120   957 consensus_queue.cc:1048] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.674834   706 raft_consensus.cc:3060] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.683590   706 raft_consensus.cc:515] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:08.688417   927 consensus_queue.cc:1048] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.691680   957 consensus_queue.cc:1048] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.695504   706 leader_election.cc:290] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.696376   784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b98bf747fd014814a18bb58429c4d505"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
mode: GRACEFUL
new_leader_uuid: "932f8c79c2f948328f8084f7e69845bf"
 from {username='slave'} at 127.0.0.1:58642
I20260709 13:10:08.697009   784 raft_consensus.cc:606] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Received request to transfer leadership to TS 932f8c79c2f948328f8084f7e69845bf
I20260709 13:10:08.698089   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aaf50aca194185bd1d3ecb6368763f" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:08.698829   783 raft_consensus.cc:3055] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.699185   783 raft_consensus.cc:740] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:08.700008   783 consensus_queue.cc:260] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:08.701308   783 raft_consensus.cc:3060] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.696954   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aaf50aca194185bd1d3ecb6368763f" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.703092   858 raft_consensus.cc:3060] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.713938   858 raft_consensus.cc:2468] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:08.717103   674 leader_election.cc:304] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.718139   908 raft_consensus.cc:2804] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.718639   908 raft_consensus.cc:697] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:08.719168   783 raft_consensus.cc:2468] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:08.719802   908 consensus_queue.cc:237] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } }
I20260709 13:10:08.728606   602 catalog_manager.cc:5697] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 1 to 2, leader changed from 0920d2f774f14e05961d4af4689dd22c (127.20.53.130) to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.739842   957 consensus_queue.cc:1048] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.749670   957 consensus_queue.cc:1048] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.757563   920 raft_consensus.cc:993] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c: : Instructing follower bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:08.757997   957 raft_consensus.cc:1081] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Signalling peer bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:08.759429   709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:57044
I20260709 13:10:08.760025   709 raft_consensus.cc:493] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.760396   709 raft_consensus.cc:3060] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.765290   957 consensus_queue.cc:1048] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.766131   709 raft_consensus.cc:515] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.768195   709 leader_election.cc:290] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:08.768899   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:08.769562   783 raft_consensus.cc:3055] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.769898   783 raft_consensus.cc:740] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:08.770658   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:08.770816   783 consensus_queue.cc:260] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.771344   857 raft_consensus.cc:3060] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.772186   783 raft_consensus.cc:3060] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.778929   957 consensus_queue.cc:1048] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.779196   783 raft_consensus.cc:2468] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:08.780077   857 raft_consensus.cc:2468] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:08.780301   673 leader_election.cc:304] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:08.781167   908 raft_consensus.cc:2804] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.781637   908 raft_consensus.cc:697] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:08.782461   908 consensus_queue.cc:237] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:08.790321   602 catalog_manager.cc:5697] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 1 to 2, leader changed from 0920d2f774f14e05961d4af4689dd22c (127.20.53.130) to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.820163   908 consensus_queue.cc:1048] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.831131   973 consensus_queue.cc:1048] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.014283   957 consensus_queue.cc:1048] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.021106   976 raft_consensus.cc:993] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf: : Instructing follower bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:09.021611   976 raft_consensus.cc:1081] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Signalling peer bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:09.024542   709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:10:09.025070   709 raft_consensus.cc:493] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.025434   709 raft_consensus.cc:3060] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.029707   957 consensus_queue.cc:1048] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.034504   709 raft_consensus.cc:515] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:09.037249   927 raft_consensus.cc:993] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c: : Instructing follower 932f8c79c2f948328f8084f7e69845bf to start an election
I20260709 13:10:09.037436   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:09.037789   927 raft_consensus.cc:1081] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Signalling peer 932f8c79c2f948328f8084f7e69845bf to start an election
I20260709 13:10:09.038112   783 raft_consensus.cc:3060] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.038123   709 leader_election.cc:290] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:09.039597   858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b98bf747fd014814a18bb58429c4d505"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
 from {username='slave'} at 127.0.0.1:49704
I20260709 13:10:09.039970   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f24b4f3428140d0904166a3f7d53166" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:09.040127   858 raft_consensus.cc:493] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.040565   858 raft_consensus.cc:3060] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.040583   857 raft_consensus.cc:3055] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.041505   857 raft_consensus.cc:740] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:09.042423   857 consensus_queue.cc:260] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:09.043690   857 raft_consensus.cc:3060] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.044554   783 raft_consensus.cc:2468] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:09.045557   673 leader_election.cc:304] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:09.046247   973 raft_consensus.cc:2804] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.046663   973 raft_consensus.cc:697] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:09.047462   973 consensus_queue.cc:237] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:09.048121   858 raft_consensus.cc:515] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:09.051009   857 raft_consensus.cc:2468] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:09.051957   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98bf747fd014814a18bb58429c4d505" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:09.052570   709 raft_consensus.cc:3060] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.053757   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98bf747fd014814a18bb58429c4d505" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:09.054382   783 raft_consensus.cc:3055] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.054708   783 raft_consensus.cc:740] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:09.055480   858 leader_election.cc:290] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 2 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:09.055959   602 catalog_manager.cc:5697] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 1 to 2, leader changed from 932f8c79c2f948328f8084f7e69845bf (127.20.53.131) to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.056532   783 consensus_queue.cc:260] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:09.058207   783 raft_consensus.cc:3060] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.059590   709 raft_consensus.cc:2468] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 2.
I20260709 13:10:09.060716   822 leader_election.cc:304] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:09.064237   934 raft_consensus.cc:2804] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.064704   934 raft_consensus.cc:697] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 2 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:09.065286   783 raft_consensus.cc:2468] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 2.
I20260709 13:10:09.065524   934 consensus_queue.cc:237] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:09.073529   606 catalog_manager.cc:5697] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 1 to 2, leader changed from 0920d2f774f14e05961d4af4689dd22c (127.20.53.130) to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 2 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.176143   858 raft_consensus.cc:1275] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.177683   973 consensus_queue.cc:1048] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.191241   783 raft_consensus.cc:1275] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.192875   950 consensus_queue.cc:1048] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.221540   783 raft_consensus.cc:1275] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.222963   950 consensus_queue.cc:1048] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.233743   858 raft_consensus.cc:1275] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.235333   973 consensus_queue.cc:1048] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.477470   783 raft_consensus.cc:1275] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer 932f8c79c2f948328f8084f7e69845bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.478780   934 consensus_queue.cc:1048] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.491431   709 raft_consensus.cc:1275] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Refusing update from remote peer 932f8c79c2f948328f8084f7e69845bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.493985   904 consensus_queue.cc:1048] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.535581   783 raft_consensus.cc:1275] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.536850   973 consensus_queue.cc:1048] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.546339   858 raft_consensus.cc:1275] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.547974   950 consensus_queue.cc:1048] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:11.734496   602 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57622:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:11.737047   602 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:11.789458   694 tablet_service.cc:1511] Processing CreateTablet for tablet e37f810da8414ad3a5ccfdc5912e814b (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:11.790993   770 tablet_service.cc:1511] Processing CreateTablet for tablet e37f810da8414ad3a5ccfdc5912e814b (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:11.791507   694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f810da8414ad3a5ccfdc5912e814b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.792804   770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f810da8414ad3a5ccfdc5912e814b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.792615   846 tablet_service.cc:1511] Processing CreateTablet for tablet e37f810da8414ad3a5ccfdc5912e814b (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:11.793614   692 tablet_service.cc:1511] Processing CreateTablet for tablet f524e4bbf7474b8ab3923a1529ee153e (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:11.794269   846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f810da8414ad3a5ccfdc5912e814b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.795060   692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f524e4bbf7474b8ab3923a1529ee153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.808275   766 tablet_service.cc:1511] Processing CreateTablet for tablet f524e4bbf7474b8ab3923a1529ee153e (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:11.809685   766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f524e4bbf7474b8ab3923a1529ee153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.821347   991 tablet_bootstrap.cc:492] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:11.825309   842 tablet_service.cc:1511] Processing CreateTablet for tablet f524e4bbf7474b8ab3923a1529ee153e (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:11.826123   990 tablet_bootstrap.cc:492] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:11.826743   842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f524e4bbf7474b8ab3923a1529ee153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.829638   991 tablet_bootstrap.cc:654] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.834085   990 tablet_bootstrap.cc:654] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.837980   692 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6782ddcec54afb8e90873b5f47c9b8 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:11.839581   692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6782ddcec54afb8e90873b5f47c9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.853039   994 tablet_bootstrap.cc:492] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:11.858855   766 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6782ddcec54afb8e90873b5f47c9b8 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:11.862527   766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6782ddcec54afb8e90873b5f47c9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.860541   846 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6782ddcec54afb8e90873b5f47c9b8 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:11.863552   846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6782ddcec54afb8e90873b5f47c9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.864224   990 tablet_bootstrap.cc:492] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:11.865943   694 tablet_service.cc:1511] Processing CreateTablet for tablet a01d817e1d9446e98e58a9d429cb02de (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:11.868228   770 tablet_service.cc:1511] Processing CreateTablet for tablet a01d817e1d9446e98e58a9d429cb02de (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:11.871176   770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01d817e1d9446e98e58a9d429cb02de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.872144   845 tablet_service.cc:1511] Processing CreateTablet for tablet a01d817e1d9446e98e58a9d429cb02de (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:11.873462   845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01d817e1d9446e98e58a9d429cb02de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.878597   990 ts_tablet_manager.cc:1403] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.018s
I20260709 13:10:11.872640   694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01d817e1d9446e98e58a9d429cb02de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.889098   698 tablet_service.cc:1511] Processing CreateTablet for tablet e6ec15dc0dd149fe891850d376e6c6bb (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:11.890625   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ec15dc0dd149fe891850d376e6c6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.891433   990 raft_consensus.cc:359] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:11.898672   990 raft_consensus.cc:385] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.899012   990 raft_consensus.cc:740] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.900094   994 tablet_bootstrap.cc:654] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.899857   990 consensus_queue.cc:260] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:11.902819   990 ts_tablet_manager.cc:1434] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:10:11.903986   990 tablet_bootstrap.cc:492] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:11.913662   774 tablet_service.cc:1511] Processing CreateTablet for tablet e6ec15dc0dd149fe891850d376e6c6bb (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:11.922735   991 tablet_bootstrap.cc:492] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:11.923060   774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ec15dc0dd149fe891850d376e6c6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.923300   991 ts_tablet_manager.cc:1403] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.102s	user 0.038s	sys 0.035s
I20260709 13:10:11.917137   994 tablet_bootstrap.cc:492] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:11.926620   994 ts_tablet_manager.cc:1403] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.007s
I20260709 13:10:11.926494   991 raft_consensus.cc:359] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:11.927505   991 raft_consensus.cc:385] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.927868   991 raft_consensus.cc:740] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.928857   991 consensus_queue.cc:260] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:11.929898   994 raft_consensus.cc:359] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:11.933458   990 tablet_bootstrap.cc:654] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.930663   846 tablet_service.cc:1511] Processing CreateTablet for tablet e6ec15dc0dd149fe891850d376e6c6bb (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:11.935708   846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ec15dc0dd149fe891850d376e6c6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.939229   991 ts_tablet_manager.cc:1434] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:10:11.930707   994 raft_consensus.cc:385] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.943921   994 raft_consensus.cc:740] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
W20260709 13:10:11.946492   810 tablet.cc:2406] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:11.949975   770 tablet_service.cc:1511] Processing CreateTablet for tablet fe0fcbaa460e457eb8c842c5deed98fd (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:11.951619   770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0fcbaa460e457eb8c842c5deed98fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.945220   994 consensus_queue.cc:260] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:11.956416   994 ts_tablet_manager.cc:1434] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:10:11.958807   991 tablet_bootstrap.cc:492] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:11.959072   994 tablet_bootstrap.cc:492] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:11.957684   845 tablet_service.cc:1511] Processing CreateTablet for tablet fe0fcbaa460e457eb8c842c5deed98fd (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:11.962672   698 tablet_service.cc:1511] Processing CreateTablet for tablet fe0fcbaa460e457eb8c842c5deed98fd (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:11.966094   845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0fcbaa460e457eb8c842c5deed98fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.966588   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0fcbaa460e457eb8c842c5deed98fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.965999   692 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9fe85d85d4491d9eb33a07d6dc6b13 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:11.967708   692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9fe85d85d4491d9eb33a07d6dc6b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.985440   991 tablet_bootstrap.cc:654] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.986491   766 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9fe85d85d4491d9eb33a07d6dc6b13 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:11.990948   766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9fe85d85d4491d9eb33a07d6dc6b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.994966   842 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9fe85d85d4491d9eb33a07d6dc6b13 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:11.996277   842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9fe85d85d4491d9eb33a07d6dc6b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.997737   994 tablet_bootstrap.cc:654] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.998970   990 tablet_bootstrap.cc:492] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:11.999495   990 ts_tablet_manager.cc:1403] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.096s	user 0.023s	sys 0.010s
I20260709 13:10:12.003396   990 raft_consensus.cc:359] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.017307   990 raft_consensus.cc:385] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.017853   990 raft_consensus.cc:740] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.027019   694 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9a03e5b3c548999bb557c28ecb0483 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:12.028276   991 tablet_bootstrap.cc:492] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:12.028796   694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9a03e5b3c548999bb557c28ecb0483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.031669   774 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9a03e5b3c548999bb557c28ecb0483 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:12.033239   774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9a03e5b3c548999bb557c28ecb0483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.038345   691 tablet_service.cc:1511] Processing CreateTablet for tablet 7f777cc9af6049989e4bd7f0b47e2dc7 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:12.039676   691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f777cc9af6049989e4bd7f0b47e2dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.033370   846 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9a03e5b3c548999bb557c28ecb0483 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:12.041864   846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9a03e5b3c548999bb557c28ecb0483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.028903   991 ts_tablet_manager.cc:1403] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.007s
I20260709 13:10:12.053946   770 tablet_service.cc:1511] Processing CreateTablet for tablet 7f777cc9af6049989e4bd7f0b47e2dc7 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:12.055712   770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f777cc9af6049989e4bd7f0b47e2dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.054934   990 consensus_queue.cc:260] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.056059   840 tablet_service.cc:1511] Processing CreateTablet for tablet 7f777cc9af6049989e4bd7f0b47e2dc7 (DEFAULT_TABLE table=soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:12.057350   840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f777cc9af6049989e4bd7f0b47e2dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.058210   990 ts_tablet_manager.cc:1434] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 13:10:12.060168   990 tablet_bootstrap.cc:492] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:12.058750   991 raft_consensus.cc:359] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.062408   991 raft_consensus.cc:385] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.062772   991 raft_consensus.cc:740] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.063344   904 raft_consensus.cc:493] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.066829   904 raft_consensus.cc:515] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.073385   904 leader_election.cc:290] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.074244   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f810da8414ad3a5ccfdc5912e814b" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.075011   706 raft_consensus.cc:2468] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:12.077064   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f810da8414ad3a5ccfdc5912e814b" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:12.077697   991 consensus_queue.cc:260] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.078414   822 leader_election.cc:304] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.080227   991 ts_tablet_manager.cc:1434] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:10:12.077749   783 raft_consensus.cc:2468] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:12.082607   904 raft_consensus.cc:2804] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.083060   904 raft_consensus.cc:493] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.083432   904 raft_consensus.cc:3060] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.087415   991 tablet_bootstrap.cc:492] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:12.095721   994 tablet_bootstrap.cc:492] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:12.096207   994 ts_tablet_manager.cc:1403] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.137s	user 0.035s	sys 0.028s
I20260709 13:10:12.098363   990 tablet_bootstrap.cc:654] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.098556   991 tablet_bootstrap.cc:654] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.100131   921 raft_consensus.cc:493] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.100608   921 raft_consensus.cc:515] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.102834   921 leader_election.cc:290] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.098611   994 raft_consensus.cc:359] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.103276   994 raft_consensus.cc:385] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.103616   994 raft_consensus.cc:740] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.104470   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.104432   994 consensus_queue.cc:260] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.105191   706 raft_consensus.cc:2468] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:12.105310   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:12.102150   904 raft_consensus.cc:515] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.106617   748 leader_election.cc:304] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.107486   921 raft_consensus.cc:2804] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.107836   921 raft_consensus.cc:493] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:12.108093   749 leader_election.cc:343] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.108157   921 raft_consensus.cc:3060] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.118444   904 leader_election.cc:290] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.119720   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f810da8414ad3a5ccfdc5912e814b" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:12.120587   706 raft_consensus.cc:3060] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.128401   991 tablet_bootstrap.cc:492] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:12.129104   991 ts_tablet_manager.cc:1403] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.010s
I20260709 13:10:12.132436   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f810da8414ad3a5ccfdc5912e814b" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:12.133282   783 raft_consensus.cc:3060] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.132932   991 raft_consensus.cc:359] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.133893   991 raft_consensus.cc:385] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.134258   991 raft_consensus.cc:740] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.135488   991 consensus_queue.cc:260] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
W20260709 13:10:12.137149   655 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:12.141927  1000 raft_consensus.cc:493] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.147540  1000 raft_consensus.cc:515] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.146812   994 ts_tablet_manager.cc:1434] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.011s
I20260709 13:10:12.159571   783 raft_consensus.cc:2468] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.162837   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6782ddcec54afb8e90873b5f47c9b8" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.141804   706 raft_consensus.cc:2468] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.160729   994 tablet_bootstrap.cc:492] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:12.163978   822 leader_election.cc:304] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
W20260709 13:10:12.165290   822 leader_election.cc:343] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.167506   784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6782ddcec54afb8e90873b5f47c9b8" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:12.161836   921 raft_consensus.cc:515] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.168443   784 raft_consensus.cc:2468] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:12.170810   904 raft_consensus.cc:2804] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.173163   822 leader_election.cc:304] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:12.172526   921 leader_election.cc:290] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.173653   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:12.172009  1000 leader_election.cc:290] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.179297   991 ts_tablet_manager.cc:1434] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.018s
I20260709 13:10:12.179414  1000 raft_consensus.cc:2804] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:12.179880   749 leader_election.cc:343] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.180435  1000 raft_consensus.cc:493] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.180956  1000 raft_consensus.cc:3060] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.184252   994 tablet_bootstrap.cc:654] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.181128   991 tablet_bootstrap.cc:492] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:12.182874   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:12.191270   706 raft_consensus.cc:3060] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.192946   990 tablet_bootstrap.cc:492] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:12.193652   990 ts_tablet_manager.cc:1403] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.134s	user 0.029s	sys 0.055s
I20260709 13:10:12.196689   994 tablet_bootstrap.cc:492] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:12.197333   994 ts_tablet_manager.cc:1403] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.010s
I20260709 13:10:12.196985   990 raft_consensus.cc:359] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.199414   990 raft_consensus.cc:385] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.199762   990 raft_consensus.cc:740] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.200112   706 raft_consensus.cc:2468] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:12.200598   990 consensus_queue.cc:260] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.201416   994 raft_consensus.cc:359] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.204397   904 raft_consensus.cc:697] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:12.208422   991 tablet_bootstrap.cc:654] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.209024   990 ts_tablet_manager.cc:1434] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:10:12.210083   990 tablet_bootstrap.cc:492] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:12.209857  1000 raft_consensus.cc:515] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.212715   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6782ddcec54afb8e90873b5f47c9b8" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:12.213287   706 raft_consensus.cc:3060] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.213812   748 leader_election.cc:304] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 932f8c79c2f948328f8084f7e69845bf
I20260709 13:10:12.218945   990 tablet_bootstrap.cc:654] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.219738  1003 raft_consensus.cc:2804] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.220281   904 consensus_queue.cc:237] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.220296  1003 raft_consensus.cc:697] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:12.221259   991 tablet_bootstrap.cc:492] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:12.221838   991 ts_tablet_manager.cc:1403] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.009s
I20260709 13:10:12.222034  1003 consensus_queue.cc:237] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.223335   994 raft_consensus.cc:385] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.223701   994 raft_consensus.cc:740] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.224568   994 consensus_queue.cc:260] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.227752   994 ts_tablet_manager.cc:1434] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:10:12.229386   994 tablet_bootstrap.cc:492] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:12.225353   991 raft_consensus.cc:359] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.236474   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6782ddcec54afb8e90873b5f47c9b8" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:12.236855   991 raft_consensus.cc:385] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.237263   991 raft_consensus.cc:740] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.237332   783 raft_consensus.cc:3060] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.238292   991 consensus_queue.cc:260] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.240233   994 tablet_bootstrap.cc:654] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.241357   991 ts_tablet_manager.cc:1434] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:10:12.242571   991 tablet_bootstrap.cc:492] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:12.247860   921 raft_consensus.cc:493] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.248577   921 raft_consensus.cc:515] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.251825   921 leader_election.cc:290] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.254315   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:12.256680   706 raft_consensus.cc:2468] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.257594  1000 leader_election.cc:290] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.257329   602 catalog_manager.cc:5697] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 1 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.258772   783 raft_consensus.cc:2468] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.260561   822 leader_election.cc:304] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.252441   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.261786   991 tablet_bootstrap.cc:654] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.252650   994 tablet_bootstrap.cc:492] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:12.262485   994 ts_tablet_manager.cc:1403] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.010s
I20260709 13:10:12.265460   994 raft_consensus.cc:359] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.266130   994 raft_consensus.cc:385] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.265789  1000 raft_consensus.cc:2804] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.266500   994 raft_consensus.cc:740] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.266896  1000 raft_consensus.cc:697] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:12.267491   994 consensus_queue.cc:260] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
W20260709 13:10:12.267997   748 leader_election.cc:343] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:12.269309   749 leader_election.cc:343] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.268146  1000 consensus_queue.cc:237] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.270036   994 ts_tablet_manager.cc:1434] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:12.271101   994 tablet_bootstrap.cc:492] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:12.269749   749 leader_election.cc:304] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c; no voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:12.272578  1003 raft_consensus.cc:2749] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.275717   606 catalog_manager.cc:5697] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 1 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.277072   990 tablet_bootstrap.cc:492] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:12.277710   994 tablet_bootstrap.cc:654] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.279670   990 ts_tablet_manager.cc:1403] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.011s
I20260709 13:10:12.284157   990 raft_consensus.cc:359] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.285194   990 raft_consensus.cc:385] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.285588   990 raft_consensus.cc:740] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.287068   990 consensus_queue.cc:260] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.288848   990 ts_tablet_manager.cc:1434] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:12.289920   990 tablet_bootstrap.cc:492] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:12.295658   991 tablet_bootstrap.cc:492] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:12.296288   991 ts_tablet_manager.cc:1403] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.015s
I20260709 13:10:12.296336   602 catalog_manager.cc:5697] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 1 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.297371   990 tablet_bootstrap.cc:654] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.300050   991 raft_consensus.cc:359] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.300949   991 raft_consensus.cc:385] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.301353   991 raft_consensus.cc:740] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.302819   991 consensus_queue.cc:260] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.309752   990 tablet_bootstrap.cc:492] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:12.309922   994 tablet_bootstrap.cc:492] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:12.310200   991 ts_tablet_manager.cc:1434] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 13:10:12.310382   990 ts_tablet_manager.cc:1403] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.015s
I20260709 13:10:12.310514   994 ts_tablet_manager.cc:1403] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.010s
I20260709 13:10:12.311364   991 tablet_bootstrap.cc:492] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:12.313838   990 raft_consensus.cc:359] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.314682   990 raft_consensus.cc:385] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.314988   990 raft_consensus.cc:740] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.316017   990 consensus_queue.cc:260] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.316586   994 raft_consensus.cc:359] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.317358   994 raft_consensus.cc:385] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.317632   994 raft_consensus.cc:740] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.318778   990 ts_tablet_manager.cc:1434] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:12.318539   994 consensus_queue.cc:260] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.319787   990 tablet_bootstrap.cc:492] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:12.320264   991 tablet_bootstrap.cc:654] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.321290   994 ts_tablet_manager.cc:1434] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:10:12.322417   994 tablet_bootstrap.cc:492] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:12.328356   990 tablet_bootstrap.cc:654] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.331316   994 tablet_bootstrap.cc:654] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.335646   991 tablet_bootstrap.cc:492] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:12.336170   991 ts_tablet_manager.cc:1403] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.003s
I20260709 13:10:12.337692   990 tablet_bootstrap.cc:492] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:12.338228   990 ts_tablet_manager.cc:1403] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:10:12.339174   991 raft_consensus.cc:359] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.339946   991 raft_consensus.cc:385] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.340251   991 raft_consensus.cc:740] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.341034   991 consensus_queue.cc:260] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.341312   990 raft_consensus.cc:359] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.342037   990 raft_consensus.cc:385] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.342355   990 raft_consensus.cc:740] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.343184   990 consensus_queue.cc:260] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.345384   990 ts_tablet_manager.cc:1434] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:12.346345   990 tablet_bootstrap.cc:492] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:12.351965   991 ts_tablet_manager.cc:1434] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:10:12.352977   990 tablet_bootstrap.cc:654] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.353084   991 tablet_bootstrap.cc:492] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:12.361861   991 tablet_bootstrap.cc:654] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.380931   994 tablet_bootstrap.cc:492] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:12.381546   994 ts_tablet_manager.cc:1403] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.032s
I20260709 13:10:12.384521   994 raft_consensus.cc:359] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.386360   994 raft_consensus.cc:385] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.386675   994 raft_consensus.cc:740] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.387828   991 tablet_bootstrap.cc:492] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:12.387455   994 consensus_queue.cc:260] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.388414   991 ts_tablet_manager.cc:1403] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.005s
I20260709 13:10:12.388434   990 tablet_bootstrap.cc:492] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:12.389912   994 ts_tablet_manager.cc:1434] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.005s
I20260709 13:10:12.390905   990 ts_tablet_manager.cc:1403] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.026s
I20260709 13:10:12.391472   994 tablet_bootstrap.cc:492] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:12.393989   990 raft_consensus.cc:359] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.394723   990 raft_consensus.cc:385] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.395033   990 raft_consensus.cc:740] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.395867   990 consensus_queue.cc:260] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.397477   991 raft_consensus.cc:359] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.398406   991 raft_consensus.cc:385] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.398813   994 tablet_bootstrap.cc:654] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.398761   991 raft_consensus.cc:740] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.399464   990 ts_tablet_manager.cc:1434] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:10:12.399884   991 consensus_queue.cc:260] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.402310   991 ts_tablet_manager.cc:1434] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:10:12.402515   990 tablet_bootstrap.cc:492] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:12.402727  1000 raft_consensus.cc:493] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.403455   991 tablet_bootstrap.cc:492] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:12.403445  1000 raft_consensus.cc:515] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.408830  1004 raft_consensus.cc:493] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.409370  1004 raft_consensus.cc:515] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.410643   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.411465   991 tablet_bootstrap.cc:654] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.411571   709 raft_consensus.cc:2468] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:12.413236  1000 leader_election.cc:290] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.413749   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:12.414042   822 leader_election.cc:304] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.416085   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:12.411511  1004 leader_election.cc:290] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.416666   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.417826   709 raft_consensus.cc:2393] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 932f8c79c2f948328f8084f7e69845bf in current term 1: Already voted for candidate 0920d2f774f14e05961d4af4689dd22c in this term.
I20260709 13:10:12.416715   783 raft_consensus.cc:2468] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:12.417021  1004 raft_consensus.cc:2804] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.421511  1004 raft_consensus.cc:493] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.421893  1004 raft_consensus.cc:3060] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.423583   991 tablet_bootstrap.cc:492] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:12.424081   991 ts_tablet_manager.cc:1403] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 13:10:12.426949   991 raft_consensus.cc:359] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.427762   991 raft_consensus.cc:385] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.428081   991 raft_consensus.cc:740] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.428807   991 consensus_queue.cc:260] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.432866   991 ts_tablet_manager.cc:1434] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:12.433857   991 tablet_bootstrap.cc:492] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c: Bootstrap starting.
I20260709 13:10:12.434894  1004 raft_consensus.cc:515] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.436853  1004 leader_election.cc:290] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.433046   990 tablet_bootstrap.cc:654] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.439967   991 tablet_bootstrap.cc:654] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.446866   822 leader_election.cc:304] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf; no voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:12.447682  1004 raft_consensus.cc:3060] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.448863   991 tablet_bootstrap.cc:492] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c: No bootstrap required, opened a new log
I20260709 13:10:12.449342   991 ts_tablet_manager.cc:1403] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 13:10:12.450865   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:12.451452   783 raft_consensus.cc:3060] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.452064   991 raft_consensus.cc:359] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.452760   991 raft_consensus.cc:385] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.453032   991 raft_consensus.cc:740] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.453681   991 consensus_queue.cc:260] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.455191   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:12.456553   709 raft_consensus.cc:3060] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.457759  1004 raft_consensus.cc:2749] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.459753   994 tablet_bootstrap.cc:492] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:12.460484   994 ts_tablet_manager.cc:1403] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.069s	user 0.037s	sys 0.018s
I20260709 13:10:12.460510  1003 raft_consensus.cc:493] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.461373  1003 raft_consensus.cc:515] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.462947   990 tablet_bootstrap.cc:492] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:12.463426  1003 leader_election.cc:290] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.464529   709 raft_consensus.cc:2468] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.455941   991 ts_tablet_manager.cc:1434] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:12.465036   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.464901   994 raft_consensus.cc:359] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.465672   994 raft_consensus.cc:385] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.465785   822 leader_election.cc:304] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.466143   994 raft_consensus.cc:740] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.466715  1004 raft_consensus.cc:2804] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.467031   994 consensus_queue.cc:260] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.465719   706 raft_consensus.cc:2468] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:12.469606   748 leader_election.cc:304] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.473483  1003 raft_consensus.cc:2804] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.473834  1003 raft_consensus.cc:493] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.474216  1003 raft_consensus.cc:3060] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.469722   950 raft_consensus.cc:493] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.463420   990 ts_tablet_manager.cc:1403] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.012s
I20260709 13:10:12.475134   950 raft_consensus.cc:515] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.471189   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:12.477658   783 raft_consensus.cc:2468] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.469678   994 ts_tablet_manager.cc:1434] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:10:12.478299   857 raft_consensus.cc:2468] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:12.478596   921 raft_consensus.cc:493] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.479102   921 raft_consensus.cc:515] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.479271   994 tablet_bootstrap.cc:492] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:12.468230  1004 raft_consensus.cc:697] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:12.480400  1004 consensus_queue.cc:237] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.480423   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:12.481189   921 leader_election.cc:290] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.481400   857 raft_consensus.cc:2468] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 0.
I20260709 13:10:12.481763  1000 raft_consensus.cc:493] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.482285  1000 raft_consensus.cc:515] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.482935   674 leader_election.cc:304] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.484388  1000 leader_election.cc:290] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.477867   990 raft_consensus.cc:359] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.486223   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:12.486511   990 raft_consensus.cc:385] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.486629   921 raft_consensus.cc:493] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.487504   921 raft_consensus.cc:515] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.488421  1025 raft_consensus.cc:2804] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.488821  1025 raft_consensus.cc:493] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.488750   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:12.489342  1025 raft_consensus.cc:3060] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.489936   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.490846   921 leader_election.cc:290] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
W20260709 13:10:12.492130   748 leader_election.cc:343] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.493201   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f777cc9af6049989e4bd7f0b47e2dc7" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.496052   950 leader_election.cc:290] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.486794   990 raft_consensus.cc:740] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
W20260709 13:10:12.494315   749 leader_election.cc:343] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.497143  1003 raft_consensus.cc:515] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.495349   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f777cc9af6049989e4bd7f0b47e2dc7" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:12.497575   749 leader_election.cc:304] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c; no voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:12.498936   990 consensus_queue.cc:260] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.500463   921 raft_consensus.cc:2749] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.500824   706 raft_consensus.cc:2468] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 0.
I20260709 13:10:12.497509   994 tablet_bootstrap.cc:654] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.502830   784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9fe85d85d4491d9eb33a07d6dc6b13" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:12.503726   784 raft_consensus.cc:2468] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:12.504914   748 leader_election.cc:304] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.505829  1025 raft_consensus.cc:515] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.507066   822 leader_election.cc:304] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:12.508008  1000 raft_consensus.cc:2804] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.508363  1000 raft_consensus.cc:493] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.506068   921 raft_consensus.cc:2804] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.508688  1000 raft_consensus.cc:3060] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.510990  1025 leader_election.cc:290] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.508661   784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:12.515848   990 ts_tablet_manager.cc:1434] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:10:12.522303   921 raft_consensus.cc:493] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.522800   921 raft_consensus.cc:3060] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:12.533946   749 leader_election.cc:343] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.540599   990 tablet_bootstrap.cc:492] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49: Bootstrap starting.
I20260709 13:10:12.550231   990 tablet_bootstrap.cc:654] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.552541   994 tablet_bootstrap.cc:492] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
W20260709 13:10:12.552488   674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.53.131:34643, user_credentials={real_user=slave}} blocked reactor thread for 69808.6us
I20260709 13:10:12.553267   994 ts_tablet_manager.cc:1403] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.026s
I20260709 13:10:12.554514   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:12.554945   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9fe85d85d4491d9eb33a07d6dc6b13" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.555369   857 raft_consensus.cc:3060] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.555639   706 raft_consensus.cc:2468] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:12.556049   994 raft_consensus.cc:359] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.556736   994 raft_consensus.cc:385] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.558319   994 raft_consensus.cc:740] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.559006   994 consensus_queue.cc:260] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.521447  1000 raft_consensus.cc:515] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.563431   994 ts_tablet_manager.cc:1434] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:12.564344   994 tablet_bootstrap.cc:492] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf: Bootstrap starting.
I20260709 13:10:12.565439   783 raft_consensus.cc:2393] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd9a363b972040448b83c054f8ec1c49 in current term 1: Already voted for candidate 0920d2f774f14e05961d4af4689dd22c in this term.
I20260709 13:10:12.570937   994 tablet_bootstrap.cc:654] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.576162   990 tablet_bootstrap.cc:492] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49: No bootstrap required, opened a new log
I20260709 13:10:12.576624   990 ts_tablet_manager.cc:1403] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:10:12.576956  1003 leader_election.cc:290] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.578049   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:12.578847   706 raft_consensus.cc:2393] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0920d2f774f14e05961d4af4689dd22c in current term 1: Already voted for candidate bd9a363b972040448b83c054f8ec1c49 in this term.
I20260709 13:10:12.579216   990 raft_consensus.cc:359] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.579866   990 raft_consensus.cc:385] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.580128   990 raft_consensus.cc:740] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.580780   990 consensus_queue.cc:260] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.581359   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9fe85d85d4491d9eb33a07d6dc6b13" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:12.581904   706 raft_consensus.cc:3060] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.582818   990 ts_tablet_manager.cc:1434] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:10:12.583362  1000 leader_election.cc:290] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.588038   921 raft_consensus.cc:515] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.590070   921 leader_election.cc:290] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.590463   857 raft_consensus.cc:2468] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 1.
I20260709 13:10:12.592142   674 leader_election.cc:304] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 0920d2f774f14e05961d4af4689dd22c
I20260709 13:10:12.593026  1027 raft_consensus.cc:2804] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.592944   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f777cc9af6049989e4bd7f0b47e2dc7" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:12.593622  1027 raft_consensus.cc:697] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:12.593737   709 raft_consensus.cc:3060] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.594709  1027 consensus_queue.cc:237] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.599436   706 raft_consensus.cc:2468] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.600435   822 leader_election.cc:304] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.601317  1004 raft_consensus.cc:2804] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.601226   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:12.601909  1004 raft_consensus.cc:697] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:12.602562   857 raft_consensus.cc:2393] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0920d2f774f14e05961d4af4689dd22c in current term 1: Already voted for candidate bd9a363b972040448b83c054f8ec1c49 in this term.
I20260709 13:10:12.601771   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f777cc9af6049989e4bd7f0b47e2dc7" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:12.603201   858 raft_consensus.cc:3060] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.602972  1004 consensus_queue.cc:237] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.606452   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9fe85d85d4491d9eb33a07d6dc6b13" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:12.607064   783 raft_consensus.cc:3060] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.606457   749 leader_election.cc:304] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c; no voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:12.611038   994 tablet_bootstrap.cc:492] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf: No bootstrap required, opened a new log
I20260709 13:10:12.611161  1002 raft_consensus.cc:2749] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.611608   994 ts_tablet_manager.cc:1403] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.009s
I20260709 13:10:12.614394   994 raft_consensus.cc:359] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.615007   994 raft_consensus.cc:385] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.615269   994 raft_consensus.cc:740] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.616027   783 raft_consensus.cc:2468] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.615932   994 consensus_queue.cc:260] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.616824   709 raft_consensus.cc:2468] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:12.618127   748 leader_election.cc:304] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.618721   994 ts_tablet_manager.cc:1434] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:12.619004  1002 raft_consensus.cc:2804] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.619539  1002 raft_consensus.cc:697] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:12.620711  1002 consensus_queue.cc:237] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.620959   603 catalog_manager.cc:5697] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 1 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.627599   858 raft_consensus.cc:2468] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 1.
I20260709 13:10:12.633780   602 catalog_manager.cc:5697] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 1 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.637593  1004 raft_consensus.cc:493] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.638082  1004 raft_consensus.cc:515] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.638227   607 catalog_manager.cc:5697] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.640033  1004 leader_election.cc:290] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.641707   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ec15dc0dd149fe891850d376e6c6bb" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:12.641717   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ec15dc0dd149fe891850d376e6c6bb" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49" is_pre_election: true
I20260709 13:10:12.642493   783 raft_consensus.cc:2468] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:12.644711  1002 consensus_queue.cc:1048] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.645172   822 leader_election.cc:304] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:12.645984  1004 raft_consensus.cc:2804] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.646382  1004 raft_consensus.cc:493] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.646714  1004 raft_consensus.cc:3060] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.648962   709 raft_consensus.cc:2468] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 0.
I20260709 13:10:12.653611   603 catalog_manager.cc:5697] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 1 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.654105  1004 raft_consensus.cc:515] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.657008   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ec15dc0dd149fe891850d376e6c6bb" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:12.657367   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ec15dc0dd149fe891850d376e6c6bb" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:12.657666   709 raft_consensus.cc:3060] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.657938   783 raft_consensus.cc:3060] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.664501   709 raft_consensus.cc:2468] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.664501   783 raft_consensus.cc:2468] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 1.
I20260709 13:10:12.665642   822 leader_election.cc:304] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.665081  1004 leader_election.cc:290] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 1 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:12.666828  1000 raft_consensus.cc:2804] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.667338  1000 raft_consensus.cc:697] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:12.668346  1000 consensus_queue.cc:237] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.672780  1002 consensus_queue.cc:1048] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.686913   603 catalog_manager.cc:5697] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 1 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.694022  1000 consensus_queue.cc:1048] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.705241   904 consensus_queue.cc:1048] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.789654   904 consensus_queue.cc:1048] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.805224  1027 raft_consensus.cc:493] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.805719  1027 raft_consensus.cc:515] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.807390  1004 consensus_queue.cc:1048] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.807792  1027 leader_election.cc:290] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.809130   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c" is_pre_election: true
I20260709 13:10:12.809268   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf" is_pre_election: true
I20260709 13:10:12.809780   783 raft_consensus.cc:2468] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 0.
I20260709 13:10:12.809978   857 raft_consensus.cc:2468] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 0.
I20260709 13:10:12.811120   673 leader_election.cc:304] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.812289  1025 raft_consensus.cc:2804] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.812669  1025 raft_consensus.cc:493] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.813045  1025 raft_consensus.cc:3060] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.819242  1025 raft_consensus.cc:515] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.820879  1025 leader_election.cc:290] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:12.821575   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:12.821781   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:12.822111   783 raft_consensus.cc:3060] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.822434   857 raft_consensus.cc:3060] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.827654   857 raft_consensus.cc:2468] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 1.
I20260709 13:10:12.827672   783 raft_consensus.cc:2468] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 1.
I20260709 13:10:12.828583   674 leader_election.cc:304] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:12.829233  1025 raft_consensus.cc:2804] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.829698  1025 raft_consensus.cc:697] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:12.830448  1025 consensus_queue.cc:237] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:12.836510   607 catalog_manager.cc:5697] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 1 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.892590  1044 consensus_queue.cc:1048] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.901829  1044 consensus_queue.cc:1048] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.950280   857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e37f810da8414ad3a5ccfdc5912e814b"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
mode: GRACEFUL
new_leader_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:10:12.950862   857 raft_consensus.cc:606] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Received request to transfer leadership to TS bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:12.955476   783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
mode: GRACEFUL
new_leader_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:58642
I20260709 13:10:12.955904   783 raft_consensus.cc:606] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Received request to transfer leadership to TS bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:12.960614   857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a6782ddcec54afb8e90873b5f47c9b8"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
mode: GRACEFUL
new_leader_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:10:12.961174   857 raft_consensus.cc:606] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Received request to transfer leadership to TS bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:12.965519   857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
mode: GRACEFUL
new_leader_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:10:12.965978   857 raft_consensus.cc:606] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Received request to transfer leadership to TS bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:12.970595   857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6ec15dc0dd149fe891850d376e6c6bb"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
mode: GRACEFUL
new_leader_uuid: "0920d2f774f14e05961d4af4689dd22c"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:10:12.971037   857 raft_consensus.cc:606] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Received request to transfer leadership to TS 0920d2f774f14e05961d4af4689dd22c
I20260709 13:10:12.984745   706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
mode: GRACEFUL
new_leader_uuid: "0920d2f774f14e05961d4af4689dd22c"
 from {username='slave'} at 127.0.0.1:43606
I20260709 13:10:12.985338   706 raft_consensus.cc:606] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Received request to transfer leadership to TS 0920d2f774f14e05961d4af4689dd22c
I20260709 13:10:12.990631   857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f9fe85d85d4491d9eb33a07d6dc6b13"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
mode: GRACEFUL
new_leader_uuid: "0920d2f774f14e05961d4af4689dd22c"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:10:12.991122   857 raft_consensus.cc:606] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Received request to transfer leadership to TS 0920d2f774f14e05961d4af4689dd22c
I20260709 13:10:12.995705   709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
mode: GRACEFUL
new_leader_uuid: "0920d2f774f14e05961d4af4689dd22c"
 from {username='slave'} at 127.0.0.1:43606
I20260709 13:10:12.996104   709 raft_consensus.cc:606] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Received request to transfer leadership to TS 0920d2f774f14e05961d4af4689dd22c
I20260709 13:10:13.000581   783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f777cc9af6049989e4bd7f0b47e2dc7"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
mode: GRACEFUL
new_leader_uuid: "932f8c79c2f948328f8084f7e69845bf"
 from {username='slave'} at 127.0.0.1:58642
I20260709 13:10:13.001017   783 raft_consensus.cc:606] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Received request to transfer leadership to TS 932f8c79c2f948328f8084f7e69845bf
I20260709 13:10:13.047571  1025 consensus_queue.cc:1048] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.057245  1025 consensus_queue.cc:1048] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.068323  1027 raft_consensus.cc:993] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49: : Instructing follower 0920d2f774f14e05961d4af4689dd22c to start an election
I20260709 13:10:13.068815  1052 raft_consensus.cc:1081] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Signalling peer 0920d2f774f14e05961d4af4689dd22c to start an election
I20260709 13:10:13.070402   783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
 from {username='slave'} at 127.0.0.1:58640
I20260709 13:10:13.070960   783 raft_consensus.cc:493] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.071285   783 raft_consensus.cc:3060] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.076436   783 raft_consensus.cc:515] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.078523   783 leader_election.cc:290] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 2 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:13.079026   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:13.078904   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0fcbaa460e457eb8c842c5deed98fd" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:13.079695   857 raft_consensus.cc:3060] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.079752   709 raft_consensus.cc:3055] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.080176   709 raft_consensus.cc:740] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:13.081000   709 consensus_queue.cc:260] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.082273   709 raft_consensus.cc:3060] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.086341   857 raft_consensus.cc:2468] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 2.
I20260709 13:10:13.087371   749 leader_election.cc:304] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:13.088114  1030 raft_consensus.cc:2804] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.088546  1030 raft_consensus.cc:697] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 2 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:13.088760   709 raft_consensus.cc:2468] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 2.
I20260709 13:10:13.089279  1030 consensus_queue.cc:237] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.095686   603 catalog_manager.cc:5697] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 1 to 2, leader changed from bd9a363b972040448b83c054f8ec1c49 (127.20.53.129) to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 2 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.123777  1000 consensus_queue.cc:1048] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.129925  1044 raft_consensus.cc:993] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf: : Instructing follower 0920d2f774f14e05961d4af4689dd22c to start an election
I20260709 13:10:13.130453   904 raft_consensus.cc:1081] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Signalling peer 0920d2f774f14e05961d4af4689dd22c to start an election
I20260709 13:10:13.132126   784 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6ec15dc0dd149fe891850d376e6c6bb"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
 from {username='slave'} at 127.0.0.1:58628
I20260709 13:10:13.132776   784 raft_consensus.cc:493] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.133205   784 raft_consensus.cc:3060] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.135656  1044 consensus_queue.cc:1048] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.146410   784 raft_consensus.cc:515] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.150671   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ec15dc0dd149fe891850d376e6c6bb" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:13.154683   709 raft_consensus.cc:3060] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.158749   784 leader_election.cc:290] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 2 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:13.159796   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ec15dc0dd149fe891850d376e6c6bb" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:13.160372   857 raft_consensus.cc:3055] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.160622   857 raft_consensus.cc:740] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:13.161300   857 consensus_queue.cc:260] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.161470   709 raft_consensus.cc:2468] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 2.
I20260709 13:10:13.162374   857 raft_consensus.cc:3060] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.162547   748 leader_election.cc:304] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:13.163381  1030 raft_consensus.cc:2804] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.165689  1030 raft_consensus.cc:697] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 2 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:13.166574  1030 consensus_queue.cc:237] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.168195  1002 consensus_queue.cc:1048] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.169313   857 raft_consensus.cc:2468] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 2.
I20260709 13:10:13.175707   602 catalog_manager.cc:5697] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 1 to 2, leader changed from 932f8c79c2f948328f8084f7e69845bf (127.20.53.131) to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 2 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.183961  1030 consensus_queue.cc:1048] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.182982  1002 raft_consensus.cc:993] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c: : Instructing follower 932f8c79c2f948328f8084f7e69845bf to start an election
I20260709 13:10:13.185503  1030 raft_consensus.cc:1081] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Signalling peer 932f8c79c2f948328f8084f7e69845bf to start an election
I20260709 13:10:13.190817  1044 consensus_queue.cc:1048] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.192173   857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f777cc9af6049989e4bd7f0b47e2dc7"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
 from {username='slave'} at 127.0.0.1:49704
I20260709 13:10:13.192798   857 raft_consensus.cc:493] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.193207   857 raft_consensus.cc:3060] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.204905  1004 consensus_queue.cc:1048] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.210994   857 raft_consensus.cc:515] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.216560   857 leader_election.cc:290] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 2 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:13.216609   706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f777cc9af6049989e4bd7f0b47e2dc7" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:13.217690   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f777cc9af6049989e4bd7f0b47e2dc7" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:13.218582   783 raft_consensus.cc:3055] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.218869   783 raft_consensus.cc:740] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:13.219530   783 consensus_queue.cc:260] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.223826   904 raft_consensus.cc:993] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf: : Instructing follower 0920d2f774f14e05961d4af4689dd22c to start an election
I20260709 13:10:13.224392  1000 raft_consensus.cc:1081] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Signalling peer 0920d2f774f14e05961d4af4689dd22c to start an election
I20260709 13:10:13.225517   783 raft_consensus.cc:3060] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.226017   782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f9fe85d85d4491d9eb33a07d6dc6b13"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
 from {username='slave'} at 127.0.0.1:58628
I20260709 13:10:13.226655   782 raft_consensus.cc:493] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.227008   782 raft_consensus.cc:3060] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.238499   783 raft_consensus.cc:2468] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 2.
I20260709 13:10:13.240093   782 raft_consensus.cc:515] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.241912   782 leader_election.cc:290] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 2 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:13.242563   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9fe85d85d4491d9eb33a07d6dc6b13" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:13.243142   709 raft_consensus.cc:3060] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.246524   822 leader_election.cc:304] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: bd9a363b972040448b83c054f8ec1c49
I20260709 13:10:13.247443   904 raft_consensus.cc:2804] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.247901   904 raft_consensus.cc:697] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 2 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:13.248611   904 consensus_queue.cc:237] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.249011   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9fe85d85d4491d9eb33a07d6dc6b13" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:13.249593   857 raft_consensus.cc:3055] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.249883   857 raft_consensus.cc:740] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:13.250670   857 consensus_queue.cc:260] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.251901   857 raft_consensus.cc:3060] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.253945   709 raft_consensus.cc:2468] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 2.
I20260709 13:10:13.255479   748 leader_election.cc:304] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:13.256279  1002 raft_consensus.cc:2804] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.256731  1002 raft_consensus.cc:697] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 2 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:13.257714  1000 raft_consensus.cc:993] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf: : Instructing follower bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:13.257507  1002 consensus_queue.cc:237] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.258222  1000 raft_consensus.cc:1081] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Signalling peer bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:13.258651   857 raft_consensus.cc:2468] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 2.
I20260709 13:10:13.259757   706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a6782ddcec54afb8e90873b5f47c9b8"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:10:13.260385   706 raft_consensus.cc:493] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.260769   706 raft_consensus.cc:3060] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.263726   603 catalog_manager.cc:5697] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 1 to 2, leader changed from 0920d2f774f14e05961d4af4689dd22c (127.20.53.130) to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 2 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.267587   607 catalog_manager.cc:5697] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 1 to 2, leader changed from 932f8c79c2f948328f8084f7e69845bf (127.20.53.131) to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 2 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.270655   904 raft_consensus.cc:993] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf: : Instructing follower bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:13.271123   904 raft_consensus.cc:1081] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Signalling peer bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:13.271231   706 raft_consensus.cc:515] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.272374  1056 raft_consensus.cc:993] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c: : Instructing follower bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:13.272684   709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e37f810da8414ad3a5ccfdc5912e814b"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:10:13.272843  1030 raft_consensus.cc:1081] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Signalling peer bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:13.273237   709 raft_consensus.cc:493] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.273633   709 raft_consensus.cc:3060] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.279511   706 leader_election.cc:290] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:13.279794   782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6782ddcec54afb8e90873b5f47c9b8" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:13.280031   858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6782ddcec54afb8e90873b5f47c9b8" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:13.280400   782 raft_consensus.cc:3060] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.280644   858 raft_consensus.cc:3055] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.281072   858 raft_consensus.cc:740] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:13.281980   709 raft_consensus.cc:515] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.281885   858 consensus_queue.cc:260] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.284466   709 leader_election.cc:290] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:13.282310   708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:57044
I20260709 13:10:13.285189   708 raft_consensus.cc:493] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.285524   856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f810da8414ad3a5ccfdc5912e814b" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:13.285576   708 raft_consensus.cc:3060] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.286221   856 raft_consensus.cc:3055] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.286527   856 raft_consensus.cc:740] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:13.287365   856 consensus_queue.cc:260] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.287411   858 raft_consensus.cc:3060] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.288776   856 raft_consensus.cc:3060] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.290927   782 raft_consensus.cc:2468] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:13.292027   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f810da8414ad3a5ccfdc5912e814b" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:13.292203   673 leader_election.cc:304] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:13.292686   783 raft_consensus.cc:3060] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.293126  1052 raft_consensus.cc:2804] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.293656  1052 raft_consensus.cc:697] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:13.293534   708 raft_consensus.cc:515] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.296916   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:13.297462   857 raft_consensus.cc:3060] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.296113   708 leader_election.cc:290] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:13.297652  1052 consensus_queue.cc:237] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.299316   783 raft_consensus.cc:2468] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:13.299861   782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f524e4bbf7474b8ab3923a1529ee153e" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:13.300452   782 raft_consensus.cc:3055] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.300452   673 leader_election.cc:304] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:13.301005   782 raft_consensus.cc:740] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:13.302435  1027 raft_consensus.cc:2804] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.302692   856 raft_consensus.cc:2468] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:13.302944  1027 raft_consensus.cc:697] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:13.303855  1027 consensus_queue.cc:237] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.304010   782 consensus_queue.cc:260] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.305284   782 raft_consensus.cc:3060] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.307142   857 raft_consensus.cc:2468] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:13.306962   607 catalog_manager.cc:5697] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 1 to 2, leader changed from 932f8c79c2f948328f8084f7e69845bf (127.20.53.131) to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.308221   674 leader_election.cc:304] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:13.309130  1027 raft_consensus.cc:2804] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.309758  1027 raft_consensus.cc:697] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:13.310460   858 raft_consensus.cc:2468] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:13.311571   782 raft_consensus.cc:2468] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:13.310551  1027 consensus_queue.cc:237] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.316623  1027 consensus_queue.cc:1048] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.325738   603 catalog_manager.cc:5697] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 1 to 2, leader changed from 932f8c79c2f948328f8084f7e69845bf (127.20.53.131) to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.327538   603 catalog_manager.cc:5697] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 1 to 2, leader changed from 0920d2f774f14e05961d4af4689dd22c (127.20.53.130) to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.331293  1027 consensus_queue.cc:1048] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.340503  1025 raft_consensus.cc:993] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49: : Instructing follower 0920d2f774f14e05961d4af4689dd22c to start an election
I20260709 13:10:13.340968  1027 raft_consensus.cc:1081] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Signalling peer 0920d2f774f14e05961d4af4689dd22c to start an election
I20260709 13:10:13.342590   782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
 from {username='slave'} at 127.0.0.1:58640
I20260709 13:10:13.343163   782 raft_consensus.cc:493] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.343503   782 raft_consensus.cc:3060] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.348163   782 raft_consensus.cc:515] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.349596   782 leader_election.cc:290] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 2 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:13.350378   708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:13.350656   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a03e5b3c548999bb557c28ecb0483" candidate_uuid: "0920d2f774f14e05961d4af4689dd22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:13.351008   708 raft_consensus.cc:3055] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.351246   857 raft_consensus.cc:3060] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.351420   708 raft_consensus.cc:740] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:13.352254   708 consensus_queue.cc:260] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.353201   708 raft_consensus.cc:3060] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.356499   857 raft_consensus.cc:2468] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 2.
I20260709 13:10:13.357542   749 leader_election.cc:304] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:13.358275  1030 raft_consensus.cc:2804] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.358625   708 raft_consensus.cc:2468] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0920d2f774f14e05961d4af4689dd22c in term 2.
I20260709 13:10:13.358778  1030 raft_consensus.cc:697] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 2 LEADER]: Becoming Leader. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:13.359669  1030 consensus_queue.cc:237] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.365394   607 catalog_manager.cc:5697] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c reported cstate change: term changed from 1 to 2, leader changed from bd9a363b972040448b83c054f8ec1c49 (127.20.53.129) to 0920d2f774f14e05961d4af4689dd22c (127.20.53.130). New cstate: current_term: 2 leader_uuid: "0920d2f774f14e05961d4af4689dd22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.460512   904 raft_consensus.cc:993] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf: : Instructing follower bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:13.461023  1004 raft_consensus.cc:1081] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Signalling peer bd9a363b972040448b83c054f8ec1c49 to start an election
I20260709 13:10:13.462512   708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
 from {username='slave'} at 127.0.0.1:57056
I20260709 13:10:13.463023   708 raft_consensus.cc:493] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.463356   708 raft_consensus.cc:3060] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.468509   708 raft_consensus.cc:515] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.470120   708 leader_election.cc:290] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Requested vote from peers 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457), 932f8c79c2f948328f8084f7e69845bf (127.20.53.131:34643)
I20260709 13:10:13.470889   782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:13.471071   857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01d817e1d9446e98e58a9d429cb02de" candidate_uuid: "bd9a363b972040448b83c054f8ec1c49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
I20260709 13:10:13.471534   782 raft_consensus.cc:3060] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.471583   857 raft_consensus.cc:3055] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.471987   857 raft_consensus.cc:740] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:13.472711   857 consensus_queue.cc:260] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.473738   857 raft_consensus.cc:3060] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.478978   782 raft_consensus.cc:2468] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:13.479650   783 raft_consensus.cc:1240] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Rejecting Update request from peer 932f8c79c2f948328f8084f7e69845bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:13.480072   857 raft_consensus.cc:2468] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9a363b972040448b83c054f8ec1c49 in term 2.
I20260709 13:10:13.480300   673 leader_election.cc:304] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:13.481297  1027 raft_consensus.cc:2804] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.481761  1027 raft_consensus.cc:697] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Becoming Leader. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:13.482581  1027 consensus_queue.cc:237] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:13.489216   607 catalog_manager.cc:5697] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 reported cstate change: term changed from 1 to 2, leader changed from 932f8c79c2f948328f8084f7e69845bf (127.20.53.131) to bd9a363b972040448b83c054f8ec1c49 (127.20.53.129). New cstate: current_term: 2 leader_uuid: "bd9a363b972040448b83c054f8ec1c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.541226   708 raft_consensus.cc:1275] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Refusing update from remote peer 0920d2f774f14e05961d4af4689dd22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.542441  1030 consensus_queue.cc:1048] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.548923   857 raft_consensus.cc:1275] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer 0920d2f774f14e05961d4af4689dd22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.550441  1056 consensus_queue.cc:1048] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.647306   857 raft_consensus.cc:1275] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer 0920d2f774f14e05961d4af4689dd22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.648557  1056 consensus_queue.cc:1048] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.656311   708 raft_consensus.cc:1275] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Refusing update from remote peer 0920d2f774f14e05961d4af4689dd22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.657555  1030 consensus_queue.cc:1048] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.695442   857 raft_consensus.cc:1275] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.696604  1027 consensus_queue.cc:1048] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.707365   782 raft_consensus.cc:1275] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.708694  1052 consensus_queue.cc:1048] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.714506   783 raft_consensus.cc:1275] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.715946  1052 consensus_queue.cc:1048] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.722738   857 raft_consensus.cc:1275] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.724231  1027 consensus_queue.cc:1048] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.742419   708 raft_consensus.cc:3060] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.749188   857 raft_consensus.cc:1275] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer 0920d2f774f14e05961d4af4689dd22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.749188   708 raft_consensus.cc:1275] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Refusing update from remote peer 932f8c79c2f948328f8084f7e69845bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.750905  1000 consensus_queue.cc:1048] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.750800  1030 consensus_queue.cc:1048] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.760892   858 raft_consensus.cc:1275] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.762763  1027 consensus_queue.cc:1048] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.762957   858 raft_consensus.cc:1275] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer 0920d2f774f14e05961d4af4689dd22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.764801  1030 consensus_queue.cc:1048] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.768594   709 raft_consensus.cc:1275] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Refusing update from remote peer 0920d2f774f14e05961d4af4689dd22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.774641   783 raft_consensus.cc:1275] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.776648  1052 consensus_queue.cc:1048] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.781492   782 raft_consensus.cc:1275] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer 932f8c79c2f948328f8084f7e69845bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.788340  1056 consensus_queue.cc:1048] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.790915  1000 consensus_queue.cc:1048] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.794661   708 raft_consensus.cc:1275] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Refusing update from remote peer 0920d2f774f14e05961d4af4689dd22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.798802  1030 consensus_queue.cc:1048] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.958767   783 raft_consensus.cc:1275] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.959949  1052 consensus_queue.cc:1048] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.968056   858 raft_consensus.cc:1275] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Refusing update from remote peer bd9a363b972040448b83c054f8ec1c49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.969887  1025 consensus_queue.cc:1048] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.003757   602 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57622:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:16.021466   602 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57622:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:16.052103 20694 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:16.158530  1102 tablet.cc:1724] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.190266  1102 tablet.cc:1724] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.233609  1115 tablet.cc:1724] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.245048   783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03d71eb6224348439b68ae13789dbfdc"
dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
mode: GRACEFUL
new_leader_uuid: "932f8c79c2f948328f8084f7e69845bf"
 from {username='slave'} at 127.0.0.1:40444
I20260709 13:10:16.245710   783 raft_consensus.cc:606] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Received request to transfer leadership to TS 932f8c79c2f948328f8084f7e69845bf
W20260709 13:10:16.261318   749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:34643, user_credentials={real_user=slave}} blocked reactor thread for 77256.5us
I20260709 13:10:16.283676  1117 tablet.cc:1724] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.320667  1114 tablet.cc:1724] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.324977  1126 tablet.cc:1724] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.332614  1116 tablet.cc:1724] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.333541  1102 tablet.cc:1724] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:16.367172  1095 log.cc:927] Time spent T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:10:16.375053   749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:34643, user_credentials={real_user=slave}} blocked reactor thread for 92801.9us
I20260709 13:10:16.396130  1102 tablet.cc:1724] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.405292  1117 tablet.cc:1724] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:16.452636   673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.130:33457, user_credentials={real_user=slave}} blocked reactor thread for 46830.9us
W20260709 13:10:16.453068   674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.53.131:34643, user_credentials={real_user=slave}} blocked reactor thread for 45503.9us
I20260709 13:10:16.462378  1133 tablet.cc:1724] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.363384  1114 tablet.cc:1724] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.468998  1137 tablet.cc:1724] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.470707  1115 tablet.cc:1724] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.483531  1138 tablet.cc:1724] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.484798  1116 tablet.cc:1724] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.477836  1135 tablet.cc:1724] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.458221  1132 tablet.cc:1724] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.544589  1132 tablet.cc:1724] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.557319  1132 tablet.cc:1724] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.561072  1116 tablet.cc:1724] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.565244  1137 tablet.cc:1724] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.525596  1126 tablet.cc:1724] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.570318  1133 tablet.cc:1724] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.588994  1115 tablet.cc:1724] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.593611   708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4"
dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
mode: GRACEFUL
new_leader_uuid: "932f8c79c2f948328f8084f7e69845bf"
 from {username='slave'} at 127.0.0.1:43616
I20260709 13:10:16.594305   708 raft_consensus.cc:606] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Received request to transfer leadership to TS 932f8c79c2f948328f8084f7e69845bf
I20260709 13:10:16.596261 20694 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:16.596908 20694 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:16.561466  1138 tablet.cc:1724] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.601420  1126 tablet.cc:1724] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:16.610345   602 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20: soft_deleted_table [id=54731554e48e4c608f53ce036d5c5ef6] alter complete (version 1)
I20260709 13:10:16.686033  1130 raft_consensus.cc:993] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c: : Instructing follower 932f8c79c2f948328f8084f7e69845bf to start an election
I20260709 13:10:16.686584  1134 raft_consensus.cc:1081] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Signalling peer 932f8c79c2f948328f8084f7e69845bf to start an election
I20260709 13:10:16.687994   855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03d71eb6224348439b68ae13789dbfdc"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
 from {username='slave'} at 127.0.0.1:49704
I20260709 13:10:16.688433   855 raft_consensus.cc:493] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.688671   855 raft_consensus.cc:3060] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.694425   855 raft_consensus.cc:515] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:16.695866   855 leader_election.cc:290] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 2 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:16.696694   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d71eb6224348439b68ae13789dbfdc" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:16.696940   782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d71eb6224348439b68ae13789dbfdc" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:16.697237   709 raft_consensus.cc:3060] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.697566   782 raft_consensus.cc:3055] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.697849   782 raft_consensus.cc:740] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0920d2f774f14e05961d4af4689dd22c, State: Running, Role: LEADER
I20260709 13:10:16.698503   782 consensus_queue.cc:260] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:16.699427   782 raft_consensus.cc:3060] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.703249   709 raft_consensus.cc:2468] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 2.
I20260709 13:10:16.704342   822 leader_election.cc:304] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 932f8c79c2f948328f8084f7e69845bf, bd9a363b972040448b83c054f8ec1c49; no voters: 
I20260709 13:10:16.704908   782 raft_consensus.cc:2468] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 2.
I20260709 13:10:16.705147  1131 raft_consensus.cc:2804] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.705687  1131 raft_consensus.cc:697] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 2 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:16.706513  1131 consensus_queue.cc:237] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:16.713838   606 catalog_manager.cc:5697] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 1 to 2, leader changed from 0920d2f774f14e05961d4af4689dd22c (127.20.53.130) to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 2 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.969475  1100 raft_consensus.cc:993] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49: : Instructing follower 932f8c79c2f948328f8084f7e69845bf to start an election
I20260709 13:10:16.969906  1052 raft_consensus.cc:1081] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Signalling peer 932f8c79c2f948328f8084f7e69845bf to start an election
I20260709 13:10:16.971200   855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4"
dest_uuid: "932f8c79c2f948328f8084f7e69845bf"
 from {username='slave'} at 127.0.0.1:49714
I20260709 13:10:16.971649   855 raft_consensus.cc:493] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.971942   855 raft_consensus.cc:3060] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.978025   855 raft_consensus.cc:515] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:16.979913   855 leader_election.cc:290] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 3 election: Requested vote from peers bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503), 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457)
I20260709 13:10:16.980389   709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd9a363b972040448b83c054f8ec1c49"
I20260709 13:10:16.980994   709 raft_consensus.cc:3055] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:16.981024   784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a3f9ad8b43a4f0893222f9de7142fc4" candidate_uuid: "932f8c79c2f948328f8084f7e69845bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0920d2f774f14e05961d4af4689dd22c"
I20260709 13:10:16.981253   709 raft_consensus.cc:740] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd9a363b972040448b83c054f8ec1c49, State: Running, Role: LEADER
I20260709 13:10:16.981685   784 raft_consensus.cc:3060] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.982065   709 consensus_queue.cc:260] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:16.983062   709 raft_consensus.cc:3060] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.986647   784 raft_consensus.cc:2468] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 3.
I20260709 13:10:16.987254   709 raft_consensus.cc:2468] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 932f8c79c2f948328f8084f7e69845bf in term 3.
I20260709 13:10:16.987596   822 leader_election.cc:304] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0920d2f774f14e05961d4af4689dd22c, 932f8c79c2f948328f8084f7e69845bf; no voters: 
I20260709 13:10:16.988271  1131 raft_consensus.cc:2804] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:16.988647  1131 raft_consensus.cc:697] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 3 LEADER]: Becoming Leader. State: Replica: 932f8c79c2f948328f8084f7e69845bf, State: Running, Role: LEADER
I20260709 13:10:16.989372  1131 consensus_queue.cc:237] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } }
I20260709 13:10:16.995687   606 catalog_manager.cc:5697] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf reported cstate change: term changed from 2 to 3, leader changed from bd9a363b972040448b83c054f8ec1c49 (127.20.53.129) to 932f8c79c2f948328f8084f7e69845bf (127.20.53.131). New cstate: current_term: 3 leader_uuid: "932f8c79c2f948328f8084f7e69845bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "932f8c79c2f948328f8084f7e69845bf" member_type: VOTER last_known_addr { host: "127.20.53.131" port: 34643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.086885   709 raft_consensus.cc:1275] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Refusing update from remote peer 932f8c79c2f948328f8084f7e69845bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.087982  1131 consensus_queue.cc:1048] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.099511   784 raft_consensus.cc:1275] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Refusing update from remote peer 932f8c79c2f948328f8084f7e69845bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.101373  1131 consensus_queue.cc:1048] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.436534   709 raft_consensus.cc:1275] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 3 FOLLOWER]: Refusing update from remote peer 932f8c79c2f948328f8084f7e69845bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:17.437749  1152 consensus_queue.cc:1048] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9a363b972040448b83c054f8ec1c49" member_type: VOTER last_known_addr { host: "127.20.53.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.446097   784 raft_consensus.cc:1275] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 3 FOLLOWER]: Refusing update from remote peer 932f8c79c2f948328f8084f7e69845bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:17.447955  1071 consensus_queue.cc:1048] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0920d2f774f14e05961d4af4689dd22c" member_type: VOTER last_known_addr { host: "127.20.53.130" port: 33457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.652107 20694 tablet_server.cc:179] TabletServer@127.20.53.129:0 shutting down...
I20260709 13:10:17.682682 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:17.683404 20694 tablet_replica.cc:333] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.684005 20694 raft_consensus.cc:2243] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.684459 20694 raft_consensus.cc:2272] T 7f777cc9af6049989e4bd7f0b47e2dc7 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.686345 20694 tablet_replica.cc:333] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.686893 20694 raft_consensus.cc:2243] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.687309 20694 raft_consensus.cc:2272] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.689049 20694 tablet_replica.cc:333] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.689575 20694 raft_consensus.cc:2243] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.689993 20694 raft_consensus.cc:2272] T fe0fcbaa460e457eb8c842c5deed98fd P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.691674 20694 tablet_replica.cc:333] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.692217 20694 raft_consensus.cc:2243] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.692950 20694 raft_consensus.cc:2272] T a01d817e1d9446e98e58a9d429cb02de P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.694800 20694 tablet_replica.cc:333] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.695339 20694 raft_consensus.cc:2243] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.695757 20694 raft_consensus.cc:2272] T 2e9a03e5b3c548999bb557c28ecb0483 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.697436 20694 tablet_replica.cc:333] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.697965 20694 raft_consensus.cc:2243] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.698755 20694 raft_consensus.cc:2272] T 5a6782ddcec54afb8e90873b5f47c9b8 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.700866 20694 tablet_replica.cc:333] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.701433 20694 raft_consensus.cc:2243] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.702210 20694 raft_consensus.cc:2272] T f524e4bbf7474b8ab3923a1529ee153e P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.704025 20694 tablet_replica.cc:333] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.704507 20694 raft_consensus.cc:2243] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.705163 20694 raft_consensus.cc:2272] T 22bf5ddd67b84506b0e7f385f47139f5 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.707103 20694 tablet_replica.cc:333] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.707633 20694 raft_consensus.cc:2243] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.708317 20694 raft_consensus.cc:2272] T e37f810da8414ad3a5ccfdc5912e814b P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.710035 20694 tablet_replica.cc:333] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.710585 20694 raft_consensus.cc:2243] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.710987 20694 raft_consensus.cc:2272] T 03d71eb6224348439b68ae13789dbfdc P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.713850 20694 tablet_replica.cc:333] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.714418 20694 raft_consensus.cc:2243] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.714833 20694 raft_consensus.cc:2272] T 17f08d6500ef4a30a3a7932a9be8403f P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.716761 20694 tablet_replica.cc:333] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.717248 20694 raft_consensus.cc:2243] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.717950 20694 raft_consensus.cc:2272] T 1f24b4f3428140d0904166a3f7d53166 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.719980 20694 tablet_replica.cc:333] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.720476 20694 raft_consensus.cc:2243] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.720888 20694 raft_consensus.cc:2272] T b98bf747fd014814a18bb58429c4d505 P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.722654 20694 tablet_replica.cc:333] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.723151 20694 raft_consensus.cc:2243] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.723532 20694 raft_consensus.cc:2272] T af1a5523ed8d4da9ad0559069a6d1116 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.725376 20694 tablet_replica.cc:333] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.725893 20694 raft_consensus.cc:2243] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.726327 20694 raft_consensus.cc:2272] T 3a3f9ad8b43a4f0893222f9de7142fc4 P bd9a363b972040448b83c054f8ec1c49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.728598 20694 tablet_replica.cc:333] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.729097 20694 raft_consensus.cc:2243] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.729817 20694 raft_consensus.cc:2272] T a9aaf50aca194185bd1d3ecb6368763f P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.731716 20694 tablet_replica.cc:333] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.732303 20694 raft_consensus.cc:2243] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.732800 20694 raft_consensus.cc:2272] T e6ec15dc0dd149fe891850d376e6c6bb P bd9a363b972040448b83c054f8ec1c49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:17.734185   748 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 13:10:17.734575 20694 tablet_replica.cc:333] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49: stopping tablet replica
I20260709 13:10:17.735136 20694 raft_consensus.cc:2243] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.735636 20694 raft_consensus.cc:2272] T 8a5a8c4732a2400491fef0a2182dc175 P bd9a363b972040448b83c054f8ec1c49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:17.737078   748 consensus_peers.cc:597] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c -> Peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Couldn't send request to peer bd9a363b972040448b83c054f8ec1c49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:17.747951   748 consensus_peers.cc:597] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c -> Peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Couldn't send request to peer bd9a363b972040448b83c054f8ec1c49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:17.748870   822 consensus_peers.cc:597] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf -> Peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Couldn't send request to peer bd9a363b972040448b83c054f8ec1c49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:17.775974 20694 tablet_server.cc:196] TabletServer@127.20.53.129:0 shutdown complete.
I20260709 13:10:17.808137 20694 tablet_server.cc:179] TabletServer@127.20.53.130:0 shutting down...
I20260709 13:10:17.836890 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:17.837549 20694 tablet_replica.cc:333] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.838141 20694 raft_consensus.cc:2243] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.838682 20694 raft_consensus.cc:2272] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.840536 20694 tablet_replica.cc:333] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.841097 20694 raft_consensus.cc:2243] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.841827 20694 raft_consensus.cc:2272] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.843590 20694 tablet_replica.cc:333] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.844113 20694 raft_consensus.cc:2243] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.844830 20694 raft_consensus.cc:2272] T fe0fcbaa460e457eb8c842c5deed98fd P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.846659 20694 tablet_replica.cc:333] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.847182 20694 raft_consensus.cc:2243] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.847584 20694 raft_consensus.cc:2272] T a01d817e1d9446e98e58a9d429cb02de P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.849370 20694 tablet_replica.cc:333] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.849890 20694 raft_consensus.cc:2243] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.850663 20694 raft_consensus.cc:2272] T 2e9a03e5b3c548999bb557c28ecb0483 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.852563 20694 tablet_replica.cc:333] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.853052 20694 raft_consensus.cc:2243] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.853458 20694 raft_consensus.cc:2272] T 5a6782ddcec54afb8e90873b5f47c9b8 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.855341 20694 tablet_replica.cc:333] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.855942 20694 raft_consensus.cc:2243] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.856380 20694 raft_consensus.cc:2272] T f524e4bbf7474b8ab3923a1529ee153e P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.858366 20694 tablet_replica.cc:333] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.859146 20694 raft_consensus.cc:2243] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.859655 20694 raft_consensus.cc:2272] T 22bf5ddd67b84506b0e7f385f47139f5 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:17.860356   748 consensus_peers.cc:597] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c -> Peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Couldn't send request to peer bd9a363b972040448b83c054f8ec1c49. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:17.861974 20694 tablet_replica.cc:333] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.862604 20694 raft_consensus.cc:2243] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.863022 20694 raft_consensus.cc:2272] T e37f810da8414ad3a5ccfdc5912e814b P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.864845 20694 tablet_replica.cc:333] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.865348 20694 raft_consensus.cc:2243] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.865741 20694 raft_consensus.cc:2272] T b98bf747fd014814a18bb58429c4d505 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.867795 20694 tablet_replica.cc:333] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.868285 20694 raft_consensus.cc:2243] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.868999 20694 raft_consensus.cc:2272] T af1a5523ed8d4da9ad0559069a6d1116 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.871572 20694 tablet_replica.cc:333] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.872131 20694 raft_consensus.cc:2243] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.873064 20694 raft_consensus.cc:2272] T 17f08d6500ef4a30a3a7932a9be8403f P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:17.873275   822 consensus_peers.cc:597] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf -> Peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Couldn't send request to peer bd9a363b972040448b83c054f8ec1c49. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:17.875735 20694 tablet_replica.cc:333] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.876557 20694 raft_consensus.cc:2243] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.877033 20694 raft_consensus.cc:2272] T 1f24b4f3428140d0904166a3f7d53166 P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:17.877911   822 consensus_peers.cc:597] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf -> Peer 0920d2f774f14e05961d4af4689dd22c (127.20.53.130:33457): Couldn't send request to peer 0920d2f774f14e05961d4af4689dd22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:17.879487 20694 tablet_replica.cc:333] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.880566 20694 raft_consensus.cc:2243] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.881500 20694 raft_consensus.cc:2272] T e6ec15dc0dd149fe891850d376e6c6bb P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:17.882735   822 consensus_peers.cc:597] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf -> Peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Couldn't send request to peer bd9a363b972040448b83c054f8ec1c49. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:17.883667 20694 tablet_replica.cc:333] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.884198 20694 raft_consensus.cc:2243] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.884929 20694 raft_consensus.cc:2272] T 8a5a8c4732a2400491fef0a2182dc175 P 0920d2f774f14e05961d4af4689dd22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.886970 20694 tablet_replica.cc:333] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.887431 20694 raft_consensus.cc:2243] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.887804 20694 raft_consensus.cc:2272] T a9aaf50aca194185bd1d3ecb6368763f P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.889756 20694 tablet_replica.cc:333] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.890231 20694 raft_consensus.cc:2243] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.890568 20694 raft_consensus.cc:2272] T 03d71eb6224348439b68ae13789dbfdc P 0920d2f774f14e05961d4af4689dd22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.893532 20694 tablet_replica.cc:333] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c: stopping tablet replica
I20260709 13:10:17.893939 20694 raft_consensus.cc:2243] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.894372 20694 raft_consensus.cc:2272] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 0920d2f774f14e05961d4af4689dd22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.933355 20694 tablet_server.cc:196] TabletServer@127.20.53.130:0 shutdown complete.
W20260709 13:10:17.944382   822 consensus_peers.cc:597] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf -> Peer bd9a363b972040448b83c054f8ec1c49 (127.20.53.129:43503): Couldn't send request to peer bd9a363b972040448b83c054f8ec1c49. Status: Network error: Client connection negotiation failed: client connection to 127.20.53.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:17.964248 20694 tablet_server.cc:179] TabletServer@127.20.53.131:0 shutting down...
I20260709 13:10:17.991487 20694 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:17.992435 20694 tablet_replica.cc:333] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:17.993062 20694 raft_consensus.cc:2243] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:17.993857 20694 raft_consensus.cc:2272] T 7f777cc9af6049989e4bd7f0b47e2dc7 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.995829 20694 tablet_replica.cc:333] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:17.996374 20694 raft_consensus.cc:2243] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.996794 20694 raft_consensus.cc:2272] T fe0fcbaa460e457eb8c842c5deed98fd P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.998553 20694 tablet_replica.cc:333] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:17.999087 20694 raft_consensus.cc:2243] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.999505 20694 raft_consensus.cc:2272] T 7f9fe85d85d4491d9eb33a07d6dc6b13 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.001161 20694 tablet_replica.cc:333] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.001665 20694 raft_consensus.cc:2243] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.002060 20694 raft_consensus.cc:2272] T a01d817e1d9446e98e58a9d429cb02de P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.003968 20694 tablet_replica.cc:333] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.004469 20694 raft_consensus.cc:2243] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.004865 20694 raft_consensus.cc:2272] T f524e4bbf7474b8ab3923a1529ee153e P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.006551 20694 tablet_replica.cc:333] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.007035 20694 raft_consensus.cc:2243] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.007426 20694 raft_consensus.cc:2272] T 22bf5ddd67b84506b0e7f385f47139f5 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.009208 20694 tablet_replica.cc:333] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.009714 20694 raft_consensus.cc:2243] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.010115 20694 raft_consensus.cc:2272] T e37f810da8414ad3a5ccfdc5912e814b P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.011778 20694 tablet_replica.cc:333] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.012291 20694 raft_consensus.cc:2243] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.013063 20694 raft_consensus.cc:2272] T 3a3f9ad8b43a4f0893222f9de7142fc4 P 932f8c79c2f948328f8084f7e69845bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.015178 20694 tablet_replica.cc:333] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.015691 20694 raft_consensus.cc:2243] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.016090 20694 raft_consensus.cc:2272] T 2e9a03e5b3c548999bb557c28ecb0483 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.017778 20694 tablet_replica.cc:333] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.018656 20694 raft_consensus.cc:2243] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.019083 20694 raft_consensus.cc:2272] T 5a6782ddcec54afb8e90873b5f47c9b8 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.020773 20694 tablet_replica.cc:333] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.021292 20694 raft_consensus.cc:2243] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.021708 20694 raft_consensus.cc:2272] T af1a5523ed8d4da9ad0559069a6d1116 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.023555 20694 tablet_replica.cc:333] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.024027 20694 raft_consensus.cc:2243] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.024726 20694 raft_consensus.cc:2272] T b98bf747fd014814a18bb58429c4d505 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.026716 20694 tablet_replica.cc:333] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.027233 20694 raft_consensus.cc:2243] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.027652 20694 raft_consensus.cc:2272] T e6ec15dc0dd149fe891850d376e6c6bb P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.029394 20694 tablet_replica.cc:333] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.029891 20694 raft_consensus.cc:2243] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.030350 20694 raft_consensus.cc:2272] T 8a5a8c4732a2400491fef0a2182dc175 P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.032232 20694 tablet_replica.cc:333] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.032701 20694 raft_consensus.cc:2243] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.033108 20694 raft_consensus.cc:2272] T a9aaf50aca194185bd1d3ecb6368763f P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.035202 20694 tablet_replica.cc:333] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.035857 20694 raft_consensus.cc:2243] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.036367 20694 raft_consensus.cc:2272] T 1f24b4f3428140d0904166a3f7d53166 P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.038717 20694 tablet_replica.cc:333] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.039156 20694 raft_consensus.cc:2243] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.039502 20694 raft_consensus.cc:2272] T 17f08d6500ef4a30a3a7932a9be8403f P 932f8c79c2f948328f8084f7e69845bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.041170 20694 tablet_replica.cc:333] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf: stopping tablet replica
I20260709 13:10:18.041589 20694 raft_consensus.cc:2243] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.042327 20694 raft_consensus.cc:2272] T 03d71eb6224348439b68ae13789dbfdc P 932f8c79c2f948328f8084f7e69845bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.080293 20694 tablet_server.cc:196] TabletServer@127.20.53.131:0 shutdown complete.
I20260709 13:10:18.108940 20694 master.cc:562] Master@127.20.53.190:37137 shutting down...
I20260709 13:10:18.129412 20694 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:18.129945 20694 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.130316 20694 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8e5b0904b04e44a88164b43a769eba20: stopping tablet replica
I20260709 13:10:18.149679 20694 master.cc:584] Master@127.20.53.190:37137 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11257 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23994 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (351420 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:10:18.204730 20694 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 407 messages since previous log ~14 seconds ago
I20260709 13:10:18.205006 20694 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 407 messages since previous log ~14 seconds ago
I20260709 13:10:18.205193 20694 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 407 messages since previous log ~14 seconds ago
I20260709 13:10:18.205410 20694 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:10:18.205618 20694 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:10:18.205796 20694 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~72 seconds ago
I20260709 13:10:18.206053 20694 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~115 seconds ago
I20260709 13:10:18.206426 20694 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:10:18.206750 20694 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
